2024-09-21T07:39:27.283 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T07:39:27.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:39:27.411 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913624' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEi9WZamMOYFbnSbtDrcnE6xiqLcDRHcbTooHbCIpwmInvTdfLwci0hQS48X3+HierYvIDvhjqLR2087282YJ6M= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKpXvnNS5AkvEcewaw5NU76c6Gyc7GwBecaP8bP1dk+T0HeufkjhX+w7fv6qscGvMtu3GrWZt72v+Z8sU+9/kc= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlIHZyHqZvEYVSgSm59GJd0TJnCDFtvb8aiQTUociXQj9/IKHkQY7mD7WVOKVR+4lZoEHXY3NJbW+M3I2BlJAQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T07:39:27.411 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T07:39:27.411 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T07:39:27.412 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T07:39:27.413 INFO:teuthology.task.internal:Checking packages... 2024-09-21T07:39:27.434 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T07:39:27.434 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:39:27.434 INFO:teuthology.packaging:ref: None 2024-09-21T07:39:27.434 INFO:teuthology.packaging:tag: None 2024-09-21T07:39:27.435 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:39:27.435 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:39:27.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:39:27.585 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T07:39:27.587 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T07:39:27.597 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T07:39:27.597 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T07:39:27.713 INFO:teuthology.task.internal:Saving configuration 2024-09-21T07:39:27.742 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T07:39:27.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T07:39:27.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:34:33.936876', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEi9WZamMOYFbnSbtDrcnE6xiqLcDRHcbTooHbCIpwmInvTdfLwci0hQS48X3+HierYvIDvhjqLR2087282YJ6M='} 2024-09-21T07:39:27.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:34:33.933175', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKpXvnNS5AkvEcewaw5NU76c6Gyc7GwBecaP8bP1dk+T0HeufkjhX+w7fv6qscGvMtu3GrWZt72v+Z8sU+9/kc='} 2024-09-21T07:39:27.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:34:33.935130', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlIHZyHqZvEYVSgSm59GJd0TJnCDFtvb8aiQTUociXQj9/IKHkQY7mD7WVOKVR+4lZoEHXY3NJbW+M3I2BlJAQ='} 2024-09-21T07:39:27.829 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T07:39:27.840 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T07:39:27.840 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T07:39:27.841 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T07:39:27.841 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T07:39:27.951 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e98c20160>, signals=[15]) 2024-09-21T07:39:27.951 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T07:39:27.962 INFO:teuthology.task.internal:Opening connections... 2024-09-21T07:39:27.962 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T07:39:27.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:39:28.049 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T07:39:28.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:39:28.130 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-21T07:39:28.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:39:28.208 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T07:39:28.225 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-09-21T07:39:28.243 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-09-21T07:39:28.243 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:39:28.301 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:39:28.302 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:39:28.303 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-09-21T07:39:28.327 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-21T07:39:28.345 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-21T07:39:28.345 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-21T07:39:28.404 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:39:28.405 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:39:28.405 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:39:28.405 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:39:28.405 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:39:28.405 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:39:28.405 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-21T07:39:28.427 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-21T07:39:28.446 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-21T07:39:28.446 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-21T07:39:28.504 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:39:28.505 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:39:28.506 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-21T07:39:28.527 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T07:39:28.537 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T07:39:28.564 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T07:39:28.565 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:39:28.568 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:39:28.570 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:39:28.587 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T07:39:28.598 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T07:39:28.598 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:39:28.625 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:39:28.629 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:39:28.656 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T07:39:28.728 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T07:39:28.747 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T07:39:28.747 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T07:39:28.748 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:39:28.748 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:39:28.749 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:39:28.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:39:28.766 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-21T07:39:28.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:39:28.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:39:28.767 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-21T07:39:28.768 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-21T07:39:28.823 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:39:28.824 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-503.el9.x86_64 2024-09-21T07:39:28.824 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-09-21T07:39:28.826 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:39:28.826 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:39:28.826 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-21T07:39:28.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-21T07:39:28.827 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.14.0-503.el9.x86_64 2024-09-21T07:39:28.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2024-09-21T07:39:31.194 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T07:39:31.249 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-21T07:39:31.870 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.3 MB 00:01 2024-09-21T07:39:32.836 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-21T07:39:35.213 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-21T07:39:39.020 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-21T07:39:39.780 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T07:39:40.207 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-21T07:39:40.512 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-21T07:39:41.264 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-21T07:39:41.633 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T07:39:42.051 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T07:39:45.759 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T07:39:46.980 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T07:39:47.242 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-21T07:39:47.490 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T07:39:48.355 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T07:39:48.912 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:39:48.912 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:39:49.005 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:39:49.012 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-21T07:39:49.013 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-21T07:39:49.014 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-21T07:39:49.438 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:39:49.438 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:39:49.524 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-21T07:39:49.534 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T07:39:49.534 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-21T07:39:49.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:39:49.536 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 79 M 2024-09-21T07:39:49.536 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 126 M 2024-09-21T07:39:49.536 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-21T07:39:49.548 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 128 kB/s | 36 kB 00:00 2024-09-21T07:39:49.692 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 329 kB/s | 36 kB 00:00 2024-09-21T07:39:50.059 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T07:39:50.386 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 43 MB/s | 35 MB 00:00 2024-09-21T07:39:50.678 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 29 MB/s | 29 MB 00:00 2024-09-21T07:39:50.678 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:39:50.678 INFO:teuthology.orchestra.run.smithi119.stdout:Total 69 MB/s | 79 MB 00:01 2024-09-21T07:39:51.363 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-21T07:39:51.724 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-21T07:39:51.724 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-21T07:39:52.667 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-21T07:39:52.667 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-21T07:39:54.044 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-21T07:39:55.148 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-21T07:39:55.836 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:39:55.912 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:39:55.992 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:39:55.993 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:39:56.100 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-09-21T07:39:56.105 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout:Install 4 Packages 2024-09-21T07:39:56.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:39:56.107 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 79 M 2024-09-21T07:39:56.107 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 126 M 2024-09-21T07:39:56.107 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-09-21T07:39:56.321 INFO:teuthology.orchestra.run.smithi006.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 386 kB/s | 36 kB 00:00 2024-09-21T07:39:56.713 INFO:teuthology.orchestra.run.smithi006.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T07:39:57.180 INFO:teuthology.orchestra.run.smithi006.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-21T07:39:57.463 INFO:teuthology.orchestra.run.smithi006.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-21T07:39:57.464 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:39:57.464 INFO:teuthology.orchestra.run.smithi006.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-21T07:39:58.174 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-09-21T07:39:58.552 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-09-21T07:39:58.552 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-09-21T07:39:58.666 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:39:58.807 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:39:59.553 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-09-21T07:39:59.553 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-09-21T07:39:59.730 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.3 MB/s | 35 MB 00:10 2024-09-21T07:40:02.129 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-09-21T07:40:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:40:02.906 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:03.649 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:03.698 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:04.905 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-21T07:40:05.688 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:05.819 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:08.551 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:16.274 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:23.344 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 866 kB/s | 29 MB 00:33 2024-09-21T07:40:23.344 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:40:23.345 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.3 MB/s | 79 MB 00:34 2024-09-21T07:40:24.025 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-21T07:40:24.394 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-21T07:40:24.394 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-21T07:40:25.336 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-21T07:40:25.336 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-21T07:40:27.854 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-21T07:40:28.537 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:40:28.619 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:31.373 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:31.523 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:36.333 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:36.482 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:41.303 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:46.754 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:47.092 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:47.092 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:40:47.092 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:47.092 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:47.968 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:47.968 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:40:47.968 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:40:47.969 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-21T07:40:48.331 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:40:48.424 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:48.424 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:40:48.425 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:40:48.425 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:40:48.425 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:40:48.425 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T07:40:48.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:40:48.426 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:40:48.486 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:48.486 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:40:48.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-09-21T07:40:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-09-21T07:40:48.528 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:40:48.529 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:40:48.529 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:40:48.529 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:40:48.530 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:40:49.150 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-21T07:40:50.466 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:40:50.495 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-21T07:40:50.497 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-21T07:40:50.513 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.cxm6p56WrF 2024-09-21T07:40:50.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cxm6p56WrF 2024-09-21T07:40:50.579 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.cxm6p56WrF 2024-09-21T07:40:50.718 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.cxm6p56WrF is 6KB 2024-09-21T07:40:50.766 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.cxm6p56WrF 2024-09-21T07:40:50.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:40:50.843 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:40:50.843 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:40:50.843 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:40:50.843 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:40:50.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:40:51.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-21T07:40:55.519 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:40:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:40:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:40:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:40:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:40:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:40:56.746 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-21T07:40:57.105 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:40:57.240 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:57.240 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:40:57.241 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:40:57.241 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:40:57.241 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:40:57.241 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T07:40:57.241 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:40:57.241 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:40:57.299 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:40:57.300 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:40:57.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 82.el9 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8274670 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:40:57.342 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:40:57.343 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:40:57.344 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:40:57.344 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:40:57.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-09-21T07:40:59.400 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:40:59.446 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-09-21T07:40:59.448 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-21T07:40:59.463 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.YYZ0cw9Y3R 2024-09-21T07:40:59.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YYZ0cw9Y3R 2024-09-21T07:40:59.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.YYZ0cw9Y3R 2024-09-21T07:40:59.679 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.YYZ0cw9Y3R is 6KB 2024-09-21T07:40:59.729 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.YYZ0cw9Y3R 2024-09-21T07:40:59.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:40:59.806 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:40:59.806 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:40:59.806 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:40:59.806 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:40:59.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:40:59.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-09-21T07:41:19.117 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:41:19.161 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:41:19.504 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:41:19.505 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:41:19.505 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:41:19.505 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:41:20.410 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:41:20.410 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:41:20.410 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-21T07:41:20.410 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.410 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.411 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.411 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.411 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:41:20.411 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-21T07:41:20.775 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:41:20.903 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.903 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:41:20.903 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:41:20.903 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:41:20.903 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:41:20.904 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T07:41:20.904 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:41:20.904 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:41:20.962 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:41:20.963 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:41:20.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-21T07:41:20.998 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:41:20.999 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:41:21.000 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-21T07:41:21.001 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:41:21.001 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:41:21.001 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:41:21.002 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:41:21.002 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:41:21.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T07:41:21.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:41:21.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:41:21.670 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-21T07:41:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:41:23.040 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-21T07:41:23.042 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-21T07:41:23.057 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.zHgRR43yzb 2024-09-21T07:41:23.057 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zHgRR43yzb 2024-09-21T07:41:23.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.zHgRR43yzb 2024-09-21T07:41:23.267 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.zHgRR43yzb is 6KB 2024-09-21T07:41:23.314 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.zHgRR43yzb 2024-09-21T07:41:23.329 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:41:23.392 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:41:23.392 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:41:23.392 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:41:23.393 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:41:23.394 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:41:23.549 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-21T07:41:29.970 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T07:41:29.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:41:29.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:41:39.439 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-21T07:41:48.399 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-09-21T07:41:48.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:41:48.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:41:51.503 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-21T07:41:53.554 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T07:41:53.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:41:53.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:41:57.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:41:57.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:42:03.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:42:03.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:42:11.951 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-21T07:42:20.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:42:20.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:42:24.015 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-21T07:42:35.426 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-21T07:42:35.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:42:35.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:42:35.908 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-21T07:42:35.923 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:42:35.924 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:42:35.924 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:42:35.924 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:42:36.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:42:36.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:42:36.925 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T07:42:36.925 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T07:42:37.025 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-09-21T07:42:37.045 DEBUG:teuthology.parallel:result is None 2024-09-21T07:42:54.447 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-21T07:42:57.405 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T07:43:09.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:43:09.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:43:09.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:43:09.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:43:09.776 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-21T07:43:09.842 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-21T07:43:10.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:43:10.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:43:10.181 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-21T07:43:10.198 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:43:10.198 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:43:10.198 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:43:10.198 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:43:10.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:43:10.254 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:43:10.254 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-21T07:43:10.269 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:43:10.269 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:43:10.269 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:43:10.269 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:43:11.200 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T07:43:11.200 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T07:43:11.270 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T07:43:11.270 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T07:43:11.299 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-09-21T07:43:11.318 DEBUG:teuthology.parallel:result is None 2024-09-21T07:43:11.388 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-21T07:43:11.413 DEBUG:teuthology.parallel:result is None 2024-09-21T07:43:11.413 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:43:11.423 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:43:11.424 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:43:11.426 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:43:11.429 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:43:11.446 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:43:11.468 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:43:11.521 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:43:11.521 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:43:11.524 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:43:11.526 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:43:11.576 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:43:11.586 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:43:11.586 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:43:11.593 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:43:11.595 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:43:11.628 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.628 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.638 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.640 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.652 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.664 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:43:11.666 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:43:11.678 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:43:11.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:43:11.685 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:43:11.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:43:11.713 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:43:11.725 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:43:11.725 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:43:11.755 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:43:11.758 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:43:11.772 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:11.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:11.907 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:11.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:12.035 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:43:12.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:43:12.103 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:12.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:12.222 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:12.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:12.308 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:43:12.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:43:12.375 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:12.416 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:43:12.472 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:12.551 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:43:12.593 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:43:12.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:43:12.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-09-21T07:43:12.660 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-21T07:43:12.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-21T07:43:12.702 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:43:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:43:12.859 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:43:13.271 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:43:13.283 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:43:13.283 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:43:13.340 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:43:13.389 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T07:43:13.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-09-21T07:43:13.440 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-09-21T07:43:13.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-21T07:43:13.492 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-21T07:43:13.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-21T07:43:13.608 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-21T07:43:13.612 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:43:13.612 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-09-21T07:43:13.636 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-09-21T07:43:13.637 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-21T07:43:13.667 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-21T07:43:13.668 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-21T07:43:13.721 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-21T07:43:13.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-09-21T07:43:13.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:43:13.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:43:13.752 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:43:13.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:43:13.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:43:13.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:43:13.864 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:43:13.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:43:13.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:43:13.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:43:14.014 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:43:14.024 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T07:43:14.026 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T07:43:14.126 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:43:14.137 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:43:14.137 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:47:03.218 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-21T07:47:03.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:47:03.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:47:03.299 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-21T07:47:03.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-21T07:47:03.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:47:03.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:47:03.457 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-21T07:47:03.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T07:47:03.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:47:03.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:47:03.615 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-21T07:47:03.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-21T07:47:03.701 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:47:03.712 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:47:03.712 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:47:03.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:47:03.715 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:47:03.715 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:47:03.717 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:47:03.717 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:47:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:47:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:47:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:47:03.764 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:47:03.774 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:47:03.790 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:47:03.790 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-21T07:47:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-09-21T07:47:03.802 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-21T07:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-09-21T07:47:03.816 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-21T07:47:03.817 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:47:03.820 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:47:03.828 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-21T07:47:03.832 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:47:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:47:03.842 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:47:03.856 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:47:03.889 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:47:03.892 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:47:03.896 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:47:03.896 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-21T07:47:03.896 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.896 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.896 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.897 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.917 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.920 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:47:03.921 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:47:03.929 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:47:03.929 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T07:47:03.929 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T07:47:03.930 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:47:03.935 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:47:03.935 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T07:47:03.935 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:47:03.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:47:03.937 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:47:03.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:47:03.938 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:47:03.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:47:04.083 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:47:04.083 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:47:04.093 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:47:04.093 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:47:04.099 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:47:04.099 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:47:04.192 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:47:04.193 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:47:04.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:47:04.202 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:47:04.202 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:47:04.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:47:04.206 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:47:04.206 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:47:04.206 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:47:04.220 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:47:04.220 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:47:04.227 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:47:04.228 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:47:04.231 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:47:04.232 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:47:04.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:47:04.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:47:04.297 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:47:04.364 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:47:04.368 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:47:04.372 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:47:04.429 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-09-21T07:47:04.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-09-21T07:47:04.432 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-21T07:47:04.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-21T07:47:04.436 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-21T07:47:04.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-21T07:47:04.654 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-21T07:47:04.676 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-21T07:47:04.681 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:47:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-09-21T07:47:04.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:47:04.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:47:05.226 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 329 kB/s | 84 kB 00:00 2024-09-21T07:47:05.259 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T07:47:05.271 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-21T07:47:05.534 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-21T07:47:05.588 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-09-21T07:47:05.592 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 84 kB/s | 24 kB 00:00 2024-09-21T07:47:05.810 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T07:47:05.864 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T07:47:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-21T07:47:07.247 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.3 MB 00:01 2024-09-21T07:47:07.651 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T07:47:08.243 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.3 MB 00:02 2024-09-21T07:47:09.050 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T07:47:11.353 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-21T07:47:13.368 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-21T07:47:15.052 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-21T07:47:15.861 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-21T07:47:15.957 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T07:47:17.620 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-21T07:47:18.700 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T07:47:21.604 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T07:47:23.874 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:23.875 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:23.887 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:47:23.888 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:47:23.889 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:47:23.890 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:47:23.892 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:47:23.894 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:47:23.895 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:47:23.964 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:47:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:47:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:47:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:47:23.999 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:47:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:47:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:47:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:47:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:47:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:47:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:47:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:47:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-09-21T07:47:24.008 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-21T07:47:24.009 INFO:teuthology.orchestra.run.smithi006.stdout:Install 149 Packages 2024-09-21T07:47:24.009 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 8 Packages 2024-09-21T07:47:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:47:24.009 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 228 M 2024-09-21T07:47:24.009 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-09-21T07:47:24.138 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T07:47:24.447 INFO:teuthology.orchestra.run.smithi006.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T07:47:24.781 INFO:teuthology.orchestra.run.smithi006.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T07:47:24.823 INFO:teuthology.orchestra.run.smithi006.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.3 MB/s | 873 kB 00:00 2024-09-21T07:47:24.848 INFO:teuthology.orchestra.run.smithi006.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T07:47:24.932 INFO:teuthology.orchestra.run.smithi006.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-21T07:47:25.232 INFO:teuthology.orchestra.run.smithi006.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T07:47:25.282 INFO:teuthology.orchestra.run.smithi006.stdout:(7/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 5.0 MB/s | 2.3 MB 00:00 2024-09-21T07:47:25.474 INFO:teuthology.orchestra.run.smithi006.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T07:47:25.691 INFO:teuthology.orchestra.run.smithi006.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 116 kB/s | 25 kB 00:00 2024-09-21T07:47:26.116 INFO:teuthology.orchestra.run.smithi006.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 20 MB/s | 18 MB 00:00 2024-09-21T07:47:26.167 INFO:teuthology.orchestra.run.smithi006.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T07:47:26.225 INFO:teuthology.orchestra.run.smithi006.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 465 kB/s | 27 kB 00:00 2024-09-21T07:47:26.275 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-21T07:47:26.275 INFO:teuthology.orchestra.run.smithi006.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T07:47:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T07:47:26.351 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:26.352 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:26.363 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:47:26.364 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:47:26.365 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:47:26.366 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:47:26.367 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:47:26.369 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:47:26.370 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:47:26.418 INFO:teuthology.orchestra.run.smithi006.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:47:26.433 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:47:26.447 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:47:26.448 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:47:26.449 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:47:26.450 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:47:26.451 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:47:26.452 INFO:teuthology.orchestra.run.smithi145.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:47:26.453 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:26.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:47:26.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:47:26.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:47:26.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:47:26.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:47:26.459 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:Install 149 Packages 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 8 Packages 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 228 M 2024-09-21T07:47:26.460 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-21T07:47:26.485 INFO:teuthology.orchestra.run.smithi006.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T07:47:26.560 INFO:teuthology.orchestra.run.smithi006.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T07:47:26.869 INFO:teuthology.orchestra.run.smithi006.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T07:47:26.892 INFO:teuthology.orchestra.run.smithi145.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-09-21T07:47:26.902 INFO:teuthology.orchestra.run.smithi006.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.3 MB/s | 45 kB 00:00 2024-09-21T07:47:27.175 INFO:teuthology.orchestra.run.smithi145.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T07:47:27.234 INFO:teuthology.orchestra.run.smithi145.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.5 MB/s | 873 kB 00:00 2024-09-21T07:47:27.259 INFO:teuthology.orchestra.run.smithi145.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T07:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout:(20/157): ceph-test-19.3.0-5120.g18432218.el9.x 25 MB/s | 40 MB 00:01 2024-09-21T07:47:27.294 INFO:teuthology.orchestra.run.smithi006.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 379 kB/s | 148 kB 00:00 2024-09-21T07:47:27.351 INFO:teuthology.orchestra.run.smithi145.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T07:47:27.412 INFO:teuthology.orchestra.run.smithi006.stdout:(22/157): ceph-radosgw-19.3.0-5120.g18432218.el 4.9 MB/s | 10 MB 00:02 2024-09-21T07:47:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:(23/157): python3-cephfs-19.3.0-5120.g18432218. 922 kB/s | 161 kB 00:00 2024-09-21T07:47:27.462 INFO:teuthology.orchestra.run.smithi006.stdout:(24/157): python3-rados-19.3.0-5120.g18432218.e 1.9 MB/s | 321 kB 00:00 2024-09-21T07:47:27.529 INFO:teuthology.orchestra.run.smithi006.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.1 MB/s | 99 kB 00:00 2024-09-21T07:47:27.554 INFO:teuthology.orchestra.run.smithi006.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 941 kB/s | 86 kB 00:00 2024-09-21T07:47:27.568 INFO:teuthology.orchestra.run.smithi145.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 23 MB/s | 5.0 MB 00:00 2024-09-21T07:47:27.579 INFO:teuthology.orchestra.run.smithi006.stdout:(27/157): python3-rbd-19.3.0-5120.g18432218.el9 1.8 MB/s | 307 kB 00:00 2024-09-21T07:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T07:47:27.660 INFO:teuthology.orchestra.run.smithi145.stdout:(7/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 5.4 MB/s | 2.3 MB 00:00 2024-09-21T07:47:27.697 INFO:teuthology.orchestra.run.smithi006.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T07:47:27.780 INFO:teuthology.orchestra.run.smithi006.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T07:47:28.256 INFO:teuthology.orchestra.run.smithi006.stdout:(31/157): ceph-grafana-dashboards-19.3.0-5120.g 51 kB/s | 34 kB 00:00 2024-09-21T07:47:28.489 INFO:teuthology.orchestra.run.smithi006.stdout:(32/157): ceph-mgr-dashboard-19.3.0-5120.g18432 18 MB/s | 14 MB 00:00 2024-09-21T07:47:28.515 INFO:teuthology.orchestra.run.smithi006.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.1 MB/s | 292 kB 00:00 2024-09-21T07:47:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.1 MB/s | 49 kB 00:00 2024-09-21T07:47:28.624 INFO:teuthology.orchestra.run.smithi006.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 8.8 MB/s | 7.4 MB 00:00 2024-09-21T07:47:28.640 INFO:teuthology.orchestra.run.smithi006.stdout:(36/157): ceph-prometheus-alerts-19.3.0-5120.g1 131 kB/s | 16 kB 00:00 2024-09-21T07:47:28.643 INFO:teuthology.orchestra.run.smithi145.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 10 MB/s | 20 MB 00:01 2024-09-21T07:47:28.666 INFO:teuthology.orchestra.run.smithi006.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 2.1 MB/s | 285 kB 00:00 2024-09-21T07:47:28.683 INFO:teuthology.orchestra.run.smithi006.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 438 kB/s | 18 kB 00:00 2024-09-21T07:47:28.694 INFO:teuthology.orchestra.run.smithi145.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T07:47:28.725 INFO:teuthology.orchestra.run.smithi006.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-21T07:47:28.875 INFO:teuthology.orchestra.run.smithi006.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 383 kB/s | 80 kB 00:00 2024-09-21T07:47:28.977 INFO:teuthology.orchestra.run.smithi145.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 13 MB/s | 18 MB 00:01 2024-09-21T07:47:29.027 INFO:teuthology.orchestra.run.smithi145.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T07:47:29.078 INFO:teuthology.orchestra.run.smithi145.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 542 kB/s | 27 kB 00:00 2024-09-21T07:47:29.083 INFO:teuthology.orchestra.run.smithi006.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 533 kB/s | 191 kB 00:00 2024-09-21T07:47:29.109 INFO:teuthology.orchestra.run.smithi006.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T07:47:29.128 INFO:teuthology.orchestra.run.smithi145.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 636 kB/s | 32 kB 00:00 2024-09-21T07:47:29.142 INFO:teuthology.orchestra.run.smithi006.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-21T07:47:29.184 INFO:teuthology.orchestra.run.smithi006.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T07:47:29.218 INFO:teuthology.orchestra.run.smithi006.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-21T07:47:29.252 INFO:teuthology.orchestra.run.smithi006.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-21T07:47:29.278 INFO:teuthology.orchestra.run.smithi145.stdout:(14/157): ceph-radosgw-19.3.0-5120.g18432218.el 6.4 MB/s | 10 MB 00:01 2024-09-21T07:47:29.285 INFO:teuthology.orchestra.run.smithi006.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T07:47:29.303 INFO:teuthology.orchestra.run.smithi145.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.3 MB/s | 766 kB 00:00 2024-09-21T07:47:29.311 INFO:teuthology.orchestra.run.smithi006.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T07:47:29.329 INFO:teuthology.orchestra.run.smithi145.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T07:47:29.354 INFO:teuthology.orchestra.run.smithi145.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T07:47:29.413 INFO:teuthology.orchestra.run.smithi145.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.9 MB/s | 507 kB 00:00 2024-09-21T07:47:29.463 INFO:teuthology.orchestra.run.smithi145.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 905 kB/s | 45 kB 00:00 2024-09-21T07:47:29.522 INFO:teuthology.orchestra.run.smithi145.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T07:47:29.580 INFO:teuthology.orchestra.run.smithi145.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T07:47:29.714 INFO:teuthology.orchestra.run.smithi145.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T07:47:29.739 INFO:teuthology.orchestra.run.smithi145.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.0 MB/s | 321 kB 00:00 2024-09-21T07:47:29.764 INFO:teuthology.orchestra.run.smithi145.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T07:47:29.789 INFO:teuthology.orchestra.run.smithi145.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T07:47:29.815 INFO:teuthology.orchestra.run.smithi145.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:47:29.865 INFO:teuthology.orchestra.run.smithi145.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T07:47:29.949 INFO:teuthology.orchestra.run.smithi145.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 411 kB/s | 34 kB 00:00 2024-09-21T07:47:30.008 INFO:teuthology.orchestra.run.smithi145.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T07:47:30.052 INFO:teuthology.orchestra.run.smithi006.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 144 kB/s | 107 kB 00:00 2024-09-21T07:47:30.158 INFO:teuthology.orchestra.run.smithi145.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.4 MB/s | 3.1 MB 00:00 2024-09-21T07:47:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-21T07:47:30.303 INFO:teuthology.orchestra.run.smithi006.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 656 kB/s | 689 kB 00:01 2024-09-21T07:47:30.584 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T07:47:30.628 INFO:teuthology.orchestra.run.smithi006.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-21T07:47:30.887 INFO:teuthology.orchestra.run.smithi006.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 33 kB 00:00 2024-09-21T07:47:30.916 INFO:teuthology.orchestra.run.smithi145.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 16 MB/s | 14 MB 00:00 2024-09-21T07:47:30.975 INFO:teuthology.orchestra.run.smithi145.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T07:47:31.067 INFO:teuthology.orchestra.run.smithi145.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 8.1 MB/s | 7.4 MB 00:00 2024-09-21T07:47:31.087 INFO:teuthology.orchestra.run.smithi006.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 351 kB/s | 313 kB 00:00 2024-09-21T07:47:31.092 INFO:teuthology.orchestra.run.smithi145.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 422 kB/s | 49 kB 00:00 2024-09-21T07:47:31.371 INFO:teuthology.orchestra.run.smithi006.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-21T07:47:31.451 INFO:teuthology.orchestra.run.smithi145.stdout:(35/157): ceph-test-19.3.0-5120.g18432218.el9.x 14 MB/s | 40 MB 00:02 2024-09-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi145.stdout:(36/157): ceph-prometheus-alerts-19.3.0-5120.g1 40 kB/s | 16 kB 00:00 2024-09-21T07:47:31.501 INFO:teuthology.orchestra.run.smithi145.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 697 kB/s | 285 kB 00:00 2024-09-21T07:47:31.554 INFO:teuthology.orchestra.run.smithi006.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-21T07:47:31.602 INFO:teuthology.orchestra.run.smithi145.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-09-21T07:47:31.627 INFO:teuthology.orchestra.run.smithi145.stdout:(39/157): cephfs-top-19.3.0-5120.g18432218.el9. 122 kB/s | 18 kB 00:00 2024-09-21T07:47:31.669 INFO:teuthology.orchestra.run.smithi145.stdout:(40/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.5 MB/s | 784 kB 00:00 2024-09-21T07:47:31.696 INFO:teuthology.orchestra.run.smithi006.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-21T07:47:31.761 INFO:teuthology.orchestra.run.smithi145.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-21T07:47:31.811 INFO:teuthology.orchestra.run.smithi145.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-21T07:47:31.836 INFO:teuthology.orchestra.run.smithi145.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-21T07:47:31.870 INFO:teuthology.orchestra.run.smithi145.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-21T07:47:31.895 INFO:teuthology.orchestra.run.smithi145.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-21T07:47:31.928 INFO:teuthology.orchestra.run.smithi145.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T07:47:31.954 INFO:teuthology.orchestra.run.smithi145.stdout:(47/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-21T07:47:31.987 INFO:teuthology.orchestra.run.smithi145.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T07:47:32.121 INFO:teuthology.orchestra.run.smithi006.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 227 kB/s | 171 kB 00:00 2024-09-21T07:47:32.188 INFO:teuthology.orchestra.run.smithi145.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 535 kB/s | 107 kB 00:00 2024-09-21T07:47:32.218 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-21T07:47:32.263 INFO:teuthology.orchestra.run.smithi006.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2024-09-21T07:47:32.266 INFO:teuthology.orchestra.run.smithi145.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi145.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-21T07:47:32.289 INFO:teuthology.orchestra.run.smithi006.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-09-21T07:47:32.314 INFO:teuthology.orchestra.run.smithi145.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-21T07:47:32.330 INFO:teuthology.orchestra.run.smithi145.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T07:47:32.389 INFO:teuthology.orchestra.run.smithi145.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T07:47:32.406 INFO:teuthology.orchestra.run.smithi145.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-21T07:47:32.448 INFO:teuthology.orchestra.run.smithi145.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-21T07:47:32.498 INFO:teuthology.orchestra.run.smithi145.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T07:47:32.523 INFO:teuthology.orchestra.run.smithi145.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T07:47:32.557 INFO:teuthology.orchestra.run.smithi145.stdout:(59/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-21T07:47:32.582 INFO:teuthology.orchestra.run.smithi145.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2024-09-21T07:47:32.616 INFO:teuthology.orchestra.run.smithi145.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T07:47:32.649 INFO:teuthology.orchestra.run.smithi145.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-21T07:47:32.691 INFO:teuthology.orchestra.run.smithi145.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-21T07:47:32.717 INFO:teuthology.orchestra.run.smithi145.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T07:47:32.759 INFO:teuthology.orchestra.run.smithi145.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T07:47:32.784 INFO:teuthology.orchestra.run.smithi145.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T07:47:32.809 INFO:teuthology.orchestra.run.smithi145.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-21T07:47:32.822 INFO:teuthology.orchestra.run.smithi006.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-21T07:47:32.910 INFO:teuthology.orchestra.run.smithi145.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:47:33.014 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T07:47:33.022 INFO:teuthology.orchestra.run.smithi006.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 736 kB/s | 662 kB 00:00 2024-09-21T07:47:33.060 INFO:teuthology.orchestra.run.smithi145.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-21T07:47:33.093 INFO:teuthology.orchestra.run.smithi145.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-21T07:47:33.160 INFO:teuthology.orchestra.run.smithi145.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T07:47:33.177 INFO:teuthology.orchestra.run.smithi145.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T07:47:33.206 INFO:teuthology.orchestra.run.smithi006.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 617 kB/s | 581 kB 00:00 2024-09-21T07:47:33.253 INFO:teuthology.orchestra.run.smithi145.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-21T07:47:33.327 INFO:teuthology.orchestra.run.smithi145.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-21T07:47:33.361 INFO:teuthology.orchestra.run.smithi145.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-21T07:47:33.403 INFO:teuthology.orchestra.run.smithi145.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 814 kB/s | 61 kB 00:00 2024-09-21T07:47:33.424 INFO:teuthology.orchestra.run.smithi006.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-21T07:47:33.487 INFO:teuthology.orchestra.run.smithi145.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-21T07:47:33.512 INFO:teuthology.orchestra.run.smithi145.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T07:47:33.537 INFO:teuthology.orchestra.run.smithi145.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-21T07:47:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-21T07:47:33.596 INFO:teuthology.orchestra.run.smithi145.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T07:47:33.638 INFO:teuthology.orchestra.run.smithi145.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-21T07:47:33.680 INFO:teuthology.orchestra.run.smithi145.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 319 kB/s | 35 kB 00:00 2024-09-21T07:47:33.730 INFO:teuthology.orchestra.run.smithi145.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T07:47:33.755 INFO:teuthology.orchestra.run.smithi145.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-21T07:47:33.823 INFO:teuthology.orchestra.run.smithi145.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-21T07:47:33.840 INFO:teuthology.orchestra.run.smithi006.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 358 kB/s | 292 kB 00:00 2024-09-21T07:47:33.847 INFO:teuthology.orchestra.run.smithi145.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 459 kB/s | 42 kB 00:00 2024-09-21T07:47:33.873 INFO:teuthology.orchestra.run.smithi145.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 542 kB/s | 77 kB 00:00 2024-09-21T07:47:33.898 INFO:teuthology.orchestra.run.smithi145.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T07:47:33.923 INFO:teuthology.orchestra.run.smithi145.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:47:33.940 INFO:teuthology.orchestra.run.smithi006.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-21T07:47:33.948 INFO:teuthology.orchestra.run.smithi145.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-21T07:47:33.966 INFO:teuthology.orchestra.run.smithi145.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 756 kB/s | 51 kB 00:00 2024-09-21T07:47:33.991 INFO:teuthology.orchestra.run.smithi145.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 796 kB/s | 54 kB 00:00 2024-09-21T07:47:34.024 INFO:teuthology.orchestra.run.smithi006.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-21T07:47:34.049 INFO:teuthology.orchestra.run.smithi145.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-21T07:47:34.208 INFO:teuthology.orchestra.run.smithi145.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 204 kB/s | 44 kB 00:00 2024-09-21T07:47:34.259 INFO:teuthology.orchestra.run.smithi145.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-09-21T07:47:34.300 INFO:teuthology.orchestra.run.smithi145.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-09-21T07:47:34.334 INFO:teuthology.orchestra.run.smithi145.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-21T07:47:34.376 INFO:teuthology.orchestra.run.smithi145.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-21T07:47:34.401 INFO:teuthology.orchestra.run.smithi145.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-21T07:47:34.568 INFO:teuthology.orchestra.run.smithi145.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T07:47:34.593 INFO:teuthology.orchestra.run.smithi145.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-21T07:47:34.618 INFO:teuthology.orchestra.run.smithi145.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 395 kB/s | 96 kB 00:00 2024-09-21T07:47:34.644 INFO:teuthology.orchestra.run.smithi145.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-21T07:47:34.702 INFO:teuthology.orchestra.run.smithi145.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T07:47:34.728 INFO:teuthology.orchestra.run.smithi145.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-21T07:47:34.761 INFO:teuthology.orchestra.run.smithi145.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-21T07:47:34.787 INFO:teuthology.orchestra.run.smithi145.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-21T07:47:34.811 INFO:teuthology.orchestra.run.smithi145.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:47:34.837 INFO:teuthology.orchestra.run.smithi145.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:47:34.870 INFO:teuthology.orchestra.run.smithi145.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T07:47:34.912 INFO:teuthology.orchestra.run.smithi145.stdout:(112/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-21T07:47:34.946 INFO:teuthology.orchestra.run.smithi145.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-21T07:47:35.021 INFO:teuthology.orchestra.run.smithi145.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T07:47:35.046 INFO:teuthology.orchestra.run.smithi145.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 5.4 MB/s | 548 kB 00:00 2024-09-21T07:47:35.072 INFO:teuthology.orchestra.run.smithi145.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-21T07:47:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-21T07:47:35.097 INFO:teuthology.orchestra.run.smithi145.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-21T07:47:35.122 INFO:teuthology.orchestra.run.smithi145.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-21T07:47:35.124 INFO:teuthology.orchestra.run.smithi006.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-21T07:47:35.156 INFO:teuthology.orchestra.run.smithi145.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-09-21T07:47:35.181 INFO:teuthology.orchestra.run.smithi145.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-21T07:47:35.191 INFO:teuthology.orchestra.run.smithi006.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-21T07:47:35.206 INFO:teuthology.orchestra.run.smithi145.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T07:47:35.232 INFO:teuthology.orchestra.run.smithi145.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T07:47:35.257 INFO:teuthology.orchestra.run.smithi145.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-21T07:47:35.291 INFO:teuthology.orchestra.run.smithi145.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-09-21T07:47:35.316 INFO:teuthology.orchestra.run.smithi145.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-21T07:47:35.341 INFO:teuthology.orchestra.run.smithi145.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-21T07:47:35.367 INFO:teuthology.orchestra.run.smithi145.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T07:47:35.392 INFO:teuthology.orchestra.run.smithi145.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T07:47:35.417 INFO:teuthology.orchestra.run.smithi145.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T07:47:35.443 INFO:teuthology.orchestra.run.smithi145.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:47:35.468 INFO:teuthology.orchestra.run.smithi145.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:47:35.501 INFO:teuthology.orchestra.run.smithi145.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-21T07:47:35.535 INFO:teuthology.orchestra.run.smithi145.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi145.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-21T07:47:35.585 INFO:teuthology.orchestra.run.smithi145.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-21T07:47:35.611 INFO:teuthology.orchestra.run.smithi145.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T07:47:35.636 INFO:teuthology.orchestra.run.smithi145.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T07:47:35.678 INFO:teuthology.orchestra.run.smithi145.stdout:(138/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-21T07:47:35.703 INFO:teuthology.orchestra.run.smithi145.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-09-21T07:47:35.728 INFO:teuthology.orchestra.run.smithi145.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T07:47:35.754 INFO:teuthology.orchestra.run.smithi145.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T07:47:35.779 INFO:teuthology.orchestra.run.smithi145.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-21T07:47:35.804 INFO:teuthology.orchestra.run.smithi145.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-21T07:47:35.817 INFO:teuthology.orchestra.run.smithi006.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 198 kB/s | 137 kB 00:00 2024-09-21T07:47:35.829 INFO:teuthology.orchestra.run.smithi145.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T07:47:35.855 INFO:teuthology.orchestra.run.smithi145.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T07:47:35.872 INFO:teuthology.orchestra.run.smithi145.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-21T07:47:35.905 INFO:teuthology.orchestra.run.smithi145.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:47:35.931 INFO:teuthology.orchestra.run.smithi145.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T07:47:35.981 INFO:teuthology.orchestra.run.smithi145.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T07:47:36.008 INFO:teuthology.orchestra.run.smithi006.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 974 kB/s | 910 kB 00:00 2024-09-21T07:47:36.089 INFO:teuthology.orchestra.run.smithi145.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-09-21T07:47:36.181 INFO:teuthology.orchestra.run.smithi145.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-09-21T07:47:36.257 INFO:teuthology.orchestra.run.smithi145.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.7 MB/s | 3.2 MB 00:00 2024-09-21T07:47:36.282 INFO:teuthology.orchestra.run.smithi145.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 409 kB/s | 41 kB 00:00 2024-09-21T07:47:36.357 INFO:teuthology.orchestra.run.smithi145.stdout:(154/157): librados2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 3.4 MB 00:00 2024-09-21T07:47:36.391 INFO:teuthology.orchestra.run.smithi145.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-21T07:47:36.417 INFO:teuthology.orchestra.run.smithi006.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-21T07:47:36.433 INFO:teuthology.orchestra.run.smithi145.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-21T07:47:36.616 INFO:teuthology.orchestra.run.smithi145.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-21T07:47:36.622 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:47:36.622 INFO:teuthology.orchestra.run.smithi145.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T07:47:36.701 INFO:teuthology.orchestra.run.smithi006.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 126 kB/s | 87 kB 00:00 2024-09-21T07:47:36.735 INFO:teuthology.orchestra.run.smithi006.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-21T07:47:37.360 INFO:teuthology.orchestra.run.smithi006.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 93 kB/s | 61 kB 00:00 2024-09-21T07:47:37.601 INFO:teuthology.orchestra.run.smithi006.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 283 kB/s | 245 kB 00:00 2024-09-21T07:47:37.867 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-21T07:47:37.960 INFO:teuthology.orchestra.run.smithi006.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-09-21T07:47:38.020 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-21T07:47:38.020 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-21T07:47:38.169 INFO:teuthology.orchestra.run.smithi006.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-09-21T07:47:38.202 INFO:teuthology.orchestra.run.smithi006.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-09-21T07:47:38.452 INFO:teuthology.orchestra.run.smithi006.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-21T07:47:38.461 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T07:47:38.753 INFO:teuthology.orchestra.run.smithi006.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-21T07:47:38.878 INFO:teuthology.orchestra.run.smithi006.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-21T07:47:39.570 INFO:teuthology.orchestra.run.smithi006.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-21T07:47:39.595 INFO:teuthology.orchestra.run.smithi006.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 298 kB/s | 250 kB 00:00 2024-09-21T07:47:39.645 INFO:teuthology.orchestra.run.smithi006.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 290 kB/s | 222 kB 00:00 2024-09-21T07:47:40.187 INFO:teuthology.orchestra.run.smithi006.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 71 kB/s | 42 kB 00:00 2024-09-21T07:47:40.210 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-21T07:47:40.210 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-21T07:47:40.213 INFO:teuthology.orchestra.run.smithi006.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-21T07:47:40.430 INFO:teuthology.orchestra.run.smithi006.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-09-21T07:47:40.641 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:40.642 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:47:40.655 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:47:40.656 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:47:40.657 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:47:40.658 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:47:40.660 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:47:40.663 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:47:40.664 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:47:40.726 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-21T07:47:40.743 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T07:47:40.743 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:47:40.744 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:47:40.745 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-21T07:47:40.746 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:47:40.747 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:47:40.748 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:47:40.749 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:47:40.750 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:47:40.751 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:47:40.752 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:47:40.753 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:47:40.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:47:40.755 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout:Install 149 Packages 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:47:40.756 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 228 M 2024-09-21T07:47:40.757 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-21T07:47:40.980 INFO:teuthology.orchestra.run.smithi006.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 200 kB/s | 159 kB 00:00 2024-09-21T07:47:41.005 INFO:teuthology.orchestra.run.smithi006.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 352 kB/s | 279 kB 00:00 2024-09-21T07:47:41.039 INFO:teuthology.orchestra.run.smithi006.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-21T07:47:41.296 INFO:teuthology.orchestra.run.smithi119.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-21T07:47:41.488 INFO:teuthology.orchestra.run.smithi119.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.4 MB/s | 873 kB 00:00 2024-09-21T07:47:41.546 INFO:teuthology.orchestra.run.smithi119.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T07:47:41.597 INFO:teuthology.orchestra.run.smithi006.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-21T07:47:41.639 INFO:teuthology.orchestra.run.smithi006.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-21T07:47:41.705 INFO:teuthology.orchestra.run.smithi119.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T07:47:41.763 INFO:teuthology.orchestra.run.smithi119.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T07:47:41.839 INFO:teuthology.orchestra.run.smithi119.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T07:47:42.165 INFO:teuthology.orchestra.run.smithi006.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-21T07:47:42.181 INFO:teuthology.orchestra.run.smithi119.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T07:47:42.432 INFO:teuthology.orchestra.run.smithi006.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T07:47:42.457 INFO:teuthology.orchestra.run.smithi006.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 270 kB/s | 221 kB 00:00 2024-09-21T07:47:42.464 INFO:teuthology.orchestra.run.smithi119.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T07:47:42.506 INFO:teuthology.orchestra.run.smithi119.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T07:47:42.840 INFO:teuthology.orchestra.run.smithi006.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 53 kB/s | 36 kB 00:00 2024-09-21T07:47:42.915 INFO:teuthology.orchestra.run.smithi119.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T07:47:43.007 INFO:teuthology.orchestra.run.smithi006.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-21T07:47:43.031 INFO:teuthology.orchestra.run.smithi119.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T07:47:43.057 INFO:teuthology.orchestra.run.smithi119.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T07:47:43.082 INFO:teuthology.orchestra.run.smithi119.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 539 kB/s | 27 kB 00:00 2024-09-21T07:47:43.107 INFO:teuthology.orchestra.run.smithi119.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 630 kB/s | 32 kB 00:00 2024-09-21T07:47:43.166 INFO:teuthology.orchestra.run.smithi119.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T07:47:43.191 INFO:teuthology.orchestra.run.smithi119.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T07:47:43.232 INFO:teuthology.orchestra.run.smithi006.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-21T07:47:43.285 INFO:teuthology.orchestra.run.smithi119.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.0 MB/s | 127 kB 00:00 2024-09-21T07:47:43.333 INFO:teuthology.orchestra.run.smithi119.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 3.5 MB/s | 507 kB 00:00 2024-09-21T07:47:43.384 INFO:teuthology.orchestra.run.smithi119.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 901 kB/s | 45 kB 00:00 2024-09-21T07:47:43.441 INFO:teuthology.orchestra.run.smithi006.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2024-09-21T07:47:43.475 INFO:teuthology.orchestra.run.smithi119.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T07:47:43.609 INFO:teuthology.orchestra.run.smithi119.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.3 MB 00:00 2024-09-21T07:47:43.634 INFO:teuthology.orchestra.run.smithi119.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.0 MB/s | 161 kB 00:00 2024-09-21T07:47:43.660 INFO:teuthology.orchestra.run.smithi119.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T07:47:43.683 INFO:teuthology.orchestra.run.smithi006.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-21T07:47:43.685 INFO:teuthology.orchestra.run.smithi119.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.9 MB/s | 307 kB 00:00 2024-09-21T07:47:43.735 INFO:teuthology.orchestra.run.smithi119.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:47:43.760 INFO:teuthology.orchestra.run.smithi119.stdout:(26/157): python3-rgw-19.3.0-5120.g18432218.el9 989 kB/s | 99 kB 00:00 2024-09-21T07:47:43.786 INFO:teuthology.orchestra.run.smithi006.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 245 kB/s | 22 kB 00:00 2024-09-21T07:47:43.836 INFO:teuthology.orchestra.run.smithi119.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T07:47:43.850 INFO:teuthology.orchestra.run.smithi006.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 104 kB/s | 64 kB 00:00 2024-09-21T07:47:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 7.3 MB/s | 863 kB 00:00 2024-09-21T07:47:43.942 INFO:teuthology.orchestra.run.smithi006.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-21T07:47:43.946 INFO:teuthology.orchestra.run.smithi119.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T07:47:43.968 INFO:teuthology.orchestra.run.smithi006.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 846 kB/s | 19 kB 00:00 2024-09-21T07:47:43.970 INFO:teuthology.orchestra.run.smithi119.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 256 kB/s | 34 kB 00:00 2024-09-21T07:47:43.987 INFO:teuthology.orchestra.run.smithi119.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.6 MB/s | 154 kB 00:00 2024-09-21T07:47:44.009 INFO:teuthology.orchestra.run.smithi006.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T07:47:44.035 INFO:teuthology.orchestra.run.smithi006.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:47:44.074 INFO:teuthology.orchestra.run.smithi006.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:47:44.085 INFO:teuthology.orchestra.run.smithi006.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T07:47:44.111 INFO:teuthology.orchestra.run.smithi006.stdout:(112/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-09-21T07:47:44.144 INFO:teuthology.orchestra.run.smithi006.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-21T07:47:44.186 INFO:teuthology.orchestra.run.smithi006.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-21T07:47:44.203 INFO:teuthology.orchestra.run.smithi006.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T07:47:44.220 INFO:teuthology.orchestra.run.smithi006.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T07:47:44.237 INFO:teuthology.orchestra.run.smithi006.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 853 kB/s | 14 kB 00:00 2024-09-21T07:47:44.262 INFO:teuthology.orchestra.run.smithi006.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T07:47:44.296 INFO:teuthology.orchestra.run.smithi006.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-21T07:47:44.329 INFO:teuthology.orchestra.run.smithi006.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T07:47:44.354 INFO:teuthology.orchestra.run.smithi119.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T07:47:44.355 INFO:teuthology.orchestra.run.smithi006.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T07:47:44.388 INFO:teuthology.orchestra.run.smithi006.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T07:47:44.404 INFO:teuthology.orchestra.run.smithi119.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T07:47:44.414 INFO:teuthology.orchestra.run.smithi006.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi006.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T07:47:44.496 INFO:teuthology.orchestra.run.smithi119.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 540 kB/s | 49 kB 00:00 2024-09-21T07:47:44.514 INFO:teuthology.orchestra.run.smithi006.stdout:(125/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-21T07:47:44.540 INFO:teuthology.orchestra.run.smithi006.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-09-21T07:47:44.565 INFO:teuthology.orchestra.run.smithi006.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T07:47:44.590 INFO:teuthology.orchestra.run.smithi006.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T07:47:44.596 INFO:teuthology.orchestra.run.smithi119.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T07:47:44.615 INFO:teuthology.orchestra.run.smithi006.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T07:47:44.621 INFO:teuthology.orchestra.run.smithi119.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 132 kB/s | 16 kB 00:00 2024-09-21T07:47:44.641 INFO:teuthology.orchestra.run.smithi006.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:47:44.647 INFO:teuthology.orchestra.run.smithi119.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T07:47:44.674 INFO:teuthology.orchestra.run.smithi006.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T07:47:44.689 INFO:teuthology.orchestra.run.smithi119.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T07:47:44.699 INFO:teuthology.orchestra.run.smithi006.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:47:44.714 INFO:teuthology.orchestra.run.smithi119.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T07:47:44.733 INFO:teuthology.orchestra.run.smithi006.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T07:47:44.759 INFO:teuthology.orchestra.run.smithi006.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-21T07:47:44.784 INFO:teuthology.orchestra.run.smithi006.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T07:47:44.826 INFO:teuthology.orchestra.run.smithi006.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-21T07:47:44.851 INFO:teuthology.orchestra.run.smithi006.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-09-21T07:47:44.877 INFO:teuthology.orchestra.run.smithi006.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T07:47:44.898 INFO:teuthology.orchestra.run.smithi119.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T07:47:44.902 INFO:teuthology.orchestra.run.smithi006.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:47:44.927 INFO:teuthology.orchestra.run.smithi006.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T07:47:44.952 INFO:teuthology.orchestra.run.smithi006.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T07:47:44.964 INFO:teuthology.orchestra.run.smithi119.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-09-21T07:47:45.002 INFO:teuthology.orchestra.run.smithi006.stdout:(142/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T07:47:45.023 INFO:teuthology.orchestra.run.smithi119.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T07:47:45.028 INFO:teuthology.orchestra.run.smithi006.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-09-21T07:47:45.048 INFO:teuthology.orchestra.run.smithi119.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T07:47:45.062 INFO:teuthology.orchestra.run.smithi006.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-21T07:47:45.073 INFO:teuthology.orchestra.run.smithi119.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T07:47:45.087 INFO:teuthology.orchestra.run.smithi006.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T07:47:45.107 INFO:teuthology.orchestra.run.smithi119.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T07:47:45.112 INFO:teuthology.orchestra.run.smithi006.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-21T07:47:45.132 INFO:teuthology.orchestra.run.smithi119.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T07:47:45.137 INFO:teuthology.orchestra.run.smithi006.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:47:45.158 INFO:teuthology.orchestra.run.smithi119.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T07:47:45.163 INFO:teuthology.orchestra.run.smithi006.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T07:47:45.183 INFO:teuthology.orchestra.run.smithi119.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T07:47:45.213 INFO:teuthology.orchestra.run.smithi006.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:47:45.216 INFO:teuthology.orchestra.run.smithi119.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-21T07:47:45.317 INFO:teuthology.orchestra.run.smithi119.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-21T07:47:45.350 INFO:teuthology.orchestra.run.smithi119.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-09-21T07:47:45.384 INFO:teuthology.orchestra.run.smithi119.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-21T07:47:45.401 INFO:teuthology.orchestra.run.smithi119.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-21T07:47:45.451 INFO:teuthology.orchestra.run.smithi119.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-21T07:47:45.477 INFO:teuthology.orchestra.run.smithi119.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-21T07:47:45.543 INFO:teuthology.orchestra.run.smithi119.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-21T07:47:45.569 INFO:teuthology.orchestra.run.smithi119.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-21T07:47:45.594 INFO:teuthology.orchestra.run.smithi119.stdout:(57/157): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 18 kB 00:00 2024-09-21T07:47:45.601 INFO:teuthology.orchestra.run.smithi006.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2024-09-21T07:47:45.619 INFO:teuthology.orchestra.run.smithi119.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T07:47:45.645 INFO:teuthology.orchestra.run.smithi119.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T07:47:45.664 INFO:teuthology.orchestra.run.smithi006.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.3 MB/s | 3.2 MB 00:00 2024-09-21T07:47:45.670 INFO:teuthology.orchestra.run.smithi119.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-21T07:47:45.695 INFO:teuthology.orchestra.run.smithi119.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-21T07:47:45.714 INFO:teuthology.orchestra.run.smithi006.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 16 MB/s | 1.8 MB 00:00 2024-09-21T07:47:45.720 INFO:teuthology.orchestra.run.smithi119.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T07:47:45.746 INFO:teuthology.orchestra.run.smithi119.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-21T07:47:45.747 INFO:teuthology.orchestra.run.smithi006.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 492 kB/s | 41 kB 00:00 2024-09-21T07:47:45.771 INFO:teuthology.orchestra.run.smithi119.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-21T07:47:45.773 INFO:teuthology.orchestra.run.smithi006.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-21T07:47:45.796 INFO:teuthology.orchestra.run.smithi119.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T07:47:45.823 INFO:teuthology.orchestra.run.smithi006.stdout:(155/157): librados2-19.3.0-5120.g18432218.el9. 4.9 MB/s | 3.4 MB 00:00 2024-09-21T07:47:45.830 INFO:teuthology.orchestra.run.smithi119.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T07:47:45.855 INFO:teuthology.orchestra.run.smithi119.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-21T07:47:45.890 INFO:teuthology.orchestra.run.smithi006.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-21T07:47:45.932 INFO:teuthology.orchestra.run.smithi006.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.3 MB/s | 1.4 MB 00:00 2024-09-21T07:47:45.939 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:47:45.939 INFO:teuthology.orchestra.run.smithi006.stdout:Total 10 MB/s | 228 MB 00:21 2024-09-21T07:47:45.947 INFO:teuthology.orchestra.run.smithi119.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-21T07:47:45.997 INFO:teuthology.orchestra.run.smithi119.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T07:47:46.039 INFO:teuthology.orchestra.run.smithi119.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-21T07:47:46.064 INFO:teuthology.orchestra.run.smithi119.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T07:47:46.173 INFO:teuthology.orchestra.run.smithi119.stdout:(72/157): postgresql-server-13.16-1.el9.x86_64. 43 MB/s | 5.8 MB 00:00 2024-09-21T07:47:46.207 INFO:teuthology.orchestra.run.smithi119.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-21T07:47:46.265 INFO:teuthology.orchestra.run.smithi119.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T07:47:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 749 kB/s | 87 kB 00:00 2024-09-21T07:47:46.382 INFO:teuthology.orchestra.run.smithi119.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-21T07:47:46.408 INFO:teuthology.orchestra.run.smithi119.stdout:(77/157): python3-colorama-0.4.6-3.el9.noarch.r 431 kB/s | 61 kB 00:00 2024-09-21T07:47:46.433 INFO:teuthology.orchestra.run.smithi119.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T07:47:46.458 INFO:teuthology.orchestra.run.smithi119.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-21T07:47:46.483 INFO:teuthology.orchestra.run.smithi119.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T07:47:46.509 INFO:teuthology.orchestra.run.smithi119.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-21T07:47:46.534 INFO:teuthology.orchestra.run.smithi119.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T07:47:46.559 INFO:teuthology.orchestra.run.smithi119.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-21T07:47:46.601 INFO:teuthology.orchestra.run.smithi119.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T07:47:46.613 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-21T07:47:46.668 INFO:teuthology.orchestra.run.smithi119.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-21T07:47:46.693 INFO:teuthology.orchestra.run.smithi119.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 842 kB/s | 77 kB 00:00 2024-09-21T07:47:46.718 INFO:teuthology.orchestra.run.smithi119.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-21T07:47:46.728 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:47:46.735 INFO:teuthology.orchestra.run.smithi119.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-21T07:47:46.761 INFO:teuthology.orchestra.run.smithi119.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-21T07:47:46.767 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:47:46.794 INFO:teuthology.orchestra.run.smithi119.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:47:46.820 INFO:teuthology.orchestra.run.smithi119.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-21T07:47:46.820 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:47:46.845 INFO:teuthology.orchestra.run.smithi119.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 605 kB/s | 51 kB 00:00 2024-09-21T07:47:46.853 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:47:46.870 INFO:teuthology.orchestra.run.smithi119.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 708 kB/s | 54 kB 00:00 2024-09-21T07:47:46.879 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:47:46.895 INFO:teuthology.orchestra.run.smithi119.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T07:47:46.933 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:47:46.946 INFO:teuthology.orchestra.run.smithi119.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-21T07:47:46.971 INFO:teuthology.orchestra.run.smithi119.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-21T07:47:47.005 INFO:teuthology.orchestra.run.smithi119.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-21T07:47:47.172 INFO:teuthology.orchestra.run.smithi119.stdout:(98/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-21T07:47:47.179 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-09-21T07:47:47.197 INFO:teuthology.orchestra.run.smithi119.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 210 kB/s | 47 kB 00:00 2024-09-21T07:47:47.222 INFO:teuthology.orchestra.run.smithi119.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T07:47:47.255 INFO:teuthology.orchestra.run.smithi119.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-09-21T07:47:47.281 INFO:teuthology.orchestra.run.smithi119.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T07:47:47.306 INFO:teuthology.orchestra.run.smithi119.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-09-21T07:47:47.331 INFO:teuthology.orchestra.run.smithi119.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-09-21T07:47:47.338 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:47:47.351 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-09-21T07:47:47.351 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-09-21T07:47:47.356 INFO:teuthology.orchestra.run.smithi119.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-09-21T07:47:47.397 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:47:47.407 INFO:teuthology.orchestra.run.smithi119.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T07:47:47.432 INFO:teuthology.orchestra.run.smithi119.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-21T07:47:47.466 INFO:teuthology.orchestra.run.smithi119.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-09-21T07:47:47.491 INFO:teuthology.orchestra.run.smithi119.stdout:(109/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.2 MB/s | 308 kB 00:00 2024-09-21T07:47:47.523 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:47:47.525 INFO:teuthology.orchestra.run.smithi119.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:47:47.547 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:47:47.550 INFO:teuthology.orchestra.run.smithi119.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-21T07:47:47.575 INFO:teuthology.orchestra.run.smithi119.stdout:(112/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-09-21T07:47:47.600 INFO:teuthology.orchestra.run.smithi119.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T07:47:47.634 INFO:teuthology.orchestra.run.smithi119.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T07:47:47.639 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:47:47.659 INFO:teuthology.orchestra.run.smithi119.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:47:47.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:47:47.684 INFO:teuthology.orchestra.run.smithi119.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T07:47:47.699 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:47:47.710 INFO:teuthology.orchestra.run.smithi119.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-21T07:47:47.743 INFO:teuthology.orchestra.run.smithi119.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-21T07:47:47.769 INFO:teuthology.orchestra.run.smithi119.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T07:47:47.794 INFO:teuthology.orchestra.run.smithi119.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T07:47:47.819 INFO:teuthology.orchestra.run.smithi119.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T07:47:47.852 INFO:teuthology.orchestra.run.smithi119.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T07:47:47.872 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:47:47.878 INFO:teuthology.orchestra.run.smithi119.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T07:47:47.903 INFO:teuthology.orchestra.run.smithi119.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T07:47:47.929 INFO:teuthology.orchestra.run.smithi119.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-21T07:47:47.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:47:47.954 INFO:teuthology.orchestra.run.smithi119.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-21T07:47:47.961 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:47:47.979 INFO:teuthology.orchestra.run.smithi119.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-21T07:47:48.004 INFO:teuthology.orchestra.run.smithi119.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T07:47:48.059 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:47:48.080 INFO:teuthology.orchestra.run.smithi119.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-21T07:47:48.086 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:47:48.105 INFO:teuthology.orchestra.run.smithi119.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:47:48.130 INFO:teuthology.orchestra.run.smithi119.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:47:48.133 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:47:48.162 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:47:48.172 INFO:teuthology.orchestra.run.smithi119.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-21T07:47:48.188 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:47:48.206 INFO:teuthology.orchestra.run.smithi119.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-21T07:47:48.231 INFO:teuthology.orchestra.run.smithi119.stdout:(134/157): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-09-21T07:47:48.256 INFO:teuthology.orchestra.run.smithi119.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T07:47:48.282 INFO:teuthology.orchestra.run.smithi119.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T07:47:48.307 INFO:teuthology.orchestra.run.smithi119.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T07:47:48.324 INFO:teuthology.orchestra.run.smithi119.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 736 kB/s | 31 kB 00:00 2024-09-21T07:47:48.349 INFO:teuthology.orchestra.run.smithi119.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-21T07:47:48.366 INFO:teuthology.orchestra.run.smithi119.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-21T07:47:48.381 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:47:48.383 INFO:teuthology.orchestra.run.smithi119.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-21T07:47:48.408 INFO:teuthology.orchestra.run.smithi119.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T07:47:48.433 INFO:teuthology.orchestra.run.smithi119.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-21T07:47:48.450 INFO:teuthology.orchestra.run.smithi119.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-21T07:47:48.476 INFO:teuthology.orchestra.run.smithi119.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-21T07:47:48.501 INFO:teuthology.orchestra.run.smithi119.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T07:47:48.526 INFO:teuthology.orchestra.run.smithi119.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:47:48.551 INFO:teuthology.orchestra.run.smithi119.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-21T07:47:48.553 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:47:48.602 INFO:teuthology.orchestra.run.smithi119.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:47:48.694 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:47:48.769 INFO:teuthology.orchestra.run.smithi119.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-21T07:47:48.804 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:48.827 INFO:teuthology.orchestra.run.smithi119.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T07:47:48.877 INFO:teuthology.orchestra.run.smithi119.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 9.7 MB/s | 3.4 MB 00:00 2024-09-21T07:47:48.879 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:48.903 INFO:teuthology.orchestra.run.smithi119.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-21T07:47:48.945 INFO:teuthology.orchestra.run.smithi119.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-21T07:47:48.978 INFO:teuthology.orchestra.run.smithi119.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T07:47:49.037 INFO:teuthology.orchestra.run.smithi119.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-21T07:47:49.095 INFO:teuthology.orchestra.run.smithi119.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-21T07:47:49.102 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:47:49.102 INFO:teuthology.orchestra.run.smithi119.stdout:Total 27 MB/s | 228 MB 00:08 2024-09-21T07:47:49.131 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:49.221 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:47:49.250 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:47:49.284 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:47:49.349 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:47:49.393 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:47:49.426 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:47:49.468 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:47:49.502 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:47:49.529 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:47:49.597 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:47:49.651 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:47:49.683 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:47:49.712 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-09-21T07:47:49.713 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-09-21T07:47:49.726 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:47:49.814 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:47:49.844 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:47:49.889 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:47:49.917 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:47:49.985 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:47:50.031 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:47:50.105 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:47:50.238 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:47:50.291 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:47:50.336 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-21T07:47:50.491 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-21T07:47:50.491 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-21T07:47:50.808 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:47:50.887 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:47:50.925 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:47:50.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:47:51.006 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:47:51.048 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:47:51.212 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:47:51.275 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:47:51.366 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:47:51.422 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:47:51.503 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:47:51.535 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:47:51.571 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:47:51.618 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:47:51.654 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:47:51.697 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:47:51.739 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:47:51.882 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:47:51.924 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:47:51.966 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:47:52.068 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:47:52.108 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:47:52.149 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:47:52.223 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:47:52.406 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:47:52.761 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-21T07:47:52.762 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-21T07:47:52.850 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:47:53.156 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:47:53.205 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:47:53.236 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:47:53.271 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:47:53.310 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:47:53.349 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:47:53.379 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:47:53.414 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:47:53.447 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:47:53.489 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:47:53.523 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:47:53.611 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:47:53.654 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:47:53.693 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:47:53.813 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:47:53.868 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:47:54.587 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:47:54.632 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:47:54.666 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:47:54.775 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:47:54.830 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:47:54.874 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:47:54.954 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:47:54.985 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:47:55.168 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:47:55.200 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:47:55.285 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:47:55.953 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:47:56.073 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:47:56.584 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-09-21T07:47:56.687 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:47:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:47:56.788 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:47:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:47:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:47:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:47:57.272 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:47:57.336 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:47:57.429 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:47:57.456 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:47:57.490 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:47:57.505 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:47:57.635 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:47:57.664 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:47:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:47:57.786 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:47:57.814 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:47:57.816 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:47:57.853 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:47:57.945 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:47:57.974 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:47:57.995 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:47:58.010 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:47:58.059 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:47:58.094 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:47:58.202 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:47:58.228 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:47:58.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:47:58.321 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:47:58.346 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:47:58.507 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:47:58.539 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:47:58.541 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:47:58.610 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:47:58.640 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:47:58.704 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:47:58.828 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:47:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:59.238 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-21T07:47:59.267 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:47:59.349 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:47:59.383 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:47:59.417 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:47:59.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:47:59.474 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:47:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:47:59.584 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:47:59.587 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:47:59.625 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:47:59.627 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:47:59.650 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:47:59.670 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:47:59.703 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:47:59.706 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:47:59.730 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:47:59.801 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:47:59.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:48:00.008 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:48:00.052 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:48:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:48:00.143 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:48:00.179 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:48:00.182 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:48:00.245 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:48:00.276 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:48:00.312 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:48:00.349 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:48:00.352 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:48:00.400 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:48:00.444 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:48:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:48:00.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:48:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:48:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:48:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:48:00.697 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:48:00.780 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:48:00.808 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:48:00.879 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:00.912 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:00.914 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:48:00.950 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:48:01.021 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:48:01.051 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:48:01.077 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:48:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:48:01.287 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:48:01.332 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:48:01.376 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:48:01.419 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:48:01.455 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:48:01.457 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:48:01.490 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:01.500 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:48:01.523 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:01.583 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:48:01.605 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:01.606 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:48:01.606 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:48:01.606 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:01.641 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:01.670 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:48:01.696 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:48:01.727 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:48:01.776 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:48:01.838 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:48:01.908 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:48:01.982 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:48:01.997 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:48:02.020 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:48:02.056 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:48:02.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:48:02.105 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:48:02.138 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:48:02.147 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:48:02.173 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:48:02.199 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:48:02.246 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:48:02.250 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:48:02.291 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:48:02.323 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:48:02.366 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:48:02.392 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:48:02.400 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:48:02.434 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:48:02.435 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:48:02.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:48:02.512 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:48:02.574 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:48:02.581 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:48:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:48:02.617 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:48:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:48:02.667 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:48:02.708 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:48:02.729 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:48:02.732 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:48:02.768 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:48:02.811 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:48:02.829 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:48:02.839 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:48:02.908 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:48:02.959 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:48:02.963 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:48:03.001 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:48:03.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:48:03.037 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:48:03.064 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:48:03.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:48:03.143 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:48:03.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:48:03.173 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:48:03.217 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:48:03.223 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:48:03.249 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:48:03.291 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:48:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:48:03.415 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:48:03.464 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:48:03.495 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:48:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:48:03.664 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:48:03.746 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:48:03.829 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:48:03.856 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:48:03.900 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:48:03.938 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:48:03.988 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:48:04.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:48:04.224 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:48:04.322 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:48:04.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:48:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:48:04.469 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:48:04.470 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:48:04.501 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:48:04.502 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:48:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:48:04.584 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:48:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:48:04.620 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:48:04.672 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:48:04.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:48:04.722 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:48:04.728 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:48:04.818 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:48:04.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:48:05.033 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:48:05.066 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:48:05.074 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:48:05.094 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:48:05.175 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:48:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:48:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:48:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:48:05.290 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:48:05.315 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:48:05.419 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:48:05.557 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:48:05.597 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:48:05.625 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:48:05.659 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:48:05.698 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:48:05.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:48:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:48:05.865 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:48:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:48:05.916 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:48:05.980 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:48:06.003 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:48:06.054 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:48:06.094 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:48:06.197 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:48:06.245 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:48:06.979 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:48:07.042 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:48:07.084 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:48:07.181 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:48:07.239 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:48:07.284 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:48:07.305 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:48:07.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:48:07.390 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:48:07.404 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:48:07.417 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:48:07.451 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:48:07.588 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:48:07.618 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:48:07.696 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:48:07.793 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:48:07.838 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:48:07.922 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:48:07.952 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:48:07.988 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:48:08.336 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:48:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:48:08.523 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:48:08.549 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:48:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:48:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:48:09.698 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:48:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:48:09.818 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:48:09.852 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:48:10.412 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:48:10.456 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:48:10.540 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:48:10.570 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:48:10.606 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:48:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:11.112 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:48:11.134 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:48:11.205 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:48:11.236 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:48:11.591 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:11.634 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:11.733 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:48:11.734 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:48:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:13.258 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-21T07:48:13.259 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:13.446 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:13.446 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:48:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:13.603 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:13.641 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:14.247 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:48:14.294 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:48:14.382 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:48:14.383 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:48:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:14.437 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:15.048 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:15.075 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:15.075 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:15.075 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:48:15.075 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:15.076 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:15.076 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:15.299 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:15.322 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:15.791 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:15.815 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:15.929 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:48:15.978 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:48:16.033 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:48:16.217 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:48:16.267 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:48:16.344 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:48:16.440 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:48:16.579 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:48:16.616 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:48:16.649 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:48:16.676 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:48:17.095 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:17.133 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:17.165 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:48:17.231 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:48:17.256 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:20.428 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:20.479 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:21.437 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:21.471 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:21.585 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:21.754 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:48:21.781 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:21.805 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:21.857 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:21.869 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:21.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:48:22.016 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:48:22.976 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:48:23.001 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:23.026 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:23.026 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:23.027 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:48:23.027 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:23.027 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:23.027 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:23.068 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:23.092 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:23.092 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:23.092 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:48:23.092 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:23.144 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:23.168 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:23.486 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:23.510 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:24.186 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-09-21T07:48:24.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:24.365 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:24.384 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:48:24.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:26.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:26.064 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-21T07:48:26.353 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:26.531 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:26.547 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:48:26.547 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:26.547 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:48:26.547 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:26.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:26.984 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:48:27.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:48:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:48:27.299 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:48:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:48:27.443 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:48:27.499 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:48:27.533 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:48:27.548 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:48:27.588 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:48:27.621 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:48:27.648 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:48:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:48:27.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:48:27.753 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:48:27.780 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:48:27.872 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:48:27.928 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:48:27.958 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:48:27.987 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:48:28.034 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:48:28.142 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:28.168 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:48:28.169 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:28.169 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:48:28.169 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:28.169 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:48:28.169 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:28.234 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:28.271 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:28.312 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:48:28.380 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:48:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:28.411 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:48:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:28.578 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:28.623 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:28.643 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:28.885 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:48:28.909 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:29.015 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:48:29.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:48:29.128 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:48:29.313 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:48:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:48:29.447 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:48:29.464 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:48:29.536 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:48:29.569 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:48:29.675 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:48:29.689 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:48:29.719 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:48:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:48:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:48:30.034 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:48:30.081 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:48:30.105 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:48:30.131 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:48:30.132 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:30.199 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:30.199 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:30.206 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:30.227 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:48:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:48:30.283 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:30.308 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:48:30.313 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:30.313 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:48:30.359 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:30.493 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:30.493 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:30.577 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:30.642 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:31.778 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:31.841 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:32.854 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:32.883 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:33.005 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:33.175 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:48:33.202 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:33.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:33.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:33.298 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:33.409 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:48:33.467 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:48:33.554 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:48:33.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:34.487 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:48:34.542 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:34.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:34.582 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:48:34.606 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:34.614 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:34.639 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:34.639 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:34.639 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:48:34.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:34.690 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:34.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:34.721 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:48:34.898 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:48:34.925 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:48:34.949 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:35.001 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:35.013 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:48:35.049 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:35.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:35.103 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:48:35.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:48:36.121 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:48:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:48:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:48:36.252 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:36.252 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:48:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:36.304 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:48:36.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:36.646 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:36.670 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:48:36.670 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:48:36.670 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:48:36.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:36.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:48:36.671 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:36.820 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:36.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:48:36.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:48:36.820 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:48:36.821 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:48:36.822 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:48:36.833 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:48:36.834 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:48:36.835 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:48:36.836 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:48:36.837 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:48:36.838 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:48:36.839 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:48:36.840 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:48:36.841 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:48:36.842 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:48:36.843 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:48:39.321 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:48:39.362 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:48:39.402 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:48:39.434 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:48:39.461 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:48:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:39.703 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.704 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.705 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:48:39.706 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.707 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:48:39.708 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:48:39.709 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:48:39.710 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:48:39.711 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.712 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.713 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:48:39.714 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-21T07:48:39.716 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:48:39.746 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:48:39.793 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:48:39.847 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:48:40.123 DEBUG:teuthology.parallel:result is None 2024-09-21T07:48:40.511 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:48:40.733 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:48:40.774 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:48:40.806 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:48:40.833 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:48:41.038 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:48:41.080 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:48:41.110 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:48:41.140 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:48:41.178 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:48:41.481 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:48:41.558 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:48:41.710 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:48:41.800 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:41.804 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:48:41.804 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:41.842 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:41.862 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:48:41.880 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:41.880 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:48:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:42.690 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:48:42.771 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:48:42.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:48:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:48:42.933 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:48:42.958 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:48:42.992 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:48:42.992 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:43.060 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:48:43.060 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:43.135 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:48:43.160 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:48:43.166 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:43.166 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:43.346 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:48:43.346 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:43.429 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:48:43.494 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:48:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:48:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:48:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:48:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:48:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:48:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:48:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:48:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:48:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:48:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:48:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:48:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:48:49.714 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:48:49.714 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:48:49.715 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:48:49.716 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:48:49.717 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:48:49.718 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:48:49.719 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:48:49.720 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:48:49.721 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:48:49.722 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:48:49.723 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:48:49.724 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.554 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.555 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.556 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:48:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:48:51.559 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:48:51.560 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:48:51.561 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:48:51.562 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.563 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:48:51.564 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:48:51.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:48:51.566 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-21T07:48:51.984 DEBUG:teuthology.parallel:result is None 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:48:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:48:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:48:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:48:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:48:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:48:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:48:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:48:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:48:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:48:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:48:52.266 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-21T07:48:52.656 DEBUG:teuthology.parallel:result is None 2024-09-21T07:48:52.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:52.800 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:48:52.827 INFO:teuthology.orchestra.run.smithi006.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:48:52.827 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:48:52.828 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:48:52.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:52.971 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:48:52.994 INFO:teuthology.orchestra.run.smithi119.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:48:52.994 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:48:52.995 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:48:52.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:53.137 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:48:53.163 INFO:teuthology.orchestra.run.smithi145.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:48:53.164 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:48:53.164 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:48:53.165 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:48:53.166 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:48:53.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:48:53.199 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:48:53.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:48:53.227 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:48:53.227 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:48:53.257 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:48:53.258 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:48:53.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:48:53.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:48:53.358 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:48:53.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:48:53.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:48:53.450 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:48:53.450 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:48:53.479 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:48:53.548 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:48:53.548 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:48:53.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:48:53.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:48:53.647 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:48:53.647 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:48:53.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:48:53.737 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:48:53.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:48:53.762 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:48:53.828 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:48:53.828 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:48:53.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:48:53.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:48:53.929 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:48:53.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:48:53.953 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:48:54.017 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:48:54.018 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:48:54.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:48:54.107 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T07:48:54.197 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T07:48:54.197 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:54.198 INFO:tasks.cephadm:Cluster fsid is f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:48:54.198 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T07:48:54.198 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.6', 'mon.b': '172.21.15.119', 'mon.c': '172.21.15.145'} 2024-09-21T07:48:54.198 INFO:tasks.cephadm:First mon is mon.a on smithi006 2024-09-21T07:48:54.198 INFO:tasks.cephadm:First mgr is x 2024-09-21T07:48:54.198 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T07:48:54.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2024-09-21T07:48:54.229 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-09-21T07:48:54.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-09-21T07:48:54.279 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T07:48:54.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:54.416 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T07:48:54.555 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:48:54.558 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:48:54.558 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:48:54.558 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:55.167 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:48 /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:55.167 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:55.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:48 /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:55.835 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:56.531 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:48 /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:56.532 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:56.552 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:56.571 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:48:56.609 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T07:48:56.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:48:56.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:48:56.614 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:48:58.170 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:48:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:48:58.216 INFO:teuthology.orchestra.run.smithi145.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:49:30.050 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout: "repo_digests": [ 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-21T07:49:30.051 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-21T07:49:42.330 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T07:49:42.331 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-21T07:49:51.670 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T07:49:51.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2024-09-21T07:49:51.730 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-09-21T07:49:51.758 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-09-21T07:49:51.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2024-09-21T07:49:51.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-09-21T07:49:51.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-09-21T07:49:51.872 INFO:tasks.cephadm:Writing seed config... 2024-09-21T07:49:51.873 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T07:49:51.873 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T07:49:51.873 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T07:49:51.874 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T07:49:51.875 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T07:49:51.875 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T07:49:51.875 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T07:49:51.875 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T07:49:51.875 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:49:51.875 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T07:49:51.894 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f3246cac-77ed-11ef-baf6-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T07:49:51.894 DEBUG:teuthology.orchestra.run.smithi006:mon.a> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service 2024-09-21T07:49:51.937 DEBUG:teuthology.orchestra.run.smithi006:mgr.x> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service 2024-09-21T07:49:51.979 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T07:49:51.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:49:52.195 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:49:52.196 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2024-09-21T07:49:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T07:49:52.196 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying podman|docker is present... 2024-09-21T07:49:52.222 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:49:52.222 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying lvm2 is present... 2024-09-21T07:49:52.222 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying time synchronization is in place... 2024-09-21T07:49:52.229 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:49:52.230 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:49:52.236 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:49:52.236 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:49:52.243 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-09-21T07:49:52.250 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-09-21T07:49:52.250 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:49:52.250 INFO:teuthology.orchestra.run.smithi006.stdout:Repeating the final host check... 2024-09-21T07:49:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:49:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T07:49:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl is present 2024-09-21T07:49:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:lvcreate is present 2024-09-21T07:49:52.780 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:49:52.781 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:49:52.789 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:49:52.789 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:49:52.798 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-09-21T07:49:52.806 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Host looks OK 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Cluster fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Acquiring lock 140480061622640 on /run/cephadm/f3246cac-77ed-11ef-baf6-efdc52797490.lock 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Lock 140480061622640 acquired on /run/cephadm/f3246cac-77ed-11ef-baf6-efdc52797490.lock 2024-09-21T07:49:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 3300 ... 2024-09-21T07:49:52.808 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 6789 ... 2024-09-21T07:49:52.808 INFO:teuthology.orchestra.run.smithi006.stdout:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-21T07:49:52.812 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.6 metric 100 2024-09-21T07:49:52.812 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2024-09-21T07:49:52.816 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T07:49:52.816 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T07:49:52.816 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-21T07:49:52.819 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T07:49:52.819 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T07:49:52.819 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:49:52.819 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T07:49:52.819 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-21T07:49:52.820 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:49:52.820 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-09-21T07:49:52.820 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-09-21T07:49:52.820 INFO:teuthology.orchestra.run.smithi006.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T07:49:52.820 INFO:teuthology.orchestra.run.smithi006.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T07:49:52.821 INFO:teuthology.orchestra.run.smithi006.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:49:55.774 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:49:55.774 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:49:55.774 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T07:49:55.774 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T07:49:55.775 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T07:49:55.775 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:49:55.775 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T07:49:58.139 INFO:teuthology.orchestra.run.smithi006.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:49:58.139 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:49:58.139 INFO:teuthology.orchestra.run.smithi006.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T07:49:59.169 INFO:teuthology.orchestra.run.smithi006.stdout:stat: stdout 167 167 2024-09-21T07:49:59.169 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial keys... 2024-09-21T07:50:00.142 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQCneu5moAnTIBAAoecpHhq56D4Qo4Wa58e6lA== 2024-09-21T07:50:01.107 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQCoeu5m5vG0HhAAT4CmPjG1vRSvK0soCNnHuQ== 2024-09-21T07:50:02.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQCpeu5mRnGlGhAA15f57+Mw17FNNzvDyjjG0A== 2024-09-21T07:50:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial monmap... 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool for a [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:50:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-09-21T07:50:05.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: set fsid to f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:05.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:50:05.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:50:05.157 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mon... 2024-09-21T07:50:06.286 INFO:teuthology.orchestra.run.smithi006.stdout:create mon.a on 2024-09-21T07:50:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T07:50:06.659 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T07:50:06.945 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target. 2024-09-21T07:50:06.945 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target. 2024-09-21T07:50:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a 2024-09-21T07:50:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service: Unit ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service not loaded. 2024-09-21T07:50:07.359 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target.wants/ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service → /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490@.service. 2024-09-21T07:50:07.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 podman[30580]: 2024-09-21 07:50:07.610420771 +0000 UTC m=+0.116093802 container create 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T07:50:07.911 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:50:07.911 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-21T07:50:07.918 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:50:07.918 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:50:07.918 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-21T07:50:07.919 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:50:07.919 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon to start... 2024-09-21T07:50:07.919 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon... 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 podman[30580]: 2024-09-21 07:50:07.813045012 +0000 UTC m=+0.318718048 container init 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 podman[30580]: 2024-09-21 07:50:07.81654892 +0000 UTC m=+0.322221951 container start 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 ceph-mon[30598]: mkfs f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 ceph-mon[30598]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 bash[30580]: 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 2024-09-21T07:50:08.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:07 smithi006 systemd[1]: Started Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:50:08.973 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout id: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout services: 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.562071s) 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T07:50:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout data: 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:mon is available 2024-09-21T07:50:08.976 INFO:teuthology.orchestra.run.smithi006.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T07:50:09.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: monmap epoch 1 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: last_changed 2024-09-21T07:50:02.349509+0000 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: min_mon_release 19 (squid) 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: election_strategy: 1 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: fsmap 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: mgrmap e1: no daemons active 2024-09-21T07:50:09.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:08 smithi006 ceph-mon[30598]: from='client.? 172.21.15.6:0/4199994279' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T07:50:10.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:09 smithi006 ceph-mon[30598]: from='client.? 172.21.15.6:0/2812206700' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:50:10.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:09 smithi006 ceph-mon[30598]: from='client.? 172.21.15.6:0/2812206700' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T07:50:10.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:10.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:50:10.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:10.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:50:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:50:10.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:50:10.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:50:10.074 INFO:teuthology.orchestra.run.smithi006.stdout:Generating new minimal ceph.conf... 2024-09-21T07:50:11.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:10 smithi006 ceph-mon[30598]: from='client.? 172.21.15.6:0/3986099455' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:11.420 INFO:teuthology.orchestra.run.smithi006.stdout:Restarting the monitor... 2024-09-21T07:50:11.704 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:11 smithi006 systemd[1]: Stopping Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:50:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a[30594]: 2024-09-21T07:50:11.701+0000 7f83944c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:50:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a[30594]: 2024-09-21T07:50:11.701+0000 7f83944c8640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T07:50:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:11 smithi006 podman[30843]: 2024-09-21 07:50:11.82557033 +0000 UTC m=+0.237061553 container died 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:50:12.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 podman[30843]: 2024-09-21 07:50:12.168806743 +0000 UTC m=+0.580297961 container cleanup 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:50:12.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 bash[30843]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a 2024-09-21T07:50:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 podman[30855]: 2024-09-21 07:50:12.453193668 +0000 UTC m=+0.626518186 container remove 9c6a4300aff7072c56d8b1eb747615826303be448767fecdd149912964c49a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:50:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:50:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 systemd[1]: Stopped Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:50:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 systemd[1]: Starting Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:50:13.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 podman[30951]: 2024-09-21 07:50:12.719386423 +0000 UTC m=+0.016624149 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:50:13.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:12 smithi006 podman[30951]: 2024-09-21 07:50:12.847334643 +0000 UTC m=+0.144572367 container create 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:50:13.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 podman[30951]: 2024-09-21 07:50:13.047924621 +0000 UTC m=+0.345162345 container init 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:50:13.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 podman[30951]: 2024-09-21 07:50:13.051162962 +0000 UTC m=+0.348400686 container start 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T07:50:13.136 INFO:teuthology.orchestra.run.smithi006.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T07:50:13.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:50:13.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: pidfile_write: ignore empty --pid-file 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: load: jerasure load: lrc 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Git sha 0 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: DB SUMMARY 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: DB Session ID: 0S9TF8R6AJFG7PN4JSKG 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T07:50:13.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 93706 ; 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.env: 0x563929c32d60 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.info_log: 0x56392e6cb360 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.statistics: (nil) 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.use_fsync: 0 2024-09-21T07:50:13.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.db_log_dir: 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.wal_dir: 2024-09-21T07:50:13.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:50:13.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.write_buffer_manager: 0x56392e6cfd60 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.unordered_write: 0 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:50:13.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.row_cache: None 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.wal_filter: None 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.wal_compression: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:50:13.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:50:13.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_open_files: -1 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Compression algorithms supported: 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kZSTD supported: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:50:13.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.merge_operator: 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_filter: None 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:50:13.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56392e6cafa0) 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_type: 0 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_index_type: 0 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_shortening: 1 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: checksum: 4 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: no_block_cache: 0 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache: 0x56392a68f610 2024-09-21T07:50:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_options: 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: capacity : 536870912 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_shard_bits : 4 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: strict_capacity_limit : 0 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_compressed: (nil) 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: persistent_cache: (nil) 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size: 4096 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size_deviation: 10 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_restart_interval: 16 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_block_restart_interval: 1 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: metadata_block_size: 4096 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: partition_filters: 0 2024-09-21T07:50:13.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: use_delta_encoding: 1 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: filter_policy: bloomfilter 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: whole_key_filtering: 1 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: verify_compression: 0 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: format_version: 5 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_index_compression: 1 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_align: 0 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: max_auto_readahead_size: 262144 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: prepopulate_block_cache: 0 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:50:13.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression: NoCompression 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.num_levels: 7 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:50:13.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:50:13.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:50:13.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:50:13.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:50:13.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.ttl: 2592000 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:50:13.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8ffaecdb-7e17-476b-a7b4-d909a7c578a2 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905013088432, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905013089586, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 89992, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 279, "table_properties": {"data_size": 88062, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11329, "raw_average_key_size": 47, "raw_value_size": 81654, "raw_average_value_size": 343, "num_data_blocks": 11, "num_entries": 238, "num_filter_entries": 238, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726905013, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8ffaecdb-7e17-476b-a7b4-d909a7c578a2", "db_session_id": "0S9TF8R6AJFG7PN4JSKG", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726905013089684, "job": 1, "event": "recovery_finished"} 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56392e6eea80 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: DB pointer 0x56392f494000 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:50:13.371 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** DB Stats ** 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: L0 2/0 89.74 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:50:13.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: Sum 2/0 89.74 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:50:13.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative compaction: 0.00 GB write, 24.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval compaction: 0.00 GB write, 24.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache BinnedLRUCache@0x56392a68f610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: starting mon.a rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???) e1 preinit fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).mds e1 new map 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).mds e1 print_map 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: e1 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: btime 2024-09-21T07:50:07:867449+0000 2024-09-21T07:50:13.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: legacy client fscid: -1 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: No filesystems configured 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 bash[30951]: 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 systemd[1]: Started Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: monmap epoch 1 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:13.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: last_changed 2024-09-21T07:50:02.349509+0000 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: min_mon_release 19 (squid) 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: election_strategy: 1 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: fsmap 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:50:13.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:13 smithi006 ceph-mon[30970]: mgrmap e1: no daemons active 2024-09-21T07:50:14.183 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T07:50:14.205 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:50:14.205 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mgr... 2024-09-21T07:50:14.205 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T07:50:14.206 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T07:50:14.475 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x 2024-09-21T07:50:14.476 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service: Unit ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service not loaded. 2024-09-21T07:50:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490.target.wants/ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-f3246cac-77ed-11ef-baf6-efdc52797490@.service. 2024-09-21T07:50:14.874 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:14 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3883923688' entity='client.admin' 2024-09-21T07:50:14.874 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:14 smithi006 systemd[1]: Starting Ceph mgr.x for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:50:15.185 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:14 smithi006 podman[31185]: 2024-09-21 07:50:14.775776416 +0000 UTC m=+0.016609392 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:50:15.185 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:14 smithi006 podman[31185]: 2024-09-21 07:50:14.900128836 +0000 UTC m=+0.140961842 container create 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:50:15.185 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:15 smithi006 podman[31185]: 2024-09-21 07:50:15.108873234 +0000 UTC m=+0.349706207 container init 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T07:50:15.185 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:15 smithi006 podman[31185]: 2024-09-21 07:50:15.111852776 +0000 UTC m=+0.352685740 container start 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:50:15.185 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:15 smithi006 bash[31185]: 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 2024-09-21T07:50:15.203 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:50:15.203 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-21T07:50:15.212 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:50:15.212 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:50:15.212 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-21T07:50:15.212 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:50:15.223 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:50:15.223 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr to start... 2024-09-21T07:50:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr... 2024-09-21T07:50:15.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:15 smithi006 systemd[1]: Started Ceph mgr.x for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:50:16.050 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:15 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/133252883' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:50:16.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:16.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:16.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T07:50:16.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:50:16.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:50:16.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:50:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:50:16.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:50:07:867449+0000", 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:50:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:50:07.868264+0000", 2024-09-21T07:50:16.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:16.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:16.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:50:16.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:16.371 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (1/15)... 2024-09-21T07:50:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3013568213' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:50:19.686 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:50:19.688 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:19.688 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:50:19.688 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:50:19.688 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:50:19.691 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:50:19.691 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:50:19.691 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:19.692 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:50:07:867449+0000", 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:50:07.868264+0000", 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:19.694 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (2/15)... 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: Activating manager daemon x 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: mgrmap e2: x(active, starting, since 0.00401761s) 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: Manager daemon x is now available 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' 2024-09-21T07:50:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:50:20.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' 2024-09-21T07:50:20.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:20 smithi006 ceph-mon[30970]: from='mgr.14100 172.21.15.6:0/667359426' entity='mgr.x' 2024-09-21T07:50:22.696 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:22 smithi006 ceph-mon[30970]: mgrmap e3: x(active, since 1.00815s) 2024-09-21T07:50:23.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:23.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:23.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T07:50:23.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:50:23.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:50:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:50:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:50:07:867449+0000", 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:50:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:50:07.868264+0000", 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:50:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:50:23.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:50:23.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:23.009 INFO:teuthology.orchestra.run.smithi006.stdout:mgr is available 2024-09-21T07:50:23.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:23 smithi006 ceph-mon[30970]: mgrmap e4: x(active, since 2s) 2024-09-21T07:50:23.651 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:23 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/816299825' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:50:24.232 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:50:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling cephadm module... 2024-09-21T07:50:24.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:24 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/285476010' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:50:25.709 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:25 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2893134032' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T07:50:25.710 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setuser ceph since I am not root 2024-09-21T07:50:25.710 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setgroup ceph since I am not root 2024-09-21T07:50:26.652 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:26 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2893134032' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T07:50:26.652 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:26 smithi006 ceph-mon[30970]: mgrmap e5: x(active, since 5s) 2024-09-21T07:50:27.226 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-09-21T07:50:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 5... 2024-09-21T07:50:27.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:27 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2648550546' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: Active manager daemon x restarted 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: Activating manager daemon x 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: mgrmap e6: x(active, starting, since 0.00360355s) 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:50:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:30 smithi006 ceph-mon[30970]: Manager daemon x is now available 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 5 is available 2024-09-21T07:50:32.258 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying orchestrator module is enabled... 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: mgrmap e7: x(active, since 1.00568s) 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: Found migration_current of "None". Setting to last migration. 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:50:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:32 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:50:33.845 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2121710117' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T07:50:33.845 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2121710117' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T07:50:33.845 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-mon[30970]: mgrmap e8: x(active, since 2s) 2024-09-21T07:50:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T07:50:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:Setting orchestrator backend to cephadm... 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:50:33.972+0000 7fd3ae77b640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:50:33] ENGINE Error in HTTPServer.serve 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Traceback (most recent call last): 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._connections.run(self.expiration_interval) 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._run(expiration_interval) 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:50:34.165 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s = self.context.wrap_socket( 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: return self.sslsocket_class._create( 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self.do_handshake() 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._sslobj.do_handshake() 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:50:34.166 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:33] ENGINE Bus STARTING 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:33] ENGINE Serving on http://172.21.15.6:8765 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:33] ENGINE Serving on https://172.21.15.6:7150 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:33] ENGINE Bus STARTED 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:33] ENGINE Error in HTTPServer.serve 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout: Traceback (most recent call last): 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:50:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._run(expiration_interval) 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: s = self.context.wrap_socket( 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: return self.sslsocket_class._create( 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: self.do_handshake() 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:50:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._sslobj.do_handshake() 2024-09-21T07:50:34.963 INFO:journalctl@ceph.mon.a.smithi006.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:50:34.963 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:34.963 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:34 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:35 smithi006 ceph-mon[30970]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:36.227 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T07:50:36.227 INFO:teuthology.orchestra.run.smithi006.stdout:Generating ssh key... 2024-09-21T07:50:36.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:36 smithi006 ceph-mon[30970]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:37.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-mon[30970]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:37.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-mon[30970]: Generating ssh key... 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Generating public/private rsa key pair. 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Your identification has been saved in /tmp/tmpj466vcqt/key 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Your public key has been saved in /tmp/tmpj466vcqt/key.pub 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: The key fingerprint is: 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: SHA256:YBfgip0XBge1AmI+2xWGp2BErmkOOABLEzVjKmTvHng ceph-f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: The key's randomart image is: 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: +---[RSA 3072]----+ 2024-09-21T07:50:37.831 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |=X+=+=+.. | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |O==o+=.. . | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |==..+.B . | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |=.*+.* + | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |*+.E+ . S | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: |+.o .. | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: | . . | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: | | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: | | 2024-09-21T07:50:37.832 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: +----[SHA256]-----+ 2024-09-21T07:50:39.348 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:50:39.349 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:50:39.349 INFO:teuthology.orchestra.run.smithi006.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T07:50:39.353 INFO:teuthology.orchestra.run.smithi006.stdout:Adding host smithi006... 2024-09-21T07:50:39.698 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:39 smithi006 ceph-mon[30970]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:40.700 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:40 smithi006 ceph-mon[30970]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:41.580 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:41 smithi006 ceph-mon[30970]: Deploying cephadm binary to smithi006 2024-09-21T07:50:44.567 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Added host 'smithi006' with addr '172.21.15.6' 2024-09-21T07:50:44.568 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mon service... 2024-09-21T07:50:45.096 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:44 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:45.097 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:44 smithi006 ceph-mon[30970]: Added host smithi006 2024-09-21T07:50:45.097 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:44 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:46.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:46 smithi006 ceph-mon[30970]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:46 smithi006 ceph-mon[30970]: Saving service mon spec with placement count:5 2024-09-21T07:50:46.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:46 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:46.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:46 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mgr service... 2024-09-21T07:50:47.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:47 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:48.641 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:48 smithi006 ceph-mon[30970]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:48.641 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:48 smithi006 ceph-mon[30970]: Saving service mgr spec with placement count:2 2024-09-21T07:50:48.641 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:48 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:48.641 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:48 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:48.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T07:50:49.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:49 smithi006 ceph-mon[30970]: from='mgr.14118 172.21.15.6:0/3127094806' entity='mgr.x' 2024-09-21T07:50:49.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:49 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2405001139' entity='client.admin' 2024-09-21T07:50:51.386 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling the dashboard module... 2024-09-21T07:50:51.811 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:51 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/771945641' entity='client.admin' 2024-09-21T07:50:51.811 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:51 smithi006 ceph-mon[30970]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:50:52.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:52 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2852388622' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T07:50:52.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setuser ceph since I am not root 2024-09-21T07:50:52.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setgroup ceph since I am not root 2024-09-21T07:50:53.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2852388622' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T07:50:53.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:53 smithi006 ceph-mon[30970]: mgrmap e9: x(active, since 21s) 2024-09-21T07:50:54.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:54.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T07:50:54.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:50:54.645 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:50:54.645 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:50:54.645 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:54.645 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-09-21T07:50:54.645 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 9... 2024-09-21T07:50:54.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1085124970' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: Active manager daemon x restarted 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: Activating manager daemon x 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: mgrmap e10: x(active, starting, since 0.0040897s) 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:50:58.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:50:58.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:57 smithi006 ceph-mon[30970]: Manager daemon x is now available 2024-09-21T07:50:59.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:58 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:59.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:58 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:50:59.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:58 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:50:59.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:58 smithi006 ceph-mon[30970]: mgrmap e11: x(active, since 1.00761s) 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 9 is available 2024-09-21T07:50:59.870 INFO:teuthology.orchestra.run.smithi006.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:50:59.668+0000 7fc7f19ad640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:50:59] ENGINE Error in HTTPServer.serve 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Traceback (most recent call last): 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._connections.run(self.expiration_interval) 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._run(expiration_interval) 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:50:59.961 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s = self.context.wrap_socket( 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: return self.sslsocket_class._create( 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self.do_handshake() 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._sslobj.do_handshake() 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:50:59.962 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:59] ENGINE Bus STARTING 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:59] ENGINE Serving on https://172.21.15.6:7150 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:50:59 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:59] ENGINE Error in HTTPServer.serve 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: Traceback (most recent call last): 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._run(expiration_interval) 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:51:00.321 INFO:journalctl@ceph.mon.a.smithi006.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: s = self.context.wrap_socket( 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: return self.sslsocket_class._create( 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: self.do_handshake() 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._sslobj.do_handshake() 2024-09-21T07:51:00.322 INFO:journalctl@ceph.mon.a.smithi006.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:51:01.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:01 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:59] ENGINE Serving on http://172.21.15.6:8765 2024-09-21T07:51:01.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:01 smithi006 ceph-mon[30970]: [21/Sep/2024:07:50:59] ENGINE Bus STARTED 2024-09-21T07:51:01.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:01 smithi006 ceph-mon[30970]: mgrmap e12: x(active, since 2s) 2024-09-21T07:51:01.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:01 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:01.254 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:01 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:02 smithi006 ceph-mon[30970]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:02.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFDzCCAvegAwIBAgIUcOpNJ6PGeXZKyjoY2o4GKrGImL8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA3NTEwMVoXDTM0\nMDkyMjA3NTEwMVowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjYwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCshOmFtTd85B4uXtmJLMCKuORlJTj2cpQSpxmO\n4kiQdU3IJvX8osgR9EvbQewemI84hU3eBRva4g+CQmu61AIrYrDQO94TTtNuIXZ9\nDCYLKeHLR34bgAnZd0KSTeWQp0beU1dkN+NZ+VQuLc3/7ler1HBGTliDstZ54vWc\n0RIzLaaODXXbTel8TMMDSNKpeMALHLDfdJglNSChfLzB2ftPu/TaN9h6rU9xLj/z\n+059Bdg6uPPc8qOXfFf57stEQOQpGoJaSTBE+FFB48uYwdJ4umo5LghbACSEZKeT\neaHCRsGcm4jNXXbbbW2bQW5x4eAdeRlF4PPqdrpxXt3JqfHesE2uMKiMcs6S1YmZ\nSWmRyDEEkaw0opVn0V59QDi+eKve2leC0BImQyuwrXY788gvx3MI19dm7XMUEdSA\nDCkK6rgvT+/VkV6dEYr/csp9RhdkZpsSZKjaVjEotQmEV3gl3AIZFhgr5vELSP+f\nWfGXjg6f5aO59e0ERzcqv2E0w7RN8wKQc39Aq+p8dFgqaJ4BuZgPlCOaP3LE7WAs\nT8RYo+HhwpmajiazwsQUlr22n7mYPN06vNfsKeMNSp+s634NXoTEMLUG6kPrewI8\nJ7RqK5pRjRztG5i5WX7T+gKEIBX5ll62rF9Q1vX5oSP1hHUyk02dMzSbKRD6PFo1\nyhl13QIDAQABo1QwUjBCBgNVHREEOzA5gh5zbWl0aGkwMDYuZnJvbnQuc2VwaWEu\nY2VwaC5jb22CEWRhc2hib2FyZF9zZXJ2ZXJzhwSsFQ8GMAwGA1UdEwEB/wQCMAAw\nDQYJKoZIhvcNAQELBQADggIBAB7bbk95+XwkEL6bYiJv+1FCcrBzjM+2gOxXQALA\nU5h4lLXGu6rGiNVTGUQQSgbONXZ9Tc7KZ2NAa6ugcGGIrLKEDAMqZWcXmxH+7GwE\n9l2G5r1U3omdqS6XjpoeN+3a3meQANmIkSP+8a5NjicZ1lyrt8D3UOxmc3DmZioc\nmK1gvxvIJJYB6CgFJMltuifiJQjhIQC42QlXkuy3+eegcLzMBZS1VNYa8waMJWN0\nb+BFYaAlL10rlhOEn3wLCafkKBVXfrPkeuDulbZYUsJ9uypzVopCyJZLV0psKEDF\nyU29z20fHfzlay6QtEwghQdZqK+yomXNG3fXXP1L+BEFAboU+TVVfAluos/B8Vpr\nD+wvEDDiEnFIft36qyTK36YgmB6K/AX6KZ2Mu53XxB7eHndH8ioytYgU/EHI88Jh\nt/bckN0oHGftUhNnxnrp+gx8gqXRbvP2MZiYNH50MZbk3j54DHe2DuJjrp4ZVVPM\n9/5Gcx1uMTW1KkqMAMqXc9T/USgPZsxIOVNOTOcGJ4BFWLMlBlvdMjyY0xUQrxqH\npm0TJIk7QkS5WfH7/Evj9qpQReZp/K26jlu/8TbL6wmtt9cm3e3qRYmqGE+suvhI\nLDHF89ltr2h1TF6cCtGqovSKVUjp/RDTz6Bz96oGGga1mzCW1NgorLvviWS77Yau\nM9TY\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEArITphbU3fOQeLl7ZiSzAirjkZSU49nKUEqcZjuJIkHVNyCb1\n/KLIEfRL20HsHpiPOIVN3gUb2uIPgkJrutQCK2Kw0DveE07TbiF2fQwmCynhy0d+\nG4AJ2XdCkk3lkKdG3lNXZDfjWflULi3N/+5Xq9RwRk5Yg7LWeeL1nNESMy2mjg11\n203pfEzDA0jSqXjACxyw33SYJTUgoXy8wdn7T7v02jfYeq1PcS4/8/tOfQXYOrjz\n3PKjl3xX+e7LREDkKRqCWkkwRPhRQePLmMHSeLpqOS4IWwAkhGSnk3mhwkbBnJuI\nzV12221tm0FuceHgHXkZReDz6na6cV7dyanx3rBNrjCojHLOktWJmUlpkcgxBJGs\nNKKVZ9FefUA4vnir3tpXgtASJkMrsK12O/PIL8dzCNfXZu1zFBHUgAwpCuq4L0/v\n1ZFenRGK/3LKfUYXZGabEmSo2lYxKLUJhFd4JdwCGRYYK+bxC0j/n1nxl44On+Wj\nufXtBEc3Kr9hNMO0TfMCkHN/QKvqfHRYKmieAbmYD5Qjmj9yxO1gLE/EWKPh4cKZ\nmo4ms8LEFJa9tp+5mDzdOrzX7CnjDUqfrOt+DV6ExDC1BupD63sCPCe0aiuaUY0c\n7RuYuVl+0/oChCAV+ZZetqxfUNb1+aEj9YR1MpNNnTM0mykQ+jxaNcoZdd0CAwEA\nAQKCAgAMn6ckyQdX5KtOslMRpgwqum+/9PLPmb+7A64rleRAacz4vd0XEOQ56Bna\n396CuKAWPy7c9Zu9rvf6jJiscZH9EbolapQL7qMq9ljgupBYFcb3ZHJWWc6esorV\nAM0xAgR+BTQqWaqRrVxbCq/9r7eLk75pbpcsf9wQzCozwNqnkwoSb+q1UuSoW0eT\nyHLdwr+usHlCyJnPcy1Bk8qOFsC8a2D1zMtS4rai7gLw++0Y2eIiHeF+Q+Tzkz4u\nxCnsgyEO3uk16RAWo+LyQtRlh506h015hKRI4GBLrb/TWz2aZSoKpxjiChpF4SJ5\nj1ahD6miDnfqdJT0jZ6D6DCrbnuLtH0Hd2x9dRH+I07svq1IHoD6YwdD9Kkc34yz\nra2bNBYpqvM3OTGkoFYWE3/9rod1t34p7V0LsB9S+579bxmNG6UfjKYZoR2SkhTq\nkc8yZboJ3iZkV5ZoiOKU35Hy5yz5UDlFfhSM0xyQaF6WEAo6zNTSCsI8l7QEY9oz\n2E1GCBVau16Wb48Fw3t+GxHdQvg8f/sSLXvhH4LjEs7Z+J2C6BxVB1xzbgPG8dSY\nrH17rwJu55oa/jZodgZYvux8KS+oOejL9pqc4g455oNdlBz8Dupe51Q29dIHqoCP\n/LyKIh3RHjujVeYt9s2EOgrI5KK9dsSldQ744sWrf2KPb6qkIQKCAQEA7BxKUQyQ\n+JiB/xwHfnDFxNRkwsJVI1dRX6zwvAOz/l5nXcirHoZWv6LH0OUlKfkEe1J7DK/P\nu6LzPJIeS7IuXmEVbgXVXEZNPxTdjOZxQMhNB5hoCzlJXzZL21T6ZKKo1eyi6Py+\nNCGvRflB1k/uTfVXXQPMqGLaox9kMpVfsFNSfVqachQg5qEolQYmjkWnaUlBp6ow\ntJjJI11UzRJdB6zsBj2N/bc83f3GrG/UpM+BfLAITclORkn8LwODHudVNuC2PxUi\nwrLc5Cn1eBhNH5ZJeY5DqBYA9O2bMxYsBTExJo7hiL2wp8zpACoDW9lFBpgG5sTh\nL/znosIuDxvCTQKCAQEAuw1HV7KR4cA8zzfIbOHaW6cZk02KaGrf4KxwSHS7zpoj\nbauUisUuPmRYv6Ee+0nAPVHUvRbup3762ouzc0XRWpntPUxl8dI1oRv1thJfaN9U\nASzdi4ynV+r+eU3pJrPUqzGwnLrBm8fwJ3xtH0FQCyLRq96bY6lHur/KC9541jv4\ngvVMFBQDDNVLTQ0vqa+wiv/DB9SIMLaPJL17X2IRFympcMvl/x1jv/3E+3VnYrZP\nwyOHkDalIEdE4BNB0APW9BkT3+yGFYRoUF1UTMRhz2BC0GveAVnNekFjM2xq975O\nxfxS72UYpQ8DJXkpd9Kq0eo83tgYDFH0zyJh/Vep0QKCAQB9gtRmnT17SObhy+6X\n4i7fYOBnP5KuhL43E+GssHNAJsLf8co1Ich/enKpswW8eClPvRq4NcVBw291pV8B\ncih/9y/DGsq+kIiDnf3f5qgRfeikvvmf7cX5HQ3Z/CRW1rjVb0NygthBMh7QHZ5H\n5JmTS3Yzdc+XO2VqDUfgM9N4EfLpu/4Z4mVS9Bx0i553RsOljlGeZTQa7JUPfY+U\nq8xURjH5Z0NRudRbVYoFJDVvnvcAZzsizn4Tk0TBYSaUiPidgXqfsgaWZSpTB5L7\nUj+9KNDKEzwX4AqGKMC1uXWRFQNBsfZmECAWMzEw6yR58Ndml+4jQklKjzA7Lun5\nEhKJAoIBAQCu+pYBkNdtAoMgKYPBb2nwERoYtRHD6i5yI32KGkFR3NlFj5uOUTSY\nQxDOeq/bzLsb4cAL/zbT0zJhXQxKykY05geLLzuygr2Ob/RkFT3RghE4ZDr/f11Q\nHlFdMqfnf5RzbTFU/FN/IgMjPP9rnJJ/SFwx1jUwfrvOE/mzLrOFXWZ1Q3ie07Wi\nvKkLdElhCCwza1yLp6KbRzwS13pg2QE51Mxf6y3FgD2+7Wrm/IXxTrDA0CzRmHzR\n/DmPEBShveXIROlVsRIhcNKQUy43/gGtl9QI2s88HkDcm+xrv4E1Ln7MMOV4cu8i\nATAlTvme0KDha6jzodylMcm8NuLJtsbxAoIBAC0UKWJw4lHmxLZR5MzGa+MAchaL\nKP/3GkkjgDwOLPL4VuGObFn67UlYI2UDMDDTzWxIMMwIiYHyK/9m2rNS6u10S2D7\nLXe5Xp1zPIVfvQfQmVjF5R7pjfkazUOBBtmK5h57fttvsuEBpi0svXs+5b0B3htJ\nHOhLmUhazHW+YPKuV9rRfHKdK0+wXK8DPVJfOnfH2bKJg7IoQWR52sUuRHTXoqai\nsflyT3zgMSEBbjoe5H8zizNme6ghE0kkD+2PrYNrBWkbyhnbL0+e7ttkQP4fUj40\nCCXEllXSGhPPQr8vRhO8ryZw8FrI1ihiQYRwWpo/vwOcy0PF13mnITL5zCQ=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T07:51:03.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T07:51:04.648 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:04 smithi006 ceph-mon[30970]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:04.648 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:04 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:05.248 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T07:51:05.248 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial admin user... 2024-09-21T07:51:05.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:05 smithi006 ceph-mon[30970]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:05.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:05 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:06.697 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OTqo4IN.q6/lODiQMrpf6.xmQUnMN03xSJN938e4.Y6A7LB/WU/WG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726905066, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:51:06.697 INFO:teuthology.orchestra.run.smithi006.stdout:Fetching dashboard port number... 2024-09-21T07:51:07.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:07 smithi006 ceph-mon[30970]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:07.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:07 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:07.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:51:07.939 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:51:07.939 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-09-21T07:51:07.947 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:51:07.947 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-09-21T07:51:07.947 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-09-21T07:51:07.947 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph Dashboard is now available at: 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout: URL: https://smithi006.front.sepia.ceph.com:8443/ 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout: User: admin 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout: Password: 1qr3qlomcb 2024-09-21T07:51:07.949 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:07.950 INFO:teuthology.orchestra.run.smithi006.stdout:Saving cluster configuration to /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config directory 2024-09-21T07:51:08.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:08 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3583153678' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T07:51:09.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.361 INFO:teuthology.orchestra.run.smithi006.stdout: ceph telemetry on 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout:For more information see: 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:09.362 INFO:teuthology.orchestra.run.smithi006.stdout:Bootstrap complete. 2024-09-21T07:51:09.404 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:51:09.405 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:09.405 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:51:09.421 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:51:09.421 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:09.422 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:51:09.477 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:51:09.477 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:09.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T07:51:09.543 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:51:09.543 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:09.543 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:51:09.599 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:51:09.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:51:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:09.688 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:51:09.801 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:09.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:51:09.868 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtWVyRbA31K3zSPvg096nHO1A/U0Ty5RgDyTjeWOwTgQWFLa6/cDlcFcaaexfNTgFVasSFuE/33RHCQjnP3cHYPrzZ11AsppjhOFzcEtbETjCdAOCFfJt2xTleP+IwRPGF1oyzpfNZ/NjZyDC2ADLTNLz0bWkd9mvSEZ7oaoqGNCz+rw9KW54RoZwqI52ehx/MO4MSmKwMf0jue+eS/O4ezXZMyue+Nr7Z+/t2FDiOmQZcjhFnldMzONzh26k1gCUAGkVnyZgDxJadI5/pX9vR+St+3t2Y16uGMVP0QSps3Ls7JYkjiQmGcA3nnX1cyH6Biy83bnltdSWzwaDR9NBi3CGXNuYnQ/+8WIjqJhU0V/YguaUeTDp7LXIMFkMOmchWyOmL5NziWm2E2kNj/nmEJIHGPgBZ76QxD/sI8KUKrcvU6d8umiTFQqyLvqmq+V3UTtmBcTUuiH/kMbMl/xdrE6S6wG3+gCh9JlkKjqIIB+ghYvAbih2LlWVdM5ghxzU= ceph-f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:09.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:51:09.902 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:09 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2876794321' entity='client.admin' 2024-09-21T07:51:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:11.899 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:51:11.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: mgrmap e13: x(active, since 12s) 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3570757389' entity='client.admin' 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"} : dispatch 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:11.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:11 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:12.408 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:14.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:14 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:14.212 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2024-09-21T07:51:14.212 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:51:14.213 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:51:14.232 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:51:14.232 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:14.290 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2024-09-21T07:51:14.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch host add smithi119 2024-09-21T07:51:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:15 smithi006 ceph-mon[30970]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:17.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:16 smithi006 ceph-mon[30970]: Deploying cephadm binary to smithi119 2024-09-21T07:51:18.981 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi119' with addr '172.21.15.119' 2024-09-21T07:51:19.306 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:19 smithi006 ceph-mon[30970]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:19.306 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:19 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:19.306 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:19 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:19.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:51:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:20.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:20 smithi006 ceph-mon[30970]: Added host smithi119 2024-09-21T07:51:20.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:20 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:20.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:20 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:20.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:20.616 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2024-09-21T07:51:21.208 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-09-21T07:51:21.208 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:51:21.208 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:51:21.227 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:51:21.227 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:21.286 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-09-21T07:51:21.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch host add smithi145 2024-09-21T07:51:21.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:21 smithi006 ceph-mon[30970]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:21.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:21 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:21.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:21 smithi006 ceph-mon[30970]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:51:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:23 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: Deploying cephadm binary to smithi145 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:25.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:24 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:25.948 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi145' with addr '172.21.15.145' 2024-09-21T07:51:26.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:25 smithi006 ceph-mon[30970]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:26.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:51:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: Added host smithi145 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:26 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:27.546 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:51:27.546 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-09-21T07:51:28.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:28 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:28.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:28 smithi006 ceph-mon[30970]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:51:28.385 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:51:28.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:51:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:29 smithi006 ceph-mon[30970]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-09-21T07:51:30.666 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1548995030' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:51:30.666 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:30.666 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:30.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:30.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:30.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"} : dispatch 2024-09-21T07:51:30.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:30.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:30 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:30.967 INFO:tasks.cephadm:Adding mon.a on smithi006 2024-09-21T07:51:30.967 INFO:tasks.cephadm:Adding mon.b on smithi119 2024-09-21T07:51:30.968 INFO:tasks.cephadm:Adding mon.c on smithi145 2024-09-21T07:51:30.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch apply mon '3;smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c' 2024-09-21T07:51:31.201 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1548995030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:31.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:31 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:31.842 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mon update... 2024-09-21T07:51:32.465 DEBUG:teuthology.orchestra.run.smithi119:mon.b> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.b.service 2024-09-21T07:51:32.470 DEBUG:teuthology.orchestra.run.smithi145:mon.c> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.c.service 2024-09-21T07:51:32.472 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:51:32.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:51:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c;count:3 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: Deploying daemon mon.c on smithi145 2024-09-21T07:51:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:32 smithi006 ceph-mon[30970]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:33.791 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:51:33.791 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":1,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","modified":"2024-09-21T07:50:02.349509Z","created":"2024-09-21T07:50:02.349509Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:51:33.792 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 1 2024-09-21T07:51:34.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:33 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/2615501199' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:34 smithi006 ceph-mon[30970]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:36.185 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:51:36.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:51:36.518 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:51:37.216 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:51:37.216 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":1,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","modified":"2024-09-21T07:50:02.349509Z","created":"2024-09-21T07:50:02.349509Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:51:37.216 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 1 2024-09-21T07:51:37.311 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T07:51:37.311 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T07:51:37.311 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T07:51:37.311 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T07:51:37.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:37 smithi006 ceph-mon[30970]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:51:37.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:51:37.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Deploying cephadm binary to smithi145 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Added host smithi145 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1548995030' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"} : dispatch 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1548995030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:51:37.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c;count:3 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:37.598 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: Deploying daemon mon.c on smithi145 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/2615501199' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 ceph-mon[34049]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 bash[33997]: a49f3f96aa2a971733022264ca11400928732cc85bcfd9a870d2d8856f047411 2024-09-21T07:51:37.599 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:37 smithi145 systemd[1]: Started Ceph mon.c for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:51:38.889 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:51:38.889 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:51:39.156 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: mon.a calling monitor election 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.647 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: mon.c calling monitor election 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: monmap epoch 2 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: last_changed 2024-09-21T07:51:37.316177+0000 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: min_mon_release 19 (squid) 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: election_strategy: 1 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:42.648 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: fsmap 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: mgrmap e13: x(active, since 44s) 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: overall HEALTH_OK 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:42.649 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:42 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: mon.a calling monitor election 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: mon.c calling monitor election 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: monmap epoch 2 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: last_changed 2024-09-21T07:51:37.316177+0000 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: min_mon_release 19 (squid) 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: election_strategy: 1 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:42.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: fsmap 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: mgrmap e13: x(active, since 44s) 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: overall HEALTH_OK 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:42.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:42 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:51:42.897 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":2,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","modified":"2024-09-21T07:51:37.316177Z","created":"2024-09-21T07:50:02.349509Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:51:42.897 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 2 2024-09-21T07:51:43.451 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:43 smithi145 ceph-mon[34049]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:43.451 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:43 smithi145 ceph-mon[34049]: Deploying daemon mon.b on smithi119 2024-09-21T07:51:43.451 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/1631317107' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:43.451 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:43 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:43.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:43 smithi006 ceph-mon[30970]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:43.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:43 smithi006 ceph-mon[30970]: Deploying daemon mon.b on smithi119 2024-09-21T07:51:43.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/1631317107' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:43.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:43 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:44.478 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:51:44.479 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:51:44.725 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:51:45.424 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:51:45.424 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":2,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","modified":"2024-09-21T07:51:37.316177Z","created":"2024-09-21T07:50:02.349509Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:51:45.424 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 2 2024-09-21T07:51:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:45 smithi145 ceph-mon[34049]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:45.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:45 smithi006 ceph-mon[30970]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:46.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:46 smithi119 systemd[1]: Started Ceph mon.b for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:51:46.984 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:51:46.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:51:47.232 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:51:51.557 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:51:51.557 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":3,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","modified":"2024-09-21T07:51:46.153748Z","created":"2024-09-21T07:50:02.349509Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:51:51.557 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 3 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: mon.a calling monitor election 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: mon.c calling monitor election 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.558 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: monmap epoch 3 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: min_mon_release 19 (squid) 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: election_strategy: 1 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: fsmap 2024-09-21T07:51:51.559 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: mgrmap e13: x(active, since 53s) 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: overall HEALTH_OK 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.560 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:51 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: mon.a calling monitor election 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: mon.c calling monitor election 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: monmap epoch 3 2024-09-21T07:51:51.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: min_mon_release 19 (squid) 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: election_strategy: 1 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: fsmap 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: mgrmap e13: x(active, since 53s) 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: overall HEALTH_OK 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:51.714 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:51 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:52.100 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:51:52.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:51:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:52.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:52 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:52.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:52 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/3464887992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:52.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:52 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:52.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:52 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:52.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:52 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:52 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:52 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/3464887992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:52 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:52 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:52 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.041 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:53.042 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-09-21T07:51:53.042 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:53.042 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: mon.a calling monitor election 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: mon.c calling monitor election 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: monmap epoch 3 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: min_mon_release 19 (squid) 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: election_strategy: 1 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: fsmap 2024-09-21T07:51:53.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: mgrmap e13: x(active, since 53s) 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: overall HEALTH_OK 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/3464887992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:53 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:53.730 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:51:53.731 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:53.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:51:53.759 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:51:53.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:53.826 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:51:53.827 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:51:53.856 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:51:53.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:53.922 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:51:53.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:51:53.949 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:51:53.949 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:51:54.014 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T07:51:54.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T07:51:54.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mon.b calling monitor election 2024-09-21T07:51:54.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: Reconfiguring daemon mon.a on smithi006 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mon.b calling monitor election 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mon.c calling monitor election 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mon.a calling monitor election 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: monmap epoch 3 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:54.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: min_mon_release 19 (squid) 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: election_strategy: 1 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: fsmap 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: mgrmap e13: x(active, since 55s) 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: overall HEALTH_OK 2024-09-21T07:51:54.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:54 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mon.b calling monitor election 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: Reconfiguring daemon mon.a on smithi006 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mon.b calling monitor election 2024-09-21T07:51:54.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mon.c calling monitor election 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mon.a calling monitor election 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: monmap epoch 3 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: min_mon_release 19 (squid) 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: election_strategy: 1 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: fsmap 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:54.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: mgrmap e13: x(active, since 55s) 2024-09-21T07:51:54.446 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: overall HEALTH_OK 2024-09-21T07:51:54.446 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:54 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mon.b calling monitor election 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: Reconfiguring daemon mon.a on smithi006 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mon.b calling monitor election 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mon.c calling monitor election 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mon.a calling monitor election 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: monmap epoch 3 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: last_changed 2024-09-21T07:51:46.153748+0000 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: created 2024-09-21T07:50:02.349509+0000 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: min_mon_release 19 (squid) 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: election_strategy: 1 2024-09-21T07:51:54.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: fsmap 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: mgrmap e13: x(active, since 55s) 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: overall HEALTH_OK 2024-09-21T07:51:54.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:54 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:51:55.282 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:51:55.153+0000 7fc8253e2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T07:51:55.282 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:55.282 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:55.282 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:55.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:51:55.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:55 smithi006 ceph-mon[30970]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:55.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:51:55.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:55 smithi119 ceph-mon[33564]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:51:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:51:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' 2024-09-21T07:51:55.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:51:55.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:51:55.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:55 smithi145 ceph-mon[34049]: from='mgr.14152 172.21.15.6:0/364338814' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:56.400 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:56 smithi119 ceph-mon[33564]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:51:56.400 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:56 smithi119 ceph-mon[33564]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:51:56.401 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:56 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:51:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:56 smithi145 ceph-mon[34049]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:51:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:56 smithi145 ceph-mon[34049]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:51:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:56 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:51:56.460 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:51:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setuser ceph since I am not root 2024-09-21T07:51:56.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:51:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ignoring --setgroup ceph since I am not root 2024-09-21T07:51:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:56 smithi006 ceph-mon[30970]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:51:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:56 smithi006 ceph-mon[30970]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:51:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:56 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:51:56.774 INFO:tasks.cephadm:Adding mgr.x on smithi006 2024-09-21T07:51:56.775 INFO:tasks.cephadm:Adding mgr.y on smithi119 2024-09-21T07:51:56.775 INFO:tasks.cephadm:Adding mgr.z on smithi145 2024-09-21T07:51:56.775 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch apply mgr '3;smithi006=x;smithi119=y;smithi145=z' 2024-09-21T07:51:57.024 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:51:57.387 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:57 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:51:57.387 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:51:57 smithi145 ceph-mon[34049]: mgrmap e14: x(active, since 58s) 2024-09-21T07:51:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:57 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:51:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:51:57 smithi119 ceph-mon[33564]: mgrmap e14: x(active, since 58s) 2024-09-21T07:51:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:57 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/250129563' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:51:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:51:57 smithi006 ceph-mon[30970]: mgrmap e14: x(active, since 58s) 2024-09-21T07:52:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: Active manager daemon x restarted 2024-09-21T07:52:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: Activating manager daemon x 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: mgrmap e15: x(active, starting, since 0.00695521s) 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:52:01.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:01 smithi119 ceph-mon[33564]: Manager daemon x is now available 2024-09-21T07:52:01.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: Active manager daemon x restarted 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: Activating manager daemon x 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: mgrmap e15: x(active, starting, since 0.00695521s) 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:52:01.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:01 smithi145 ceph-mon[34049]: Manager daemon x is now available 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: Active manager daemon x restarted 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: Activating manager daemon x 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: mgrmap e15: x(active, starting, since 0.00695521s) 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:52:01.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:52:01.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:52:01.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:01 smithi006 ceph-mon[30970]: Manager daemon x is now available 2024-09-21T07:52:02.494 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mgr update... 2024-09-21T07:52:02.739 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:02.739 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:52:02.739 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:52:02.739 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:02 smithi145 ceph-mon[34049]: mgrmap e16: x(active, since 1.00988s) 2024-09-21T07:52:02.739 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:02.796 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:02.796 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:52:02.796 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:52:02.796 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:02 smithi006 ceph-mon[30970]: mgrmap e16: x(active, since 1.00988s) 2024-09-21T07:52:02.797 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:02.815 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:02.815 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:52:02.815 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:52:02.815 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:02 smithi119 ceph-mon[33564]: mgrmap e16: x(active, since 1.00988s) 2024-09-21T07:52:02.815 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:03.056 DEBUG:teuthology.orchestra.run.smithi119:mgr.y> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.y.service 2024-09-21T07:52:03.059 DEBUG:teuthology.orchestra.run.smithi145:mgr.z> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.z.service 2024-09-21T07:52:03.061 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T07:52:03.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T07:52:03.064 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T07:52:03.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T07:52:03.107 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T07:52:03.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T07:52:03.150 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:52:03.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T07:52:03.193 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:52:03.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T07:52:03.236 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T07:52:03.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T07:52:03.281 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:52:03.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T07:52:03.330 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T07:52:03.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T07:52:03.374 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T07:52:03.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T07:52:03.435 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T07:52:03.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T07:52:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:03.487 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T07:52:03.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T07:52:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:03.539 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T07:52:03.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T07:52:03.591 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T07:52:03.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T07:52:03.637 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:52:03.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T07:52:03.691 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:52:03.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T07:52:03.748 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T07:52:03.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T07:52:03.816 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:52:03.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T07:52:03.865 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:52:03.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:52:03.911 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:52:03.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:52:03.958 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:52:03.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T07:52:04.006 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T07:52:04.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T07:52:04.051 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T07:52:04.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T07:52:04.105 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T07:52:04.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: Saving service mgr spec with placement smithi006=x;smithi119=y;smithi145=z;count:3 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:04.140 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T07:52:04.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T07:52:04.141 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:52:04.028+0000 7f6a9bd50640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:52:04] ENGINE Error in HTTPServer.serve 2024-09-21T07:52:04.141 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: Traceback (most recent call last): 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._connections.run(self.expiration_interval) 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._run(expiration_interval) 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:52:04.142 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: s = self.context.wrap_socket( 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: return self.sslsocket_class._create( 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self.do_handshake() 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:52:04.143 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: self._sslobj.do_handshake() 2024-09-21T07:52:04.144 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:52:04.144 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:52:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:52:04.211 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T07:52:04.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T07:52:04.281 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T07:52:04.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T07:52:04.326 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T07:52:04.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T07:52:04.377 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:52:04.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: Saving service mgr spec with placement smithi006=x;smithi119=y;smithi145=z;count:3 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:04.427 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:52:04.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: Saving service mgr spec with placement smithi006=x;smithi119=y;smithi145=z;count:3 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:04.475 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:52:04.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T07:52:04.524 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T07:52:04.524 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi006') 2024-09-21T07:52:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:05.307 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:05.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: [21/Sep/2024:07:52:03] ENGINE Bus STARTING 2024-09-21T07:52:05.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: [21/Sep/2024:07:52:03] ENGINE Serving on http://172.21.15.6:8765 2024-09-21T07:52:05.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: [21/Sep/2024:07:52:04] ENGINE Serving on https://172.21.15.6:7150 2024-09-21T07:52:05.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: [21/Sep/2024:07:52:04] ENGINE Bus STARTED 2024-09-21T07:52:05.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: [21/Sep/2024:07:52:04] ENGINE Error in HTTPServer.serve 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: Traceback (most recent call last): 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._run(expiration_interval) 2024-09-21T07:52:05.360 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: s = self.context.wrap_socket( 2024-09-21T07:52:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:52:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: return self.sslsocket_class._create( 2024-09-21T07:52:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:52:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: self.do_handshake() 2024-09-21T07:52:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:52:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout: self._sslobj.do_handshake() 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: mgrmap e17: x(active, since 2s) 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:05.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:05 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: [21/Sep/2024:07:52:03] ENGINE Bus STARTING 2024-09-21T07:52:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: [21/Sep/2024:07:52:03] ENGINE Serving on http://172.21.15.6:8765 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: [21/Sep/2024:07:52:04] ENGINE Serving on https://172.21.15.6:7150 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: [21/Sep/2024:07:52:04] ENGINE Bus STARTED 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: [21/Sep/2024:07:52:04] ENGINE Error in HTTPServer.serve 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: Traceback (most recent call last): 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._run(expiration_interval) 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:52:05.409 INFO:journalctl@ceph.mon.b.smithi119.stdout: s = self.context.wrap_socket( 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: return self.sslsocket_class._create( 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: self.do_handshake() 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._sslobj.do_handshake() 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: mgrmap e17: x(active, since 2s) 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:05.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:05 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: [21/Sep/2024:07:52:03] ENGINE Bus STARTING 2024-09-21T07:52:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: [21/Sep/2024:07:52:03] ENGINE Serving on http://172.21.15.6:8765 2024-09-21T07:52:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: [21/Sep/2024:07:52:04] ENGINE Serving on https://172.21.15.6:7150 2024-09-21T07:52:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: [21/Sep/2024:07:52:04] ENGINE Bus STARTED 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: [21/Sep/2024:07:52:04] ENGINE Error in HTTPServer.serve 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: Traceback (most recent call last): 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._run(expiration_interval) 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: s = self.context.wrap_socket( 2024-09-21T07:52:05.444 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: return self.sslsocket_class._create( 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: self.do_handshake() 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._sslobj.do_handshake() 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: mgrmap e17: x(active, since 2s) 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:05.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:05 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:06.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.242+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e003fb70 msgr2=0x7f89e0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.242+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e003fb70 0x7f89e0042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009b60 tx=0x7f89ec005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.242+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89f8103750 msgr2=0x7f89f8199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.242+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89f8103750 0x7f89f8199c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009880 tx=0x7f89e802f410 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 shutdown_connections 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e003fb70 0x7f89e0042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89f81047e0 0x7f89f819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f8105180 0x7f89f819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 --2- 172.21.15.6:0/99452818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89f8103750 0x7f89f8199c90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 >> 172.21.15.6:0/99452818 conn(0x7f89f80ff0c0 msgr2=0x7f89f8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 shutdown_connections 2024-09-21T07:52:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.243+0000 7f89fd7bd640 1 -- 172.21.15.6:0/99452818 wait complete. 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3870669958' entity='client.admin' 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:52:06.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: Deploying daemon mgr.z on smithi145 2024-09-21T07:52:06.574 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:06 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/99452818' entity='client.admin' 2024-09-21T07:52:06.638 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3870669958' entity='client.admin' 2024-09-21T07:52:06.638 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.638 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.638 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: Deploying daemon mgr.z on smithi145 2024-09-21T07:52:06.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:06 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/99452818' entity='client.admin' 2024-09-21T07:52:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3870669958' entity='client.admin' 2024-09-21T07:52:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi006:/etc/ceph/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:52:06.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Updating smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:06.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: Deploying daemon mgr.z on smithi145 2024-09-21T07:52:06.661 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:06 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/99452818' entity='client.admin' 2024-09-21T07:52:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 -- 172.21.15.6:0/3910719173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb81083a0 msgr2=0x7efeb81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 --2- 172.21.15.6:0/3910719173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb81083a0 0x7efeb81087b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efea8009900 tx=0x7efea802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 -- 172.21.15.6:0/3910719173 shutdown_connections 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 --2- 172.21.15.6:0/3910719173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8108cf0 0x7efeb810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 --2- 172.21.15.6:0/3910719173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb81083a0 0x7efeb81087b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 --2- 172.21.15.6:0/3910719173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb8102a60 0x7efeb8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 -- 172.21.15.6:0/3910719173 >> 172.21.15.6:0/3910719173 conn(0x7efeb8079730 msgr2=0x7efeb8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 -- 172.21.15.6:0/3910719173 shutdown_connections 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.939+0000 7efebf3de640 1 -- 172.21.15.6:0/3910719173 wait complete. 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 Processor -- start 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 -- start start 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 0x7efeb819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 0x7efeb819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81125d0 con 0x7efeb8108cf0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8112450 con 0x7efeb8102a60 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.940+0000 7efebf3de640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8112750 con 0x7efeb81083a0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd17a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 0x7efeb819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45740/0 (socket says 172.21.15.6:45740) 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 -- 172.21.15.6:0/1420979246 learned_addr learned my addr 172.21.15.6:0/1420979246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebc979640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 0x7efeb819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 -- 172.21.15.6:0/1420979246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 msgr2=0x7efeb819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 0x7efeb819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 -- 172.21.15.6:0/1420979246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 msgr2=0x7efeb819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 0x7efeb819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 -- 172.21.15.6:0/1420979246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81a0180 con 0x7efeb8108cf0 2024-09-21T07:52:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebc979640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 0x7efeb819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd17a640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 0x7efeb819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebd97b640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efeb000efd0 tx=0x7efeb000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0003b70 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7efeb0003d10 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0010730 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81a0470 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.941+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a6bd0 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.942+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb8102e70 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.942+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7efeb00108d0 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.943+0000 7efeae7fc640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 0x7efea4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.943+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efeb0054a80 con 0x7efeb8108cf0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.943+0000 7efebd17a640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 0x7efea4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.943+0000 7efebd17a640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 0x7efea4042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009fc0 tx=0x7efeb4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:06.948+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efeb0018dd0 con 0x7efeb8108cf0 2024-09-21T07:52:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.138+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7efeb810baf0 con 0x7efeb8108cf0 2024-09-21T07:52:07.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.142+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7efeb001ede0 con 0x7efeb8108cf0 2024-09-21T07:52:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.143+0000 7efeae7fc640 1 -- 172.21.15.6:0/1420979246 <== mon.0 v2:172.21.15.6:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7efeb0009820 con 0x7efeb8108cf0 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.144+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 msgr2=0x7efea4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.144+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 0x7efea4042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009fc0 tx=0x7efeb4005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.144+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 msgr2=0x7efeb819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.144+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efeb000efd0 tx=0x7efeb000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 shutdown_connections 2024-09-21T07:52:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efea403fb70 0x7efea4042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb81083a0 0x7efeb819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8108cf0 0x7efeb819fa50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 --2- 172.21.15.6:0/1420979246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb8102a60 0x7efeb819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 >> 172.21.15.6:0/1420979246 conn(0x7efeb8079730 msgr2=0x7efeb806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 shutdown_connections 2024-09-21T07:52:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.145+0000 7efebf3de640 1 -- 172.21.15.6:0/1420979246 wait complete. 2024-09-21T07:52:07.943 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:07 smithi145 systemd[1]: Starting Ceph mgr.z for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 -- 172.21.15.6:0/1715069459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04108d00 msgr2=0x7f6d0410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 --2- 172.21.15.6:0/1715069459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04108d00 0x7f6d0410f530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009ca0 tx=0x7f6cfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 -- 172.21.15.6:0/1715069459 shutdown_connections 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 --2- 172.21.15.6:0/1715069459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04108d00 0x7f6d0410f530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 --2- 172.21.15.6:0/1715069459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 0x7f6d041087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 --2- 172.21.15.6:0/1715069459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04102ac0 0x7f6d04102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 -- 172.21.15.6:0/1715069459 >> 172.21.15.6:0/1715069459 conn(0x7f6d04079790 msgr2=0x7f6d04079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 -- 172.21.15.6:0/1715069459 shutdown_connections 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.159+0000 7f6d0b278640 1 -- 172.21.15.6:0/1715069459 wait complete. 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 Processor -- start 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 -- start start 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 0x7f6d0419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04108d00 0x7f6d0419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6d04113870 con 0x7f6d04102ac0 2024-09-21T07:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041136f0 con 0x7f6d041083b0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d0b278640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041139f0 con 0x7f6d04108d00 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.160+0000 7f6d09014640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45754/0 (socket says 172.21.15.6:45754) 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 -- 172.21.15.6:0/3480908650 learned_addr learned my addr 172.21.15.6:0/3480908650 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d08813640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 0x7f6d0419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09815640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04108d00 0x7f6d0419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 -- 172.21.15.6:0/3480908650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04108d00 msgr2=0x7f6d0419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04108d00 0x7f6d0419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 -- 172.21.15.6:0/3480908650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 msgr2=0x7f6d0419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 0x7f6d0419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 -- 172.21.15.6:0/3480908650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d041a0210 con 0x7f6d04102ac0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d09014640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e9f0 tx=0x7f6d0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000cd80 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6d00005490 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00010430 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.161+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d041a0500 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.162+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041a6c60 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.163+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d04102ed0 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.163+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f6d000105d0 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.163+0000 7f6cfa7fc640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 0x7f6cf0042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.163+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6d000549d0 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.163+0000 7f6d08813640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 0x7f6cf0042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.164+0000 7f6d08813640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 0x7f6cf0042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40095f0 tx=0x7f6cf4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.169+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d00016330 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.362+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f6d0410aaf0 con 0x7f6d04102ac0 2024-09-21T07:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.367+0000 7f6cfa7fc640 1 -- 172.21.15.6:0/3480908650 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f6d00019d50 con 0x7f6d04102ac0 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 msgr2=0x7f6cf0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 0x7f6cf0042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40095f0 tx=0x7f6cf4005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 msgr2=0x7f6d0419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e9f0 tx=0x7f6d0000edf0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 shutdown_connections 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cf003fb70 0x7f6cf0042080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d04108d00 0x7f6d0419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d041083b0 0x7f6d0419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 --2- 172.21.15.6:0/3480908650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d04102ac0 0x7f6d0419a2a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.369+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 >> 172.21.15.6:0/3480908650 conn(0x7f6d04079790 msgr2=0x7f6d041064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.370+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 shutdown_connections 2024-09-21T07:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:07.370+0000 7f6d0b278640 1 -- 172.21.15.6:0/3480908650 wait complete. 2024-09-21T07:52:08.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:08 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1420979246' entity='client.admin' 2024-09-21T07:52:08.239 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:08 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3480908650' entity='client.admin' 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:08 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1420979246' entity='client.admin' 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:08 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3480908650' entity='client.admin' 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:07 smithi145 podman[35911]: 2024-09-21 07:52:07.968039965 +0000 UTC m=+0.099237541 container create 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:07 smithi145 podman[35911]: 2024-09-21 07:52:07.884480573 +0000 UTC m=+0.015678118 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:08 smithi145 podman[35911]: 2024-09-21 07:52:08.162063411 +0000 UTC m=+0.293260950 container init 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:08 smithi145 podman[35911]: 2024-09-21 07:52:08.164810496 +0000 UTC m=+0.296008026 container start 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:08 smithi145 ceph-mgr[35930]: -- 172.21.15.145:0/3363506755 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558dbb7f0e0 con 0x5558dbb9da80 2024-09-21T07:52:08.280 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:08 smithi145 bash[35911]: 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 2024-09-21T07:52:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:08 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1420979246' entity='client.admin' 2024-09-21T07:52:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:08 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3480908650' entity='client.admin' 2024-09-21T07:52:08.694 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 07:52:08 smithi145 systemd[1]: Started Ceph mgr.z for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:52:09.023 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.024 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.031 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:09.471 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:09.471 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi006') 2024-09-21T07:52:09.471 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-21T07:52:09.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:09.573 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:09.573 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:09.573 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:09.573 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:09 smithi006 ceph-mon[30970]: Deploying daemon mgr.y on smithi119 2024-09-21T07:52:09.606 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.606 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.606 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.607 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:09.607 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:09.607 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:09.607 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:09.607 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:09 smithi145 ceph-mon[34049]: Deploying daemon mgr.y on smithi119 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:52:09.638 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:09.639 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:09.639 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:09 smithi119 ceph-mon[33564]: Deploying daemon mgr.y on smithi119 2024-09-21T07:52:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:10.223 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:10.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 -- 172.21.15.6:0/3283272358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 msgr2=0x7f3da8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 --2- 172.21.15.6:0/3283272358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da8102e80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009900 tx=0x7f3d9802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 -- 172.21.15.6:0/3283272358 shutdown_connections 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 --2- 172.21.15.6:0/3283272358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da8108d00 0x7f3da810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 --2- 172.21.15.6:0/3283272358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da81083b0 0x7f3da81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 --2- 172.21.15.6:0/3283272358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da8102e80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 -- 172.21.15.6:0/3283272358 >> 172.21.15.6:0/3283272358 conn(0x7f3da8079710 msgr2=0x7f3da8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 -- 172.21.15.6:0/3283272358 shutdown_connections 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.659+0000 7f3dae701640 1 -- 172.21.15.6:0/3283272358 wait complete. 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.660+0000 7f3dae701640 1 Processor -- start 2024-09-21T07:52:10.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.660+0000 7f3dae701640 1 -- start start 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.660+0000 7f3dae701640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.660+0000 7f3dae701640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da81083b0 0x7f3da819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dae701640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8108d00 0x7f3da819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dae701640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8112750 con 0x7f3da8102a70 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dae701640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81125d0 con 0x7f3da8108d00 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dae701640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81128d0 con 0x7f3da81083b0 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45784/0 (socket says 172.21.15.6:45784) 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 -- 172.21.15.6:0/879235289 learned_addr learned my addr 172.21.15.6:0/879235289 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dacc9e640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8108d00 0x7f3da819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da77fe640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da81083b0 0x7f3da819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 -- 172.21.15.6:0/879235289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da81083b0 msgr2=0x7f3da819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:10.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da81083b0 0x7f3da819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 -- 172.21.15.6:0/879235289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8108d00 msgr2=0x7f3da819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8108d00 0x7f3da819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 -- 172.21.15.6:0/879235289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da81a63e0 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da7fff640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d98003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9803f070 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da81a6670 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3d9803bae0 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.661+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98035030 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.662+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a6ba0 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da8103cf0 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f3d98042070 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3da57fa640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 0x7f3d90042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3d98074de0 con 0x7f3da8102a70 2024-09-21T07:52:10.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3da77fe640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 0x7f3d90042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:10.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.663+0000 7f3da77fe640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 0x7f3d90042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3da81049f0 tx=0x7f3d9c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:10.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.672+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d98042360 con 0x7f3da8102a70 2024-09-21T07:52:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.866+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f3da810aa80 con 0x7f3da8102a70 2024-09-21T07:52:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.870+0000 7f3da57fa640 1 -- 172.21.15.6:0/879235289 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f3d9803bd00 con 0x7f3da8102a70 2024-09-21T07:52:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 msgr2=0x7f3d90042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 0x7f3d90042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3da81049f0 tx=0x7f3d9c005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 msgr2=0x7f3da819b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d98003c10 comp rx=0 tx=0).stop 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 shutdown_connections 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d9003fb70 0x7f3d90042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3da81083b0 0x7f3da819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8108d00 0x7f3da819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 --2- 172.21.15.6:0/879235289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da8102a70 0x7f3da819b120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 >> 172.21.15.6:0/879235289 conn(0x7f3da8079710 msgr2=0x7f3da81065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 shutdown_connections 2024-09-21T07:52:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.873+0000 7f3dae701640 1 -- 172.21.15.6:0/879235289 wait complete. 2024-09-21T07:52:10.908 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 07:52:10 smithi119 systemd[1]: Started Ceph mgr.y for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:52:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.445+0000 7fede8510640 1 -- 172.21.15.6:0/1756885604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 msgr2=0x7fede0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.445+0000 7fede8510640 1 --2- 172.21.15.6:0/1756885604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede0102e70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feddc009900 tx=0x7feddc02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 -- 172.21.15.6:0/1756885604 shutdown_connections 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 --2- 172.21.15.6:0/1756885604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 --2- 172.21.15.6:0/1756885604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 --2- 172.21.15.6:0/1756885604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede0102e70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 -- 172.21.15.6:0/1756885604 >> 172.21.15.6:0/1756885604 conn(0x7fede0079730 msgr2=0x7fede0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 -- 172.21.15.6:0/1756885604 shutdown_connections 2024-09-21T07:52:11.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 -- 172.21.15.6:0/1756885604 wait complete. 2024-09-21T07:52:11.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 Processor -- start 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.446+0000 7fede8510640 1 -- start start 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fede01126f0 con 0x7fede0102a60 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fede0112570 con 0x7fede01083a0 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede8510640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fede0112870 con 0x7fede0108cf0 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede5aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56426/0 (socket says 172.21.15.6:56426) 2024-09-21T07:52:11.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 -- 172.21.15.6:0/2208588434 learned_addr learned my addr 172.21.15.6:0/2208588434 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede5aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43046/0 (socket says 172.21.15.6:43046) 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede62ac640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 -- 172.21.15.6:0/2208588434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 msgr2=0x7fede0199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 -- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 msgr2=0x7fede01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede01991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 -- 172.21.15.6:0/2208588434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede019f130 con 0x7fede0108cf0 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede5aab640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede62ac640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.447+0000 7fede6aad640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fd0 tx=0x7fedd800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.448+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8017070 con 0x7fede0108cf0 2024-09-21T07:52:11.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.448+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fedd8003de0 con 0x7fede0108cf0 2024-09-21T07:52:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.448+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede019f420 con 0x7fede0108cf0 2024-09-21T07:52:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.448+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8010460 con 0x7fede0108cf0 2024-09-21T07:52:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.448+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede006ae60 con 0x7fede0108cf0 2024-09-21T07:52:11.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.449+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0102e70 con 0x7fede0108cf0 2024-09-21T07:52:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.449+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fedd8010600 con 0x7fede0108cf0 2024-09-21T07:52:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.449+0000 7fedd77fe640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 0x7fedcc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.449+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fedd8054830 con 0x7fede0108cf0 2024-09-21T07:52:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.449+0000 7fede62ac640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 0x7fedcc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.450+0000 7fede62ac640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 0x7fedcc042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feddc005ab0 tx=0x7feddc005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.455+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedd800fc70 con 0x7fede0108cf0 2024-09-21T07:52:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.645+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fede006b940 con 0x7fede0108cf0 2024-09-21T07:52:11.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.652+0000 7fedd77fe640 1 -- 172.21.15.6:0/2208588434 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7fedd801b400 con 0x7fede0108cf0 2024-09-21T07:52:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 msgr2=0x7fedcc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 0x7fedcc042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feddc005ab0 tx=0x7feddc005a20 comp rx=0 tx=0).stop 2024-09-21T07:52:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 msgr2=0x7fede019ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009fd0 tx=0x7fedd800b260 comp rx=0 tx=0).stop 2024-09-21T07:52:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 shutdown_connections 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fedcc03fb70 0x7fedcc042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fede0108cf0 0x7fede019ea00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fede01083a0 0x7fede0199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 --2- 172.21.15.6:0/2208588434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fede0102a60 0x7fede01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 >> 172.21.15.6:0/2208588434 conn(0x7fede0079730 msgr2=0x7fede0101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 shutdown_connections 2024-09-21T07:52:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:11.655+0000 7fede8510640 1 -- 172.21.15.6:0/2208588434 wait complete. 2024-09-21T07:52:11.904 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1406884249' entity='client.admin' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/879235289' entity='client.admin' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1406884249' entity='client.admin' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/879235289' entity='client.admin' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1406884249' entity='client.admin' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/879235289' entity='client.admin' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 -- 172.21.15.6:0/1749659144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370103b60 msgr2=0x7f8370103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 --2- 172.21.15.6:0/1749659144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370103b60 0x7f8370103f70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8360009900 tx=0x7f836002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 -- 172.21.15.6:0/1749659144 shutdown_connections 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 --2- 172.21.15.6:0/1749659144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370109df0 0x7f8370110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 --2- 172.21.15.6:0/1749659144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83701094a0 0x7f83701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 --2- 172.21.15.6:0/1749659144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370103b60 0x7f8370103f70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 -- 172.21.15.6:0/1749659144 >> 172.21.15.6:0/1749659144 conn(0x7f837007b850 msgr2=0x7f837007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 -- 172.21.15.6:0/1749659144 shutdown_connections 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.531+0000 7f83758c2640 1 -- 172.21.15.6:0/1749659144 wait complete. 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 Processor -- start 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 -- start start 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370103b60 0x7f837019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8370109df0 0x7f837019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8370113840 con 0x7f83701094a0 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83701136c0 con 0x7f8370109df0 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f83758c2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83701139c0 con 0x7f8370103b60 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f8367fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f8367fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45766/0 (socket says 172.21.15.6:45766) 2024-09-21T07:52:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.532+0000 7f8367fff640 1 -- 172.21.15.6:0/1406884249 learned_addr learned my addr 172.21.15.6:0/1406884249 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f836effd640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370103b60 0x7f837019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f836f7fe640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8370109df0 0x7f837019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 -- 172.21.15.6:0/1406884249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370103b60 msgr2=0x7f837019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370103b60 0x7f837019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 -- 172.21.15.6:0/1406884249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8370109df0 msgr2=0x7f837019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8370109df0 0x7f837019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 -- 172.21.15.6:0/1406884249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83701a0280 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f8367fff640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f835800d950 tx=0x7f835800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358017070 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8358004490 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83701a0570 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358005540 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.533+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83701a6cd0 con 0x7f83701094a0 2024-09-21T07:52:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.534+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370103f70 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.534+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f83580047a0 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.535+0000 7f83748c0640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 0x7f835c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.535+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8358054290 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.535+0000 7f836effd640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 0x7f835c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.535+0000 7f836effd640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 0x7f835c042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8360009230 tx=0x7f83600058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.540+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8358020020 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.741+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f837010bb70 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.745+0000 7f83748c0640 1 -- 172.21.15.6:0/1406884249 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v15)=0 v15) ==== 127+0+0 (secure 0 0 0) 0x7f8358023d40 con 0x7f83701094a0 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 msgr2=0x7f835c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 0x7f835c042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8360009230 tx=0x7f83600058d0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 msgr2=0x7f837019a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f835800d950 tx=0x7f835800de10 comp rx=0 tx=0).stop 2024-09-21T07:52:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 shutdown_connections 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f835c03fb70 0x7f835c042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8370109df0 0x7f837019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83701094a0 0x7f837019a8b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 --2- 172.21.15.6:0/1406884249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8370103b60 0x7f837019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 >> 172.21.15.6:0/1406884249 conn(0x7f837007b850 msgr2=0x7f83701076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 shutdown_connections 2024-09-21T07:52:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:10.747+0000 7f83758c2640 1 -- 172.21.15.6:0/1406884249 wait complete. 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 -- 172.21.15.6:0/2887073126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac104a30 msgr2=0x7f96ac104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 --2- 172.21.15.6:0/2887073126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac104a30 0x7f96ac104e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f969c009900 tx=0x7f969c02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 -- 172.21.15.6:0/2887073126 shutdown_connections 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 --2- 172.21.15.6:0/2887073126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac10de60 0x7f96ac110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 --2- 172.21.15.6:0/2887073126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac105380 0x7f96ac10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 --2- 172.21.15.6:0/2887073126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac104a30 0x7f96ac104e40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 -- 172.21.15.6:0/2887073126 >> 172.21.15.6:0/2887073126 conn(0x7f96ac079760 msgr2=0x7f96ac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 -- 172.21.15.6:0/2887073126 shutdown_connections 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.661+0000 7f96b1cee640 1 -- 172.21.15.6:0/2887073126 wait complete. 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.662+0000 7f96b1cee640 1 Processor -- start 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.662+0000 7f96b1cee640 1 -- start start 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 0x7f96ac19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac10de60 0x7f96ac19fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac113880 con 0x7f96ac105380 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac113700 con 0x7f96ac10de60 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96b1cee640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac113a00 con 0x7f96ac104a30 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 0x7f96ac19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56436/0 (socket says 172.21.15.6:56436) 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 -- 172.21.15.6:0/1961853128 learned_addr learned my addr 172.21.15.6:0/1961853128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96abfff640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac10de60 0x7f96ac19fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 -- 172.21.15.6:0/1961853128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac10de60 msgr2=0x7f96ac19fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac10de60 0x7f96ac19fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 -- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 msgr2=0x7f96ac19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 0x7f96ac19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96ab7fe640 1 -- 172.21.15.6:0/1961853128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac1a02c0 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.663+0000 7f96aaffd640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 0x7f96ac19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96ab7fe640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f969c005ab0 tx=0x7f969c003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c03f070 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f969c03bce0 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac1a0550 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c035030 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.664+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac1a6d10 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.665+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f969c042070 con 0x7f96ac104a30 2024-09-21T07:52:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.665+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac06c1f0 con 0x7f96ac104a30 2024-09-21T07:52:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.665+0000 7f96a8ff9640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 0x7f9698042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.665+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f969c074df0 con 0x7f96ac104a30 2024-09-21T07:52:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.665+0000 7f96aaffd640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 0x7f9698042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.666+0000 7f96aaffd640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 0x7f9698042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96ac102400 tx=0x7f969400b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.670+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f969c079070 con 0x7f96ac104a30 2024-09-21T07:52:12.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: Reconfiguring daemon mgr.x on smithi006 2024-09-21T07:52:12.857 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.867+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f96ac108f70 con 0x7f96ac104a30 2024-09-21T07:52:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.872+0000 7f96a8ff9640 1 -- 172.21.15.6:0/1961853128 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f969c045d70 con 0x7f96ac104a30 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 msgr2=0x7f9698042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 0x7f9698042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96ac102400 tx=0x7f969400b410 comp rx=0 tx=0).stop 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 msgr2=0x7f96ac19a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f969c005ab0 tx=0x7f969c003c80 comp rx=0 tx=0).stop 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 shutdown_connections 2024-09-21T07:52:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f969803fb70 0x7f9698042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96ac10de60 0x7f96ac19fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96ac105380 0x7f96ac19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 --2- 172.21.15.6:0/1961853128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96ac104a30 0x7f96ac19a350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.875+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 >> 172.21.15.6:0/1961853128 conn(0x7f96ac079760 msgr2=0x7f96ac100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.876+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 shutdown_connections 2024-09-21T07:52:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:12.876+0000 7f96b1cee640 1 -- 172.21.15.6:0/1961853128 wait complete. 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:52:12.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:12.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:12.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: Reconfiguring daemon mgr.x on smithi006 2024-09-21T07:52:12.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:52:12.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:52:12.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:52:12.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:12.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: Reconfiguring daemon mgr.x on smithi006 2024-09-21T07:52:12.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:14.080 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:14.080 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: Standby manager daemon z started 2024-09-21T07:52:14.081 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:52:14.081 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:14.081 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:52:14.081 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:14.081 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/267140719' entity='client.admin' 2024-09-21T07:52:14.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:14.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: Standby manager daemon z started 2024-09-21T07:52:14.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:52:14.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:14.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:52:14.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:14.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/267140719' entity='client.admin' 2024-09-21T07:52:14.195 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:14.195 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: Standby manager daemon z started 2024-09-21T07:52:14.195 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:52:14.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:14.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:52:14.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.145:0/708062690' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:14.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/267140719' entity='client.admin' 2024-09-21T07:52:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 -- 172.21.15.6:0/2840198520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61141083a0 msgr2=0x7f61141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 --2- 172.21.15.6:0/2840198520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61141083a0 0x7f61141087b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6100009900 tx=0x7f610002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 -- 172.21.15.6:0/2840198520 shutdown_connections 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 --2- 172.21.15.6:0/2840198520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114108cf0 0x7f611410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 --2- 172.21.15.6:0/2840198520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61141083a0 0x7f61141087b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 --2- 172.21.15.6:0/2840198520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6114102a60 0x7f6114102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 -- 172.21.15.6:0/2840198520 >> 172.21.15.6:0/2840198520 conn(0x7f6114079730 msgr2=0x7f6114079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 -- 172.21.15.6:0/2840198520 shutdown_connections 2024-09-21T07:52:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.544+0000 7f611adbb640 1 -- 172.21.15.6:0/2840198520 wait complete. 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.545+0000 7f611adbb640 1 Processor -- start 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 -- start start 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114102a60 0x7f6114199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 0x7f6114199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6114112740 con 0x7f6114108cf0 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f61141125c0 con 0x7f61141083a0 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f611adbb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f61141128c0 con 0x7f6114102a60 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6113fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 0x7f6114199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45846/0 (socket says 172.21.15.6:45846) 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6118b57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114102a60 0x7f6114199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6113fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 0x7f6114199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43114/0 (socket says 172.21.15.6:43114) 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 -- 172.21.15.6:0/153464994 learned_addr learned my addr 172.21.15.6:0/153464994 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 -- 172.21.15.6:0/153464994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114102a60 msgr2=0x7f6114199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114102a60 0x7f6114199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 -- 172.21.15.6:0/153464994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 msgr2=0x7f6114199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 0x7f6114199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.546+0000 7f6119358640 1 -- 172.21.15.6:0/153464994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611419f100 con 0x7f6114108cf0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f6119358640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f610c00eb10 tx=0x7f610c00d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c00dcf0 con 0x7f6114108cf0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f610c00de90 con 0x7f6114108cf0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c005a30 con 0x7f6114108cf0 2024-09-21T07:52:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611419f3f0 con 0x7f6114108cf0 2024-09-21T07:52:14.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.547+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611406ae60 con 0x7f6114108cf0 2024-09-21T07:52:14.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.548+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6114102e70 con 0x7f6114108cf0 2024-09-21T07:52:14.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.549+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 103193+0+0 (secure 0 0 0) 0x7f610c004a40 con 0x7f6114108cf0 2024-09-21T07:52:14.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.549+0000 7f6111ffb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 0x7f610407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.550+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f610c09c9a0 con 0x7f6114108cf0 2024-09-21T07:52:14.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.550+0000 7f6118b57640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 0x7f610407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.550+0000 7f6118b57640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 0x7f610407d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6108010d80 tx=0x7f6108012040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:14.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.554+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f610c069310 con 0x7f6114108cf0 2024-09-21T07:52:14.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.746+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f611406b880 con 0x7f6114108cf0 2024-09-21T07:52:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.750+0000 7f6111ffb640 1 -- 172.21.15.6:0/153464994 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v20)=0 v20) ==== 111+0+0 (secure 0 0 0) 0x7f610c06e1c0 con 0x7f6114108cf0 2024-09-21T07:52:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 msgr2=0x7f610407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 0x7f610407d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6108010d80 tx=0x7f6108012040 comp rx=0 tx=0).stop 2024-09-21T07:52:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 msgr2=0x7f611419e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f610c00eb10 tx=0x7f610c00d2e0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 shutdown_connections 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f610407b020 0x7f610407d530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6114108cf0 0x7f611419e9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141083a0 0x7f6114199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 --2- 172.21.15.6:0/153464994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6114102a60 0x7f6114199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.752+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 >> 172.21.15.6:0/153464994 conn(0x7f6114079730 msgr2=0x7f61141052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.753+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 shutdown_connections 2024-09-21T07:52:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.753+0000 7f611adbb640 1 -- 172.21.15.6:0/153464994 wait complete. 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 -- 172.21.15.6:0/4287257694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6641094c0 msgr2=0x7fc6641098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 --2- 172.21.15.6:0/4287257694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6641094c0 0x7fc6641098d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc660009900 tx=0x7fc66002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 -- 172.21.15.6:0/4287257694 shutdown_connections 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 --2- 172.21.15.6:0/4287257694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 0x7fc664110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 --2- 172.21.15.6:0/4287257694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6641094c0 0x7fc6641098d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 --2- 172.21.15.6:0/4287257694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc664103b80 0x7fc664103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 -- 172.21.15.6:0/4287257694 >> 172.21.15.6:0/4287257694 conn(0x7fc6640ff610 msgr2=0x7fc664101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 -- 172.21.15.6:0/4287257694 shutdown_connections 2024-09-21T07:52:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.920+0000 7fc66b755640 1 -- 172.21.15.6:0/4287257694 wait complete. 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 Processor -- start 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 -- start start 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6641094c0 0x7fc66419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 0x7fc66419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc6641138b0 con 0x7fc664103b80 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc664113730 con 0x7fc664109e10 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc66b755640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc664113a30 con 0x7fc6641094c0 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45856/0 (socket says 172.21.15.6:45856) 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 -- 172.21.15.6:0/254090310 learned_addr learned my addr 172.21.15.6:0/254090310 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc669cf2640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 0x7fc66419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc668cf0640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6641094c0 0x7fc66419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 -- 172.21.15.6:0/254090310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6641094c0 msgr2=0x7fc66419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6641094c0 0x7fc66419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 -- 172.21.15.6:0/254090310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 msgr2=0x7fc66419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.921+0000 7fc6694f1640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 0x7fc66419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc6694f1640 1 -- 172.21.15.6:0/254090310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6641a0270 con 0x7fc664103b80 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc6694f1640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc65800d770 tx=0x7fc65800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658017070 con 0x7fc664103b80 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6641a0560 con 0x7fc664103b80 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc658005490 con 0x7fc664103b80 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658004b00 con 0x7fc664103b80 2024-09-21T07:52:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.922+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a6cc0 con 0x7fc664103b80 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.923+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664104e00 con 0x7fc664103b80 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.924+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 103193+0+0 (secure 0 0 0) 0x7fc658004ca0 con 0x7fc664103b80 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.924+0000 7fc6567fc640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 0x7fc65007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.924+0000 7fc668cf0640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 0x7fc65007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.924+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc65809c8f0 con 0x7fc664103b80 2024-09-21T07:52:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.925+0000 7fc668cf0640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 0x7fc65007d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6600057c0 tx=0x7fc660005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:14.929+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc658069280 con 0x7fc664103b80 2024-09-21T07:52:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 -- 172.21.15.6:0/787860050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 msgr2=0x7f5e7010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/787860050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7010f520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009ca0 tx=0x7f5e6802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 -- 172.21.15.6:0/787860050 shutdown_connections 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/787860050 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e701083a0 0x7f5e701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/787860050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7010f520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/787860050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e70102a60 0x7f5e70102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 -- 172.21.15.6:0/787860050 >> 172.21.15.6:0/787860050 conn(0x7f5e70079730 msgr2=0x7f5e70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 -- 172.21.15.6:0/787860050 shutdown_connections 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.069+0000 7f5e77cbe640 1 -- 172.21.15.6:0/787860050 wait complete. 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 Processor -- start 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 -- start start 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70102a60 0x7f5e7019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e701083a0 0x7f5e7019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e70112740 con 0x7f5e70108cf0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701125c0 con 0x7f5e701083a0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e77cbe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701128c0 con 0x7f5e70102a60 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e7625b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e7625b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45836/0 (socket says 172.21.15.6:45836) 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e75a5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70102a60 0x7f5e7019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.070+0000 7f5e7625b640 1 -- 172.21.15.6:0/267140719 learned_addr learned my addr 172.21.15.6:0/267140719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e75259640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e701083a0 0x7f5e7019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 -- 172.21.15.6:0/267140719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70102a60 msgr2=0x7f5e7019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70102a60 0x7f5e7019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 -- 172.21.15.6:0/267140719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e701083a0 msgr2=0x7f5e7019b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e701083a0 0x7f5e7019b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 -- 172.21.15.6:0/267140719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e701a6380 con 0x7f5e70108cf0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e7625b640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009430 tx=0x7f5e68003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68032e40 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5e680044b0 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68030ad0 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e701a6610 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.071+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e701a6b50 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.072+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e70102e70 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.072+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f5e68030cd0 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.073+0000 7f5e66ffd640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 0x7f5e5c0420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.073+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5e680759e0 con 0x7f5e70108cf0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.073+0000 7f5e75a5a640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 0x7f5e5c0420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.073+0000 7f5e75a5a640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 0x7f5e5c0420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006b9c0 tx=0x7f5e6c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.078+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e6803ccf0 con 0x7f5e70108cf0 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.272+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5e7010aae0 con 0x7f5e70108cf0 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.276+0000 7f5e66ffd640 1 -- 172.21.15.6:0/267140719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f5e6804e440 con 0x7f5e70108cf0 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 msgr2=0x7f5e5c0420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 0x7f5e5c0420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006b9c0 tx=0x7f5e6c00b390 comp rx=0 tx=0).stop 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 msgr2=0x7f5e7019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009430 tx=0x7f5e68003f80 comp rx=0 tx=0).stop 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 shutdown_connections 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5e5c03fba0 0x7f5e5c0420b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e70108cf0 0x7f5e7019bb70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e701083a0 0x7f5e7019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 --2- 172.21.15.6:0/267140719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e70102a60 0x7f5e7019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 >> 172.21.15.6:0/267140719 conn(0x7f5e70079730 msgr2=0x7f5e70104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 shutdown_connections 2024-09-21T07:52:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:13.278+0000 7f5e77cbe640 1 -- 172.21.15.6:0/267140719 wait complete. 2024-09-21T07:52:15.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:14 smithi006 ceph-mon[30970]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T07:52:15.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:52:15.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:14 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/153464994' entity='client.admin' 2024-09-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.118+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fc66410bc00 con 0x7fc664103b80 2024-09-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.124+0000 7fc6567fc640 1 -- 172.21.15.6:0/254090310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7fc65806e130 con 0x7fc664103b80 2024-09-21T07:52:15.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 msgr2=0x7fc65007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 0x7fc65007d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6600057c0 tx=0x7fc660005a20 comp rx=0 tx=0).stop 2024-09-21T07:52:15.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 msgr2=0x7fc66419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc65800d770 tx=0x7fc65800dc30 comp rx=0 tx=0).stop 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 shutdown_connections 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc65007b020 0x7fc65007d530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6641094c0 0x7fc66419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc664109e10 0x7fc66419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 --2- 172.21.15.6:0/254090310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc664103b80 0x7fc66419a300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 >> 172.21.15.6:0/254090310 conn(0x7fc6640ff610 msgr2=0x7fc664101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 shutdown_connections 2024-09-21T07:52:15.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.127+0000 7fc66b755640 1 -- 172.21.15.6:0/254090310 wait complete. 2024-09-21T07:52:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:14 smithi119 ceph-mon[33564]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T07:52:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:52:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:14 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/153464994' entity='client.admin' 2024-09-21T07:52:15.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:14 smithi145 ceph-mon[34049]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T07:52:15.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:52:15.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:14 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/153464994' entity='client.admin' 2024-09-21T07:52:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/504817105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 msgr2=0x7fe4a4104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/504817105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a4104df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009900 tx=0x7fe49c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/504817105 shutdown_connections 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/504817105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 0x7fe4a410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/504817105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 0x7fe4a4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/504817105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a4104df0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/504817105 >> 172.21.15.6:0/504817105 conn(0x7fe4a4079730 msgr2=0x7fe4a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/504817105 shutdown_connections 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.953+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/504817105 wait complete. 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 Processor -- start 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 -- start start 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 0x7fe4a419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 0x7fe4a419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a4113950 con 0x7fe4a41049e0 2024-09-21T07:52:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a41137d0 con 0x7fe4a410de40 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4ac3e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a4113ad0 con 0x7fe4a4105330 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4aa180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4aa180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45908/0 (socket says 172.21.15.6:45908) 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.954+0000 7fe4aa180640 1 -- 172.21.15.6:0/3783604795 learned_addr learned my addr 172.21.15.6:0/3783604795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4a997f640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 0x7fe4a419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa981640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 0x7fe4a419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 -- 172.21.15.6:0/3783604795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 msgr2=0x7fe4a419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 0x7fe4a419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 -- 172.21.15.6:0/3783604795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 msgr2=0x7fe4a419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 0x7fe4a419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 -- 172.21.15.6:0/3783604795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a41a02d0 con 0x7fe4a41049e0 2024-09-21T07:52:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4aa180640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009230 tx=0x7fe49c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c03f030 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a41a0560 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe49c003a80 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c035070 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.955+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a41a0a90 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.956+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a406c240 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.957+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 103193+0+0 (secure 0 0 0) 0x7fe49c042030 con 0x7fe4a41049e0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.958+0000 7fe4a37fe640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 0x7fe48c07d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.958+0000 7fe4a997f640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 0x7fe48c07d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.958+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe49c0bd5e0 con 0x7fe4a41049e0 2024-09-21T07:52:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.958+0000 7fe4a997f640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 0x7fe48c07d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe498005e10 tx=0x7fe498005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.964+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4a41a0a90 con 0x7fe4a41049e0 2024-09-21T07:52:16.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.136+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fe49c081700 con 0x7fe4a41049e0 2024-09-21T07:52:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.158+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe4a4108f40 con 0x7fe4a41049e0 2024-09-21T07:52:16.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.164+0000 7fe4a37fe640 1 -- 172.21.15.6:0/3783604795 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fe49c085b90 con 0x7fe4a41049e0 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 msgr2=0x7fe48c07d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 0x7fe48c07d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe498005e10 tx=0x7fe498005da0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 msgr2=0x7fe4a419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009230 tx=0x7fe49c004270 comp rx=0 tx=0).stop 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 shutdown_connections 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe48c07b050 0x7fe48c07d560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4a4105330 0x7fe4a419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a410de40 0x7fe4a419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 --2- 172.21.15.6:0/3783604795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a41049e0 0x7fe4a419a420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 >> 172.21.15.6:0/3783604795 conn(0x7fe4a4079730 msgr2=0x7fe4a4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 shutdown_connections 2024-09-21T07:52:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.166+0000 7fe4ac3e4640 1 -- 172.21.15.6:0/3783604795 wait complete. 2024-09-21T07:52:16.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/254090310' entity='client.admin' 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: Standby manager daemon y started 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:16.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:16 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:16.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/254090310' entity='client.admin' 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: Standby manager daemon y started 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:16.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:16 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:16.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/254090310' entity='client.admin' 2024-09-21T07:52:16.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: Standby manager daemon y started 2024-09-21T07:52:16.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:52:16.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:52:16.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:52:16.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='mgr.? 172.21.15.119:0/1138206055' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:52:16.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:16 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 -- 172.21.15.6:0/2959566973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb0410de10 msgr2=0x7fdb04110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/2959566973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb0410de10 0x7fdb04110300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009ca0 tx=0x7fdafc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 -- 172.21.15.6:0/2959566973 shutdown_connections 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/2959566973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb0410de10 0x7fdb04110300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/2959566973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04105300 0x7fdb0410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/2959566973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb041049b0 0x7fdb04104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 -- 172.21.15.6:0/2959566973 >> 172.21.15.6:0/2959566973 conn(0x7fdb04079730 msgr2=0x7fdb04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 -- 172.21.15.6:0/2959566973 shutdown_connections 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.632+0000 7fdb0aeff640 1 -- 172.21.15.6:0/2959566973 wait complete. 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 Processor -- start 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 -- start start 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb041049b0 0x7fdb0419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 0x7fdb0419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04113970 con 0x7fdb04105300 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041137f0 con 0x7fdb041049b0 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0aeff640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04113af0 con 0x7fdb0410de10 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49736/0 (socket says 172.21.15.6:49736) 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb03fff640 1 -- 172.21.15.6:0/3463826053 learned_addr learned my addr 172.21.15.6:0/3463826053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb08c9b640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb041049b0 0x7fdb0419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.633+0000 7fdb0949c640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 0x7fdb0419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 -- 172.21.15.6:0/3463826053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 msgr2=0x7fdb0419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 0x7fdb0419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 -- 172.21.15.6:0/3463826053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb041049b0 msgr2=0x7fdb0419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb041049b0 0x7fdb0419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 -- 172.21.15.6:0/3463826053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb041a02d0 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb0949c640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 0x7fdb0419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb03fff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000e9f0 tx=0x7fdaf000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf000ccc0 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdaf00108c0 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0018750 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb041a05c0 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.634+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb041a6de0 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.635+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0406b560 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.637+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fdaf0010430 con 0x7fdb04105300 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.638+0000 7fdb01ffb640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 0x7fdaf40b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.638+0000 7fdb08c9b640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 0x7fdaf40b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.638+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdaf00e5fa0 con 0x7fdb04105300 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.638+0000 7fdb08c9b640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 0x7fdaf40b8a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb0406bc60 tx=0x7fdaf8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.641+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdaf00ae390 con 0x7fdb04105300 2024-09-21T07:52:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.830+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fdb041a6fb0 con 0x7fdb04105300 2024-09-21T07:52:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.830+0000 7fdb01ffb640 1 -- 172.21.15.6:0/3463826053 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v23)=0 v23) ==== 108+0+0 (secure 0 0 0) 0x7fdaf00b2770 con 0x7fdb04105300 2024-09-21T07:52:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 msgr2=0x7fdaf40b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 0x7fdaf40b8a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb0406bc60 tx=0x7fdaf8005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 msgr2=0x7fdb0419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000e9f0 tx=0x7fdaf000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 shutdown_connections 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdaf40b6580 0x7fdaf40b8a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb0410de10 0x7fdb0419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb04105300 0x7fdb0419a9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 --2- 172.21.15.6:0/3463826053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb041049b0 0x7fdb0419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.832+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 >> 172.21.15.6:0/3463826053 conn(0x7fdb04079730 msgr2=0x7fdb040ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.833+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 shutdown_connections 2024-09-21T07:52:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:16.833+0000 7fdb0aeff640 1 -- 172.21.15.6:0/3463826053 wait complete. 2024-09-21T07:52:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:17 smithi119 ceph-mon[33564]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T07:52:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:52:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:17 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3783604795' entity='client.admin' 2024-09-21T07:52:17.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:17 smithi006 ceph-mon[30970]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T07:52:17.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:52:17.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:17 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3783604795' entity='client.admin' 2024-09-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:17 smithi145 ceph-mon[34049]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T07:52:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:52:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:17 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3783604795' entity='client.admin' 2024-09-21T07:52:17.530 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 -- 172.21.15.6:0/1476276741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4102a60 msgr2=0x7f7cf4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 --2- 172.21.15.6:0/1476276741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4102a60 0x7f7cf4102e70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009900 tx=0x7f7cdc02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 -- 172.21.15.6:0/1476276741 shutdown_connections 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 --2- 172.21.15.6:0/1476276741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 0x7f7cf410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 --2- 172.21.15.6:0/1476276741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf41083a0 0x7f7cf41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 --2- 172.21.15.6:0/1476276741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf4102a60 0x7f7cf4102e70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 -- 172.21.15.6:0/1476276741 >> 172.21.15.6:0/1476276741 conn(0x7f7cf4079730 msgr2=0x7f7cf4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 -- 172.21.15.6:0/1476276741 shutdown_connections 2024-09-21T07:52:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.950+0000 7f7cfab68640 1 -- 172.21.15.6:0/1476276741 wait complete. 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.951+0000 7f7cfab68640 1 Processor -- start 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.951+0000 7f7cfab68640 1 -- start start 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.951+0000 7f7cfab68640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 0x7f7cf41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.951+0000 7f7cfab68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.951+0000 7f7cfab68640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 0x7f7cf419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cfab68640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4112810 con 0x7f7cf41083a0 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cfab68640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4112690 con 0x7f7cf4102a60 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cfab68640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4112990 con 0x7f7cf4108cf0 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49752/0 (socket says 172.21.15.6:49752) 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 -- 172.21.15.6:0/2096556939 learned_addr learned my addr 172.21.15.6:0/2096556939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf9105640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 0x7f7cf419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf8904640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 0x7f7cf41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 -- 172.21.15.6:0/2096556939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 msgr2=0x7f7cf419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 0x7f7cf419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 -- 172.21.15.6:0/2096556939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 msgr2=0x7f7cf41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 0x7f7cf41992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 -- 172.21.15.6:0/2096556939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf419f170 con 0x7f7cf41083a0 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf8904640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 0x7f7cf41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf3fff640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400ccb0 tx=0x7f7ce400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400ce60 con 0x7f7cf41083a0 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf419f460 con 0x7f7cf41083a0 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ce400fae0 con 0x7f7cf41083a0 2024-09-21T07:52:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.952+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4018aa0 con 0x7f7cf41083a0 2024-09-21T07:52:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.953+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf406ae60 con 0x7f7cf41083a0 2024-09-21T07:52:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.954+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf4103ce0 con 0x7f7cf41083a0 2024-09-21T07:52:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.955+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f7ce4018c40 con 0x7f7cf41083a0 2024-09-21T07:52:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.956+0000 7f7cf1ffb640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 0x7f7ce00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.956+0000 7f7cf8904640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 0x7f7ce00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:17.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.956+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7ce40e5d30 con 0x7f7cf41083a0 2024-09-21T07:52:17.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.957+0000 7f7cf8904640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 0x7f7ce00b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006010 tx=0x7f7cdc000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:17.960+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ce40ec080 con 0x7f7cf41083a0 2024-09-21T07:52:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 -- 172.21.15.6:0/1223858585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac102a70 msgr2=0x7fe1ac102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/1223858585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac102a70 0x7fe1ac102e80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009900 tx=0x7fe1a802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 -- 172.21.15.6:0/1223858585 shutdown_connections 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/1223858585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac108d00 0x7fe1ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/1223858585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac1083b0 0x7fe1ac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/1223858585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac102a70 0x7fe1ac102e80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 -- 172.21.15.6:0/1223858585 >> 172.21.15.6:0/1223858585 conn(0x7fe1ac079730 msgr2=0x7fe1ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 -- 172.21.15.6:0/1223858585 shutdown_connections 2024-09-21T07:52:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.127+0000 7fe1b3b52640 1 -- 172.21.15.6:0/1223858585 wait complete. 2024-09-21T07:52:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 Processor -- start 2024-09-21T07:52:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 -- start start 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac102a70 0x7fe1ac19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac1083b0 0x7fe1ac19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac113970 con 0x7fe1ac108d00 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1137f0 con 0x7fe1ac102a70 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b3b52640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac113af0 con 0x7fe1ac1083b0 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49770/0 (socket says 172.21.15.6:49770) 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 -- 172.21.15.6:0/4142220688 learned_addr learned my addr 172.21.15.6:0/4142220688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b10ed640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac1083b0 0x7fe1ac19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b18ee640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac102a70 0x7fe1ac19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 -- 172.21.15.6:0/4142220688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac1083b0 msgr2=0x7fe1ac19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac1083b0 0x7fe1ac19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 -- 172.21.15.6:0/4142220688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac102a70 msgr2=0x7fe1ac19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac102a70 0x7fe1ac19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.128+0000 7fe1b20ef640 1 -- 172.21.15.6:0/4142220688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac1a02b0 con 0x7fe1ac108d00 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1b20ef640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400eaa0 tx=0x7fe1a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400cdb0 con 0x7fe1ac108d00 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1a4005020 con 0x7fe1ac108d00 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac1a05a0 con 0x7fe1ac108d00 2024-09-21T07:52:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac1a6d00 con 0x7fe1ac108d00 2024-09-21T07:52:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.129+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40116d0 con 0x7fe1ac108d00 2024-09-21T07:52:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.130+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac103cf0 con 0x7fe1ac108d00 2024-09-21T07:52:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.132+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fe1a40051d0 con 0x7fe1ac108d00 2024-09-21T07:52:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.133+0000 7fe1a2ffd640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 0x7fe1980b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.133+0000 7fe1b18ee640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 0x7fe1980b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.133+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe1a40e5bf0 con 0x7fe1ac108d00 2024-09-21T07:52:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.133+0000 7fe1b18ee640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 0x7fe1980b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.140+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a4016030 con 0x7fe1ac108d00 2024-09-21T07:52:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.158+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7cf406b8e0 con 0x7f7cf41083a0 2024-09-21T07:52:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.164+0000 7f7cf1ffb640 1 -- 172.21.15.6:0/2096556939 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f7ce4014030 con 0x7f7cf41083a0 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.168+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 msgr2=0x7f7ce00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.168+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 0x7f7ce00b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006010 tx=0x7f7cdc000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.168+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 msgr2=0x7f7cf4199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.168+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400ccb0 tx=0x7f7ce400a620 comp rx=0 tx=0).stop 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 shutdown_connections 2024-09-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ce00b6580 0x7f7ce00b8a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cf4108cf0 0x7f7cf419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf41083a0 0x7f7cf4199860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 --2- 172.21.15.6:0/2096556939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cf4102a60 0x7f7cf41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 >> 172.21.15.6:0/2096556939 conn(0x7f7cf4079730 msgr2=0x7f7cf4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 shutdown_connections 2024-09-21T07:52:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.169+0000 7f7cfab68640 1 -- 172.21.15.6:0/2096556939 wait complete. 2024-09-21T07:52:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.340+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fe1ac102e80 con 0x7fe1ac108d00 2024-09-21T07:52:18.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.346+0000 7fe1a2ffd640 1 -- 172.21.15.6:0/4142220688 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v25)=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fe1ac102e80 con 0x7fe1ac108d00 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 msgr2=0x7fe1980b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 0x7fe1980b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 msgr2=0x7fe1ac19fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400eaa0 tx=0x7fe1a400ef60 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 shutdown_connections 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1980b64d0 0x7fe1980b89e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ac1083b0 0x7fe1ac19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ac108d00 0x7fe1ac19fb80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 --2- 172.21.15.6:0/4142220688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1ac102a70 0x7fe1ac19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 >> 172.21.15.6:0/4142220688 conn(0x7fe1ac079730 msgr2=0x7fe1ac1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 shutdown_connections 2024-09-21T07:52:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:18.348+0000 7fe1b3b52640 1 -- 172.21.15.6:0/4142220688 wait complete. 2024-09-21T07:52:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2096556939' entity='client.admin' 2024-09-21T07:52:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4142220688' entity='client.admin' 2024-09-21T07:52:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2096556939' entity='client.admin' 2024-09-21T07:52:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4142220688' entity='client.admin' 2024-09-21T07:52:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2096556939' entity='client.admin' 2024-09-21T07:52:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4142220688' entity='client.admin' 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.632+0000 7f3d24989640 1 -- 172.21.15.6:0/2602774180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2010dec0 msgr2=0x7f3d201103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.632+0000 7f3d24989640 1 --2- 172.21.15.6:0/2602774180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2010dec0 0x7f3d201103b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009900 tx=0x7f3d1802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 -- 172.21.15.6:0/2602774180 shutdown_connections 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 --2- 172.21.15.6:0/2602774180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d201053b0 0x7f3d2010d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 --2- 172.21.15.6:0/2602774180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2010dec0 0x7f3d201103b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 --2- 172.21.15.6:0/2602774180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d20104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 -- 172.21.15.6:0/2602774180 >> 172.21.15.6:0/2602774180 conn(0x7f3d200796d0 msgr2=0x7f3d20079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 -- 172.21.15.6:0/2602774180 shutdown_connections 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.633+0000 7f3d24989640 1 -- 172.21.15.6:0/2602774180 wait complete. 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 Processor -- start 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 -- start start 2024-09-21T07:52:19.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d2019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 0x7f3d2019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d2010dec0 0x7f3d2019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201138b0 con 0x7f3d201053b0 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20113730 con 0x7f3d20104a60 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d24989640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20113a30 con 0x7f3d2010dec0 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 0x7f3d2019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d1e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d2019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 0x7f3d2019a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45880/0 (socket says 172.21.15.6:45880) 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d1dd9b640 1 -- 172.21.15.6:0/1171953931 learned_addr learned my addr 172.21.15.6:0/1171953931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.634+0000 7f3d1ed9d640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d2010dec0 0x7f3d2019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 -- 172.21.15.6:0/1171953931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d2010dec0 msgr2=0x7f3d2019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d2010dec0 0x7f3d2019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 -- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 msgr2=0x7f3d2019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 0x7f3d2019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 -- 172.21.15.6:0/1171953931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d201a0250 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d1e59c640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d2019a2e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000ec80 tx=0x7f3d1000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10003b70 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3d10003d10 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d201a0540 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10010800 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.635+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a6ca0 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.636+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d20104e70 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.637+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) ==== 103193+0+0 (secure 0 0 0) 0x7f3d100109a0 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.637+0000 7f3d0f7fe640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 0x7f3d0807d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.637+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3d1009d530 con 0x7f3d20104a60 2024-09-21T07:52:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.637+0000 7f3d1dd9b640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 0x7f3d0807d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.638+0000 7f3d1dd9b640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 0x7f3d0807d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d2010f880 tx=0x7f3d1400b440 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.642+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d10065b60 con 0x7f3d20104a60 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.831+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3d20108fc0 con 0x7f3d20104a60 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.837+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 7 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d10064f70 con 0x7f3d20104a60 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.837+0000 7f3d0f7fe640 1 -- 172.21.15.6:0/1171953931 <== mon.2 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7f3d10069f40 con 0x7f3d20104a60 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 msgr2=0x7f3d0807d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 0x7f3d0807d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d2010f880 tx=0x7f3d1400b440 comp rx=0 tx=0).stop 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 msgr2=0x7f3d2019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d2019a2e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000ec80 tx=0x7f3d1000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 shutdown_connections 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d0807b020 0x7f3d0807d530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d2010dec0 0x7f3d2019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d201053b0 0x7f3d2019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 --2- 172.21.15.6:0/1171953931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d20104a60 0x7f3d2019a2e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 >> 172.21.15.6:0/1171953931 conn(0x7f3d200796d0 msgr2=0x7f3d201008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 shutdown_connections 2024-09-21T07:52:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:15.839+0000 7f3d24989640 1 -- 172.21.15.6:0/1171953931 wait complete. 2024-09-21T07:52:20.396 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-21T07:52:20.396 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 -- 172.21.15.6:0/2291245596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e50108cf0 msgr2=0x7f6e5010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 --2- 172.21.15.6:0/2291245596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e50108cf0 0x7f6e5010f520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009900 tx=0x7f6e4802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 -- 172.21.15.6:0/2291245596 shutdown_connections 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 --2- 172.21.15.6:0/2291245596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e50108cf0 0x7f6e5010f520 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 --2- 172.21.15.6:0/2291245596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e501083a0 0x7f6e501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 --2- 172.21.15.6:0/2291245596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50102a60 0x7f6e50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 -- 172.21.15.6:0/2291245596 >> 172.21.15.6:0/2291245596 conn(0x7f6e50079730 msgr2=0x7f6e50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 -- 172.21.15.6:0/2291245596 shutdown_connections 2024-09-21T07:52:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.540+0000 7f6e55345640 1 -- 172.21.15.6:0/2291245596 wait complete. 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 Processor -- start 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 -- start start 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e50102a60 0x7f6e5019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50108cf0 0x7f6e5019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50113930 con 0x7f6e501083a0 2024-09-21T07:52:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e501137b0 con 0x7f6e50102a60 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e55345640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50113ab0 con 0x7f6e50108cf0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.541+0000 7f6e4e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49788/0 (socket says 172.21.15.6:49788) 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 -- 172.21.15.6:0/3230446092 learned_addr learned my addr 172.21.15.6:0/3230446092 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4effd640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e50102a60 0x7f6e5019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4f7fe640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50108cf0 0x7f6e5019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 -- 172.21.15.6:0/3230446092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50108cf0 msgr2=0x7f6e5019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50108cf0 0x7f6e5019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 -- 172.21.15.6:0/3230446092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e50102a60 msgr2=0x7f6e5019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e50102a60 0x7f6e5019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 -- 172.21.15.6:0/3230446092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e501a01d0 con 0x7f6e501083a0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e4e7fc640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c970 tx=0x7f6e3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38014070 con 0x7f6e501083a0 2024-09-21T07:52:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e38004440 con 0x7f6e501083a0 2024-09-21T07:52:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e501a04c0 con 0x7f6e501083a0 2024-09-21T07:52:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e501a6ce0 con 0x7f6e501083a0 2024-09-21T07:52:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.542+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38003d40 con 0x7f6e501083a0 2024-09-21T07:52:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.543+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e50102e70 con 0x7f6e501083a0 2024-09-21T07:52:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.545+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f6e38017070 con 0x7f6e501083a0 2024-09-21T07:52:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.546+0000 7f6e47fff640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 0x7f6e3c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.546+0000 7f6e4effd640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 0x7f6e3c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.546+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6e380e59f0 con 0x7f6e501083a0 2024-09-21T07:52:20.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.547+0000 7f6e4effd640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 0x7f6e3c0b8a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e40007ec0 tx=0x7f6e400075b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:20.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.549+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e3801e020 con 0x7f6e501083a0 2024-09-21T07:52:20.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.742+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6e5019b450 con 0x7f6e501083a0 2024-09-21T07:52:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.746+0000 7f6e47fff640 1 -- 172.21.15.6:0/3230446092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f6e380adde0 con 0x7f6e501083a0 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 msgr2=0x7f6e3c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 0x7f6e3c0b8a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e40007ec0 tx=0x7f6e400075b0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 msgr2=0x7f6e5019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c970 tx=0x7f6e3800ce30 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 shutdown_connections 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6e3c0b6500 0x7f6e3c0b8a10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e50108cf0 0x7f6e5019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e501083a0 0x7f6e5019a8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 --2- 172.21.15.6:0/3230446092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e50102a60 0x7f6e5019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.749+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 >> 172.21.15.6:0/3230446092 conn(0x7f6e50079730 msgr2=0x7f6e50104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.750+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 shutdown_connections 2024-09-21T07:52:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:20.750+0000 7f6e55345640 1 -- 172.21.15.6:0/3230446092 wait complete. 2024-09-21T07:52:21.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 -- 172.21.15.6:0/2753040692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 msgr2=0x7fe7981066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/2753040692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe7981066c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe780009900 tx=0x7fe78002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 -- 172.21.15.6:0/2753040692 shutdown_connections 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/2753040692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 0x7fe798110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/2753040692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe7981066c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/2753040692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 0x7fe798102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 -- 172.21.15.6:0/2753040692 >> 172.21.15.6:0/2753040692 conn(0x7fe798077cc0 msgr2=0x7fe798078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 -- 172.21.15.6:0/2753040692 shutdown_connections 2024-09-21T07:52:21.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.161+0000 7fe79d5c2640 1 -- 172.21.15.6:0/2753040692 wait complete. 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 Processor -- start 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 -- start start 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 0x7fe79819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 0x7fe79819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981139d0 con 0x7fe7981062b0 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe798113850 con 0x7fe798102060 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.162+0000 7fe79d5c2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe798113b50 con 0x7fe798106c00 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49798/0 (socket says 172.21.15.6:49798) 2024-09-21T07:52:21.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 -- 172.21.15.6:0/3877195784 learned_addr learned my addr 172.21.15.6:0/3877195784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7977fe640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 0x7fe79819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe796ffd640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 0x7fe79819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 -- 172.21.15.6:0/3877195784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 msgr2=0x7fe79819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 0x7fe79819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 -- 172.21.15.6:0/3877195784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 msgr2=0x7fe79819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 0x7fe79819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 -- 172.21.15.6:0/3877195784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7981a0310 con 0x7fe7981062b0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe7967fc640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe78002a930 tx=0x7fe780003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78003f070 con 0x7fe7981062b0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe780003e10 con 0x7fe7981062b0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7981a05a0 con 0x7fe7981062b0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780035030 con 0x7fe7981062b0 2024-09-21T07:52:21.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.163+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7981a6d60 con 0x7fe7981062b0 2024-09-21T07:52:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.165+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79806b8b0 con 0x7fe7981062b0 2024-09-21T07:52:21.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.166+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fe780042070 con 0x7fe7981062b0 2024-09-21T07:52:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.167+0000 7fe78ffff640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 0x7fe7840b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.167+0000 7fe796ffd640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 0x7fe7840b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:21.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.167+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe780105e90 con 0x7fe7981062b0 2024-09-21T07:52:21.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.167+0000 7fe796ffd640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 0x7fe7840b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe79806bb50 tx=0x7fe78800a590 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:21.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.171+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7800d2700 con 0x7fe7981062b0 2024-09-21T07:52:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.362+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe79810bcf0 con 0x7fe7981062b0 2024-09-21T07:52:21.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.366+0000 7fe78ffff640 1 -- 172.21.15.6:0/3877195784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7fe7800d7640 con 0x7fe7981062b0 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 msgr2=0x7fe7840b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 0x7fe7840b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe79806bb50 tx=0x7fe78800a590 comp rx=0 tx=0).stop 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 msgr2=0x7fe79819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe78002a930 tx=0x7fe780003c20 comp rx=0 tx=0).stop 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 shutdown_connections 2024-09-21T07:52:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7840b64d0 0x7fe7840b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe798106c00 0x7fe79819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7981062b0 0x7fe79819a940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 --2- 172.21.15.6:0/3877195784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe798102060 0x7fe79819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 >> 172.21.15.6:0/3877195784 conn(0x7fe798077cc0 msgr2=0x7fe798107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 shutdown_connections 2024-09-21T07:52:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:21.368+0000 7fe79d5c2640 1 -- 172.21.15.6:0/3877195784 wait complete. 2024-09-21T07:52:22.050 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3230446092' entity='client.admin' 2024-09-21T07:52:22.050 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3877195784' entity='client.admin' 2024-09-21T07:52:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3230446092' entity='client.admin' 2024-09-21T07:52:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3877195784' entity='client.admin' 2024-09-21T07:52:22.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3230446092' entity='client.admin' 2024-09-21T07:52:22.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3877195784' entity='client.admin' 2024-09-21T07:52:22.368 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 -- 172.21.15.6:0/721598472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3841094a0 msgr2=0x7fc3841098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 --2- 172.21.15.6:0/721598472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3841094a0 0x7fc3841098b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc374009900 tx=0x7fc37402a410 comp rx=0 tx=0).stop 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 -- 172.21.15.6:0/721598472 shutdown_connections 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 --2- 172.21.15.6:0/721598472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc384109df0 0x7fc384110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 --2- 172.21.15.6:0/721598472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3841094a0 0x7fc3841098b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 --2- 172.21.15.6:0/721598472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384103b60 0x7fc384103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 -- 172.21.15.6:0/721598472 >> 172.21.15.6:0/721598472 conn(0x7fc38407b850 msgr2=0x7fc38407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 -- 172.21.15.6:0/721598472 shutdown_connections 2024-09-21T07:52:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.994+0000 7fc38bdab640 1 -- 172.21.15.6:0/721598472 wait complete. 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 Processor -- start 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 -- start start 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3841094a0 0x7fc38419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 0x7fc38419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc384113960 con 0x7fc384103b60 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841137e0 con 0x7fc384109df0 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc38bdab640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc384113ae0 con 0x7fc3841094a0 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc389b47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc389b47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49814/0 (socket says 172.21.15.6:49814) 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc389b47640 1 -- 172.21.15.6:0/2904534243 learned_addr learned my addr 172.21.15.6:0/2904534243 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.995+0000 7fc389346640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3841094a0 0x7fc38419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc38a348640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 0x7fc38419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 -- 172.21.15.6:0/2904534243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3841094a0 msgr2=0x7fc38419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3841094a0 0x7fc38419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 -- 172.21.15.6:0/2904534243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 msgr2=0x7fc38419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 0x7fc38419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 -- 172.21.15.6:0/2904534243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3841a0380 con 0x7fc384103b60 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc38a348640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 0x7fc38419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc389b47640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d950 tx=0x7fc38000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380017070 con 0x7fc384103b60 2024-09-21T07:52:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc380009c30 con 0x7fc384103b60 2024-09-21T07:52:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3841a0670 con 0x7fc384103b60 2024-09-21T07:52:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38000f620 con 0x7fc384103b60 2024-09-21T07:52:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.996+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3841a6dd0 con 0x7fc384103b60 2024-09-21T07:52:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.997+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc384103f70 con 0x7fc384103b60 2024-09-21T07:52:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:22.999+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fc380005030 con 0x7fc384103b60 2024-09-21T07:52:23.003 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:22 smithi006 ceph-mon[30970]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.000+0000 7fc37affd640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 0x7fc3700b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.000+0000 7fc389346640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 0x7fc3700b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.001+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc3800e5280 con 0x7fc384103b60 2024-09-21T07:52:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.001+0000 7fc389346640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 0x7fc3700b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc374005940 tx=0x7fc3740058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.004+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3800ad790 con 0x7fc384103b60 2024-09-21T07:52:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:22 smithi119 ceph-mon[33564]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:23.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:22 smithi145 ceph-mon[34049]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.202+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc38419b540 con 0x7fc384103b60 2024-09-21T07:52:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.207+0000 7fc37affd640 1 -- 172.21.15.6:0/2904534243 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7fc380009de0 con 0x7fc384103b60 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 msgr2=0x7fc3700b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 0x7fc3700b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc374005940 tx=0x7fc3740058d0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 msgr2=0x7fc38419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d950 tx=0x7fc38000de10 comp rx=0 tx=0).stop 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 shutdown_connections 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3700b6550 0x7fc3700b8a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3841094a0 0x7fc38419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc384109df0 0x7fc38419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 --2- 172.21.15.6:0/2904534243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc384103b60 0x7fc38419a410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 >> 172.21.15.6:0/2904534243 conn(0x7fc38407b850 msgr2=0x7fc3841055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 shutdown_connections 2024-09-21T07:52:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.209+0000 7fc38bdab640 1 -- 172.21.15.6:0/2904534243 wait complete. 2024-09-21T07:52:24.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:24 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2904534243' entity='client.admin' 2024-09-21T07:52:24.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:24 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3054612128' entity='client.admin' 2024-09-21T07:52:24.553 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:24 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2904534243' entity='client.admin' 2024-09-21T07:52:24.553 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:24 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3054612128' entity='client.admin' 2024-09-21T07:52:24.604 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi006') 2024-09-21T07:52:24.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:24 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2904534243' entity='client.admin' 2024-09-21T07:52:24.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:24 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3054612128' entity='client.admin' 2024-09-21T07:52:25.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3292215258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d04103b60 msgr2=0x7f9d04103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3292215258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d04103b60 0x7f9d04103f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009900 tx=0x7f9d0002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3292215258 shutdown_connections 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3292215258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d041094a0 0x7f9d041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3292215258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3292215258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d04103b60 0x7f9d04103f70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3292215258 >> 172.21.15.6:0/3292215258 conn(0x7f9d0407b850 msgr2=0x7f9d0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3292215258 shutdown_connections 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.417+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3292215258 wait complete. 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 Processor -- start 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 -- start start 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d04103b60 0x7f9d0419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d0419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041139b0 con 0x7f9d041094a0 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04113830 con 0x7f9d04109df0 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d0b8ca640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04113b30 con 0x7f9d04103b60 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.418+0000 7f9d08e65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49824/0 (socket says 172.21.15.6:49824) 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 -- 172.21.15.6:0/3054612128 learned_addr learned my addr 172.21.15.6:0/3054612128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d09666640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d04103b60 0x7f9d0419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d09e67640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d0419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 -- 172.21.15.6:0/3054612128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d04103b60 msgr2=0x7f9d0419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d04103b60 0x7f9d0419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 -- 172.21.15.6:0/3054612128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 msgr2=0x7f9d0419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d0419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 -- 172.21.15.6:0/3054612128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d041a0330 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d09e67640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d0419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d08e65640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400d950 tx=0x7f9cf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4017070 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf4009c30 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40047a0 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d041a0620 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.419+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d041a6d80 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.420+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d04103f70 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.422+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f9cf4004020 con 0x7f9d041094a0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.422+0000 7f9cfa7fc640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 0x7f9cf00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.423+0000 7f9d09666640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 0x7f9cf00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.423+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9cf40e59a0 con 0x7f9d041094a0 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.423+0000 7f9d09666640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 0x7f9cf00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006010 tx=0x7f9d00000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.426+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cf4020020 con 0x7f9d041094a0 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.614+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f9d0419b4f0 con 0x7f9d041094a0 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.618+0000 7f9cfa7fc640 1 -- 172.21.15.6:0/3054612128 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v29)=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f9d0419b4f0 con 0x7f9d041094a0 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 msgr2=0x7f9cf00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 0x7f9cf00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006010 tx=0x7f9d00000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 msgr2=0x7f9d0419a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400d950 tx=0x7f9cf400de10 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 shutdown_connections 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9cf00b6550 0x7f9cf00b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d04109df0 0x7f9d0419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d041094a0 0x7f9d0419a960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.620+0000 7f9d0b8ca640 1 --2- 172.21.15.6:0/3054612128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d04103b60 0x7f9d0419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.621+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 >> 172.21.15.6:0/3054612128 conn(0x7f9d0407b850 msgr2=0x7f9d04107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:25.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.621+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 shutdown_connections 2024-09-21T07:52:25.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:23.621+0000 7f9d0b8ca640 1 -- 172.21.15.6:0/3054612128 wait complete. 2024-09-21T07:52:25.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:25 smithi006 ceph-mon[30970]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:25.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:25 smithi119 ceph-mon[33564]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:25 smithi145 ceph-mon[34049]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:25.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.866+0000 7f6f9ba24640 1 -- 172.21.15.6:0/3209439264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 msgr2=0x7f6f941098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.866+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/3209439264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f941098e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009860 tx=0x7f6f8402a340 comp rx=0 tx=0).stop 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 -- 172.21.15.6:0/3209439264 shutdown_connections 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/3209439264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94109e20 0x7f6f94110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/3209439264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f941098e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/3209439264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94103b90 0x7f6f94103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 -- 172.21.15.6:0/3209439264 >> 172.21.15.6:0/3209439264 conn(0x7f6f940ff5e0 msgr2=0x7f6f94101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 -- 172.21.15.6:0/3209439264 shutdown_connections 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.867+0000 7f6f9ba24640 1 -- 172.21.15.6:0/3209439264 wait complete. 2024-09-21T07:52:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 Processor -- start 2024-09-21T07:52:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 -- start start 2024-09-21T07:52:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f9419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94109e20 0x7f6f9419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94113990 con 0x7f6f94103b90 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94113810 con 0x7f6f941094d0 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.868+0000 7f6f9ba24640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94113b10 con 0x7f6f94109e20 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49836/0 (socket says 172.21.15.6:49836) 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 -- 172.21.15.6:0/1779086619 learned_addr learned my addr 172.21.15.6:0/1779086619 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f98fbf640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f9419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f99fc1640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94109e20 0x7f6f9419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 -- 172.21.15.6:0/1779086619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94109e20 msgr2=0x7f6f9419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94109e20 0x7f6f9419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 -- 172.21.15.6:0/1779086619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 msgr2=0x7f6f9419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f9419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.869+0000 7f6f997c0640 1 -- 172.21.15.6:0/1779086619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f941a0330 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.870+0000 7f6f997c0640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000d950 tx=0x7f6f9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.870+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90017070 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.870+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f90009c30 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.871+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000f620 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.871+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f941a0620 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.871+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f941a6d80 con 0x7f6f94103b90 2024-09-21T07:52:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.872+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f94104e10 con 0x7f6f94103b90 2024-09-21T07:52:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.874+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f6f90005030 con 0x7f6f94103b90 2024-09-21T07:52:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.875+0000 7f6f8a7fc640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 0x7f6f800b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.875+0000 7f6f98fbf640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 0x7f6f800b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.876+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6f900e5290 con 0x7f6f94103b90 2024-09-21T07:52:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.876+0000 7f6f98fbf640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 0x7f6f800b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402a860 tx=0x7f6f84000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:25.879+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f900ad7a0 con 0x7f6f94103b90 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 -- 172.21.15.6:0/134590819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 msgr2=0x7fc4ac110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/134590819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac110300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009900 tx=0x7fc4a402a410 comp rx=0 tx=0).stop 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 -- 172.21.15.6:0/134590819 shutdown_connections 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/134590819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac110300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/134590819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ac105300 0x7fc4ac10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/134590819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac1049b0 0x7fc4ac104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 -- 172.21.15.6:0/134590819 >> 172.21.15.6:0/134590819 conn(0x7fc4ac079730 msgr2=0x7fc4ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 -- 172.21.15.6:0/134590819 shutdown_connections 2024-09-21T07:52:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.053+0000 7fc4b3a23640 1 -- 172.21.15.6:0/134590819 wait complete. 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.054+0000 7fc4b3a23640 1 Processor -- start 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.054+0000 7fc4b3a23640 1 -- start start 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ac1049b0 0x7fc4ac19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 0x7fc4ac19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b1fc0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b1fc0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49854/0 (socket says 172.21.15.6:49854) 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b0fbe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 0x7fc4ac19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b1fc0640 1 -- 172.21.15.6:0/857668633 learned_addr learned my addr 172.21.15.6:0/857668633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac113940 con 0x7fc4ac10de10 2024-09-21T07:52:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac1137c0 con 0x7fc4ac1049b0 2024-09-21T07:52:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.055+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac113ac0 con 0x7fc4ac105300 2024-09-21T07:52:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 -- 172.21.15.6:0/857668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ac1049b0 msgr2=0x7fc4ac19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ac1049b0 0x7fc4ac19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 -- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 msgr2=0x7fc4ac19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac1a02e0 con 0x7fc4ac105300 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b0fbe640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 0x7fc4ac19a910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0005fd0 tx=0x7fc4a000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0009c00 con 0x7fc4ac105300 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.056+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1a05d0 con 0x7fc4ac105300 2024-09-21T07:52:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.057+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1a6d30 con 0x7fc4ac105300 2024-09-21T07:52:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.057+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4a00044c0 con 0x7fc4ac105300 2024-09-21T07:52:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.058+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0003d70 con 0x7fc4ac105300 2024-09-21T07:52:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.058+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc498005290 con 0x7fc4ac105300 2024-09-21T07:52:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.061+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fc4a0004030 con 0x7fc4ac105300 2024-09-21T07:52:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.062+0000 7fc4aa7fc640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 0x7fc4940b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.062+0000 7fc4b17bf640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 0x7fc4940b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.062+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc4a00e53b0 con 0x7fc4ac105300 2024-09-21T07:52:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.063+0000 7fc4b17bf640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 0x7fc4940b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005c40 tx=0x7fc49c005bd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.067+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4a0017020 con 0x7fc4ac105300 2024-09-21T07:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.075+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f6f94103fa0 con 0x7f6f94103b90 2024-09-21T07:52:26.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.081+0000 7f6f8a7fc640 1 -- 172.21.15.6:0/1779086619 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7f6f90009de0 con 0x7f6f94103b90 2024-09-21T07:52:26.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.083+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 msgr2=0x7f6f800b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.083+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 0x7f6f800b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402a860 tx=0x7f6f84000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 msgr2=0x7f6f9419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000d950 tx=0x7f6f9000de10 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 shutdown_connections 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f800b6550 0x7f6f800b8a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f94109e20 0x7f6f9419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f941094d0 0x7f6f9419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 --2- 172.21.15.6:0/1779086619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f94103b90 0x7f6f9419a3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 >> 172.21.15.6:0/1779086619 conn(0x7f6f940ff5e0 msgr2=0x7f6f94101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 shutdown_connections 2024-09-21T07:52:26.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.084+0000 7f6f9ba24640 1 -- 172.21.15.6:0/1779086619 wait complete. 2024-09-21T07:52:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.276+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fc498005580 con 0x7fc4ac105300 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.284+0000 7fc4aa7fc640 1 -- 172.21.15.6:0/857668633 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v31)=0 v31) ==== 115+0+0 (secure 0 0 0) 0x7fc4a00ad840 con 0x7fc4ac105300 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 msgr2=0x7fc4940b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 0x7fc4940b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005c40 tx=0x7fc49c005bd0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 msgr2=0x7fc4ac19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 0x7fc4ac19a910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0005fd0 tx=0x7fc4a000dde0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 shutdown_connections 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc4940b6550 0x7fc4940b8a60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac105300 0x7fc4ac19a910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4ac10de10 0x7fc4ac19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 --2- 172.21.15.6:0/857668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ac1049b0 0x7fc4ac19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 >> 172.21.15.6:0/857668633 conn(0x7fc4ac079730 msgr2=0x7fc4ac100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 shutdown_connections 2024-09-21T07:52:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.286+0000 7fc4b3a23640 1 -- 172.21.15.6:0/857668633 wait complete. 2024-09-21T07:52:27.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:27 smithi006 ceph-mon[30970]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:27.403 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:27 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1779086619' entity='client.admin' 2024-09-21T07:52:27.403 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:27 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:27 smithi119 ceph-mon[33564]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:27 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1779086619' entity='client.admin' 2024-09-21T07:52:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:27 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:27 smithi145 ceph-mon[34049]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:27 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1779086619' entity='client.admin' 2024-09-21T07:52:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:27 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 -- 172.21.15.6:0/290211950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 msgr2=0x7fcbc41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/290211950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc41098d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009900 tx=0x7fcbb802a410 comp rx=0 tx=0).stop 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 -- 172.21.15.6:0/290211950 shutdown_connections 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/290211950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/290211950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc41098d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/290211950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 0x7fcbc4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 -- 172.21.15.6:0/290211950 >> 172.21.15.6:0/290211950 conn(0x7fcbc40ff610 msgr2=0x7fcbc4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 -- 172.21.15.6:0/290211950 shutdown_connections 2024-09-21T07:52:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.893+0000 7fcbc89a2640 1 -- 172.21.15.6:0/290211950 wait complete. 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 Processor -- start 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 -- start start 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 0x7fcbc419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc4113980 con 0x7fcbc41094c0 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc4113800 con 0x7fcbc4103b80 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc89a2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc4113b00 con 0x7fcbc4109e10 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56200/0 (socket says 172.21.15.6:56200) 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.894+0000 7fcbc1d9b640 1 -- 172.21.15.6:0/2083873187 learned_addr learned my addr 172.21.15.6:0/2083873187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc259c640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 0x7fcbc419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc2d9d640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 -- 172.21.15.6:0/2083873187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 msgr2=0x7fcbc419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 -- 172.21.15.6:0/2083873187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 msgr2=0x7fcbc419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 0x7fcbc419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 -- 172.21.15.6:0/2083873187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc41a0380 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc2d9d640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc1d9b640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8005940 tx=0x7fcbb80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb803f030 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc41a0610 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbb8003a80 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8035070 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.895+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc41a6dd0 con 0x7fcbc41094c0 2024-09-21T07:52:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.896+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc4104e00 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.898+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fcbb8042030 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.899+0000 7fcbb37fe640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 0x7fcbac0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.899+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcbb8105d70 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.899+0000 7fcbc259c640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 0x7fcbac0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.900+0000 7fcbc259c640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 0x7fcbac0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:26.904+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbb80ce200 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.108+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fcbc410bbe0 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.112+0000 7fcbb37fe640 1 -- 172.21.15.6:0/2083873187 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v32)=0 v32) ==== 106+0+0 (secure 0 0 0) 0x7fcbb80d25e0 con 0x7fcbc41094c0 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 msgr2=0x7fcbac0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 0x7fcbac0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4005850 comp rx=0 tx=0).stop 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 msgr2=0x7fcbc419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8005940 tx=0x7fcbb80040e0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 shutdown_connections 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcbac0b64d0 0x7fcbac0b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4109e10 0x7fcbc419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc41094c0 0x7fcbc419a9b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 --2- 172.21.15.6:0/2083873187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc4103b80 0x7fcbc419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 >> 172.21.15.6:0/2083873187 conn(0x7fcbc40ff610 msgr2=0x7fcbc4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 shutdown_connections 2024-09-21T07:52:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:27.115+0000 7fcbc89a2640 1 -- 172.21.15.6:0/2083873187 wait complete. 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 -- 172.21.15.6:0/4008489237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 msgr2=0x7f551c112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 --2- 172.21.15.6:0/4008489237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c112620 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5514009ca0 tx=0x7f551402a950 comp rx=0 tx=0).stop 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 -- 172.21.15.6:0/4008489237 shutdown_connections 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 --2- 172.21.15.6:0/4008489237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102fa0 0x7f551c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 --2- 172.21.15.6:0/4008489237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c112620 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 --2- 172.21.15.6:0/4008489237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102650 0x7f551c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 -- 172.21.15.6:0/4008489237 >> 172.21.15.6:0/4008489237 conn(0x7f551c079760 msgr2=0x7f551c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.071+0000 7f5523b8b640 1 -- 172.21.15.6:0/4008489237 shutdown_connections 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.072+0000 7f5523b8b640 1 -- 172.21.15.6:0/4008489237 wait complete. 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 Processor -- start 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 -- start start 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 0x7f551c19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 0x7f551c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f551c115b50 con 0x7f551c110200 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f551c1159d0 con 0x7f551c102fa0 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5523b8b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f551c115cd0 con 0x7f551c102650 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.073+0000 7f5522128640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56210/0 (socket says 172.21.15.6:56210) 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5521927640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 0x7f551c19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 -- 172.21.15.6:0/224687082 learned_addr learned my addr 172.21.15.6:0/224687082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5521126640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 0x7f551c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 -- 172.21.15.6:0/224687082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 msgr2=0x7f551c19c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 0x7f551c19c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 -- 172.21.15.6:0/224687082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 msgr2=0x7f551c19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 0x7f551c19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 -- 172.21.15.6:0/224687082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c1a2490 con 0x7f551c110200 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5521126640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 0x7f551c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5521927640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 0x7f551c19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5522128640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f551402ae70 tx=0x7f5514003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514034040 con 0x7f551c110200 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5514030850 con 0x7f551c110200 2024-09-21T07:52:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c1a2720 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.074+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514004600 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.075+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c1a8ee0 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.075+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c06c1f0 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.077+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f5514037020 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.078+0000 7f5512ffd640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 0x7f55080b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.078+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5514106650 con 0x7f551c110200 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.078+0000 7f5521927640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 0x7f55080b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.078+0000 7f5521927640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 0x7f55080b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5518009fc0 tx=0x7f5518005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.081+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5514083710 con 0x7f551c110200 2024-09-21T07:52:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.270+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f551c102a60 con 0x7f551c110200 2024-09-21T07:52:28.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:28 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2083873187' entity='client.admin' 2024-09-21T07:52:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.274+0000 7f5512ffd640 1 -- 172.21.15.6:0/224687082 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f551c102a60 con 0x7f551c110200 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 msgr2=0x7f55080b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 0x7f55080b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5518009fc0 tx=0x7f5518005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 msgr2=0x7f551c1a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f551402ae70 tx=0x7f5514003ce0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 shutdown_connections 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55080b64d0 0x7f55080b89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551c110200 0x7f551c1a1d60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c102fa0 0x7f551c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 --2- 172.21.15.6:0/224687082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f551c102650 0x7f551c19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 >> 172.21.15.6:0/224687082 conn(0x7f551c079760 msgr2=0x7f551c108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 shutdown_connections 2024-09-21T07:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:28.276+0000 7f5523b8b640 1 -- 172.21.15.6:0/224687082 wait complete. 2024-09-21T07:52:28.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:28 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2083873187' entity='client.admin' 2024-09-21T07:52:28.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:28 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2083873187' entity='client.admin' 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 -- 172.21.15.6:0/570249653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5900108cf0 msgr2=0x7f590010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 --2- 172.21.15.6:0/570249653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5900108cf0 0x7f590010f520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009ca0 tx=0x7f58f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 -- 172.21.15.6:0/570249653 shutdown_connections 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 --2- 172.21.15.6:0/570249653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5900108cf0 0x7f590010f520 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 --2- 172.21.15.6:0/570249653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59001083a0 0x7f59001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 --2- 172.21.15.6:0/570249653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 0x7f5900102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 -- 172.21.15.6:0/570249653 >> 172.21.15.6:0/570249653 conn(0x7f5900079730 msgr2=0x7f5900079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 -- 172.21.15.6:0/570249653 shutdown_connections 2024-09-21T07:52:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.300+0000 7f59064d6640 1 -- 172.21.15.6:0/570249653 wait complete. 2024-09-21T07:52:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.301+0000 7f59064d6640 1 Processor -- start 2024-09-21T07:52:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.301+0000 7f59064d6640 1 -- start start 2024-09-21T07:52:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 0x7f59001991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5900108cf0 0x7f590019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5900112860 con 0x7f59001083a0 2024-09-21T07:52:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f59001126e0 con 0x7f5900108cf0 2024-09-21T07:52:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f59064d6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f59001129e0 con 0x7f5900102a60 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56230/0 (socket says 172.21.15.6:56230) 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58ff7fe640 1 -- 172.21.15.6:0/2739030047 learned_addr learned my addr 172.21.15.6:0/2739030047 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58fffff640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 0x7f59001991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f5904a73640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5900108cf0 0x7f590019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58ff7fe640 1 -- 172.21.15.6:0/2739030047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 msgr2=0x7f59001991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.302+0000 7f58ff7fe640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 0x7f59001991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58ff7fe640 1 -- 172.21.15.6:0/2739030047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5900108cf0 msgr2=0x7f590019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58ff7fe640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5900108cf0 0x7f590019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58ff7fe640 1 -- 172.21.15.6:0/2739030047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590019f160 con 0x7f59001083a0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58ff7fe640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c940 tx=0x7f58f400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f400bcb0 con 0x7f59001083a0 2024-09-21T07:52:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590019f450 con 0x7f59001083a0 2024-09-21T07:52:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590006ae60 con 0x7f59001083a0 2024-09-21T07:52:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58f400be50 con 0x7f59001083a0 2024-09-21T07:52:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.303+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4004e40 con 0x7f59001083a0 2024-09-21T07:52:29.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.304+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5900102e70 con 0x7f59001083a0 2024-09-21T07:52:29.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.306+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f58f4005000 con 0x7f59001083a0 2024-09-21T07:52:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.307+0000 7f58fd7fa640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 0x7f58e80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.308+0000 7f58fffff640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 0x7f58e80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.308+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f58f40e9de0 con 0x7f59001083a0 2024-09-21T07:52:29.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.308+0000 7f58fffff640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 0x7f58e80b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005fd0 tx=0x7f58f0005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.311+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58f405a710 con 0x7f59001083a0 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/224687082' entity='client.admin' 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/224687082' entity='client.admin' 2024-09-21T07:52:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:29.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:29.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/224687082' entity='client.admin' 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.500+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f590019a320 con 0x7f59001083a0 2024-09-21T07:52:29.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.505+0000 7f58fd7fa640 1 -- 172.21.15.6:0/2739030047 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v34)=0 v34) ==== 138+0+0 (secure 0 0 0) 0x7f58f40b2270 con 0x7f59001083a0 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 msgr2=0x7f58e80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 0x7f58e80b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005fd0 tx=0x7f58f0005850 comp rx=0 tx=0).stop 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 msgr2=0x7f5900199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c940 tx=0x7f58f400ce00 comp rx=0 tx=0).stop 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 shutdown_connections 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58e80b64d0 0x7f58e80b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5900108cf0 0x7f590019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59001083a0 0x7f5900199790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 --2- 172.21.15.6:0/2739030047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5900102a60 0x7f59001991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 >> 172.21.15.6:0/2739030047 conn(0x7f5900079730 msgr2=0x7f59001043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 shutdown_connections 2024-09-21T07:52:29.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:29.507+0000 7f59064d6640 1 -- 172.21.15.6:0/2739030047 wait complete. 2024-09-21T07:52:30.221 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:30 smithi119 ceph-mon[33564]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:52:30.221 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:30 smithi119 ceph-mon[33564]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:52:30.221 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:30 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2739030047' entity='client.admin' 2024-09-21T07:52:30.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:30 smithi006 ceph-mon[30970]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:52:30.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:30 smithi006 ceph-mon[30970]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:52:30.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:30 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2739030047' entity='client.admin' 2024-09-21T07:52:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:30 smithi145 ceph-mon[34049]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:52:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:30 smithi145 ceph-mon[34049]: Reconfiguring daemon mon.b on smithi119 2024-09-21T07:52:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:30 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2739030047' entity='client.admin' 2024-09-21T07:52:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 -- 172.21.15.6:0/3146244047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1688108cf0 msgr2=0x7f168810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 --2- 172.21.15.6:0/3146244047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1688108cf0 0x7f168810f520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1680009ca0 tx=0x7f168002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 -- 172.21.15.6:0/3146244047 shutdown_connections 2024-09-21T07:52:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 --2- 172.21.15.6:0/3146244047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1688108cf0 0x7f168810f520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 --2- 172.21.15.6:0/3146244047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16881083a0 0x7f16881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 --2- 172.21.15.6:0/3146244047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688102a60 0x7f1688102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 -- 172.21.15.6:0/3146244047 >> 172.21.15.6:0/3146244047 conn(0x7f1688079730 msgr2=0x7f1688079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 -- 172.21.15.6:0/3146244047 shutdown_connections 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.600+0000 7f168ec43640 1 -- 172.21.15.6:0/3146244047 wait complete. 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 Processor -- start 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 -- start start 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1688102a60 0x7f1688199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688108cf0 0x7f168819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1688112860 con 0x7f16881083a0 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16881126e0 con 0x7f1688102a60 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168ec43640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f16881129e0 con 0x7f1688108cf0 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f1687fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f1687fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56254/0 (socket says 172.21.15.6:56254) 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f1687fff640 1 -- 172.21.15.6:0/2752187226 learned_addr learned my addr 172.21.15.6:0/2752187226 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.601+0000 7f168d1e0640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688108cf0 0x7f168819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f168c9df640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1688102a60 0x7f1688199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 -- 172.21.15.6:0/2752187226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688108cf0 msgr2=0x7f168819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688108cf0 0x7f168819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 -- 172.21.15.6:0/2752187226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1688102a60 msgr2=0x7f1688199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1688102a60 0x7f1688199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 -- 172.21.15.6:0/2752187226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168819f180 con 0x7f16881083a0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1687fff640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f167c005fd0 tx=0x7f167c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c017070 con 0x7f16881083a0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168819f470 con 0x7f16881083a0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f167c009c30 con 0x7f16881083a0 2024-09-21T07:52:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c003c70 con 0x7f16881083a0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.602+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16881a5bd0 con 0x7f16881083a0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.603+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1688102e70 con 0x7f16881083a0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.605+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f167c003e10 con 0x7f16881083a0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.605+0000 7f1685ffb640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 0x7f16700b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.606+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f167c0e53a0 con 0x7f16881083a0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.606+0000 7f168c9df640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 0x7f16700b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.606+0000 7f168c9df640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 0x7f16700b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1678005fd0 tx=0x7f1678005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.610+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f167c020030 con 0x7f16881083a0 2024-09-21T07:52:30.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.801+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f168802e640 con 0x7f16881083a0 2024-09-21T07:52:30.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.806+0000 7f1685ffb640 1 -- 172.21.15.6:0/2752187226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f167c0ad830 con 0x7f16881083a0 2024-09-21T07:52:30.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 msgr2=0x7f16700b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 0x7f16700b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1678005fd0 tx=0x7f1678005850 comp rx=0 tx=0).stop 2024-09-21T07:52:30.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 msgr2=0x7f16881997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f167c005fd0 tx=0x7f167c00dde0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 shutdown_connections 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16700b64d0 0x7f16700b89e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688108cf0 0x7f168819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16881083a0 0x7f16881997b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 --2- 172.21.15.6:0/2752187226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1688102a60 0x7f1688199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.808+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 >> 172.21.15.6:0/2752187226 conn(0x7f1688079730 msgr2=0x7f16881043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.809+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 shutdown_connections 2024-09-21T07:52:30.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.809+0000 7f168ec43640 1 -- 172.21.15.6:0/2752187226 wait complete. 2024-09-21T07:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 -- 172.21.15.6:0/1807963217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c409c3a0 msgr2=0x7fc9c40a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/1807963217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c409c3a0 0x7fc9c40a2bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc066480 tx=0x7fc9cc098170 comp rx=0 tx=0).stop 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 -- 172.21.15.6:0/1807963217 shutdown_connections 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/1807963217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c409be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/1807963217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c409c3a0 0x7fc9c40a2bd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/1807963217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c4096110 0x7fc9c4096520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 -- 172.21.15.6:0/1807963217 >> 172.21.15.6:0/1807963217 conn(0x7fc9c400dcd0 msgr2=0x7fc9c400e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 -- 172.21.15.6:0/1807963217 shutdown_connections 2024-09-21T07:52:30.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.851+0000 7fc9cb59e640 1 -- 172.21.15.6:0/1807963217 wait complete. 2024-09-21T07:52:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.852+0000 7fc9cb59e640 1 Processor -- start 2024-09-21T07:52:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.852+0000 7fc9cb59e640 1 -- start start 2024-09-21T07:52:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 0x7fc9c412c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 0x7fc9c41320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c40a5e20 con 0x7fc9c4096110 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c40a5ca0 con 0x7fc9c409c3a0 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cb59e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c40a5fa0 con 0x7fc9c409ba50 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9c9d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 0x7fc9c412c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9c9d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47236/0 (socket says 172.21.15.6:47236) 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9c9d9b640 1 -- 172.21.15.6:0/3359570336 learned_addr learned my addr 172.21.15.6:0/3359570336 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.853+0000 7fc9cad9d640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 0x7fc9c41320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 -- 172.21.15.6:0/3359570336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 msgr2=0x7fc9c412ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 -- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 msgr2=0x7fc9c412c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 0x7fc9c412c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 -- 172.21.15.6:0/3359570336 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c41327e0 con 0x7fc9c409c3a0 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9c9d9b640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cad9d640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 0x7fc9c41320b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc052860 tx=0x7fc9cc0a0440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9ca59c640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 0x7fc9c412c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0af070 con 0x7fc9c409c3a0 2024-09-21T07:52:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9cc0a0e30 con 0x7fc9c409c3a0 2024-09-21T07:52:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0a1470 con 0x7fc9c409c3a0 2024-09-21T07:52:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c4132a70 con 0x7fc9c409c3a0 2024-09-21T07:52:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.854+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c4132ed0 con 0x7fc9c409c3a0 2024-09-21T07:52:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.856+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c4096520 con 0x7fc9c409c3a0 2024-09-21T07:52:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.857+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fc9cc06a6f0 con 0x7fc9c409c3a0 2024-09-21T07:52:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.858+0000 7fc9bb7fe640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 0x7fc9b40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.858+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc9cc172570 con 0x7fc9c409c3a0 2024-09-21T07:52:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.859+0000 7fc9ca59c640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 0x7fc9b40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.859+0000 7fc9ca59c640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 0x7fc9b40b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00bfd0 tx=0x7fc9bc00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:30.863+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9cc13ee70 con 0x7fc9c409c3a0 2024-09-21T07:52:31.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.053+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fc9c412d9a0 con 0x7fc9c409c3a0 2024-09-21T07:52:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.061+0000 7fc9bb7fe640 1 -- 172.21.15.6:0/3359570336 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) ==== 133+0+0 (secure 0 0 0) 0x7fc9cc143d20 con 0x7fc9c409c3a0 2024-09-21T07:52:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.063+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 msgr2=0x7fc9b40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.063+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 0x7fc9b40b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00bfd0 tx=0x7fc9bc00b390 comp rx=0 tx=0).stop 2024-09-21T07:52:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.063+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 msgr2=0x7fc9c41320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.063+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 0x7fc9c41320b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc052860 tx=0x7fc9cc0a0440 comp rx=0 tx=0).stop 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 shutdown_connections 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc9b40b6550 0x7fc9b40b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9c409ba50 0x7fc9c412ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c409c3a0 0x7fc9c41320b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 --2- 172.21.15.6:0/3359570336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c4096110 0x7fc9c412c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 >> 172.21.15.6:0/3359570336 conn(0x7fc9c400dcd0 msgr2=0x7fc9c4099b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 shutdown_connections 2024-09-21T07:52:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:31.064+0000 7fc9cb59e640 1 -- 172.21.15.6:0/3359570336 wait complete. 2024-09-21T07:52:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2752187226' entity='client.admin' 2024-09-21T07:52:31.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:31 smithi119 ceph-mon[33564]: from='client.? ' entity='client.admin' 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2752187226' entity='client.admin' 2024-09-21T07:52:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:31 smithi145 ceph-mon[34049]: from='client.? ' entity='client.admin' 2024-09-21T07:52:31.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:31.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2752187226' entity='client.admin' 2024-09-21T07:52:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:31 smithi006 ceph-mon[30970]: from='client.? ' entity='client.admin' 2024-09-21T07:52:31.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi006') 2024-09-21T07:52:31.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi006') 2024-09-21T07:52:31.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi006') 2024-09-21T07:52:31.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi006') 2024-09-21T07:52:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:52:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: Reconfiguring daemon mon.c on smithi145 2024-09-21T07:52:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:32.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:32.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:32.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: Reconfiguring daemon mon.c on smithi145 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:32.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:32.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: Reconfiguring daemon mon.c on smithi145 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:32.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:32.566 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:33 smithi119 ceph-mon[33564]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:33.416 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:33 smithi006 ceph-mon[30970]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:33 smithi145 ceph-mon[34049]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 -- 172.21.15.6:0/583268429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73181083a0 msgr2=0x7f73181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 --2- 172.21.15.6:0/583268429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73181083a0 0x7f73181087b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f730c009900 tx=0x7f730c02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 -- 172.21.15.6:0/583268429 shutdown_connections 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 --2- 172.21.15.6:0/583268429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318108cf0 0x7f731810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 --2- 172.21.15.6:0/583268429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73181083a0 0x7f73181087b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 --2- 172.21.15.6:0/583268429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7318102a60 0x7f7318102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 -- 172.21.15.6:0/583268429 >> 172.21.15.6:0/583268429 conn(0x7f7318079730 msgr2=0x7f7318079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.631+0000 7f731dd97640 1 -- 172.21.15.6:0/583268429 shutdown_connections 2024-09-21T07:52:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.632+0000 7f731dd97640 1 -- 172.21.15.6:0/583268429 wait complete. 2024-09-21T07:52:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.632+0000 7f731dd97640 1 Processor -- start 2024-09-21T07:52:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.632+0000 7f731dd97640 1 -- start start 2024-09-21T07:52:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318102a60 0x7f731819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73181083a0 0x7f731819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7318112810 con 0x7f7318108cf0 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7318112690 con 0x7f73181083a0 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f731dd97640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7318112990 con 0x7f7318102a60 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56296/0 (socket says 172.21.15.6:56296) 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 -- 172.21.15.6:0/3526729404 learned_addr learned my addr 172.21.15.6:0/3526729404 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7316ffd640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73181083a0 0x7f731819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f73177fe640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318102a60 0x7f731819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 -- 172.21.15.6:0/3526729404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318102a60 msgr2=0x7f731819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318102a60 0x7f731819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 -- 172.21.15.6:0/3526729404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73181083a0 msgr2=0x7f731819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73181083a0 0x7f731819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 -- 172.21.15.6:0/3526729404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73181a0340 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.633+0000 7f7317fff640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7310009fd0 tx=0x7f731000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.634+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310017070 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.634+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73181a0630 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.634+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7310003e00 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.634+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310010460 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.634+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73181a6d90 con 0x7f7318108cf0 2024-09-21T07:52:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.635+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7318102e70 con 0x7f7318108cf0 2024-09-21T07:52:33.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.637+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f7310003970 con 0x7f7318108cf0 2024-09-21T07:52:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.638+0000 7f7314ff9640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 0x7f73000b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.638+0000 7f73177fe640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 0x7f73000b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.638+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f73100e57d0 con 0x7f7318108cf0 2024-09-21T07:52:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.638+0000 7f73177fe640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 0x7f73000b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f730800bbe0 tx=0x7f730800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:33.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.642+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73100b2040 con 0x7f7318108cf0 2024-09-21T07:52:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.836+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f731819b500 con 0x7f7318108cf0 2024-09-21T07:52:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.840+0000 7f7314ff9640 1 -- 172.21.15.6:0/3526729404 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v37)=0 v37) ==== 129+0+0 (secure 0 0 0) 0x7f73100b6f80 con 0x7f7318108cf0 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.842+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 msgr2=0x7f73000b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 0x7f73000b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f730800bbe0 tx=0x7f730800b390 comp rx=0 tx=0).stop 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 msgr2=0x7f731819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7310009fd0 tx=0x7f731000b260 comp rx=0 tx=0).stop 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 shutdown_connections 2024-09-21T07:52:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73000b64d0 0x7f73000b89e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7318108cf0 0x7f731819fc10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73181083a0 0x7f731819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 --2- 172.21.15.6:0/3526729404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7318102a60 0x7f731819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 >> 172.21.15.6:0/3526729404 conn(0x7f7318079730 msgr2=0x7f731806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 shutdown_connections 2024-09-21T07:52:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:33.843+0000 7f731dd97640 1 -- 172.21.15.6:0/3526729404 wait complete. 2024-09-21T07:52:34.039 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:34.039 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi006') 2024-09-21T07:52:34.039 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi006') 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3526729404' entity='client.admin' 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:35.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3526729404' entity='client.admin' 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3526729404' entity='client.admin' 2024-09-21T07:52:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:35.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:52:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 -- 172.21.15.6:0/3878018280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 msgr2=0x7f70d4112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 --2- 172.21.15.6:0/3878018280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d4112620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009ca0 tx=0x7f70cc02a950 comp rx=0 tx=0).stop 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 -- 172.21.15.6:0/3878018280 shutdown_connections 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 --2- 172.21.15.6:0/3878018280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d4112620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 --2- 172.21.15.6:0/3878018280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102fa0 0x7f70d410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 --2- 172.21.15.6:0/3878018280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102650 0x7f70d4102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 -- 172.21.15.6:0/3878018280 >> 172.21.15.6:0/3878018280 conn(0x7f70d4079730 msgr2=0x7f70d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 -- 172.21.15.6:0/3878018280 shutdown_connections 2024-09-21T07:52:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.878+0000 7f70db451640 1 -- 172.21.15.6:0/3878018280 wait complete. 2024-09-21T07:52:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 Processor -- start 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 -- start start 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102650 0x7f70d419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102fa0 0x7f70d419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70d4115b20 con 0x7f70d4110200 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41159a0 con 0x7f70d4102650 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70db451640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f70d4115ca0 con 0x7f70d4102fa0 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d99ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d99ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56302/0 (socket says 172.21.15.6:56302) 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d99ee640 1 -- 172.21.15.6:0/1820944653 learned_addr learned my addr 172.21.15.6:0/1820944653 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d89ec640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102fa0 0x7f70d419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d91ed640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102650 0x7f70d419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d99ee640 1 -- 172.21.15.6:0/1820944653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102fa0 msgr2=0x7f70d419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.879+0000 7f70d99ee640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102fa0 0x7f70d419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70d99ee640 1 -- 172.21.15.6:0/1820944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102650 msgr2=0x7f70d419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70d99ee640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102650 0x7f70d419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70d99ee640 1 -- 172.21.15.6:0/1820944653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d41a24a0 con 0x7f70d4110200 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70d99ee640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70cc02ae70 tx=0x7f70cc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc034040 con 0x7f70d4110200 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70cc030850 con 0x7f70d4110200 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d41a2730 con 0x7f70d4110200 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc004500 con 0x7f70d4110200 2024-09-21T07:52:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.880+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d41a8ef0 con 0x7f70d4110200 2024-09-21T07:52:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.881+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d4102a60 con 0x7f70d4110200 2024-09-21T07:52:35.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.884+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f70cc037020 con 0x7f70d4110200 2024-09-21T07:52:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.885+0000 7f70ca7fc640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 0x7f70c00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.885+0000 7f70d91ed640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 0x7f70c00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.885+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f70cc106550 con 0x7f70d4110200 2024-09-21T07:52:35.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.885+0000 7f70d91ed640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 0x7f70c00b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009bd0 tx=0x7f70c4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:35.888+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70cc083710 con 0x7f70d4110200 2024-09-21T07:52:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.077+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f70d41a90c0 con 0x7f70d4110200 2024-09-21T07:52:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.078+0000 7f70ca7fc640 1 -- 172.21.15.6:0/1820944653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v37)=0 v37) ==== 106+0+0 (secure 0 0 0) 0x7f70cc0ce9e0 con 0x7f70d4110200 2024-09-21T07:52:36.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 msgr2=0x7f70c00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 0x7f70c00b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009bd0 tx=0x7f70c4005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:36.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 msgr2=0x7f70d41a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70cc02ae70 tx=0x7f70cc003c10 comp rx=0 tx=0).stop 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 shutdown_connections 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70c00b6550 0x7f70c00b8a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d4102fa0 0x7f70d419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.080+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70d4110200 0x7f70d41a1d70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.081+0000 7f70db451640 1 --2- 172.21.15.6:0/1820944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d4102650 0x7f70d419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.081+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 >> 172.21.15.6:0/1820944653 conn(0x7f70d4079730 msgr2=0x7f70d4108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.081+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 shutdown_connections 2024-09-21T07:52:36.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:36.081+0000 7f70db451640 1 -- 172.21.15.6:0/1820944653 wait complete. 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f3246cac-77ed-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-21T07:52:36.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config dump 2024-09-21T07:52:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:36 smithi119 ceph-mon[33564]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:37.189 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:36 smithi006 ceph-mon[30970]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:36 smithi145 ceph-mon[34049]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 -- 172.21.15.6:0/2653769198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0940109e00 msgr2=0x7f0940110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 --2- 172.21.15.6:0/2653769198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0940109e00 0x7f0940110630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ca0 tx=0x7f093802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 -- 172.21.15.6:0/2653769198 shutdown_connections 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 --2- 172.21.15.6:0/2653769198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0940109e00 0x7f0940110630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 --2- 172.21.15.6:0/2653769198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09401094b0 0x7f09401098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 --2- 172.21.15.6:0/2653769198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940103b70 0x7f0940103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 -- 172.21.15.6:0/2653769198 >> 172.21.15.6:0/2653769198 conn(0x7f09400ff5e0 msgr2=0x7f0940101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 -- 172.21.15.6:0/2653769198 shutdown_connections 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.520+0000 7f094580c640 1 -- 172.21.15.6:0/2653769198 wait complete. 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 Processor -- start 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 -- start start 2024-09-21T07:52:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0940103b70 0x7f094019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940109e00 0x7f094019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09401139c0 con 0x7f09401094b0 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113840 con 0x7f0940103b70 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f094580c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113b40 con 0x7f0940109e00 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47950/0 (socket says 172.21.15.6:47950) 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f093e7fc640 1 -- 172.21.15.6:0/2952434147 learned_addr learned my addr 172.21.15.6:0/2952434147 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.521+0000 7f093effd640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0940103b70 0x7f094019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093f7fe640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940109e00 0x7f094019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 -- 172.21.15.6:0/2952434147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940109e00 msgr2=0x7f094019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940109e00 0x7f094019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 -- 172.21.15.6:0/2952434147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0940103b70 msgr2=0x7f094019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0940103b70 0x7f094019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 -- 172.21.15.6:0/2952434147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09401a02c0 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f093e7fc640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f093400d950 tx=0x7f093400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934017070 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09401a05b0 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0934009c30 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340047a0 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.522+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401a6d10 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.523+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0940103f80 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.526+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f0934004020 con 0x7f09401094b0 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.527+0000 7f094480a640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 0x7f09280b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.527+0000 7f093effd640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 0x7f09280b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.527+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f09340e58e0 con 0x7f09401094b0 2024-09-21T07:52:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.527+0000 7f093effd640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 0x7f09280b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0930009bd0 tx=0x7f0930005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.530+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0934020020 con 0x7f09401094b0 2024-09-21T07:52:37.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.716+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f094002e640 con 0x7f09401094b0 2024-09-21T07:52:37.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.717+0000 7f094480a640 1 -- 172.21.15.6:0/2952434147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+21721 (secure 0 0 0) 0x7f09340adcd0 con 0x7f09401094b0 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global dev auth_debug true 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global basic log_to_file true 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global basic log_to_journald false 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global basic log_to_stderr false 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_allow_pool_delete true 2024-09-21T07:52:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global dev ms_die_on_bug true 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global dev ms_die_on_old_message true 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T07:52:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced debug_mon 20/20 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced debug_ms 1/1 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced debug_paxos 20/20 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:52:37.721 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced debug_client 20/20 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T07:52:37.722 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev bdev_debug_aio true 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced debug_bluefs 20/20 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced debug_bluestore 20/20 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced debug_ms 1/1 2024-09-21T07:52:37.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced debug_osd 20/20 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_op_order true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_shutdown true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T07:52:37.724 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_mds 20/20 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_ms 2/2 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T07:52:37.725 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_bal_split_size 100 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_debug_frag true 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_verify_scatter true 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced client_mount_timeout 600 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced debug_client 20/20 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced debug_ms 1/1 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:52:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:52:37.727 INFO:teuthology.orchestra.run.smithi006.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T07:52:37.727 INFO:teuthology.orchestra.run.smithi006.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T07:52:37.727 INFO:teuthology.orchestra.run.smithi006.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T07:52:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 msgr2=0x7f09280b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 0x7f09280b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0930009bd0 tx=0x7f0930005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 msgr2=0x7f094019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f093400d950 tx=0x7f093400de10 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 shutdown_connections 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09280b64d0 0x7f09280b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0940109e00 0x7f094019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09401094b0 0x7f094019a8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 --2- 172.21.15.6:0/2952434147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0940103b70 0x7f094019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 >> 172.21.15.6:0/2952434147 conn(0x7f09400ff5e0 msgr2=0x7f0940101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 shutdown_connections 2024-09-21T07:52:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:37.719+0000 7f094580c640 1 -- 172.21.15.6:0/2952434147 wait complete. 2024-09-21T07:52:38.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:37 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2952434147' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:52:38.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2952434147' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:52:38.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:37 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2952434147' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:52:38.389 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:52:38.389 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:52:38.389 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:52:38.407 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:52:38.407 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-09-21T07:52:38.463 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:52:38.463 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T07:52:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:38.464 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-21 07:51:12.717253967 +0000 2024-09-21T07:52:38.464 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-21 07:46:40.533633366 +0000 2024-09-21T07:52:38.464 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-21 07:46:40.533633366 +0000 2024-09-21T07:52:38.464 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-21 07:46:40.533633366 +0000 2024-09-21T07:52:38.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:52:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-21T07:52:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-21T07:52:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000272253 s, 1.9 MB/s 2024-09-21T07:52:38.530 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:52:38.587 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:38.643 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-21 07:51:12.751253649 +0000 2024-09-21T07:52:38.644 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-21 07:46:40.882630111 +0000 2024-09-21T07:52:38.644 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-21 07:46:40.882630111 +0000 2024-09-21T07:52:38.644 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-21 07:46:40.882630111 +0000 2024-09-21T07:52:38.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:52:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-21T07:52:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-21T07:52:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000184489 s, 2.8 MB/s 2024-09-21T07:52:38.708 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:52:38.764 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-09-21T07:52:38.820 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:52:38.820 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-21 07:51:12.785253332 +0000 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-21 07:46:41.219626969 +0000 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-21 07:46:41.219626969 +0000 2024-09-21T07:52:38.821 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-21 07:46:41.219626969 +0000 2024-09-21T07:52:38.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:52:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-21T07:52:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-21T07:52:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000195769 s, 2.6 MB/s 2024-09-21T07:52:38.886 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:52:38.942 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-09-21T07:52:38.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:38 smithi006 ceph-mon[30970]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-21 07:51:12.819253014 +0000 2024-09-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-21 07:46:41.558623809 +0000 2024-09-21T07:52:38.976 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-21 07:46:41.558623809 +0000 2024-09-21T07:52:38.976 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-21 07:46:41.558623809 +0000 2024-09-21T07:52:38.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:52:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-21T07:52:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-21T07:52:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000186201 s, 2.7 MB/s 2024-09-21T07:52:39.040 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:52:39.097 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T07:52:39.097 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:52:39.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:52:39.116 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-21T07:52:39.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:38 smithi119 ceph-mon[33564]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 07:52:09.917566279 +0000 2024-09-21T07:52:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 07:46:33.016541109 +0000 2024-09-21T07:52:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 07:46:33.016541109 +0000 2024-09-21T07:52:39.175 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 07:46:33.016541109 +0000 2024-09-21T07:52:39.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:52:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:38 smithi145 ceph-mon[34049]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:39.244 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T07:52:39.244 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T07:52:39.244 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000288132 s, 1.8 MB/s 2024-09-21T07:52:39.245 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:52:39.303 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 07:52:09.917566279 +0000 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 07:46:33.338533533 +0000 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 07:46:33.338533533 +0000 2024-09-21T07:52:39.360 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 07:46:33.338533533 +0000 2024-09-21T07:52:39.361 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:52:39.426 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T07:52:39.426 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T07:52:39.426 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00020951 s, 2.4 MB/s 2024-09-21T07:52:39.427 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:52:39.485 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 07:52:09.917566279 +0000 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 07:46:33.660525956 +0000 2024-09-21T07:52:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 07:46:33.660525956 +0000 2024-09-21T07:52:39.543 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 07:46:33.660525956 +0000 2024-09-21T07:52:39.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:52:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T07:52:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T07:52:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000203041 s, 2.5 MB/s 2024-09-21T07:52:39.608 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:52:39.665 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 07:52:09.918566255 +0000 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 07:46:33.989518214 +0000 2024-09-21T07:52:39.721 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 07:46:33.989518214 +0000 2024-09-21T07:52:39.722 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 07:46:33.989518214 +0000 2024-09-21T07:52:39.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:52:39.785 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T07:52:39.785 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T07:52:39.785 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000265356 s, 1.9 MB/s 2024-09-21T07:52:39.786 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:52:39.842 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-21T07:52:39.843 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:52:39.862 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:52:39.863 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-21 07:52:07.715602042 +0000 2024-09-21T07:52:39.921 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-21 07:46:43.008032313 +0000 2024-09-21T07:52:39.922 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-21 07:46:43.008032313 +0000 2024-09-21T07:52:39.922 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-21 07:46:43.008032313 +0000 2024-09-21T07:52:39.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:52:39.991 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-21T07:52:39.991 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-21T07:52:39.991 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000239404 s, 2.1 MB/s 2024-09-21T07:52:39.992 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:52:40.051 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-21 07:52:07.716602022 +0000 2024-09-21T07:52:40.107 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-21 07:46:43.320025791 +0000 2024-09-21T07:52:40.108 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-21 07:46:43.320025791 +0000 2024-09-21T07:52:40.108 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-21 07:46:43.320025791 +0000 2024-09-21T07:52:40.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:52:40.173 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-21T07:52:40.173 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-21T07:52:40.173 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000208416 s, 2.5 MB/s 2024-09-21T07:52:40.174 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:52:40.232 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-21T07:52:40.289 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:52:40.289 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:40.289 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T07:52:40.289 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:40.289 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:40.290 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-21 07:52:07.716602022 +0000 2024-09-21T07:52:40.290 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-21 07:46:43.650018891 +0000 2024-09-21T07:52:40.290 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-21 07:46:43.650018891 +0000 2024-09-21T07:52:40.290 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-21 07:46:43.650018891 +0000 2024-09-21T07:52:40.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:52:40.354 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-21T07:52:40.354 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-21T07:52:40.354 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00022173 s, 2.3 MB/s 2024-09-21T07:52:40.356 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:52:40.413 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-21T07:52:40.469 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:52:40.469 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-21 07:52:07.717602000 +0000 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-21 07:46:43.956012494 +0000 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-21 07:46:43.956012494 +0000 2024-09-21T07:52:40.470 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-21 07:46:43.956012494 +0000 2024-09-21T07:52:40.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:52:40.534 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-21T07:52:40.534 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-21T07:52:40.534 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000202374 s, 2.5 MB/s 2024-09-21T07:52:40.535 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:52:40.592 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2024-09-21T07:52:40.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:52:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:40.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:40 smithi006 ceph-mon[30970]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:40 smithi119 ceph-mon[33564]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:40 smithi145 ceph-mon[34049]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:42 smithi119 ceph-mon[33564]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:42 smithi145 ceph-mon[34049]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:42 smithi006 ceph-mon[30970]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:43.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:52:43.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2024-09-21T07:52:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 -- 172.21.15.6:0/3058301048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 msgr2=0x7fd7f0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/3058301048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0110630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009ca0 tx=0x7fd7e802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 -- 172.21.15.6:0/3058301048 shutdown_connections 2024-09-21T07:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/3058301048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 0x7fd7f01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/3058301048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0110630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/3058301048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 0x7fd7f0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 -- 172.21.15.6:0/3058301048 >> 172.21.15.6:0/3058301048 conn(0x7fd7f007b910 msgr2=0x7fd7f007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 -- 172.21.15.6:0/3058301048 shutdown_connections 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.455+0000 7fd7f7b28640 1 -- 172.21.15.6:0/3058301048 wait complete. 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 Processor -- start 2024-09-21T07:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 -- start start 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 0x7fd7f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 0x7fd7f0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01139c0 con 0x7fd7f0109e00 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0113840 con 0x7fd7f0103bc0 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f7b28640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0113b40 con 0x7fd7f01094b0 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f60c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f60c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47966/0 (socket says 172.21.15.6:47966) 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f60c5640 1 -- 172.21.15.6:0/1500243248 learned_addr learned my addr 172.21.15.6:0/1500243248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f58c4640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 0x7fd7f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.456+0000 7fd7f50c3640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 0x7fd7f0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 -- 172.21.15.6:0/1500243248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 msgr2=0x7fd7f0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 0x7fd7f0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 -- 172.21.15.6:0/1500243248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 msgr2=0x7fd7f0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 0x7fd7f0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 -- 172.21.15.6:0/1500243248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f01a8670 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f60c5640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005cc0 tx=0x7fd7e8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8032e00 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f01a8900 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7e80044d0 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8030b70 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.457+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f01a8e90 con 0x7fd7f0109e00 2024-09-21T07:52:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.458+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f0103fd0 con 0x7fd7f0109e00 2024-09-21T07:52:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.460+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fd7e8030d10 con 0x7fd7f0109e00 2024-09-21T07:52:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.460+0000 7fd7e6ffd640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 0x7fd7dc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.461+0000 7fd7f58c4640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 0x7fd7dc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.461+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd7e8106a20 con 0x7fd7f0109e00 2024-09-21T07:52:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.461+0000 7fd7f58c4640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 0x7fd7dc0b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0077160 tx=0x7fd7ec00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.464+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7e80ceeb0 con 0x7fd7f0109e00 2024-09-21T07:52:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:52:44.663+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd7f0063800 con 0x7fd7dc0b6550 2024-09-21T07:52:44.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:44 smithi006 ceph-mon[30970]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:44.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:52:44.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:52:44.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:44 smithi119 ceph-mon[33564]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:52:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:52:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:44 smithi145 ceph-mon[34049]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:52:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:52:45.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:46.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:45 smithi006 ceph-mon[30970]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:52:46.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:45 smithi119 ceph-mon[33564]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:52:46.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:45 smithi145 ceph-mon[34049]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:52:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:46 smithi119 ceph-mon[33564]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:46 smithi145 ceph-mon[34049]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:46 smithi006 ceph-mon[30970]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"} : dispatch 2024-09-21T07:52:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"}]': finished 2024-09-21T07:52:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:47 smithi119 ceph-mon[33564]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:52:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:52:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2371322763' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:52:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"} : dispatch 2024-09-21T07:52:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"}]': finished 2024-09-21T07:52:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:47 smithi145 ceph-mon[34049]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:52:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:52:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2371322763' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:52:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"} : dispatch 2024-09-21T07:52:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1936395879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba946387-792a-4df2-a544-d128afc01190"}]': finished 2024-09-21T07:52:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:47 smithi006 ceph-mon[30970]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:52:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:52:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2371322763' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:52:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:49 smithi119 ceph-mon[33564]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:49 smithi145 ceph-mon[34049]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:49.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:49 smithi006 ceph-mon[30970]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:51 smithi119 ceph-mon[33564]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:51 smithi145 ceph-mon[34049]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:51.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:51 smithi006 ceph-mon[30970]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:53.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:53 smithi006 ceph-mon[30970]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:53 smithi119 ceph-mon[33564]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:53 smithi145 ceph-mon[34049]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:55 smithi119 ceph-mon[33564]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:55 smithi145 ceph-mon[34049]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:55.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:55 smithi006 ceph-mon[30970]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:56 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:52:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:56 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:56 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:52:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:56 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:56 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:52:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:56 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:57 smithi119 ceph-mon[33564]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:57 smithi119 ceph-mon[33564]: Deploying daemon osd.0 on smithi006 2024-09-21T07:52:57.422 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:57 smithi006 ceph-mon[30970]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:57.422 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:57 smithi006 ceph-mon[30970]: Deploying daemon osd.0 on smithi006 2024-09-21T07:52:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:57 smithi145 ceph-mon[34049]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:57 smithi145 ceph-mon[34049]: Deploying daemon osd.0 on smithi006 2024-09-21T07:52:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:52:59 smithi119 ceph-mon[33564]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:52:59 smithi145 ceph-mon[34049]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:52:59.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:52:59 smithi006 ceph-mon[30970]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:01.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:01 smithi006 ceph-mon[30970]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:01 smithi145 ceph-mon[34049]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:01.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:01 smithi119 ceph-mon[33564]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:02.440 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:02.440 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:02.440 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:02.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:02.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:02.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:03 smithi145 ceph-mon[34049]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:03 smithi006 ceph-mon[30970]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:03.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:03 smithi119 ceph-mon[33564]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:05.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:05.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:05.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:05.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:05.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:05.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.688+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1500243248 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7f0063800 con 0x7fd7dc0b6550 2024-09-21T07:53:05.690 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2024-09-21T07:53:05.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 msgr2=0x7fd7dc0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:05.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 0x7fd7dc0b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0077160 tx=0x7fd7ec00b410 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 msgr2=0x7fd7f0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005cc0 tx=0x7fd7e8032a10 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 shutdown_connections 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd7dc0b6550 0x7fd7dc0b8a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7f01094b0 0x7fd7f0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f0109e00 0x7fd7f0076190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 --2- 172.21.15.6:0/1500243248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f0103bc0 0x7fd7f0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 >> 172.21.15.6:0/1500243248 conn(0x7fd7f007b910 msgr2=0x7fd7f0107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 shutdown_connections 2024-09-21T07:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:05.691+0000 7fd7f7b28640 1 -- 172.21.15.6:0/1500243248 wait complete. 2024-09-21T07:53:06.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:06.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:06.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:06.285 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T07:53:06.287 INFO:tasks.cephadm:Deploying osd.1 on smithi119 with /dev/vg_nvme/lv_4... 2024-09-21T07:53:06.288 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:53:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:53:06.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:06.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:06.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:07 smithi006 ceph-mon[30970]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:07 smithi145 ceph-mon[34049]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:07 smithi119 ceph-mon[33564]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:08.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:08 smithi119 ceph-mon[33564]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:53:08.398 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:08 smithi006 ceph-mon[30970]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:53:08.398 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:53:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T07:53:08.097+0000 7fe2edb45640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:53:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:08 smithi145 ceph-mon[34049]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:53:09.075 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:53:09.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-09-21T07:53:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:53:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:09 smithi119 ceph-mon[33564]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:09 smithi119 ceph-mon[33564]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:53:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:09 smithi119 ceph-mon[33564]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:53:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:09 smithi119 ceph-mon[33564]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:53:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:09 smithi145 ceph-mon[34049]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:09 smithi145 ceph-mon[34049]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:53:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:09 smithi145 ceph-mon[34049]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:53:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:09 smithi145 ceph-mon[34049]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:53:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-mon[30970]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-mon[30970]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:53:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-mon[30970]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:53:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-mon[30970]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:53:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:09.461 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T07:53:09.193+0000 7fe2e9ac7640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:53:09.461 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:53:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T07:53:09.198+0000 7fe2e58c5640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 -- 172.21.15.119:0/249791535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 msgr2=0x7fb7b4110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/249791535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b4110310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009ca0 tx=0x7fb7ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 -- 172.21.15.119:0/249791535 shutdown_connections 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/249791535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b4110310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/249791535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41052f0 0x7fb7b410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/249791535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41048c0 0x7fb7b4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 -- 172.21.15.119:0/249791535 >> 172.21.15.119:0/249791535 conn(0x7fb7b4079740 msgr2=0x7fb7b4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 -- 172.21.15.119:0/249791535 shutdown_connections 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.851+0000 7fb7b9c52640 1 -- 172.21.15.119:0/249791535 wait complete. 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 Processor -- start 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 -- start start 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41048c0 0x7fb7b419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41052f0 0x7fb7b419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4113980 con 0x7fb7b41048c0 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4113800 con 0x7fb7b410de70 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b9c52640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4113b00 con 0x7fb7b41052f0 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:09.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41048c0 0x7fb7b419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57542/0 (socket says 172.21.15.119:57542) 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 -- 172.21.15.119:0/3665308789 learned_addr learned my addr 172.21.15.119:0/3665308789 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7abfff640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41052f0 0x7fb7b419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 -- 172.21.15.119:0/3665308789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41052f0 msgr2=0x7fb7b419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41052f0 0x7fb7b419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 -- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41048c0 msgr2=0x7fb7b419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41048c0 0x7fb7b419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.852+0000 7fb7b3fff640 1 -- 172.21.15.119:0/3665308789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b41a0320 con 0x7fb7b410de70 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b3fff640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac031040 tx=0x7fb7ac032bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac004040 con 0x7fb7b410de70 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7ac004670 con 0x7fb7b410de70 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac030bb0 con 0x7fb7b410de70 2024-09-21T07:53:09.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b41a05b0 con 0x7fb7b410de70 2024-09-21T07:53:09.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.853+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b41a6d70 con 0x7fb7b410de70 2024-09-21T07:53:09.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.854+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b406c180 con 0x7fb7b410de70 2024-09-21T07:53:09.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.856+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fb7ac0041e0 con 0x7fb7b410de70 2024-09-21T07:53:09.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.856+0000 7fb7b17fa640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 0x7fb7a00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:09.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.856+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7fb7ac106bf0 con 0x7fb7b410de70 2024-09-21T07:53:09.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.857+0000 7fb7b37fe640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 0x7fb7a00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:09.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.857+0000 7fb7b37fe640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 0x7fb7a00b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4005fd0 tx=0x7fb7a400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:09.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:09.860+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7ac0cef30 con 0x7fb7b410de70 2024-09-21T07:53:10.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:10.046+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb7b4063800 con 0x7fb7a00b64d0 2024-09-21T07:53:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:53:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:53:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi006 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:10.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi006 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:10.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:10.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:53:10.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:53:10.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi006 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 17092M 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:10.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:11.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] boot 2024-09-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:53:11.390 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] boot 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:53:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:53:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:53:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:53:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: osd.0 [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] boot 2024-09-21T07:53:11.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:53:11.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:53:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:12 smithi119 ceph-mon[33564]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:53:12.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:12 smithi145 ceph-mon[34049]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:53:12.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:12 smithi006 ceph-mon[30970]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:53:13.648 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:13.648 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/3536751902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"}]': finished 2024-09-21T07:53:13.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:53:13.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:13.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/290171459' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/3536751902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"}]': finished 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/290171459' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/3536751902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"} : dispatch 2024-09-21T07:53:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93cedb16-3deb-4ddc-b6fa-38e5abf65026"}]': finished 2024-09-21T07:53:13.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:53:13.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:13.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/290171459' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:14.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:14 smithi119 ceph-mon[33564]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:14.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:14 smithi145 ceph-mon[34049]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:14.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:14 smithi006 ceph-mon[30970]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:16.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:16 smithi119 ceph-mon[33564]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:16 smithi145 ceph-mon[34049]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:16.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:16 smithi006 ceph-mon[30970]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:18.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:18 smithi119 ceph-mon[33564]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:18.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:18 smithi145 ceph-mon[34049]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:18.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:18 smithi006 ceph-mon[30970]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:20.894 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:20 smithi119 ceph-mon[33564]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:20.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:20 smithi145 ceph-mon[34049]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:20.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:20 smithi006 ceph-mon[30970]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:21.903 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:53:21.903 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:21.903 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:21 smithi119 ceph-mon[33564]: Deploying daemon osd.1 on smithi119 2024-09-21T07:53:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:53:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:21 smithi145 ceph-mon[34049]: Deploying daemon osd.1 on smithi119 2024-09-21T07:53:21.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:53:21.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:21.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:21 smithi006 ceph-mon[30970]: Deploying daemon osd.1 on smithi119 2024-09-21T07:53:22.906 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:22 smithi119 ceph-mon[33564]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:22.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:22 smithi145 ceph-mon[34049]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:22.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:22 smithi006 ceph-mon[30970]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:24 smithi119 ceph-mon[33564]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:24 smithi145 ceph-mon[34049]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:24 smithi006 ceph-mon[30970]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:26.771 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:26 smithi119 ceph-mon[33564]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:26 smithi145 ceph-mon[34049]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:26.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:26 smithi006 ceph-mon[30970]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:27.540 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:27.540 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:27.540 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:27.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:27.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:27.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:28 smithi119 ceph-mon[33564]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:28 smithi145 ceph-mon[34049]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:29.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:28 smithi006 ceph-mon[30970]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.437+0000 7fb7b17fa640 1 -- 172.21.15.119:0/3665308789 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb7b4063800 con 0x7fb7a00b64d0 2024-09-21T07:53:30.439 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 1 on host 'smithi119' 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 msgr2=0x7fb7a00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 0x7fb7a00b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4005fd0 tx=0x7fb7a400b390 comp rx=0 tx=0).stop 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 msgr2=0x7fb7b419fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac031040 tx=0x7fb7ac032bc0 comp rx=0 tx=0).stop 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 shutdown_connections 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb7a00b64d0 0x7fb7a00b89e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7b41052f0 0x7fb7b419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b410de70 0x7fb7b419fbf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 --2- 172.21.15.119:0/3665308789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7b41048c0 0x7fb7b419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 >> 172.21.15.119:0/3665308789 conn(0x7fb7b4079740 msgr2=0x7fb7b4100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.439+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 shutdown_connections 2024-09-21T07:53:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:53:30.440+0000 7fb7b9c52640 1 -- 172.21.15.119:0/3665308789 wait complete. 2024-09-21T07:53:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:30.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:30.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:30.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:30.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:31.061 DEBUG:teuthology.orchestra.run.smithi119:osd.1> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T07:53:31.064 INFO:tasks.cephadm:Deploying osd.2 on smithi145 with /dev/vg_nvme/lv_4... 2024-09-21T07:53:31.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:53:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:53:32.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:32 smithi145 ceph-mon[34049]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:32.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:32 smithi119 ceph-mon[33564]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:32.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:32 smithi006 ceph-mon[30970]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:33.113 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:53:32 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T07:53:32.737+0000 7fa0c35d7640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:53:33.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:33 smithi145 ceph-mon[34049]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:33.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:33 smithi145 ceph-mon[34049]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:33.722 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:53:33.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-09-21T07:53:33.845 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:33 smithi119 ceph-mon[33564]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:33.845 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:33 smithi119 ceph-mon[33564]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:33.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:33 smithi006 ceph-mon[30970]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:33.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:33 smithi006 ceph-mon[30970]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:53:34.006 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 -- 172.21.15.145:0/903404255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 msgr2=0x7f4f641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 --2- 172.21.15.145:0/903404255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f641087b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009900 tx=0x7f4f4c02a410 comp rx=0 tx=0).stop 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 -- 172.21.15.145:0/903404255 shutdown_connections 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 --2- 172.21.15.145:0/903404255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f641087b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 --2- 172.21.15.145:0/903404255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 0x7f4f6410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 --2- 172.21.15.145:0/903404255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 0x7f4f64102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.531+0000 7f4f6a771640 1 -- 172.21.15.145:0/903404255 >> 172.21.15.145:0/903404255 conn(0x7f4f64079730 msgr2=0x7f4f64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- 172.21.15.145:0/903404255 shutdown_connections 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- 172.21.15.145:0/903404255 wait complete. 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 Processor -- start 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- start start 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 0x7f4f6419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 0x7f4f641a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64112810 con 0x7f4f64108cf0 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64112690 con 0x7f4f64102a60 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.532+0000 7f4f6a771640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64112990 con 0x7f4f641083a0 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:53946/0 (socket says 172.21.15.145:53946) 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 -- 172.21.15.145:0/1418259011 learned_addr learned my addr 172.21.15.145:0/1418259011 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-21T07:53:34.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f63fff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 0x7f4f6419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f68d0e640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 0x7f4f641a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 -- 172.21.15.145:0/1418259011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 msgr2=0x7f4f6419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 0x7f4f6419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 -- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 msgr2=0x7f4f641a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 0x7f4f641a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 -- 172.21.15.145:0/1418259011 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f641a2440 con 0x7f4f641083a0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f5bfff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005940 tx=0x7f4f4c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c03f030 con 0x7f4f641083a0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f4c003c90 con 0x7f4f641083a0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f641a26d0 con 0x7f4f641083a0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c035070 con 0x7f4f641083a0 2024-09-21T07:53:34.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.533+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f641a2bb0 con 0x7f4f641083a0 2024-09-21T07:53:34.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.535+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64102e70 con 0x7f4f641083a0 2024-09-21T07:53:34.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.536+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f4f4c042030 con 0x7f4f641083a0 2024-09-21T07:53:34.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.537+0000 7f4f61ffb640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 0x7f4f500b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.537+0000 7f4f63fff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 0x7f4f500b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.537+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2118+0+0 (secure 0 0 0) 0x7f4f4c106310 con 0x7f4f641083a0 2024-09-21T07:53:34.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.538+0000 7f4f63fff640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 0x7f4f500b8a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f54005d00 tx=0x7f4f5400b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.541+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f4c0ce490 con 0x7f4f641083a0 2024-09-21T07:53:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:53:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:53:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi119 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:34.731+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4f6406b5d0 con 0x7f4f500b6500 2024-09-21T07:53:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:53:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi119 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:53:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi119 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:34.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:35.408 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T07:53:35.015+0000 7fa0bf559640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:53:35.408 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T07:53:35.020+0000 7fa0b734f640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:53:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:53:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:53:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:35.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:35.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:35.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:35.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:35 smithi145 ceph-mon[34049]: from='osd.1 ' entity='osd.1' 2024-09-21T07:53:35.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:53:35.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:35 smithi119 ceph-mon[33564]: from='osd.1 ' entity='osd.1' 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:35.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:35 smithi006 ceph-mon[30970]: from='osd.1 ' entity='osd.1' 2024-09-21T07:53:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] boot 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:53:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:53:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:53:36.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:36.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:36.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] boot 2024-09-21T07:53:36.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:53:36.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: osd.1 [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] boot 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:53:36.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:53:37.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/3330621999' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"}]': finished 2024-09-21T07:53:37.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:53:37.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:37.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:37 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/1708424083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/3330621999' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"}]': finished 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/1708424083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:37.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/3330621999' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"} : dispatch 2024-09-21T07:53:37.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67832f5-9808-4579-b997-627e0a1363dc"}]': finished 2024-09-21T07:53:37.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:53:37.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:37.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:37 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/1708424083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:53:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:38 smithi119 ceph-mon[33564]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:38 smithi145 ceph-mon[34049]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:38 smithi006 ceph-mon[30970]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:40 smithi119 ceph-mon[33564]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:40 smithi145 ceph-mon[34049]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:41.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:40 smithi006 ceph-mon[30970]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:43.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:42 smithi006 ceph-mon[30970]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:43.290 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:42 smithi145 ceph-mon[34049]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:42 smithi119 ceph-mon[33564]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:44 smithi145 ceph-mon[34049]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:44 smithi119 ceph-mon[33564]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:45.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:44 smithi006 ceph-mon[30970]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:46.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:45 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:53:46.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:45 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:46.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:45 smithi145 ceph-mon[34049]: Deploying daemon osd.2 on smithi145 2024-09-21T07:53:46.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:45 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:53:46.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:45 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:46.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:45 smithi119 ceph-mon[33564]: Deploying daemon osd.2 on smithi145 2024-09-21T07:53:46.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:45 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:53:46.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:45 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:46.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:45 smithi006 ceph-mon[30970]: Deploying daemon osd.2 on smithi145 2024-09-21T07:53:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:46 smithi145 ceph-mon[34049]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:46 smithi119 ceph-mon[33564]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:47.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:46 smithi006 ceph-mon[30970]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:48 smithi119 ceph-mon[33564]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:48 smithi145 ceph-mon[34049]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:49.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:48 smithi006 ceph-mon[30970]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:51.175 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:51 smithi145 ceph-mon[34049]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:51 smithi119 ceph-mon[33564]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:51 smithi006 ceph-mon[30970]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:52.113 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:52.113 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:52.113 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:52.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:53.320 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:53 smithi145 ceph-mon[34049]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:53 smithi119 ceph-mon[33564]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:53.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:53 smithi006 ceph-mon[30970]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:55.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:55.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:55.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:55.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:55.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.465+0000 7f4f61ffb640 1 -- 172.21.15.145:0/1418259011 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f6406b5d0 con 0x7f4f500b6500 2024-09-21T07:53:55.467 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 2 on host 'smithi145' 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 msgr2=0x7f4f500b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 0x7f4f500b8a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f54005d00 tx=0x7f4f5400b410 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 msgr2=0x7f4f6419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005940 tx=0x7f4f4c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 shutdown_connections 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4f500b6500 0x7f4f500b8a10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f641083a0 0x7f4f6419cb30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f64108cf0 0x7f4f641a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 --2- 172.21.15.145:0/1418259011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f64102a60 0x7f4f6419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 >> 172.21.15.145:0/1418259011 conn(0x7f4f64079730 msgr2=0x7f4f6406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 shutdown_connections 2024-09-21T07:53:55.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:53:55.468+0000 7f4f6a771640 1 -- 172.21.15.145:0/1418259011 wait complete. 2024-09-21T07:53:56.088 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:56.088 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.088 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.122 DEBUG:teuthology.orchestra.run.smithi145:osd.2> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T07:53:56.124 INFO:tasks.cephadm:Deploying osd.3 on smithi006 with /dev/vg_nvme/lv_3... 2024-09-21T07:53:56.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:53:56.154 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:56.154 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.154 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:56.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:53:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:56 smithi119 ceph-mon[33564]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:56 smithi145 ceph-mon[34049]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:57.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:56 smithi006 ceph-mon[30970]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:57.886 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:53:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T07:53:57.524+0000 7fbb71a66640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:53:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:57 smithi119 ceph-mon[33564]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:57 smithi119 ceph-mon[33564]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:57 smithi145 ceph-mon[34049]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:57 smithi145 ceph-mon[34049]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:58.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:57 smithi006 ceph-mon[30970]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:58.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:57 smithi006 ceph-mon[30970]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:53:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:59.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:59.188 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.188 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:59.188 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:59.188 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:53:59.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T07:53:58.895+0000 7fbb6d9e8640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:53:59.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T07:53:58.899+0000 7fbb697e6640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:59.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:59.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:53:59.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2024-09-21T07:53:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:53:59.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 -- 172.21.15.6:0/3266602536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0214108cf0 msgr2=0x7f021410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:59.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 --2- 172.21.15.6:0/3266602536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0214108cf0 0x7f021410f520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0204009ca0 tx=0x7f020402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 -- 172.21.15.6:0/3266602536 shutdown_connections 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 --2- 172.21.15.6:0/3266602536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02141083a0 0x7f02141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 --2- 172.21.15.6:0/3266602536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0214108cf0 0x7f021410f520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 --2- 172.21.15.6:0/3266602536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 0x7f0214102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 -- 172.21.15.6:0/3266602536 >> 172.21.15.6:0/3266602536 conn(0x7f0214079730 msgr2=0x7f0214079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 -- 172.21.15.6:0/3266602536 shutdown_connections 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.994+0000 7f021acb2640 1 -- 172.21.15.6:0/3266602536 wait complete. 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 Processor -- start 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 -- start start 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 0x7f021419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0214108cf0 0x7f021419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113980 con 0x7f02141083a0 2024-09-21T07:53:59.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113800 con 0x7f0214102a60 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f021acb2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113b00 con 0x7f0214108cf0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f0213fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f0213fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50150/0 (socket says 172.21.15.6:50150) 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.995+0000 7f0213fff640 1 -- 172.21.15.6:0/3596973559 learned_addr learned my addr 172.21.15.6:0/3596973559 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0218a4e640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 0x7f021419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f021924f640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0214108cf0 0x7f021419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 -- 172.21.15.6:0/3596973559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0214108cf0 msgr2=0x7f021419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0214108cf0 0x7f021419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 -- 172.21.15.6:0/3596973559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 msgr2=0x7f021419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 0x7f021419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 -- 172.21.15.6:0/3596973559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02141a02a0 con 0x7f02141083a0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0213fff640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00d770 tx=0x7f01fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc017070 con 0x7f02141083a0 2024-09-21T07:54:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01fc009c30 con 0x7f02141083a0 2024-09-21T07:54:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02141a0590 con 0x7f02141083a0 2024-09-21T07:54:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00f620 con 0x7f02141083a0 2024-09-21T07:54:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.996+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02141a6cf0 con 0x7f02141083a0 2024-09-21T07:54:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.998+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214102e70 con 0x7f02141083a0 2024-09-21T07:54:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:53:59.999+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f01fc01a070 con 0x7f02141083a0 2024-09-21T07:54:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.000+0000 7f0211ffb640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 0x7f02000b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.000+0000 7f0218a4e640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 0x7f02000b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.000+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3066+0+0 (secure 0 0 0) 0x7f01fc0e57e0 con 0x7f02141083a0 2024-09-21T07:54:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.001+0000 7f0218a4e640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 0x7f02000b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f020c00bbe0 tx=0x7f020c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.003+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01fc009de0 con 0x7f02141083a0 2024-09-21T07:54:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi145 2024-09-21T07:54:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-21T07:54:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:54:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:54:00.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:00.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:53:59 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:00.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi145 2024-09-21T07:54:00.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-21T07:54:00.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:54:00.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:54:00.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:00.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:53:59 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:00.201+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0214063800 con 0x7f02000b64d0 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi145 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:00.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:53:59 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:54:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:54:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:54:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] boot 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:01.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] boot 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:01.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:01.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:01.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: osd.2 [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] boot 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:01 smithi145 ceph-mon[34049]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:54:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:01 smithi006 ceph-mon[30970]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:54:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:01 smithi119 ceph-mon[33564]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:54:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52447]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52447]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52447]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52450]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52450]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.013 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52450]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: pgmap v67: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:03.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"} : dispatch 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"}]': finished 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52459]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.015 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:02 smithi006 sudo[52462]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42223]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42223]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42226]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42226]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.159 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 07:54:02 smithi119 sudo[42226]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: pgmap v67: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:03.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:54:03.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"} : dispatch 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"}]': finished 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42229]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42229]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42232]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42232]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 sudo[42232]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42572]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42572]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.193 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42572]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.194 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42575]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.194 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42575]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.194 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.194 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42575]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: pgmap v67: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:03.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:54:03.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"} : dispatch 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1592376498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4"}]': finished 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42578]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:02 smithi145 sudo[42578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 sudo[42578]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 sudo[42581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 sudo[42581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:54:03.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 sudo[42581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:54:03.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 sudo[42581]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:54:03.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:03.957+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f01fc0a91f0 con 0x7f02141083a0 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/969864107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:04.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:54:04.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/969864107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:04.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:54:04.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:54:04.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:54:04.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/969864107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:04.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:54:04.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:05.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:04 smithi006 ceph-mon[30970]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:05.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:04 smithi006 ceph-mon[30970]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:54:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:04 smithi119 ceph-mon[33564]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:04 smithi119 ceph-mon[33564]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:54:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:04 smithi145 ceph-mon[34049]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:04 smithi145 ceph-mon[34049]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:54:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:06 smithi006 ceph-mon[30970]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:06 smithi119 ceph-mon[33564]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:06 smithi145 ceph-mon[34049]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:09.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:08 smithi006 ceph-mon[30970]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:09.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:08 smithi119 ceph-mon[33564]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:08 smithi145 ceph-mon[34049]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:11.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:10 smithi006 ceph-mon[30970]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:10 smithi119 ceph-mon[33564]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:10 smithi145 ceph-mon[34049]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:12.344 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:54:12.345 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:54:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:12.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:54:12.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:12 smithi006 ceph-mon[30970]: Deploying daemon osd.3 on smithi006 2024-09-21T07:54:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:12 smithi006 ceph-mon[30970]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:13.309 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:12 smithi119 ceph-mon[33564]: Deploying daemon osd.3 on smithi006 2024-09-21T07:54:13.309 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:12 smithi119 ceph-mon[33564]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:12 smithi145 ceph-mon[34049]: Deploying daemon osd.3 on smithi006 2024-09-21T07:54:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:12 smithi145 ceph-mon[34049]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:15.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:14 smithi006 ceph-mon[30970]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:14 smithi119 ceph-mon[33564]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:14 smithi145 ceph-mon[34049]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:17.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:16 smithi006 ceph-mon[30970]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:16 smithi119 ceph-mon[33564]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:16 smithi145 ceph-mon[34049]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:18.274 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:18.275 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:18.275 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:19.266 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:19 smithi006 ceph-mon[30970]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:19 smithi119 ceph-mon[33564]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:19 smithi145 ceph-mon[34049]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:21.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:21.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:21.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:21.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.422+0000 7f0211ffb640 1 -- 172.21.15.6:0/3596973559 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0214063800 con 0x7f02000b64d0 2024-09-21T07:54:21.424 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 3 on host 'smithi006' 2024-09-21T07:54:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 msgr2=0x7f02000b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 0x7f02000b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f020c00bbe0 tx=0x7f020c00b390 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 msgr2=0x7f021419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00d770 tx=0x7f01fc00dc30 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 shutdown_connections 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02000b64d0 0x7f02000b89e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0214108cf0 0x7f021419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02141083a0 0x7f021419a8d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 --2- 172.21.15.6:0/3596973559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0214102a60 0x7f021419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 >> 172.21.15.6:0/3596973559 conn(0x7f0214079730 msgr2=0x7f02141043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 shutdown_connections 2024-09-21T07:54:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:54:21.425+0000 7f021acb2640 1 -- 172.21.15.6:0/3596973559 wait complete. 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.110 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:22.110 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.110 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.138 DEBUG:teuthology.orchestra.run.smithi006:osd.3> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T07:54:22.140 INFO:tasks.cephadm:Deploying osd.4 on smithi119 with /dev/vg_nvme/lv_3... 2024-09-21T07:54:22.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:54:22.396 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:54:22.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:22.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:22.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:22.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:23 smithi119 ceph-mon[33564]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:23.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:23 smithi006 ceph-mon[30970]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:23 smithi145 ceph-mon[34049]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:23.564 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 07:54:23 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T07:54:23.278+0000 7f257d9a1640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:54:24.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:24 smithi119 ceph-mon[33564]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:54:24.336 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:24 smithi006 ceph-mon[30970]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:54:24.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:24 smithi145 ceph-mon[34049]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:54:24.961 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:54:24.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-09-21T07:54:25.239 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:54:25.359 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:25 smithi119 ceph-mon[33564]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:25.359 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:25 smithi119 ceph-mon[33564]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:54:25.359 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:25 smithi119 ceph-mon[33564]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:54:25.360 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:25 smithi119 ceph-mon[33564]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:54:25.360 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:25 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:25 smithi145 ceph-mon[34049]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:25 smithi145 ceph-mon[34049]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:54:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:25 smithi145 ceph-mon[34049]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:54:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:25 smithi145 ceph-mon[34049]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:54:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:25 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-mon[30970]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-mon[30970]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:54:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-mon[30970]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:54:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-mon[30970]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:54:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:25.461 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T07:54:25.026+0000 7f2579923640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:54:25.461 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 07:54:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T07:54:25.032+0000 7f2575721640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 -- 172.21.15.119:0/163340782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc104a30 msgr2=0x7f01cc104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 --2- 172.21.15.119:0/163340782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc104a30 0x7f01cc104e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009ca0 tx=0x7f01bc02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 -- 172.21.15.119:0/163340782 shutdown_connections 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 --2- 172.21.15.119:0/163340782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc10de60 0x7f01cc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 --2- 172.21.15.119:0/163340782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc105380 0x7f01cc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 --2- 172.21.15.119:0/163340782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc104a30 0x7f01cc104e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 -- 172.21.15.119:0/163340782 >> 172.21.15.119:0/163340782 conn(0x7f01cc079760 msgr2=0x7f01cc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:25.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 -- 172.21.15.119:0/163340782 shutdown_connections 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.728+0000 7f01d13ca640 1 -- 172.21.15.119:0/163340782 wait complete. 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 Processor -- start 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 -- start start 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc104a30 0x7f01cc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc10de60 0x7f01cc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc113a80 con 0x7f01cc10de60 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc113900 con 0x7f01cc105380 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01d13ca640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc113c00 con 0x7f01cc104a30 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01ca7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56764/0 (socket says 172.21.15.119:56764) 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01ca7fc640 1 -- 172.21.15.119:0/1405840427 learned_addr learned my addr 172.21.15.119:0/1405840427 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T07:54:25.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.729+0000 7f01cb7fe640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc10de60 0x7f01cc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01caffd640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc104a30 0x7f01cc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 -- 172.21.15.119:0/1405840427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc104a30 msgr2=0x7f01cc19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc104a30 0x7f01cc19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 -- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc10de60 msgr2=0x7f01cc19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc10de60 0x7f01cc19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 -- 172.21.15.119:0/1405840427 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1a04a0 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01ca7fc640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f01c0006fd0 tx=0x7f01c000b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011830 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01c0016070 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1a0790 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0010d30 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.730+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1a6ef0 con 0x7f01cc105380 2024-09-21T07:54:25.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.731+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc104ec0 con 0x7f01cc105380 2024-09-21T07:54:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.733+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f01c00119d0 con 0x7f01cc105380 2024-09-21T07:54:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.733+0000 7f01b3fff640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 0x7f01b40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.734+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7f01c00e5c90 con 0x7f01cc105380 2024-09-21T07:54:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.734+0000 7f01caffd640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 0x7f01b40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:25.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.734+0000 7f01caffd640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 0x7f01b40b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01bc006010 tx=0x7f01bc000f40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:25.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.737+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01c00ad780 con 0x7f01cc105380 2024-09-21T07:54:25.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:25.924+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f01cc063800 con 0x7f01b40b6560 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi006 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-21T07:54:26.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:26.306 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:26.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:54:26.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:54:26.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi006 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:26.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:26.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi006 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 8546M 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:26.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] boot 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:54:27.317 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:54:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:54:27.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:27.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:27.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] boot 2024-09-21T07:54:27.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:54:27.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: osd.3 [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] boot 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:54:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:54:28.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:28 smithi119 ceph-mon[33564]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:54:28.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:28 smithi145 ceph-mon[34049]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:54:28.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:28 smithi006 ceph-mon[30970]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:54:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:54:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/794040447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"}]': finished 2024-09-21T07:54:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:54:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:29.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/1087394163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/794040447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"}]': finished 2024-09-21T07:54:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:54:29.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:29.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/1087394163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/794040447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"} : dispatch 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a92a8a1e-7783-42c7-8724-62e824581e6d"}]': finished 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/1087394163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:31 smithi119 ceph-mon[33564]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:31 smithi145 ceph-mon[34049]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:31.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:31 smithi006 ceph-mon[30970]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:33.321 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:33 smithi119 ceph-mon[33564]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:33 smithi145 ceph-mon[34049]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:33.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:33 smithi006 ceph-mon[30970]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:35 smithi119 ceph-mon[33564]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T07:54:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:35 smithi145 ceph-mon[34049]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T07:54:35.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:35 smithi006 ceph-mon[30970]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T07:54:37.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:37 smithi119 ceph-mon[33564]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:54:37.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:54:37.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:37 smithi145 ceph-mon[34049]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:54:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:54:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:37.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:37 smithi006 ceph-mon[30970]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:54:37.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:54:37.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:38.121 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:38 smithi119 ceph-mon[33564]: Deploying daemon osd.4 on smithi119 2024-09-21T07:54:38.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:38 smithi145 ceph-mon[34049]: Deploying daemon osd.4 on smithi119 2024-09-21T07:54:38.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:38 smithi006 ceph-mon[30970]: Deploying daemon osd.4 on smithi119 2024-09-21T07:54:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:39 smithi119 ceph-mon[33564]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T07:54:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:39 smithi145 ceph-mon[34049]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T07:54:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:39 smithi006 ceph-mon[30970]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T07:54:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:41 smithi119 ceph-mon[33564]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:54:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:41 smithi145 ceph-mon[34049]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:54:41.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:41 smithi006 ceph-mon[30970]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:54:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:43 smithi119 ceph-mon[33564]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:43 smithi145 ceph-mon[34049]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:43 smithi006 ceph-mon[30970]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:44.290 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:44.290 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:44.290 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:44.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:44.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:44.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:45 smithi119 ceph-mon[33564]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:45 smithi145 ceph-mon[34049]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:45.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:45 smithi006 ceph-mon[30970]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:46.982 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.692+0000 7f01b3fff640 1 -- 172.21.15.119:0/1405840427 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f01cc063800 con 0x7f01b40b6560 2024-09-21T07:54:47.694 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 4 on host 'smithi119' 2024-09-21T07:54:47.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 msgr2=0x7f01b40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:47.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 0x7f01b40b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01bc006010 tx=0x7f01bc000f40 comp rx=0 tx=0).stop 2024-09-21T07:54:47.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 msgr2=0x7f01cc19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f01c0006fd0 tx=0x7f01c000b8e0 comp rx=0 tx=0).stop 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 shutdown_connections 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01b40b6560 0x7f01b40b8a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01cc10de60 0x7f01cc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01cc105380 0x7f01cc19aad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 --2- 172.21.15.119:0/1405840427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01cc104a30 0x7f01cc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 >> 172.21.15.119:0/1405840427 conn(0x7f01cc079760 msgr2=0x7f01cc100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 shutdown_connections 2024-09-21T07:54:47.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:54:47.695+0000 7f01d13ca640 1 -- 172.21.15.119:0/1405840427 wait complete. 2024-09-21T07:54:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:48.340 DEBUG:teuthology.orchestra.run.smithi119:osd.4> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T07:54:48.342 INFO:tasks.cephadm:Deploying osd.5 on smithi145 with /dev/vg_nvme/lv_3... 2024-09-21T07:54:48.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:54:48.596 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:54:48.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:48 smithi119 ceph-mon[33564]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:49.050 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:48 smithi145 ceph-mon[34049]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:49.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:48 smithi006 ceph-mon[30970]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:49.517 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 07:54:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T07:54:49.184+0000 7f04c7e6c640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:54:49.852 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:49 smithi119 ceph-mon[33564]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:49.852 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:49 smithi119 ceph-mon[33564]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:50.075 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:49 smithi145 ceph-mon[34049]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:50.075 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:49 smithi145 ceph-mon[34049]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:50.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:49 smithi006 ceph-mon[30970]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:50.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:49 smithi006 ceph-mon[30970]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:54:50.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:50.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:54:50.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:50.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:54:50.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:50.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-mon[33564]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:50.909 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T07:54:50.752+0000 7f04c3dee640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:54:50.909 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 07:54:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T07:54:50.758+0000 7f04bfbec640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:54:51.153 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:51.153 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:54:51.153 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:51.154 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:54:51.154 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:51.154 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:50 smithi145 ceph-mon[34049]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:51.156 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:54:51.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: from='osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:51.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:50 smithi006 ceph-mon[30970]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:54:51.422 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:51.832 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:51.833 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:51.833 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:51.833 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:51.833 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:51.833 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:51.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 -- 172.21.15.145:0/4126929797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 msgr2=0x7f48dc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4126929797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc10f550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009900 tx=0x7f48d402a410 comp rx=0 tx=0).stop 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 -- 172.21.15.145:0/4126929797 shutdown_connections 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4126929797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc10f550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4126929797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 0x7f48dc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4126929797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 -- 172.21.15.145:0/4126929797 >> 172.21.15.145:0/4126929797 conn(0x7f48dc079760 msgr2=0x7f48dc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 -- 172.21.15.145:0/4126929797 shutdown_connections 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.924+0000 7f48e3c34640 1 -- 172.21.15.145:0/4126929797 wait complete. 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 Processor -- start 2024-09-21T07:54:51.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 -- start start 2024-09-21T07:54:51.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 0x7f48dc199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc112920 con 0x7f48dc102ae0 2024-09-21T07:54:51.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1127a0 con 0x7f48dc1083d0 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e3c34640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc112aa0 con 0x7f48dc108d20 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e21d1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e21d1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41434/0 (socket says 172.21.15.145:41434) 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.925+0000 7f48e21d1640 1 -- 172.21.15.145:0/4187906148 learned_addr learned my addr 172.21.15.145:0/4187906148 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e11cf640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 0x7f48dc199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e19d0640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 -- 172.21.15.145:0/4187906148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 msgr2=0x7f48dc199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 0x7f48dc199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 -- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 msgr2=0x7f48dc1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 -- 172.21.15.145:0/4187906148 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc19f320 con 0x7f48dc108d20 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e19d0640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:51.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e21d1640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005ab0 tx=0x7f48d40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d403f030 con 0x7f48dc108d20 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48d4003c90 con 0x7f48dc108d20 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc19f5b0 con 0x7f48dc108d20 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4035070 con 0x7f48dc108d20 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.926+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc1a5d70 con 0x7f48dc108d20 2024-09-21T07:54:51.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.927+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48dc102f70 con 0x7f48dc108d20 2024-09-21T07:54:51.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.929+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f48d4042030 con 0x7f48dc108d20 2024-09-21T07:54:51.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.929+0000 7f48daffd640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 0x7f48c40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.929+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4316+0+0 (secure 0 0 0) 0x7f48d4106d90 con 0x7f48dc108d20 2024-09-21T07:54:51.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.930+0000 7f48e19d0640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 0x7f48c40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.930+0000 7f48e19d0640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 0x7f48c40b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009fa0 tx=0x7f48cc009570 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:51.933+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48d40ce5c0 con 0x7f48dc108d20 2024-09-21T07:54:52.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:54:52.119+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f48dc063800 con 0x7f48c40b6560 2024-09-21T07:54:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:54:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:54:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:52.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:52.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:54:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:54:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:54:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi119 2024-09-21T07:54:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T07:54:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] boot 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi119 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] boot 2024-09-21T07:54:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:54:53.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:53.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:53.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:53.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:53.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi119 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: osd.4 [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] boot 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:54:53.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:54:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:54:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:54:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:54:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:54.054 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:53 smithi006 ceph-mon[30970]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:54:54.061 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:53 smithi145 ceph-mon[34049]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:54:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:53 smithi119 ceph-mon[33564]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/2314124482' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"}]': finished 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:54:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/2314124482' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"}]': finished 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:54:55.080 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/2314124482' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"} : dispatch 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80b6eb01-3f7b-472a-aee0-0c1f8ff4e278"}]': finished 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:54:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:54:56.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:55 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/3276385784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:55 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/3276385784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:56.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:55 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/3276385784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:54:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:56 smithi119 ceph-mon[33564]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:56 smithi145 ceph-mon[34049]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:57.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:56 smithi006 ceph-mon[30970]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:54:58 smithi119 ceph-mon[33564]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:54:58 smithi145 ceph-mon[34049]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:54:59.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:54:58 smithi006 ceph-mon[30970]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:01.067 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:00 smithi145 ceph-mon[34049]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:00 smithi119 ceph-mon[33564]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:00 smithi006 ceph-mon[30970]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:03.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:02 smithi119 ceph-mon[33564]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:02 smithi145 ceph-mon[34049]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:03.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:02 smithi006 ceph-mon[30970]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:55:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:03 smithi145 ceph-mon[34049]: Deploying daemon osd.5 on smithi145 2024-09-21T07:55:04.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:55:04.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:04.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:03 smithi119 ceph-mon[33564]: Deploying daemon osd.5 on smithi145 2024-09-21T07:55:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:55:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:03 smithi006 ceph-mon[30970]: Deploying daemon osd.5 on smithi145 2024-09-21T07:55:04.935 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:04 smithi145 ceph-mon[34049]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:05.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:04 smithi119 ceph-mon[33564]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:05.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:04 smithi006 ceph-mon[30970]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:07.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:06 smithi119 ceph-mon[33564]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:07.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:06 smithi145 ceph-mon[34049]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:06 smithi006 ceph-mon[30970]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:08.903 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:08 smithi145 ceph-mon[34049]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:09.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:08 smithi119 ceph-mon[33564]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:09.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:08 smithi006 ceph-mon[30970]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:09.898 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:09.898 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:09.898 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:10.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:10.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:10.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:10.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:10.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:10.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:11 smithi145 ceph-mon[34049]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:11 smithi006 ceph-mon[30970]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:11 smithi119 ceph-mon[33564]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:12.845 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:12.845 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:12.845 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:12.846 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:12.846 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:12.846 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.128+0000 7f48daffd640 1 -- 172.21.15.145:0/4187906148 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f48dc063800 con 0x7f48c40b6560 2024-09-21T07:55:13.130 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 5 on host 'smithi145' 2024-09-21T07:55:13.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 msgr2=0x7f48c40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 0x7f48c40b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009fa0 tx=0x7f48cc009570 comp rx=0 tx=0).stop 2024-09-21T07:55:13.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 msgr2=0x7f48dc19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005ab0 tx=0x7f48d40042f0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 shutdown_connections 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f48c40b6560 0x7f48c40b8a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48dc108d20 0x7f48dc19ebf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48dc1083d0 0x7f48dc199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 --2- 172.21.15.145:0/4187906148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc102ae0 0x7f48dc1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.131+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 >> 172.21.15.145:0/4187906148 conn(0x7f48dc079760 msgr2=0x7f48dc105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.132+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 shutdown_connections 2024-09-21T07:55:13.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:55:13.132+0000 7f48e3c34640 1 -- 172.21.15.145:0/4187906148 wait complete. 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.850 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:13 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:13.850 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:13 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.850 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:13 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:13.877 DEBUG:teuthology.orchestra.run.smithi145:osd.5> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T07:55:13.880 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_2... 2024-09-21T07:55:13.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:55:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:55:14.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:13 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:14.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:13 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:14.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:13 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:14.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:13 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:14.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:13 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:14.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:13 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:15.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:15 smithi145 ceph-mon[34049]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:15 smithi119 ceph-mon[33564]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:15.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:15 smithi006 ceph-mon[30970]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:15.694 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 07:55:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T07:55:15.522+0000 7f09fffb5640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:55:16.389 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:16 smithi145 ceph-mon[34049]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.389 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:16 smithi145 ceph-mon[34049]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:16 smithi119 ceph-mon[33564]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:16 smithi119 ceph-mon[33564]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:16 smithi006 ceph-mon[30970]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:16 smithi006 ceph-mon[30970]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:55:16.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2024-09-21T07:55:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:55:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:55:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:55:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:17.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:17.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:17.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T07:55:17.144+0000 7f09fbf37640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:55:17.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T07:55:17.154+0000 7f09f7d35640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:55:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:55:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:55:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:17.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:17.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- 172.21.15.6:0/124307617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c102ae0 msgr2=0x7f0e3c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 --2- 172.21.15.6:0/124307617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c102ef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009900 tx=0x7f0e2c02a410 comp rx=0 tx=0).stop 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- 172.21.15.6:0/124307617 shutdown_connections 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 --2- 172.21.15.6:0/124307617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108d70 0x7f0e3c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 --2- 172.21.15.6:0/124307617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c108420 0x7f0e3c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 --2- 172.21.15.6:0/124307617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c102ef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- 172.21.15.6:0/124307617 >> 172.21.15.6:0/124307617 conn(0x7f0e3c079770 msgr2=0x7f0e3c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- 172.21.15.6:0/124307617 shutdown_connections 2024-09-21T07:55:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- 172.21.15.6:0/124307617 wait complete. 2024-09-21T07:55:17.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 Processor -- start 2024-09-21T07:55:17.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.638+0000 7f0e428fd640 1 -- start start 2024-09-21T07:55:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 0x7f0e3c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c112930 con 0x7f0e3c108d70 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c1127b0 con 0x7f0e3c102ae0 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e428fd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c112ab0 con 0x7f0e3c108420 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51914/0 (socket says 172.21.15.6:51914) 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 -- 172.21.15.6:0/3137365929 learned_addr learned my addr 172.21.15.6:0/3137365929 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e3bfff640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e3b7fe640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 0x7f0e3c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 -- 172.21.15.6:0/3137365929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 msgr2=0x7f0e3c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 0x7f0e3c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 -- 172.21.15.6:0/3137365929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c102ae0 msgr2=0x7f0e3c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 -- 172.21.15.6:0/3137365929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c1a0380 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e3b7fe640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 0x7f0e3c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.639+0000 7f0e40e9a640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400eb10 tx=0x7f0e3400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.640+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34004b20 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.640+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c1a0670 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.640+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e34004cc0 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.640+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34010690 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.640+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c1a6dd0 con 0x7f0e3c108d70 2024-09-21T07:55:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.641+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c103d60 con 0x7f0e3c108d70 2024-09-21T07:55:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.642+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f0e34005000 con 0x7f0e3c108d70 2024-09-21T07:55:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.643+0000 7f0e397fa640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 0x7f0e240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.644+0000 7f0e3bfff640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 0x7f0e240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.644+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f0e340e6be0 con 0x7f0e3c108d70 2024-09-21T07:55:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.644+0000 7f0e3bfff640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 0x7f0e240b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006010 tx=0x7f0e2c000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.647+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e34056710 con 0x7f0e3c108d70 2024-09-21T07:55:17.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:17.844+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0e3c063800 con 0x7f0e240b6560 2024-09-21T07:55:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi145 2024-09-21T07:55:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-21T07:55:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:55:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:55:18.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] boot 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:55:18.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:18 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi145 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] boot 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:55:18.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:18 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi145 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: osd.5 [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] boot 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:55:18.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:18 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:55:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:19 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:55:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:19 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:55:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:19 smithi119 ceph-mon[33564]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:19 smithi119 ceph-mon[33564]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:19.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:19 smithi119 ceph-mon[33564]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:55:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:19 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:55:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:19 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:55:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:19 smithi145 ceph-mon[34049]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:19 smithi145 ceph-mon[34049]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:19 smithi145 ceph-mon[34049]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:55:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:19 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:55:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:19 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:55:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:19 smithi006 ceph-mon[30970]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:55:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:19 smithi006 ceph-mon[30970]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:19.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:19 smithi006 ceph-mon[30970]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:55:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:55:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"} : dispatch 2024-09-21T07:55:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"}]': finished 2024-09-21T07:55:21.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:55:21.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:21.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2844207310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"} : dispatch 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"}]': finished 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2844207310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"} : dispatch 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1213708155' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24def8b3-915b-4aae-8d84-76eead4d123e"}]': finished 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2844207310' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:23.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:23 smithi119 ceph-mon[33564]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:23 smithi145 ceph-mon[34049]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:23.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:23 smithi006 ceph-mon[30970]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:25.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:25 smithi119 ceph-mon[33564]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:55:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:25 smithi145 ceph-mon[34049]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:55:25.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:25 smithi006 ceph-mon[30970]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:55:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:27 smithi119 ceph-mon[33564]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:55:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:27 smithi145 ceph-mon[34049]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:55:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:27 smithi006 ceph-mon[30970]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:55:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:29 smithi119 ceph-mon[33564]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:55:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:55:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:29 smithi145 ceph-mon[34049]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:55:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:55:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:29.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:29 smithi006 ceph-mon[30970]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:55:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:55:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:30.442 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:30 smithi006 ceph-mon[30970]: Deploying daemon osd.6 on smithi006 2024-09-21T07:55:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:30 smithi145 ceph-mon[34049]: Deploying daemon osd.6 on smithi006 2024-09-21T07:55:30.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:30 smithi119 ceph-mon[33564]: Deploying daemon osd.6 on smithi006 2024-09-21T07:55:31.425 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:31 smithi006 ceph-mon[30970]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:55:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:31 smithi145 ceph-mon[34049]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:55:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:31 smithi119 ceph-mon[33564]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:55:33.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:33 smithi145 ceph-mon[34049]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:55:33.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:33 smithi006 ceph-mon[30970]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:55:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:33 smithi119 ceph-mon[33564]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:55:35.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:35 smithi006 ceph-mon[30970]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:55:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:35 smithi145 ceph-mon[34049]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:55:35.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:35 smithi119 ceph-mon[33564]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:55:36.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:36.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:36.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:36.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:36.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:36.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:37 smithi145 ceph-mon[34049]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:37 smithi006 ceph-mon[30970]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:37 smithi119 ceph-mon[33564]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:39.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:39.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.631+0000 7f0e397fa640 1 -- 172.21.15.6:0/3137365929 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0e3c063800 con 0x7f0e240b6560 2024-09-21T07:55:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 6 on host 'smithi006' 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 msgr2=0x7f0e240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 0x7f0e240b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006010 tx=0x7f0e2c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 msgr2=0x7f0e3c19fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400eb10 tx=0x7f0e3400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 shutdown_connections 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e240b6560 0x7f0e240b8a70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e3c108420 0x7f0e3c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3c108d70 0x7f0e3c19fc50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 --2- 172.21.15.6:0/3137365929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c102ae0 0x7f0e3c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 >> 172.21.15.6:0/3137365929 conn(0x7f0e3c079770 msgr2=0x7f0e3c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 shutdown_connections 2024-09-21T07:55:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:55:39.634+0000 7f0e428fd640 1 -- 172.21.15.6:0/3137365929 wait complete. 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:40 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:40.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:40 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:40 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.289 DEBUG:teuthology.orchestra.run.smithi006:osd.6> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.6.service 2024-09-21T07:55:40.291 INFO:tasks.cephadm:Deploying osd.7 on smithi119 with /dev/vg_nvme/lv_2... 2024-09-21T07:55:40.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:55:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:40 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:40 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:40 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.543 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:55:40.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:40 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:40.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:40 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:40.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:40 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:41.195 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 07:55:40 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T07:55:40.882+0000 7efc26686640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:55:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:41 smithi119 ceph-mon[33564]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:41 smithi119 ceph-mon[33564]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:55:41.449 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:41 smithi006 ceph-mon[30970]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:41.449 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:41 smithi006 ceph-mon[30970]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:55:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:41 smithi145 ceph-mon[34049]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:41 smithi145 ceph-mon[34049]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:55:42.319 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:55:42.319 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:55:42.320 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:55:42.320 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:42.320 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:55:42.320 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:42 smithi119 ceph-mon[33564]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:55:42.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-mon[30970]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:55:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:55:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:55:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:55:42.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:42.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:55:42.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:42 smithi145 ceph-mon[34049]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:55:42.949 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T07:55:42.667+0000 7efc22e1d640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:55:42.949 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 07:55:42 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T07:55:42.680+0000 7efc1a3fe640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:55:43.254 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:55:43.280 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-09-21T07:55:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:43 smithi006 ceph-mon[30970]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:43 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:43 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:43 smithi006 ceph-mon[30970]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' 2024-09-21T07:55:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:43 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.535 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:55:43.584 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:43 smithi119 ceph-mon[33564]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:43.584 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:43 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.584 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:43 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.584 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:43 smithi119 ceph-mon[33564]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' 2024-09-21T07:55:43.585 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:43 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:43 smithi145 ceph-mon[34049]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:43.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:43 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:43 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:43.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:43 smithi145 ceph-mon[34049]: from='osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555]' entity='osd.6' 2024-09-21T07:55:43.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:43 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:44.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- 172.21.15.119:0/477734051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28109df0 msgr2=0x7f5a28110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:44.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 --2- 172.21.15.119:0/477734051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28109df0 0x7f5a28110620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009ca0 tx=0x7f5a2002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- 172.21.15.119:0/477734051 shutdown_connections 2024-09-21T07:55:44.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 --2- 172.21.15.119:0/477734051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a281094a0 0x7f5a281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 --2- 172.21.15.119:0/477734051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28109df0 0x7f5a28110620 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 --2- 172.21.15.119:0/477734051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a28103b60 0x7f5a28103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- 172.21.15.119:0/477734051 >> 172.21.15.119:0/477734051 conn(0x7f5a2807b850 msgr2=0x7f5a2807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- 172.21.15.119:0/477734051 shutdown_connections 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- 172.21.15.119:0/477734051 wait complete. 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 Processor -- start 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.029+0000 7f5a2e366640 1 -- start start 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 0x7f5a2819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a28109df0 0x7f5a2819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a281139b0 con 0x7f5a281094a0 2024-09-21T07:55:44.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28113830 con 0x7f5a28103b60 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2e366640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28113b30 con 0x7f5a28109df0 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38988/0 (socket says 172.21.15.119:38988) 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 -- 172.21.15.119:0/3809180978 learned_addr learned my addr 172.21.15.119:0/3809180978 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a2c903640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a28109df0 0x7f5a2819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a1ffff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 0x7f5a2819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 -- 172.21.15.119:0/3809180978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a28109df0 msgr2=0x7f5a2819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a28109df0 0x7f5a2819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 -- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 msgr2=0x7f5a2819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 0x7f5a2819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 -- 172.21.15.119:0/3809180978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a281a02b0 con 0x7f5a28103b60 2024-09-21T07:55:44.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a1ffff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 0x7f5a2819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a27fff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800d950 tx=0x7f5a1800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.030+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18017070 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.031+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a281a05a0 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.031+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a18009c30 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.031+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800f620 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.031+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a281a6d00 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.032+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a28103f70 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.033+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f5a18005030 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.034+0000 7f5a25ffb640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 0x7f5a140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.034+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5180+0+0 (secure 0 0 0) 0x7f5a180e6300 con 0x7f5a28103b60 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.034+0000 7f5a1ffff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 0x7f5a140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:44.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.034+0000 7f5a1ffff640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 0x7f5a140b8a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a28107090 tx=0x7f5a10005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:44.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.037+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a180ad7d0 con 0x7f5a28103b60 2024-09-21T07:55:44.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:55:44.225+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5a28063800 con 0x7f5a140b6560 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi006 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.608 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] boot 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:44.609 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:44.610 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:44.610 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:44.610 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:55:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:55:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi006 2024-09-21T07:55:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] boot 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:55:44.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:44.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:44.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:44.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:44.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi006 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 5697M 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: osd.6 [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] boot 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:55:44.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:55:44.713 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:45.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:45 smithi119 ceph-mon[33564]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:55:45.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:45 smithi145 ceph-mon[34049]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:55:45.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:45 smithi006 ceph-mon[30970]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/3143559357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"}]': finished 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:55:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/3143559357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"}]': finished 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:55:46.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:55:47.004 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:47.004 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/3143559357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:47.004 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"} : dispatch 2024-09-21T07:55:47.004 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "348c45b0-811d-4c56-a331-7033863e36d4"}]': finished 2024-09-21T07:55:47.005 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:55:47.005 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:55:47.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/448712682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/448712682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/448712682' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:55:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:48 smithi145 ceph-mon[34049]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:48 smithi006 ceph-mon[30970]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:48 smithi119 ceph-mon[33564]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:50.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:50 smithi006 ceph-mon[30970]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:50 smithi119 ceph-mon[33564]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:50 smithi145 ceph-mon[34049]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:52 smithi119 ceph-mon[33564]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:52.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:52 smithi006 ceph-mon[30970]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:52 smithi145 ceph-mon[34049]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:54.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:54 smithi119 ceph-mon[33564]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:54 smithi006 ceph-mon[30970]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:54 smithi145 ceph-mon[34049]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:55.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:55:55.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:55.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:55 smithi119 ceph-mon[33564]: Deploying daemon osd.7 on smithi119 2024-09-21T07:55:55.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:55:55.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:55.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:55 smithi006 ceph-mon[30970]: Deploying daemon osd.7 on smithi119 2024-09-21T07:55:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:55:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:55 smithi145 ceph-mon[34049]: Deploying daemon osd.7 on smithi119 2024-09-21T07:55:56.921 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:56 smithi119 ceph-mon[33564]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:56.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:56 smithi006 ceph-mon[30970]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:56 smithi145 ceph-mon[34049]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:58.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:55:58 smithi006 ceph-mon[30970]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:55:58 smithi119 ceph-mon[33564]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:55:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:55:58 smithi145 ceph-mon[34049]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:00.867 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:00 smithi119 ceph-mon[33564]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:00 smithi145 ceph-mon[34049]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:00 smithi006 ceph-mon[30970]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:01.868 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:01.869 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:01.869 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:03.278 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:03 smithi119 ceph-mon[33564]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:03 smithi145 ceph-mon[34049]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:03 smithi006 ceph-mon[30970]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:05.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.195+0000 7f5a25ffb640 1 -- 172.21.15.119:0/3809180978 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5a28063800 con 0x7f5a140b6560 2024-09-21T07:56:05.198 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 7 on host 'smithi119' 2024-09-21T07:56:05.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 msgr2=0x7f5a140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 0x7f5a140b8a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a28107090 tx=0x7f5a10005f90 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 msgr2=0x7f5a2819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800d950 tx=0x7f5a1800de10 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 shutdown_connections 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5a140b6560 0x7f5a140b8a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5a28109df0 0x7f5a2819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a281094a0 0x7f5a2819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 --2- 172.21.15.119:0/3809180978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28103b60 0x7f5a2819a340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 >> 172.21.15.119:0/3809180978 conn(0x7f5a2807b850 msgr2=0x7f5a281074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 shutdown_connections 2024-09-21T07:56:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:56:05.198+0000 7f5a2e366640 1 -- 172.21.15.119:0/3809180978 wait complete. 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:05.842 DEBUG:teuthology.orchestra.run.smithi119:osd.7> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.7.service 2024-09-21T07:56:05.845 INFO:tasks.cephadm:Deploying osd.8 on smithi145 with /dev/vg_nvme/lv_2... 2024-09-21T07:56:05.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:56:06.101 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:56:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:06.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:06.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:06.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:06.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:06.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:06.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:07.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:07 smithi119 ceph-mon[33564]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:07.394 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 07:56:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T07:56:07.249+0000 7fb34ffa7640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:56:07.452 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:07 smithi145 ceph-mon[34049]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:07 smithi006 ceph-mon[30970]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:08.344 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:08 smithi145 ceph-mon[34049]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.344 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:08 smithi145 ceph-mon[34049]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:08 smithi006 ceph-mon[30970]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:08 smithi006 ceph-mon[30970]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.615 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:08 smithi119 ceph-mon[33564]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.615 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:08 smithi119 ceph-mon[33564]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:56:08.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:56:08.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-09-21T07:56:09.053 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:09.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:09.445 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- 172.21.15.145:0/3456081951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 msgr2=0x7fbafc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:09.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 --2- 172.21.15.145:0/3456081951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc10f520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009ca0 tx=0x7fbaf402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- 172.21.15.145:0/3456081951 shutdown_connections 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 --2- 172.21.15.145:0/3456081951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc10f520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 --2- 172.21.15.145:0/3456081951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc1083a0 0x7fbafc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 --2- 172.21.15.145:0/3456081951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc102a60 0x7fbafc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- 172.21.15.145:0/3456081951 >> 172.21.15.145:0/3456081951 conn(0x7fbafc079730 msgr2=0x7fbafc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- 172.21.15.145:0/3456081951 shutdown_connections 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- 172.21.15.145:0/3456081951 wait complete. 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 Processor -- start 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.559+0000 7fbb04038640 1 -- start start 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc102a60 0x7fbafc19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 0x7fbafc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113960 con 0x7fbafc1083a0 2024-09-21T07:56:09.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1137e0 con 0x7fbafc102a60 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb04038640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113ae0 con 0x7fbafc108cf0 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:46754/0 (socket says 172.21.15.145:46754) 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 -- 172.21.15.145:0/156662083 learned_addr learned my addr 172.21.15.145:0/156662083 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb01dd4640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc102a60 0x7fbafc19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb015d3640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 0x7fbafc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 -- 172.21.15.145:0/156662083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc102a60 msgr2=0x7fbafc19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc102a60 0x7fbafc19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 -- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 msgr2=0x7fbafc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 0x7fbafc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 -- 172.21.15.145:0/156662083 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1a0360 con 0x7fbafc108cf0 2024-09-21T07:56:09.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb015d3640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 0x7fbafc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.560+0000 7fbb025d5640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4005cc0 tx=0x7fbaf4032c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.561+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4004040 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.561+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbaf4004670 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.561+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1a05f0 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.561+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4030cc0 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.561+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1a6db0 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.562+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc102e70 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.563+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fbaf40041e0 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.564+0000 7fbaf2ffd640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 0x7fbae80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.564+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5332+0+0 (secure 0 0 0) 0x7fbaf4107d10 con 0x7fbafc108cf0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.565+0000 7fbb01dd4640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 0x7fbae80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.565+0000 7fbb01dd4640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 0x7fbae80b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80058c0 tx=0x7fbaf800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:09.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.568+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbaf40cf120 con 0x7fbafc108cf0 2024-09-21T07:56:09.658 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T07:56:09.210+0000 7fb34bf29640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:56:09.658 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T07:56:09.221+0000 7fb347d27640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:56:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:09.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:09.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:09.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:09.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:09.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:09.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:09.758+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbafc063800 con 0x7fbae80b65e0 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi119 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:10.416 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] boot 2024-09-21T07:56:10.417 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:56:10.417 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi119 2024-09-21T07:56:10.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] boot 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:56:10.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi119 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:10.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: osd.7 [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] boot 2024-09-21T07:56:10.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:56:10.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:56:11.437 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:11 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:56:11.437 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:11 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:56:11.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:11 smithi145 ceph-mon[34049]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:11.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:11 smithi145 ceph-mon[34049]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:11.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:11 smithi145 ceph-mon[34049]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:56:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:11 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:56:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:11 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:56:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:11 smithi119 ceph-mon[33564]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:11 smithi119 ceph-mon[33564]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:11 smithi119 ceph-mon[33564]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:56:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:11 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:56:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:11 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:56:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:11 smithi006 ceph-mon[30970]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:56:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:11 smithi006 ceph-mon[30970]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:11 smithi006 ceph-mon[30970]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:56:12.540 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:12 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/631783798' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.540 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:12 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.540 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:12 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"}]': finished 2024-09-21T07:56:12.540 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:12 smithi145 ceph-mon[34049]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:56:12.540 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:12 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:12 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/631783798' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:12 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:12 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"}]': finished 2024-09-21T07:56:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:12 smithi119 ceph-mon[33564]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:56:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:12 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:12 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/631783798' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:12 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"} : dispatch 2024-09-21T07:56:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:12 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e25c1373-dd60-4948-a8d9-c5c43d9aebf8"}]': finished 2024-09-21T07:56:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:12 smithi006 ceph-mon[30970]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:56:12.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:12 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:13.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:13 smithi119 ceph-mon[33564]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:13.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/408030467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:13.614 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:13 smithi006 ceph-mon[30970]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:13.614 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/408030467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:13 smithi145 ceph-mon[34049]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/408030467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:15.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:15 smithi119 ceph-mon[33564]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:15 smithi145 ceph-mon[34049]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:15.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:15 smithi006 ceph-mon[30970]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:17 smithi145 ceph-mon[34049]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:17 smithi119 ceph-mon[33564]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:17.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:17 smithi006 ceph-mon[30970]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:19.510 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:19 smithi145 ceph-mon[34049]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:56:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:19 smithi119 ceph-mon[33564]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:56:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:19 smithi006 ceph-mon[30970]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:56:21.583 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:21 smithi145 ceph-mon[34049]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:56:21.584 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:56:21.584 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:21 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:21 smithi119 ceph-mon[33564]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:56:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:56:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:21 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:21.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:21 smithi006 ceph-mon[30970]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:56:21.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:56:21.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:21 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:22.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:22 smithi145 ceph-mon[34049]: Deploying daemon osd.8 on smithi145 2024-09-21T07:56:22.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:22 smithi119 ceph-mon[33564]: Deploying daemon osd.8 on smithi145 2024-09-21T07:56:22.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:22 smithi006 ceph-mon[30970]: Deploying daemon osd.8 on smithi145 2024-09-21T07:56:23.398 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:23 smithi145 ceph-mon[34049]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:23 smithi119 ceph-mon[33564]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:23 smithi006 ceph-mon[30970]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:25.357 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:25 smithi145 ceph-mon[34049]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:25.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:25 smithi119 ceph-mon[33564]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:25.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:25 smithi006 ceph-mon[30970]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:27 smithi119 ceph-mon[33564]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:27 smithi145 ceph-mon[34049]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:27 smithi006 ceph-mon[30970]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:29.295 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:29 smithi145 ceph-mon[34049]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:29 smithi119 ceph-mon[33564]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:29.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:29 smithi006 ceph-mon[30970]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:30.592 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.592 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.592 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:30.593 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:30.593 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.593 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:30 smithi145 ceph-mon[34049]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:30.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.634+0000 7fbaf2ffd640 1 -- 172.21.15.145:0/156662083 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbafc063800 con 0x7fbae80b65e0 2024-09-21T07:56:30.636 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 8 on host 'smithi145' 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 msgr2=0x7fbae80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 0x7fbae80b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80058c0 tx=0x7fbaf800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 msgr2=0x7fbafc19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4005cc0 tx=0x7fbaf4032c40 comp rx=0 tx=0).stop 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 shutdown_connections 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbae80b65e0 0x7fbae80b8af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbafc108cf0 0x7fbafc19fc30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:30.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbafc1083a0 0x7fbafc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:30.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 --2- 172.21.15.145:0/156662083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbafc102a60 0x7fbafc19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:30.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 >> 172.21.15.145:0/156662083 conn(0x7fbafc079730 msgr2=0x7fbafc104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:30.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 shutdown_connections 2024-09-21T07:56:30.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:56:30.637+0000 7fbb04038640 1 -- 172.21.15.145:0/156662083 wait complete. 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:30 smithi006 ceph-mon[30970]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:30 smithi119 ceph-mon[33564]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:31.433 DEBUG:teuthology.orchestra.run.smithi145:osd.8> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.8.service 2024-09-21T07:56:31.436 INFO:tasks.cephadm:Deploying osd.9 on smithi006 with /dev/vg_nvme/lv_1... 2024-09-21T07:56:31.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:56:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:31.708 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:56:31.829 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:31.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:31.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:32.663 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:32 smithi145 ceph-mon[34049]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:32.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:32 smithi006 ceph-mon[30970]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:32.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:32 smithi119 ceph-mon[33564]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:33.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 07:56:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T07:56:32.942+0000 7f5a679bb640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:56:33.594 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:33 smithi006 ceph-mon[30970]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:33.594 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:33 smithi006 ceph-mon[30970]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:33 smithi119 ceph-mon[33564]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:33 smithi119 ceph-mon[33564]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:33 smithi145 ceph-mon[34049]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:33 smithi145 ceph-mon[34049]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.649 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:34.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:34.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:34 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:56:34.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi006:vg_nvme/lv_1 2024-09-21T07:56:34.693 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T07:56:34.487+0000 7f5a6393d640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:56:34.693 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T07:56:34.499+0000 7f5a5f73b640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:56:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:56:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:56:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:34.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:34 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:56:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:34.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:34 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:56:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.465+0000 7f85920b1640 1 -- 172.21.15.6:0/3233158370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c109e10 msgr2=0x7f858c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.465+0000 7f85920b1640 1 --2- 172.21.15.6:0/3233158370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c109e10 0x7f858c110640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8584009ca0 tx=0x7f858402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 -- 172.21.15.6:0/3233158370 shutdown_connections 2024-09-21T07:56:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 --2- 172.21.15.6:0/3233158370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c109e10 0x7f858c110640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 --2- 172.21.15.6:0/3233158370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c1094c0 0x7f858c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 --2- 172.21.15.6:0/3233158370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 0x7f858c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 -- 172.21.15.6:0/3233158370 >> 172.21.15.6:0/3233158370 conn(0x7f858c0ff610 msgr2=0x7f858c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 -- 172.21.15.6:0/3233158370 shutdown_connections 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.466+0000 7f85920b1640 1 -- 172.21.15.6:0/3233158370 wait complete. 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 Processor -- start 2024-09-21T07:56:35.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 -- start start 2024-09-21T07:56:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 0x7f858c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:35.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c109e10 0x7f858c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1139d0 con 0x7f858c1094c0 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f858c113850 con 0x7f858c109e10 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f85920b1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f858c113b50 con 0x7f858c103b80 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f858affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f858affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55484/0 (socket says 172.21.15.6:55484) 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.467+0000 7f858affd640 1 -- 172.21.15.6:0/2776575978 learned_addr learned my addr 172.21.15.6:0/2776575978 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858b7fe640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 0x7f858c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858bfff640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c109e10 0x7f858c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 -- 172.21.15.6:0/2776575978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 msgr2=0x7f858c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 0x7f858c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 -- 172.21.15.6:0/2776575978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c109e10 msgr2=0x7f858c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:35.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c109e10 0x7f858c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 -- 172.21.15.6:0/2776575978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c1a02f0 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f858affd640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f858000d950 tx=0x7f858000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580017070 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c1a05e0 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8580009c30 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85800047a0 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.468+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c1a6d40 con 0x7f858c1094c0 2024-09-21T07:56:35.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.469+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c103f90 con 0x7f858c1094c0 2024-09-21T07:56:35.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.471+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f8580004020 con 0x7f858c1094c0 2024-09-21T07:56:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.472+0000 7f8588ff9640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 0x7f85740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.473+0000 7f858b7fe640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 0x7f85740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.473+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f85800e6a00 con 0x7f858c1094c0 2024-09-21T07:56:35.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.473+0000 7f858b7fe640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 0x7f85740b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f857c00bbe0 tx=0x7f857c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:35.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.476+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8580020020 con 0x7f858c1094c0 2024-09-21T07:56:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:35.678+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f858c063800 con 0x7f85740b6560 2024-09-21T07:56:35.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi145 2024-09-21T07:56:35.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-21T07:56:35.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] boot 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:56:35.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi145 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] boot 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:56:35.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi145 2024-09-21T07:56:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-21T07:56:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:56:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:56:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:35.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: osd.8 [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] boot 2024-09-21T07:56:35.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:56:35.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:36.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:56:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:56:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:36.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:56:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:37.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:37 smithi006 ceph-mon[30970]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:56:37.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:37 smithi119 ceph-mon[33564]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:56:37.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:37 smithi145 ceph-mon[34049]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:56:38.562 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:38.562 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:56:38.563 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"} : dispatch 2024-09-21T07:56:38.563 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"}]': finished 2024-09-21T07:56:38.563 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:56:38.563 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:56:38.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:38.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:56:38.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"} : dispatch 2024-09-21T07:56:38.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"}]': finished 2024-09-21T07:56:38.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:56:38.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"} : dispatch 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3158164099' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "565edfc0-01d7-484b-abb2-923dcd7337d9"}]': finished 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:56:38.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:56:39.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:39 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1684150095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:39.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:39 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1684150095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:39.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:39 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1684150095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:56:40.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:40 smithi119 ceph-mon[33564]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:40.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:40 smithi145 ceph-mon[34049]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:40.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:40 smithi006 ceph-mon[30970]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 250 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:42.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:42 smithi006 ceph-mon[30970]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:42.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:42 smithi119 ceph-mon[33564]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:42.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:42 smithi145 ceph-mon[34049]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:56:44.582 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:44 smithi006 ceph-mon[30970]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T07:56:44.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:44 smithi119 ceph-mon[33564]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T07:56:44.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:44 smithi145 ceph-mon[34049]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T07:56:46.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:46 smithi119 ceph-mon[33564]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:56:46.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:46 smithi145 ceph-mon[34049]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:56:46.944 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:46 smithi006 ceph-mon[30970]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:56:47.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:56:47.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:47.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:47 smithi006 ceph-mon[30970]: Deploying daemon osd.9 on smithi006 2024-09-21T07:56:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:56:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:47 smithi119 ceph-mon[33564]: Deploying daemon osd.9 on smithi006 2024-09-21T07:56:47.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:56:47.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:47.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:47 smithi145 ceph-mon[34049]: Deploying daemon osd.9 on smithi006 2024-09-21T07:56:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:48 smithi006 ceph-mon[30970]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:48.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:48 smithi119 ceph-mon[33564]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:48 smithi145 ceph-mon[34049]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:56:50.752 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:50 smithi006 ceph-mon[30970]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:50.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:50 smithi119 ceph-mon[33564]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:50.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:50 smithi145 ceph-mon[34049]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:56:52.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:52 smithi006 ceph-mon[30970]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:52 smithi119 ceph-mon[33564]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:52.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:52 smithi145 ceph-mon[34049]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:56:53.677 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:53.678 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:53.678 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:53.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:53.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:53.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:55 smithi119 ceph-mon[33564]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:55 smithi145 ceph-mon[34049]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:55.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:55 smithi006 ceph-mon[30970]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:57.210 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 9 on host 'smithi006' 2024-09-21T07:56:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.207+0000 7f8588ff9640 1 -- 172.21.15.6:0/2776575978 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f858c063800 con 0x7f85740b6560 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 msgr2=0x7f85740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 0x7f85740b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f857c00bbe0 tx=0x7f857c00b390 comp rx=0 tx=0).stop 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 msgr2=0x7f858c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f858000d950 tx=0x7f858000de10 comp rx=0 tx=0).stop 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 shutdown_connections 2024-09-21T07:56:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85740b6560 0x7f85740b8a70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f858c109e10 0x7f858c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c1094c0 0x7f858c19a920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 --2- 172.21.15.6:0/2776575978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f858c103b80 0x7f858c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 >> 172.21.15.6:0/2776575978 conn(0x7f858c0ff610 msgr2=0x7f858c106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 shutdown_connections 2024-09-21T07:56:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:56:57.211+0000 7f85920b1640 1 -- 172.21.15.6:0/2776575978 wait complete. 2024-09-21T07:56:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:57 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:57 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:57.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:57 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.047 DEBUG:teuthology.orchestra.run.smithi006:osd.9> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.9.service 2024-09-21T07:56:58.049 INFO:tasks.cephadm:Deploying osd.10 on smithi119 with /dev/vg_nvme/lv_1... 2024-09-21T07:56:58.049 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:56:58.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:58.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.268 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:58 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.307 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:56:58.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:58.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:58 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:58.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:58.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:58 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:56:59.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:59 smithi006 ceph-mon[30970]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:59.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:56:59 smithi006 ceph-mon[30970]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:56:59.461 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 07:56:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T07:56:59.189+0000 7f59fc1f5640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:56:59.633 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:59 smithi119 ceph-mon[33564]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:59.633 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:56:59 smithi119 ceph-mon[33564]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:56:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:59 smithi145 ceph-mon[34049]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:56:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:56:59 smithi145 ceph-mon[34049]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:57:00.478 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:57:00.478 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:57:00.478 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:57:00.478 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.479 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:57:00.479 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:57:00.479 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:57:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:57:00.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]} : dispatch 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: from='osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:57:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:00.711 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T07:57:00.219+0000 7f59f8177640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:57:00.712 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 07:57:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T07:57:00.235+0000 7f59f3f75640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:01.304 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:01.304 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:01.304 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.304 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:01.307 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T07:57:01.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:01.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T07:57:01.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:01.695 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- 172.21.15.119:0/67799520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010108d70 msgr2=0x7fd01010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 --2- 172.21.15.119:0/67799520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010108d70 0x7fd01010f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd008009ca0 tx=0x7fd00802a8e0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- 172.21.15.119:0/67799520 shutdown_connections 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 --2- 172.21.15.119:0/67799520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010108d70 0x7fd01010f5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 --2- 172.21.15.119:0/67799520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108420 0x7fd010108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 --2- 172.21.15.119:0/67799520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010102ae0 0x7fd010102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- 172.21.15.119:0/67799520 >> 172.21.15.119:0/67799520 conn(0x7fd010079770 msgr2=0x7fd010079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- 172.21.15.119:0/67799520 shutdown_connections 2024-09-21T07:57:02.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- 172.21.15.119:0/67799520 wait complete. 2024-09-21T07:57:02.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 Processor -- start 2024-09-21T07:57:02.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.067+0000 7fd015b45640 1 -- start start 2024-09-21T07:57:02.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:02.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 0x7fd01019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:02.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108d70 0x7fd01019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd0101129a0 con 0x7fd010108d70 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd010112820 con 0x7fd010102ae0 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd015b45640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd010112b20 con 0x7fd010108420 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39934/0 (socket says 172.21.15.119:39934) 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 -- 172.21.15.119:0/2801252688 learned_addr learned my addr 172.21.15.119:0/2801252688 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00ffff640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108d70 0x7fd01019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd007fff640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 0x7fd01019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 -- 172.21.15.119:0/2801252688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 msgr2=0x7fd01019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 0x7fd01019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 -- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108d70 msgr2=0x7fd01019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108d70 0x7fd01019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:02.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 -- 172.21.15.119:0/2801252688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0101a65e0 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd007fff640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 0x7fd01019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.068+0000 7fd00f7fe640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b4a0 tx=0x7fd00000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.069+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000014070 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.069+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0101a68d0 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.069+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd000010aa0 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.069+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000017b70 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.069+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0101a6e10 con 0x7fd010102ae0 2024-09-21T07:57:02.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.070+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd010103d60 con 0x7fd010102ae0 2024-09-21T07:57:02.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.071+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fd000017070 con 0x7fd010102ae0 2024-09-21T07:57:02.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.072+0000 7fd00d7fa640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 0x7fcffc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:02.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.072+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6476+0+0 (secure 0 0 0) 0x7fd0000e62b0 con 0x7fd010102ae0 2024-09-21T07:57:02.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.072+0000 7fd007fff640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 0x7fcffc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:02.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.073+0000 7fd007fff640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 0x7fcffc0b8aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:02.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.075+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0000ad270 con 0x7fd010102ae0 2024-09-21T07:57:02.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:02.265+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd010063800 con 0x7fcffc0b6590 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi006 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] boot 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:57:02.644 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi006 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] boot 2024-09-21T07:57:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:57:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:02.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi006 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 4273M 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: osd.9 [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] boot 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:57:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:03.533 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/1985666738' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"}]': finished 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:05.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:05.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/1985666738' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"}]': finished 2024-09-21T07:57:05.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:57:05.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/1985666738' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"} : dispatch 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16df7040-3040-4d5c-8bfd-8f00307555eb"}]': finished 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:57:05.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:06 smithi119 ceph-mon[33564]: from='client.? 172.21.15.119:0/2785553172' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:06.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:06 smithi145 ceph-mon[34049]: from='client.? 172.21.15.119:0/2785553172' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:06 smithi006 ceph-mon[30970]: from='client.? 172.21.15.119:0/2785553172' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:07 smithi119 ceph-mon[33564]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:07.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:07 smithi145 ceph-mon[34049]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:07.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:07 smithi006 ceph-mon[30970]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:09.543 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:09 smithi119 ceph-mon[33564]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:09 smithi145 ceph-mon[34049]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:09.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:09 smithi006 ceph-mon[30970]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:11.541 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:11 smithi119 ceph-mon[33564]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:11 smithi145 ceph-mon[34049]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:11 smithi006 ceph-mon[30970]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:13.513 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:13 smithi006 ceph-mon[30970]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:13 smithi119 ceph-mon[33564]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:13 smithi145 ceph-mon[34049]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:14.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:57:14.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:14.534 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:57:14.534 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:14.601 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:57:14.601 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:15 smithi119 ceph-mon[33564]: Deploying daemon osd.10 on smithi119 2024-09-21T07:57:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:15 smithi119 ceph-mon[33564]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:15 smithi145 ceph-mon[34049]: Deploying daemon osd.10 on smithi119 2024-09-21T07:57:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:15 smithi145 ceph-mon[34049]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:15 smithi006 ceph-mon[30970]: Deploying daemon osd.10 on smithi119 2024-09-21T07:57:15.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:15 smithi006 ceph-mon[30970]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:17.305 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:17 smithi119 ceph-mon[33564]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:17 smithi145 ceph-mon[34049]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:17.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:17 smithi006 ceph-mon[30970]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:19 smithi119 ceph-mon[33564]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:19 smithi145 ceph-mon[34049]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:19 smithi006 ceph-mon[30970]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:20 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:20 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:20.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:20 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:20.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:20 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:20.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:20 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:20.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:20 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:20 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:20 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:20 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:21 smithi119 ceph-mon[33564]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:21 smithi145 ceph-mon[34049]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:21.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:21 smithi006 ceph-mon[30970]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:23.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.268+0000 7fd00d7fa640 1 -- 172.21.15.119:0/2801252688 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd010063800 con 0x7fcffc0b6590 2024-09-21T07:57:23.270 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 10 on host 'smithi119' 2024-09-21T07:57:23.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 msgr2=0x7fcffc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 0x7fcffc0b8aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 msgr2=0x7fd01019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b4a0 tx=0x7fd00000b960 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 shutdown_connections 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcffc0b6590 0x7fcffc0b8aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd010108420 0x7fd01019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd010108d70 0x7fd01019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 --2- 172.21.15.119:0/2801252688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd010102ae0 0x7fd01019b350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 >> 172.21.15.119:0/2801252688 conn(0x7fd010079770 msgr2=0x7fd010106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 shutdown_connections 2024-09-21T07:57:23.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T07:57:23.271+0000 7fd015b45640 1 -- 172.21.15.119:0/2801252688 wait complete. 2024-09-21T07:57:23.645 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:23.645 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:23 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:23.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:23 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:23 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:23.984 DEBUG:teuthology.orchestra.run.smithi119:osd.10> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.10.service 2024-09-21T07:57:23.987 INFO:tasks.cephadm:Deploying osd.11 on smithi145 with /dev/vg_nvme/lv_1... 2024-09-21T07:57:23.987 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:57:24.242 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:57:25.423 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:25 smithi119 ceph-mon[33564]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:25.617 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:25 smithi145 ceph-mon[34049]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:25.709 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 07:57:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T07:57:25.597+0000 7ff5da8ee640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:57:25.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:25 smithi006 ceph-mon[30970]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:26.470 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:26 smithi145 ceph-mon[34049]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:26.470 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:26 smithi145 ceph-mon[34049]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:26.587 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:26 smithi119 ceph-mon[33564]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:26.587 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:26 smithi119 ceph-mon[33564]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:26.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:26 smithi006 ceph-mon[30970]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:26.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:26 smithi006 ceph-mon[30970]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:57:27.053 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-21T07:57:27.079 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-09-21T07:57:27.328 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi119 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.595 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:27.596 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T07:57:27.300+0000 7ff5d6870640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:57:27.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T07:57:27.311+0000 7ff5d266e640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi119 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T07:57:27.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:27.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:27.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi119 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:27.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:27.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- 172.21.15.145:0/3323133729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c108d70 msgr2=0x7f735c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 --2- 172.21.15.145:0/3323133729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c108d70 0x7f735c10f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7354009ca0 tx=0x7f735402a8e0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- 172.21.15.145:0/3323133729 shutdown_connections 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 --2- 172.21.15.145:0/3323133729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c108d70 0x7f735c10f5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 --2- 172.21.15.145:0/3323133729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108420 0x7f735c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 --2- 172.21.15.145:0/3323133729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c102ae0 0x7f735c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- 172.21.15.145:0/3323133729 >> 172.21.15.145:0/3323133729 conn(0x7f735c079770 msgr2=0x7f735c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- 172.21.15.145:0/3323133729 shutdown_connections 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- 172.21.15.145:0/3323133729 wait complete. 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 Processor -- start 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.828+0000 7f736155d640 1 -- start start 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:27.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 0x7f735c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108d70 0x7f735c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f735c112920 con 0x7f735c108420 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f735c1127a0 con 0x7f735c108d70 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f735c112aa0 con 0x7f735c102ae0 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:37084/0 (socket says 172.21.15.145:37084) 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 -- 172.21.15.145:0/3670028037 learned_addr learned my addr 172.21.15.145:0/3670028037 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735a7fc640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 0x7f735c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735b7fe640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108d70 0x7f735c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 -- 172.21.15.145:0/3670028037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108d70 msgr2=0x7f735c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108d70 0x7f735c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 -- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 msgr2=0x7f735c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:27.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 0x7f735c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 -- 172.21.15.145:0/3670028037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735c1a6560 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735a7fc640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 0x7f735c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f735affd640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f734c00d950 tx=0x7f734c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c017070 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f734c009c30 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735c1a6850 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.829+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c00f620 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.830+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f735c1a6d90 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.831+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f735c103d60 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.832+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f734c010460 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.833+0000 7f7343fff640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 0x7f73440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.833+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7f734c0e6980 con 0x7f735c102ae0 2024-09-21T07:57:27.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.833+0000 7f735a7fc640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 0x7f73440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:27.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.834+0000 7f735a7fc640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 0x7f73440b8aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f735c1053d0 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:27.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:27.838+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f734c0ad8a0 con 0x7f735c102ae0 2024-09-21T07:57:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:28.025+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f735c063800 con 0x7f73440b6590 2024-09-21T07:57:28.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:57:28.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:57:28.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] boot 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:57:28.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:28 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:28.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:28.666 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:28.666 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] boot 2024-09-21T07:57:28.666 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:57:28.666 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:28 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: osd.10 [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] boot 2024-09-21T07:57:28.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:57:28.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:28 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:57:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:29 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:57:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:29 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:57:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:29 smithi145 ceph-mon[34049]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:57:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:29 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:57:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:29 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:57:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:29 smithi119 ceph-mon[33564]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:57:29.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:29 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:57:29.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:29 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:57:29.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:29 smithi006 ceph-mon[30970]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:57:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/1575012168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"}]': finished 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:31.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.145:0/4194089631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/1575012168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"}]': finished 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:31.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.145:0/4194089631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:57:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/1575012168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"} : dispatch 2024-09-21T07:57:31.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "818aec19-fff3-4e7a-959c-785c93f0462d"}]': finished 2024-09-21T07:57:31.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:57:31.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:31.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.145:0/4194089631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:57:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:33 smithi145 ceph-mon[34049]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:57:33.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:33 smithi006 ceph-mon[30970]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:57:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:33 smithi119 ceph-mon[33564]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:57:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:35 smithi145 ceph-mon[34049]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:57:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:35 smithi006 ceph-mon[30970]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:57:35.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:35 smithi119 ceph-mon[33564]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T07:57:37.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:37 smithi006 ceph-mon[30970]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:57:37.531 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:37 smithi145 ceph-mon[34049]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:57:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:37 smithi119 ceph-mon[33564]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:57:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:39 smithi006 ceph-mon[30970]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:57:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:57:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:39.493 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:39 smithi145 ceph-mon[34049]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:57:39.493 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:57:39.493 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:39 smithi119 ceph-mon[33564]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:57:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:57:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:40.427 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:40 smithi145 ceph-mon[34049]: Deploying daemon osd.11 on smithi145 2024-09-21T07:57:40.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:40 smithi006 ceph-mon[30970]: Deploying daemon osd.11 on smithi145 2024-09-21T07:57:40.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:40 smithi119 ceph-mon[33564]: Deploying daemon osd.11 on smithi145 2024-09-21T07:57:41.369 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:41 smithi145 ceph-mon[34049]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:57:41.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:41 smithi006 ceph-mon[30970]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:57:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:41 smithi119 ceph-mon[33564]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:57:43.635 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:43 smithi145 ceph-mon[34049]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:43.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:43 smithi119 ceph-mon[33564]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:43.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:43 smithi006 ceph-mon[30970]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:45.480 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:45 smithi119 ceph-mon[33564]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:45.481 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:45 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:45.481 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:45 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:45.481 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:45 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:45.512 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:45 smithi145 ceph-mon[34049]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:45.512 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:45 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:45.512 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:45 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:45.512 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:45 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:45.546 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:45 smithi006 ceph-mon[30970]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:45.547 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:45 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:45.547 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:45 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:45.547 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:45 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:47.373 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:47 smithi145 ceph-mon[34049]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:47.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:47 smithi119 ceph-mon[33564]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:47.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:47 smithi006 ceph-mon[30970]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:48.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.432+0000 7f7343fff640 1 -- 172.21.15.145:0/3670028037 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f735c063800 con 0x7f73440b6590 2024-09-21T07:57:48.434 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 11 on host 'smithi145' 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 msgr2=0x7f73440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 0x7f73440b8aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f735c1053d0 tx=0x7f7350008040 comp rx=0 tx=0).stop 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 msgr2=0x7f735c19b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f734c00d950 tx=0x7f734c00de10 comp rx=0 tx=0).stop 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 shutdown_connections 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f73440b6590 0x7f73440b8aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f735c108d70 0x7f735c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735c108420 0x7f735c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 --2- 172.21.15.145:0/3670028037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f735c102ae0 0x7f735c19b2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.434+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 >> 172.21.15.145:0/3670028037 conn(0x7f735c079770 msgr2=0x7f735c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.435+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 shutdown_connections 2024-09-21T07:57:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:57:48.435+0000 7f736155d640 1 -- 172.21.15.145:0/3670028037 wait complete. 2024-09-21T07:57:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:48.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:48.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:48.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.132 DEBUG:teuthology.orchestra.run.smithi145:osd.11> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.11.service 2024-09-21T07:57:49.134 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:57:49.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:57:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:49.407 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:57:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 -- 172.21.15.6:0/4245648111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a48108cf0 msgr2=0x7f2a4810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 --2- 172.21.15.6:0/4245648111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a48108cf0 0x7f2a4810f520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009ca0 tx=0x7f2a4002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 -- 172.21.15.6:0/4245648111 shutdown_connections 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 --2- 172.21.15.6:0/4245648111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a48108cf0 0x7f2a4810f520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 --2- 172.21.15.6:0/4245648111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a481083a0 0x7f2a481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 --2- 172.21.15.6:0/4245648111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 0x7f2a48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 -- 172.21.15.6:0/4245648111 >> 172.21.15.6:0/4245648111 conn(0x7f2a48079730 msgr2=0x7f2a48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 -- 172.21.15.6:0/4245648111 shutdown_connections 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.895+0000 7f2a4f048640 1 -- 172.21.15.6:0/4245648111 wait complete. 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 Processor -- start 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 -- start start 2024-09-21T07:57:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 0x7f2a4819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a48108cf0 0x7f2a481a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48112860 con 0x7f2a481083a0 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481126e0 con 0x7f2a48108cf0 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a4f048640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481129e0 con 0x7f2a48102a60 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.896+0000 7f2a47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40410/0 (socket says 172.21.15.6:40410) 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 -- 172.21.15.6:0/2426992008 learned_addr learned my addr 172.21.15.6:0/2426992008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a4cde4640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 0x7f2a4819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a4d5e5640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a48108cf0 0x7f2a481a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 -- 172.21.15.6:0/2426992008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 msgr2=0x7f2a4819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 0x7f2a4819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 -- 172.21.15.6:0/2426992008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a48108cf0 msgr2=0x7f2a481a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a48108cf0 0x7f2a481a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 -- 172.21.15.6:0/2426992008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a481a2530 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a47fff640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c970 tx=0x7f2a3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c007bb0 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a3c007d50 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a481a2820 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c004e10 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.897+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481a8f80 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.898+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48102e70 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.900+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2a3c005000 con 0x7f2a481083a0 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.901+0000 7f2a45ffb640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 0x7f2a300b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.901+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f2a3c0e6d90 con 0x7f2a481083a0 2024-09-21T07:57:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.901+0000 7f2a4cde4640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 0x7f2a300b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.902+0000 7f2a4cde4640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 0x7f2a300b8af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009bd0 tx=0x7f2a38005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:49.904+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a3c014030 con 0x7f2a481083a0 2024-09-21T07:57:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.092+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2a4819d6f0 con 0x7f2a481083a0 2024-09-21T07:57:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.092+0000 7f2a45ffb640 1 -- 172.21.15.6:0/2426992008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f2a3c0b1f10 con 0x7f2a481083a0 2024-09-21T07:57:50.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:57:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 msgr2=0x7f2a300b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 0x7f2a300b8af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009bd0 tx=0x7f2a38005f90 comp rx=0 tx=0).stop 2024-09-21T07:57:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 msgr2=0x7f2a4819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c970 tx=0x7f2a3c00ce30 comp rx=0 tx=0).stop 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 shutdown_connections 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2a300b65e0 0x7f2a300b8af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a48108cf0 0x7f2a481a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a481083a0 0x7f2a4819cb60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 --2- 172.21.15.6:0/2426992008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48102a60 0x7f2a4819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 >> 172.21.15.6:0/2426992008 conn(0x7f2a48079730 msgr2=0x7f2a48104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 shutdown_connections 2024-09-21T07:57:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:50.095+0000 7f2a4f048640 1 -- 172.21.15.6:0/2426992008 wait complete. 2024-09-21T07:57:50.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:50 smithi006 ceph-mon[30970]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:50.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:50 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2426992008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:50.919 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726905448,"num_in_osds":12,"osd_in_since":1726905450,"num_remapped_pgs":0} 2024-09-21T07:57:50.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:50 smithi145 ceph-mon[34049]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:50.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:50 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2426992008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:50 smithi119 ceph-mon[33564]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:50 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2426992008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:51.363 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 07:57:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T07:57:50.985+0000 7f6b04067640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:57:51.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:57:51.950 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:51 smithi006 ceph-mon[30970]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:51.950 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:51 smithi006 ceph-mon[30970]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:52.081 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:51 smithi145 ceph-mon[34049]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:52.081 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:51 smithi145 ceph-mon[34049]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:51 smithi119 ceph-mon[33564]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:51 smithi119 ceph-mon[33564]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:57:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:57:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 -- 172.21.15.6:0/1346632657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c102a80 msgr2=0x7f838c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 --2- 172.21.15.6:0/1346632657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c102a80 0x7f838c102e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f837c009900 tx=0x7f837c02a410 comp rx=0 tx=0).stop 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 -- 172.21.15.6:0/1346632657 shutdown_connections 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 --2- 172.21.15.6:0/1346632657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c1083c0 0x7f838c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 --2- 172.21.15.6:0/1346632657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 0x7f838c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 --2- 172.21.15.6:0/1346632657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c102a80 0x7f838c102e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 -- 172.21.15.6:0/1346632657 >> 172.21.15.6:0/1346632657 conn(0x7f838c079740 msgr2=0x7f838c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 -- 172.21.15.6:0/1346632657 shutdown_connections 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.687+0000 7f8390830640 1 -- 172.21.15.6:0/1346632657 wait complete. 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 Processor -- start 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 -- start start 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c102a80 0x7f838c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 0x7f838c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f838c112830 con 0x7f838c1083c0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1126b0 con 0x7f838c108d10 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8390830640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1129b0 con 0x7f838c102a80 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8389d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8389d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40428/0 (socket says 172.21.15.6:40428) 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f8389d9b640 1 -- 172.21.15.6:0/723184103 learned_addr learned my addr 172.21.15.6:0/723184103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f838ad9d640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 0x7f838c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.688+0000 7f838a59c640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c102a80 0x7f838c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 -- 172.21.15.6:0/723184103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c102a80 msgr2=0x7f838c198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c102a80 0x7f838c198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 -- 172.21.15.6:0/723184103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 msgr2=0x7f838c199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 0x7f838c199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 -- 172.21.15.6:0/723184103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c1a8660 con 0x7f838c1083c0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8389d9b640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f838000d770 tx=0x7f838000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380017070 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c1a8950 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8380009c30 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838000f620 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.689+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c1a8ee0 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.690+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c103d00 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.692+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f838001a070 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.692+0000 7f837b7fe640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 0x7f83740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.692+0000 7f838a59c640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 0x7f83740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.693+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7046+0+0 (secure 0 0 0) 0x7f83800e68b0 con 0x7f838c1083c0 2024-09-21T07:57:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.693+0000 7f838a59c640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 0x7f83740b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f838c1081d0 tx=0x7f837c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.697+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8380009de0 con 0x7f838c1083c0 2024-09-21T07:57:52.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.890+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f838c10aae0 con 0x7f838c1083c0 2024-09-21T07:57:52.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.890+0000 7f837b7fe640 1 -- 172.21.15.6:0/723184103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f83800b1a10 con 0x7f838c1083c0 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: Detected new or changed devices on smithi145 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:52.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:52.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:52.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 msgr2=0x7f83740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 0x7f83740b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f838c1081d0 tx=0x7f837c0058d0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 msgr2=0x7f838c1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f838000d770 tx=0x7f838000dc30 comp rx=0 tx=0).stop 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 shutdown_connections 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83740b6560 0x7f83740b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f838c108d10 0x7f838c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f838c1083c0 0x7f838c1994f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 --2- 172.21.15.6:0/723184103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f838c102a80 0x7f838c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 >> 172.21.15.6:0/723184103 conn(0x7f838c079740 msgr2=0x7f838c1015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 shutdown_connections 2024-09-21T07:57:52.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:52.893+0000 7f8390830640 1 -- 172.21.15.6:0/723184103 wait complete. 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: Detected new or changed devices on smithi145 2024-09-21T07:57:53.123 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:53.124 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:57:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: Detected new or changed devices on smithi145 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:53.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:53.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:57:53.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T07:57:53.120+0000 7f6afffe9640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:57:53.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T07:57:53.135+0000 7f6af7ddf640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:57:53.793 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726905448,"num_in_osds":12,"osd_in_since":1726905450,"num_remapped_pgs":0} 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/723184103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:53 smithi006 ceph-mon[30970]: from='osd.11 ' entity='osd.11' 2024-09-21T07:57:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:57:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:57:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/723184103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:54.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:53 smithi119 ceph-mon[33564]: from='osd.11 ' entity='osd.11' 2024-09-21T07:57:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-21T07:57:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:57:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:54.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/723184103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:54.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:53 smithi145 ceph-mon[34049]: from='osd.11 ' entity='osd.11' 2024-09-21T07:57:54.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:57:54.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: purged_snaps scrub starts 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: purged_snaps scrub ok 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] boot 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:57:54.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:54 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:57:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: purged_snaps scrub starts 2024-09-21T07:57:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: purged_snaps scrub ok 2024-09-21T07:57:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] boot 2024-09-21T07:57:55.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:57:55.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:54 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: purged_snaps scrub starts 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: purged_snaps scrub ok 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: osd.11 [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] boot 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:57:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:54 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 -- 172.21.15.6:0/3767156726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108b50 msgr2=0x7f160010f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 --2- 172.21.15.6:0/3767156726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108b50 0x7f160010f380 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009ca0 tx=0x7f15f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 -- 172.21.15.6:0/3767156726 shutdown_connections 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 --2- 172.21.15.6:0/3767156726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108200 0x7f1600108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 --2- 172.21.15.6:0/3767156726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108b50 0x7f160010f380 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 --2- 172.21.15.6:0/3767156726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 0x7f1600102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 -- 172.21.15.6:0/3767156726 >> 172.21.15.6:0/3767156726 conn(0x7f16000fe350 msgr2=0x7f16001007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 -- 172.21.15.6:0/3767156726 shutdown_connections 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.548+0000 7f16053a2640 1 -- 172.21.15.6:0/3767156726 wait complete. 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 Processor -- start 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 -- start start 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 0x7f160019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108b50 0x7f160019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1600112700 con 0x7f1600108200 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1600112580 con 0x7f16001028c0 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.549+0000 7f16053a2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1600112880 con 0x7f1600108b50 2024-09-21T07:57:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40434/0 (socket says 172.21.15.6:40434) 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 -- 172.21.15.6:0/3620647164 learned_addr learned my addr 172.21.15.6:0/3620647164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f1604ba1640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108b50 0x7f160019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15fffff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 0x7f160019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 -- 172.21.15.6:0/3620647164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108b50 msgr2=0x7f160019fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108b50 0x7f160019fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 -- 172.21.15.6:0/3620647164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 msgr2=0x7f160019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 0x7f160019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 -- 172.21.15.6:0/3620647164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16001a0150 con 0x7f1600108200 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15f7fff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15e800d740 tx=0x7f15e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8017070 con 0x7f1600108200 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e800de50 con 0x7f1600108200 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16001a0440 con 0x7f1600108200 2024-09-21T07:57:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800f620 con 0x7f1600108200 2024-09-21T07:57:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.550+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16001a6ba0 con 0x7f1600108200 2024-09-21T07:57:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.552+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1600102cd0 con 0x7f1600108200 2024-09-21T07:57:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.554+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f15e801a070 con 0x7f1600108200 2024-09-21T07:57:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.555+0000 7f15fdffb640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 0x7f15ec0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.555+0000 7f15fffff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 0x7f15ec0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.555+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f15e80e6800 con 0x7f1600108200 2024-09-21T07:57:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.556+0000 7f15fffff640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 0x7f15ec0b8af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15f00058c0 tx=0x7f15f000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.558+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15e80b18c0 con 0x7f1600108200 2024-09-21T07:57:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.749+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f16001a6ed0 con 0x7f1600108200 2024-09-21T07:57:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.749+0000 7f15fdffb640 1 -- 172.21.15.6:0/3620647164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f15e80b6800 con 0x7f1600108200 2024-09-21T07:57:55.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:57:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 msgr2=0x7f15ec0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 0x7f15ec0b8af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15f00058c0 tx=0x7f15f000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 msgr2=0x7f160019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15e800d740 tx=0x7f15e800dc00 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 shutdown_connections 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f15ec0b65e0 0x7f15ec0b8af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1600108b50 0x7f160019fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1600108200 0x7f160019a780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 --2- 172.21.15.6:0/3620647164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16001028c0 0x7f160019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 >> 172.21.15.6:0/3620647164 conn(0x7f16000fe350 msgr2=0x7f160006bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 shutdown_connections 2024-09-21T07:57:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:55.752+0000 7f16053a2640 1 -- 172.21.15.6:0/3620647164 wait complete. 2024-09-21T07:57:56.499 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726905474,"num_in_osds":12,"osd_in_since":1726905450,"num_remapped_pgs":0} 2024-09-21T07:57:56.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:57:56.755 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:57:56.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:56 smithi006 ceph-mon[30970]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:56.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:56 smithi006 ceph-mon[30970]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:57:56.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:56 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3620647164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:56 smithi119 ceph-mon[33564]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:56 smithi119 ceph-mon[33564]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:57:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:56 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3620647164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:56 smithi145 ceph-mon[34049]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:56 smithi145 ceph-mon[34049]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:57:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:56 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3620647164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:57:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 -- 172.21.15.6:0/2177629934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109560 msgr2=0x7f072c109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 --2- 172.21.15.6:0/2177629934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109560 0x7f072c109970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0720009900 tx=0x7f072002a410 comp rx=0 tx=0).stop 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 -- 172.21.15.6:0/2177629934 shutdown_connections 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 --2- 172.21.15.6:0/2177629934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c109eb0 0x7f072c1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 --2- 172.21.15.6:0/2177629934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109560 0x7f072c109970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 --2- 172.21.15.6:0/2177629934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c102080 0x7f072c102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 -- 172.21.15.6:0/2177629934 >> 172.21.15.6:0/2177629934 conn(0x7f072c079ec0 msgr2=0x7f072c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 -- 172.21.15.6:0/2177629934 shutdown_connections 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.389+0000 7f0731554640 1 -- 172.21.15.6:0/2177629934 wait complete. 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 Processor -- start 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 -- start start 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c102080 0x7f072c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c109560 0x7f072c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f072c113a20 con 0x7f072c109eb0 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1138a0 con 0x7f072c102080 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.390+0000 7f0731554640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f072c113ba0 con 0x7f072c109560 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35532/0 (socket says 172.21.15.6:35532) 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 -- 172.21.15.6:0/1315079658 learned_addr learned my addr 172.21.15.6:0/1315079658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072a7fc640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c109560 0x7f072c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072affd640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c102080 0x7f072c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 -- 172.21.15.6:0/1315079658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c109560 msgr2=0x7f072c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c109560 0x7f072c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 -- 172.21.15.6:0/1315079658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c102080 msgr2=0x7f072c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c102080 0x7f072c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 -- 172.21.15.6:0/1315079658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c1a02e0 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f072b7fe640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072400eaa0 tx=0x7f072400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724004d20 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0724005020 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c1a05d0 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07240116d0 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.391+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c1a0a90 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.392+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072c102490 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.394+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f07240051d0 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.395+0000 7f0713fff640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 0x7f07140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.395+0000 7f072affd640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 0x7f07140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.395+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f07240e7500 con 0x7f072c109eb0 2024-09-21T07:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.395+0000 7f072affd640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 0x7f07140b8aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f071c00abe0 tx=0x7f071c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.398+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0724016030 con 0x7f072c109eb0 2024-09-21T07:57:57.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.590+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f072c19b560 con 0x7f072c109eb0 2024-09-21T07:57:57.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.591+0000 7f0713fff640 1 -- 172.21.15.6:0/1315079658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18745 (secure 0 0 0) 0x7f072c19b560 con 0x7f072c109eb0 2024-09-21T07:57:57.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:57:57.593 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:57:55.709594+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 msgr2=0x7f07140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 0x7f07140b8aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f071c00abe0 tx=0x7f071c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 msgr2=0x7f072c19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072400eaa0 tx=0x7f072400eea0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 shutdown_connections 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07140b6590 0x7f07140b8aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072c109560 0x7f072c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c109eb0 0x7f072c19fc70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 --2- 172.21.15.6:0/1315079658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f072c102080 0x7f072c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 >> 172.21.15.6:0/1315079658 conn(0x7f072c079ec0 msgr2=0x7f072c107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 shutdown_connections 2024-09-21T07:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:57.594+0000 7f0731554640 1 -- 172.21.15.6:0/1315079658 wait complete. 2024-09-21T07:57:57.911 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:57 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1315079658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:57:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:57 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1315079658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:57:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:57 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1315079658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:57:58.328 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:54:01.897308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:57:58.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:57:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:57:58.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:58 smithi006 ceph-mon[30970]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3961867336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104840 msgr2=0x7f0e4c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3961867336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104840 0x7f0e4c104c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009900 tx=0x7f0e4402a410 comp rx=0 tx=0).stop 2024-09-21T07:57:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3961867336 shutdown_connections 2024-09-21T07:57:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3961867336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3961867336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105270 0x7f0e4c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3961867336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104840 0x7f0e4c104c50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3961867336 >> 172.21.15.6:0/3961867336 conn(0x7f0e4c079730 msgr2=0x7f0e4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3961867336 shutdown_connections 2024-09-21T07:57:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.101+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3961867336 wait complete. 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.102+0000 7f0e50cc7640 1 Processor -- start 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.102+0000 7f0e50cc7640 1 -- start start 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.102+0000 7f0e50cc7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c104840 0x7f0e4c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.102+0000 7f0e50cc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e50cc7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e50cc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c113940 con 0x7f0e4c105270 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e50cc7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1137c0 con 0x7f0e4c10ddf0 2024-09-21T07:57:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e50cc7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c113ac0 con 0x7f0e4c104840 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35552/0 (socket says 172.21.15.6:35552) 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 -- 172.21.15.6:0/3962094658 learned_addr learned my addr 172.21.15.6:0/3962094658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c104840 0x7f0e4c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e4ad9d640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 -- 172.21.15.6:0/3962094658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c104840 msgr2=0x7f0e4c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c104840 0x7f0e4c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 -- 172.21.15.6:0/3962094658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 msgr2=0x7f0e4c19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 -- 172.21.15.6:0/3962094658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c1a0380 con 0x7f0e4c105270 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e4ad9d640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e49d9b640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d950 tx=0x7f0e3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34017070 con 0x7f0e4c105270 2024-09-21T07:57:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e34009c30 con 0x7f0e4c105270 2024-09-21T07:57:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.103+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c1a0670 con 0x7f0e4c105270 2024-09-21T07:57:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.104+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e340047a0 con 0x7f0e4c105270 2024-09-21T07:57:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.104+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c1a6dd0 con 0x7f0e4c105270 2024-09-21T07:57:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.105+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4c104c50 con 0x7f0e4c105270 2024-09-21T07:57:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.107+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f0e34004020 con 0x7f0e4c105270 2024-09-21T07:57:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.108+0000 7f0e437fe640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 0x7f0e380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.108+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 0x7f0e380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.108+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f0e340e71f0 con 0x7f0e4c105270 2024-09-21T07:57:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.109+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 0x7f0e380b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004770 tx=0x7f0e440058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.111+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e34020020 con 0x7f0e4c105270 2024-09-21T07:57:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:58 smithi119 ceph-mon[33564]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:58 smithi145 ceph-mon[34049]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:57:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.302+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e4c1089e0 con 0x7f0e4c105270 2024-09-21T07:57:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.302+0000 7f0e437fe640 1 -- 172.21.15.6:0/3962094658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f0e340addb0 con 0x7f0e4c105270 2024-09-21T07:57:59.304 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 msgr2=0x7f0e380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 0x7f0e380b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004770 tx=0x7f0e440058d0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 msgr2=0x7f0e4c19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d950 tx=0x7f0e3400de10 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 shutdown_connections 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e380b6560 0x7f0e380b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c10ddf0 0x7f0e4c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c105270 0x7f0e4c19a9b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 --2- 172.21.15.6:0/3962094658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c104840 0x7f0e4c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 >> 172.21.15.6:0/3962094658 conn(0x7f0e4c079730 msgr2=0x7f0e4c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 shutdown_connections 2024-09-21T07:57:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:57:59.304+0000 7f0e50cc7640 1 -- 172.21.15.6:0/3962094658 wait complete. 2024-09-21T07:57:59.988 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:57:59 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3962094658' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.a on smithi006 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.d on smithi006 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.g on smithi006 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.j on smithi006 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.b on smithi119 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.e on smithi119 2024-09-21T07:58:00.019 INFO:tasks.cephadm:Adding mds.h on smithi119 2024-09-21T07:58:00.020 INFO:tasks.cephadm:Adding mds.k on smithi119 2024-09-21T07:58:00.020 INFO:tasks.cephadm:Adding mds.c on smithi145 2024-09-21T07:58:00.020 INFO:tasks.cephadm:Adding mds.f on smithi145 2024-09-21T07:58:00.020 INFO:tasks.cephadm:Adding mds.i on smithi145 2024-09-21T07:58:00.020 INFO:tasks.cephadm:Adding mds.l on smithi145 2024-09-21T07:58:00.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph orch apply mds all '12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l' 2024-09-21T07:58:00.048 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:57:59 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3962094658' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:58:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:57:59 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3962094658' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:58:00.278 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 -- 172.21.15.145:0/2653292305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 msgr2=0x7f53a81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 --2- 172.21.15.145:0/2653292305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81087b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009900 tx=0x7f53a402a410 comp rx=0 tx=0).stop 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 -- 172.21.15.145:0/2653292305 shutdown_connections 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 --2- 172.21.15.145:0/2653292305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81087b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 --2- 172.21.15.145:0/2653292305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8108cf0 0x7f53a810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 --2- 172.21.15.145:0/2653292305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8102a60 0x7f53a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.787+0000 7f53af420640 1 -- 172.21.15.145:0/2653292305 >> 172.21.15.145:0/2653292305 conn(0x7f53a8079730 msgr2=0x7f53a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 -- 172.21.15.145:0/2653292305 shutdown_connections 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 -- 172.21.15.145:0/2653292305 wait complete. 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 Processor -- start 2024-09-21T07:58:00.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 -- start start 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8102a60 0x7f53a8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 0x7f53a819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.788+0000 7f53af420640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53a8112850 con 0x7f53a8108cf0 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53af420640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53a81126d0 con 0x7f53a8102a60 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53af420640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f53a81129d0 con 0x7f53a81083a0 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:41092/0 (socket says 172.21.15.145:41092) 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 -- 172.21.15.145:0/1043498230 learned_addr learned my addr 172.21.15.145:0/1043498230 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ad1bc640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8102a60 0x7f53a8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ad9bd640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 0x7f53a819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 -- 172.21.15.145:0/1043498230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8102a60 msgr2=0x7f53a8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8102a60 0x7f53a8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:00.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 -- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 msgr2=0x7f53a819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 0x7f53a819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 -- 172.21.15.145:0/1043498230 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a819f1f0 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ad9bd640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 0x7f53a819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53ac9bb640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005940 tx=0x7f53a40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a403f030 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a819f480 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53a4003c90 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a819f9b0 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.789+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4035070 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.791+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a8102e70 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.793+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f53a4042030 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.794+0000 7f539a7fc640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 0x7f53940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.794+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f53a41079a0 con 0x7f53a81083a0 2024-09-21T07:58:00.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.794+0000 7f53ad1bc640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 0x7f53940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:00.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.795+0000 7f53ad1bc640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 0x7f53940b8aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f539c00abe0 tx=0x7f539c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:00.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.796+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53a819f9b0 con 0x7f53a81083a0 2024-09-21T07:58:00.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:00 smithi145 ceph-mon[34049]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:00.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.990+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}) -- 0x7f53a810a680 con 0x7f53940b6590 2024-09-21T07:58:01.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:00.998+0000 7f539a7fc640 1 -- 172.21.15.145:0/1043498230 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f53a810a680 con 0x7f53940b6590 2024-09-21T07:58:01.000 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mds.all update... 2024-09-21T07:58:01.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 msgr2=0x7f53940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:01.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 0x7f53940b8aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f539c00abe0 tx=0x7f539c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 msgr2=0x7f53a81998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005940 tx=0x7f53a40042f0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 shutdown_connections 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53940b6590 0x7f53940b8aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53a81083a0 0x7f53a81998e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a8108cf0 0x7f53a819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 --2- 172.21.15.145:0/1043498230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53a8102a60 0x7f53a8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:01.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 >> 172.21.15.145:0/1043498230 conn(0x7f53a8079730 msgr2=0x7f53a8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:01.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 shutdown_connections 2024-09-21T07:58:01.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-21T07:58:01.001+0000 7f53af420640 1 -- 172.21.15.145:0/1043498230 wait complete. 2024-09-21T07:58:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:00 smithi119 ceph-mon[33564]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:00 smithi006 ceph-mon[30970]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:01.701 DEBUG:teuthology.orchestra.run.smithi006:mds.a> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.a.service 2024-09-21T07:58:01.705 DEBUG:teuthology.orchestra.run.smithi006:mds.d> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.d.service 2024-09-21T07:58:01.750 DEBUG:teuthology.orchestra.run.smithi006:mds.g> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.g.service 2024-09-21T07:58:01.794 DEBUG:teuthology.orchestra.run.smithi006:mds.j> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.j.service 2024-09-21T07:58:01.838 DEBUG:teuthology.orchestra.run.smithi119:mds.b> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.b.service 2024-09-21T07:58:01.841 DEBUG:teuthology.orchestra.run.smithi119:mds.e> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.e.service 2024-09-21T07:58:01.885 DEBUG:teuthology.orchestra.run.smithi119:mds.h> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.h.service 2024-09-21T07:58:01.929 DEBUG:teuthology.orchestra.run.smithi119:mds.k> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.k.service 2024-09-21T07:58:01.973 DEBUG:teuthology.orchestra.run.smithi145:mds.c> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.c.service 2024-09-21T07:58:01.976 DEBUG:teuthology.orchestra.run.smithi145:mds.f> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.f.service 2024-09-21T07:58:02.018 DEBUG:teuthology.orchestra.run.smithi145:mds.i> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.i.service 2024-09-21T07:58:02.061 DEBUG:teuthology.orchestra.run.smithi145:mds.l> sudo journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.l.service 2024-09-21T07:58:02.104 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:58:02.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:02.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:02.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:02.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.358 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-21T07:58:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:02.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:02.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.883+0000 7fdc899b8640 1 -- 172.21.15.6:0/1790638957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc84108d20 msgr2=0x7fdc8410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.883+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1790638957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc84108d20 0x7fdc8410f550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009900 tx=0x7fdc7c02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 -- 172.21.15.6:0/1790638957 shutdown_connections 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1790638957 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc841083d0 0x7fdc841087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1790638957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc84108d20 0x7fdc8410f550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1790638957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 0x7fdc84102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 -- 172.21.15.6:0/1790638957 >> 172.21.15.6:0/1790638957 conn(0x7fdc84079760 msgr2=0x7fdc84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 -- 172.21.15.6:0/1790638957 shutdown_connections 2024-09-21T07:58:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 -- 172.21.15.6:0/1790638957 wait complete. 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.884+0000 7fdc899b8640 1 Processor -- start 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 -- start start 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 0x7fdc8419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84108d20 0x7fdc8419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84113960 con 0x7fdc841083d0 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc841137e0 con 0x7fdc84102ae0 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc899b8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84113ae0 con 0x7fdc84108d20 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35572/0 (socket says 172.21.15.6:35572) 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 -- 172.21.15.6:0/1085190742 learned_addr learned my addr 172.21.15.6:0/1085190742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc837fe640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84108d20 0x7fdc8419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 0x7fdc8419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 -- 172.21.15.6:0/1085190742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84108d20 msgr2=0x7fdc8419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84108d20 0x7fdc8419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 -- 172.21.15.6:0/1085190742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 msgr2=0x7fdc8419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 0x7fdc8419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.885+0000 7fdc827fc640 1 -- 172.21.15.6:0/1085190742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc841a02a0 con 0x7fdc841083d0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc827fc640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c970 tx=0x7fdc7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78007bb0 con 0x7fdc841083d0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc78007d50 con 0x7fdc841083d0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc841a0590 con 0x7fdc841083d0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78004e10 con 0x7fdc841083d0 2024-09-21T07:58:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.886+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc841a6cf0 con 0x7fdc841083d0 2024-09-21T07:58:02.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.887+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc84103d10 con 0x7fdc841083d0 2024-09-21T07:58:02.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.888+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fdc78004fb0 con 0x7fdc841083d0 2024-09-21T07:58:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.889+0000 7fdc889b6640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 0x7fdc6c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.889+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 0x7fdc6c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.889+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fdc780e6c10 con 0x7fdc841083d0 2024-09-21T07:58:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.890+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 0x7fdc6c0b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005fd0 tx=0x7fdc74009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:02.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:02.894+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc78014030 con 0x7fdc841083d0 2024-09-21T07:58:03.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.120+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc8419b460 con 0x7fdc841083d0 2024-09-21T07:58:03.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:02 smithi006 ceph-mon[30970]: Deploying daemon mds.l on smithi145 2024-09-21T07:58:03.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:02 smithi006 ceph-mon[30970]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:03.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.121+0000 7fdc889b6640 1 -- 172.21.15.6:0/1085190742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fdc8419b460 con 0x7fdc841083d0 2024-09-21T07:58:03.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:03.123 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"btime":"2024-09-21T07:50:07:867449+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:58:03.123 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 msgr2=0x7fdc6c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 0x7fdc6c0b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005fd0 tx=0x7fdc74009500 comp rx=0 tx=0).stop 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 msgr2=0x7fdc8419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c970 tx=0x7fdc7800ce30 comp rx=0 tx=0).stop 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 shutdown_connections 2024-09-21T07:58:03.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdc6c0b6560 0x7fdc6c0b8a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84108d20 0x7fdc8419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841083d0 0x7fdc8419a8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 --2- 172.21.15.6:0/1085190742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc84102ae0 0x7fdc8419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 >> 172.21.15.6:0/1085190742 conn(0x7fdc84079760 msgr2=0x7fdc84105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 shutdown_connections 2024-09-21T07:58:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:03.123+0000 7fdc899b8640 1 -- 172.21.15.6:0/1085190742 wait complete. 2024-09-21T07:58:03.145 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:02 smithi145 ceph-mon[34049]: Deploying daemon mds.l on smithi145 2024-09-21T07:58:03.145 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:02 smithi145 ceph-mon[34049]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:02 smithi119 ceph-mon[33564]: Deploying daemon mds.l on smithi145 2024-09-21T07:58:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:02 smithi119 ceph-mon[33564]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:03.443 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 systemd[1]: Starting Ceph mds.l for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:03.793 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 podman[62069]: 2024-09-21 07:58:03.445478195 +0000 UTC m=+0.016252449 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:03.793 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 podman[62069]: 2024-09-21 07:58:03.564845176 +0000 UTC m=+0.135619423 container create 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1085190742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.145:6832/4259948654,v1:172.21.15.145:6833/4259948654] up:boot 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: fsmap 1 up:standby 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:04.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:04 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 podman[62069]: 2024-09-21 07:58:03.792614621 +0000 UTC m=+0.363388867 container init 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 podman[62069]: 2024-09-21 07:58:03.795350626 +0000 UTC m=+0.366124884 container start 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 ceph-mds[62088]: -- 172.21.15.145:0/3479647934 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b9a8a9860 con 0x557b9ea51a80 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l[62084]: starting mds.l at 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 bash[62069]: 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 2024-09-21T07:58:04.195 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 07:58:03 smithi145 systemd[1]: Started Ceph mds.l for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1085190742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.145:6832/4259948654,v1:172.21.15.145:6833/4259948654] up:boot 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: fsmap 1 up:standby 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:04.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:04 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1085190742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.145:6832/4259948654,v1:172.21.15.145:6833/4259948654] up:boot 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: fsmap 1 up:standby 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:04.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:04.351 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:04 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:05 smithi119 ceph-mon[33564]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:05 smithi119 ceph-mon[33564]: Deploying daemon mds.k on smithi119 2024-09-21T07:58:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:05 smithi145 ceph-mon[34049]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:05 smithi145 ceph-mon[34049]: Deploying daemon mds.k on smithi119 2024-09-21T07:58:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:05 smithi006 ceph-mon[30970]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:05.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:05 smithi006 ceph-mon[30970]: Deploying daemon mds.k on smithi119 2024-09-21T07:58:05.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:06.158 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:05 smithi119 systemd[1]: Starting Ceph mds.k for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:06.214 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:06.534 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 podman[62185]: 2024-09-21 07:58:06.084183845 +0000 UTC m=+0.015802372 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:06.534 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 podman[62185]: 2024-09-21 07:58:06.2056319 +0000 UTC m=+0.137250415 container create d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:58:06.534 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 podman[62185]: 2024-09-21 07:58:06.533378197 +0000 UTC m=+0.464996713 container init d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T07:58:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 -- 172.21.15.6:0/2512908116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 msgr2=0x7fb5cc104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 --2- 172.21.15.6:0/2512908116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc104c70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009900 tx=0x7fb5bc02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 -- 172.21.15.6:0/2512908116 shutdown_connections 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 --2- 172.21.15.6:0/2512908116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc10de10 0x7fb5cc1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 --2- 172.21.15.6:0/2512908116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc105290 0x7fb5cc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 --2- 172.21.15.6:0/2512908116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc104c70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 -- 172.21.15.6:0/2512908116 >> 172.21.15.6:0/2512908116 conn(0x7fb5cc079730 msgr2=0x7fb5cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 -- 172.21.15.6:0/2512908116 shutdown_connections 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.703+0000 7fb5d2038640 1 -- 172.21.15.6:0/2512908116 wait complete. 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 Processor -- start 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 -- start start 2024-09-21T07:58:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 0x7fb5cc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 0x7fb5cc19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc113910 con 0x7fb5cc104860 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc113790 con 0x7fb5cc10de10 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5d2038640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc113a90 con 0x7fb5cc105290 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.704+0000 7fb5cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60702/0 (socket says 172.21.15.6:60702) 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 -- 172.21.15.6:0/221323961 learned_addr learned my addr 172.21.15.6:0/221323961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cbfff640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 0x7fb5cc19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5caffd640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 0x7fb5cc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 -- 172.21.15.6:0/221323961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 msgr2=0x7fb5cc19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 0x7fb5cc19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 -- 172.21.15.6:0/221323961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 msgr2=0x7fb5cc19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 0x7fb5cc19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 -- 172.21.15.6:0/221323961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc1a03b0 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5caffd640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 0x7fb5cc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cbfff640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 0x7fb5cc19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5cb7fe640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009230 tx=0x7fb5bc0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc03f030 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5bc0043d0 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc1a0640 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.705+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc035070 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.706+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc1a6e00 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.707+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5cc104c70 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.708+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fb5bc042030 con 0x7fb5cc104860 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.709+0000 7fb5c8ff9640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 0x7fb5b40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.709+0000 7fb5caffd640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 0x7fb5b40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.709+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb5bc1076f0 con 0x7fb5cc104860 2024-09-21T07:58:06.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.710+0000 7fb5caffd640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 0x7fb5b40b8af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc102490 tx=0x7fb5c0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.713+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5bc0ce350 con 0x7fb5cc104860 2024-09-21T07:58:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 podman[62185]: 2024-09-21 07:58:06.536497084 +0000 UTC m=+0.468115602 container start d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T07:58:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 ceph-mds[62204]: -- 172.21.15.119:0/3431273336 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c66f60f860 con 0x55c6737b7a80 2024-09-21T07:58:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k[62200]: starting mds.k at 2024-09-21T07:58:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 bash[62185]: d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 2024-09-21T07:58:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 07:58:06 smithi119 systemd[1]: Started Ceph mds.k for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.940+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5cc19b570 con 0x7fb5cc104860 2024-09-21T07:58:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.940+0000 7fb5c8ff9640 1 -- 172.21.15.6:0/221323961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fb5cc19b570 con 0x7fb5cc104860 2024-09-21T07:58:06.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:06.942 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"btime":"2024-09-21T07:58:03:833769+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:58:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-09-21T07:58:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 msgr2=0x7fb5b40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 0x7fb5b40b8af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc102490 tx=0x7fb5c0005f90 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 msgr2=0x7fb5cc19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009230 tx=0x7fb5bc0319a0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 shutdown_connections 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5b40b65e0 0x7fb5b40b8af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5cc105290 0x7fb5cc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc10de10 0x7fb5cc19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 --2- 172.21.15.6:0/221323961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5cc104860 0x7fb5cc19a440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 >> 172.21.15.6:0/221323961 conn(0x7fb5cc079730 msgr2=0x7fb5cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 shutdown_connections 2024-09-21T07:58:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:06.943+0000 7fb5d2038640 1 -- 172.21.15.6:0/221323961 wait complete. 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:07.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:07 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/221323961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:07.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:07 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/221323961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:07.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:07.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:07.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:07 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/221323961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:08.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:08 smithi006 ceph-mon[30970]: Deploying daemon mds.j on smithi006 2024-09-21T07:58:08.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:08 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6832/592378988,v1:172.21.15.119:6833/592378988] up:boot 2024-09-21T07:58:08.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:08 smithi006 ceph-mon[30970]: fsmap 2 up:standby 2024-09-21T07:58:08.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:08 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:58:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:08 smithi119 ceph-mon[33564]: Deploying daemon mds.j on smithi006 2024-09-21T07:58:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:08 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6832/592378988,v1:172.21.15.119:6833/592378988] up:boot 2024-09-21T07:58:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:08 smithi119 ceph-mon[33564]: fsmap 2 up:standby 2024-09-21T07:58:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:08 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:58:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:08 smithi145 ceph-mon[34049]: Deploying daemon mds.j on smithi006 2024-09-21T07:58:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:08 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6832/592378988,v1:172.21.15.119:6833/592378988] up:boot 2024-09-21T07:58:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:08 smithi145 ceph-mon[34049]: fsmap 2 up:standby 2024-09-21T07:58:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:08 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:58:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:09 smithi006 ceph-mon[30970]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:09.461 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 systemd[1]: Starting Ceph mds.j for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:09 smithi119 ceph-mon[33564]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:09 smithi145 ceph-mon[34049]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:09.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:09.926 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 podman[72125]: 2024-09-21 07:58:09.540633026 +0000 UTC m=+0.016234478 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:09.926 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 podman[72125]: 2024-09-21 07:58:09.652947315 +0000 UTC m=+0.128548810 container create 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T07:58:09.926 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 podman[72125]: 2024-09-21 07:58:09.880461788 +0000 UTC m=+0.356063225 container init 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:58:09.926 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 podman[72125]: 2024-09-21 07:58:09.884617965 +0000 UTC m=+0.360219404 container start 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T07:58:10.063 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:10.186 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 ceph-mds[72162]: -- 172.21.15.6:0/1745238911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d56847d860 con 0x55d56c625a80 2024-09-21T07:58:10.186 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j[72158]: starting mds.j at 2024-09-21T07:58:10.186 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 bash[72125]: 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 2024-09-21T07:58:10.186 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 07:58:09 smithi006 systemd[1]: Started Ceph mds.j for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 -- 172.21.15.6:0/493690481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 msgr2=0x7fe46410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 --2- 172.21.15.6:0/493690481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46410f540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009ca0 tx=0x7fe45c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 -- 172.21.15.6:0/493690481 shutdown_connections 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 --2- 172.21.15.6:0/493690481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46410f540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 --2- 172.21.15.6:0/493690481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 0x7fe4641087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 --2- 172.21.15.6:0/493690481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 0x7fe464102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 -- 172.21.15.6:0/493690481 >> 172.21.15.6:0/493690481 conn(0x7fe464079740 msgr2=0x7fe464079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 -- 172.21.15.6:0/493690481 shutdown_connections 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.596+0000 7fe46a501640 1 -- 172.21.15.6:0/493690481 wait complete. 2024-09-21T07:58:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.597+0000 7fe46a501640 1 Processor -- start 2024-09-21T07:58:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.597+0000 7fe46a501640 1 -- start start 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 0x7fe464199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 0x7fe4641997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe464112880 con 0x7fe464108d10 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe464112700 con 0x7fe4641083c0 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe46a501640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe464112a00 con 0x7fe464102a80 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60746/0 (socket says 172.21.15.6:60746) 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 -- 172.21.15.6:0/2443314011 learned_addr learned my addr 172.21.15.6:0/2443314011 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe4637fe640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 0x7fe4641997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe463fff640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 0x7fe464199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 -- 172.21.15.6:0/2443314011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 msgr2=0x7fe464199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 0x7fe464199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 -- 172.21.15.6:0/2443314011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 msgr2=0x7fe4641997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 0x7fe4641997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 -- 172.21.15.6:0/2443314011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46419f1c0 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe468a9e640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005e30 tx=0x7fe45c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.598+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c032d10 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.599+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46419f450 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.599+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe45c032eb0 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.599+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c030b20 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.599+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4641a5c10 con 0x7fe464108d10 2024-09-21T07:58:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.600+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe464102e90 con 0x7fe464108d10 2024-09-21T07:58:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.601+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fe45c030cc0 con 0x7fe464108d10 2024-09-21T07:58:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.602+0000 7fe4617fa640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 0x7fe44c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.602+0000 7fe463fff640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 0x7fe44c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.602+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fe45c1082e0 con 0x7fe464108d10 2024-09-21T07:58:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.603+0000 7fe463fff640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 0x7fe44c0b8a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe454009bd0 tx=0x7fe454005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.606+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe45c0ceea0 con 0x7fe464108d10 2024-09-21T07:58:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.836+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46419a380 con 0x7fe464108d10 2024-09-21T07:58:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.837+0000 7fe4617fa640 1 -- 172.21.15.6:0/2443314011 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fe45c0d3280 con 0x7fe464108d10 2024-09-21T07:58:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:10.839 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"btime":"2024-09-21T07:58:10:201796+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:58:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 4 2024-09-21T07:58:10.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 msgr2=0x7fe44c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:10.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 0x7fe44c0b8a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe454009bd0 tx=0x7fe454005f90 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 msgr2=0x7fe46419ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005e30 tx=0x7fe45c0093d0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 shutdown_connections 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe44c0b6560 0x7fe44c0b8a70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe464108d10 0x7fe46419ea90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4641083c0 0x7fe4641997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 --2- 172.21.15.6:0/2443314011 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe464102a80 0x7fe464199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 >> 172.21.15.6:0/2443314011 conn(0x7fe464079740 msgr2=0x7fe4641043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 shutdown_connections 2024-09-21T07:58:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:10.839+0000 7fe46a501640 1 -- 172.21.15.6:0/2443314011 wait complete. 2024-09-21T07:58:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: Deploying daemon mds.d on smithi006 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.6:6834/161038542,v1:172.21.15.6:6835/161038542] up:boot 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: fsmap 3 up:standby 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:58:11.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2443314011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: Deploying daemon mds.d on smithi006 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.6:6834/161038542,v1:172.21.15.6:6835/161038542] up:boot 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: fsmap 3 up:standby 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:58:11.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2443314011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: Deploying daemon mds.d on smithi006 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.6:6834/161038542,v1:172.21.15.6:6835/161038542] up:boot 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: fsmap 3 up:standby 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:58:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2443314011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:13.207 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:13 smithi006 ceph-mon[30970]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:13 smithi119 ceph-mon[33564]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:13 smithi145 ceph-mon[34049]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:13.461 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 07:58:13 smithi006 podman[72507]: 2024-09-21 07:58:13.448812948 +0000 UTC m=+0.356385108 container start 1f7001471cae33cce85273eaf2e8af05a163a5361f02aa39e5ebbec29a55d2c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:58:13.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:13.823 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:13.945 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 07:58:13 smithi006 ceph-mds[72526]: -- 172.21.15.6:0/3417902570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a1298fc20 con 0x555a16b37a80 2024-09-21T07:58:13.945 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 07:58:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d[72522]: starting mds.d at 2024-09-21T07:58:13.945 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 07:58:13 smithi006 bash[72507]: 1f7001471cae33cce85273eaf2e8af05a163a5361f02aa39e5ebbec29a55d2c4 2024-09-21T07:58:13.945 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 07:58:13 smithi006 systemd[1]: Started Ceph mds.d for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/3501794593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4109e00 msgr2=0x7ff4c4110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/3501794593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4109e00 0x7ff4c4110630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009ca0 tx=0x7ff4bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/3501794593 shutdown_connections 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/3501794593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c41094b0 0x7ff4c41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/3501794593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4109e00 0x7ff4c4110630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/3501794593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c4103bc0 0x7ff4c4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/3501794593 >> 172.21.15.6:0/3501794593 conn(0x7ff4c407b910 msgr2=0x7ff4c407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/3501794593 shutdown_connections 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/3501794593 wait complete. 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.373+0000 7ff4cc2d4640 1 Processor -- start 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 -- start start 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 0x7ff4c419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 0x7ff4c419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c41139c0 con 0x7ff4c4103bc0 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4113840 con 0x7ff4c41094b0 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4cc2d4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4113b40 con 0x7ff4c4109e00 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4ca070640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4ca070640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60788/0 (socket says 172.21.15.6:60788) 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4ca070640 1 -- 172.21.15.6:0/2418315141 learned_addr learned my addr 172.21.15.6:0/2418315141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4c986f640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 0x7ff4c419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.374+0000 7ff4ca871640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 0x7ff4c419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 -- 172.21.15.6:0/2418315141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 msgr2=0x7ff4c419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 0x7ff4c419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 -- 172.21.15.6:0/2418315141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 msgr2=0x7ff4c419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 0x7ff4c419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 -- 172.21.15.6:0/2418315141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c41a0320 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca871640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 0x7ff4c419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4c986f640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 0x7ff4c419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4ca070640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d950 tx=0x7ff4c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0017070 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4c0009c30 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c41a0610 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000f620 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.375+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c41a6d70 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.376+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4103fd0 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.378+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7ff4c0005030 con 0x7ff4c4103bc0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.379+0000 7ff4bb7fe640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 0x7ff4b00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.380+0000 7ff4c986f640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 0x7ff4b00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.380+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff4c00e6cc0 con 0x7ff4c4103bc0 2024-09-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.380+0000 7ff4c986f640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 0x7ff4b00b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005fd0 tx=0x7ff4b400b5d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.383+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4c00ad880 con 0x7ff4c4103bc0 2024-09-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.609+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c419b4e0 con 0x7ff4c4103bc0 2024-09-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.610+0000 7ff4bb7fe640 1 -- 172.21.15.6:0/2418315141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7ff4c419b4e0 con 0x7ff4c4103bc0 2024-09-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"btime":"2024-09-21T07:58:14:031697+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 5 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 msgr2=0x7ff4b00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 0x7ff4b00b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005fd0 tx=0x7ff4b400b5d0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 msgr2=0x7ff4c419a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d950 tx=0x7ff4c000de10 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 shutdown_connections 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4b00b65e0 0x7ff4b00b8af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4c4109e00 0x7ff4c419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4c41094b0 0x7ff4c419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 --2- 172.21.15.6:0/2418315141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c4103bc0 0x7ff4c419a3b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 >> 172.21.15.6:0/2418315141 conn(0x7ff4c407b910 msgr2=0x7ff4c4107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 shutdown_connections 2024-09-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:14.612+0000 7ff4cc2d4640 1 -- 172.21.15.6:0/2418315141 wait complete. 2024-09-21T07:58:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: Deploying daemon mds.e on smithi119 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.6:6836/3652258575,v1:172.21.15.6:6837/3652258575] up:boot 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: fsmap 4 up:standby 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:58:14.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:14 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2418315141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:14.933 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:14.933 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.933 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: Deploying daemon mds.e on smithi119 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.6:6836/3652258575,v1:172.21.15.6:6837/3652258575] up:boot 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: fsmap 4 up:standby 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:58:14.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:14 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2418315141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: Deploying daemon mds.e on smithi119 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.6:6836/3652258575,v1:172.21.15.6:6837/3652258575] up:boot 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: fsmap 4 up:standby 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:58:14.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:14 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2418315141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:16.408 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 07:58:16 smithi119 systemd[1]: Started Ceph mds.e for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:17.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:17.561 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6834/467473041,v1:172.21.15.119:6835/467473041] up:boot 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: fsmap 5 up:standby 2024-09-21T07:58:17.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:17 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:58:17.682 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6834/467473041,v1:172.21.15.119:6835/467473041] up:boot 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: fsmap 5 up:standby 2024-09-21T07:58:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:17 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:58:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:17.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:17.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:17.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6834/467473041,v1:172.21.15.119:6835/467473041] up:boot 2024-09-21T07:58:17.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: fsmap 5 up:standby 2024-09-21T07:58:17.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:17 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:58:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 -- 172.21.15.6:0/1482316748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 msgr2=0x7f909410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 --2- 172.21.15.6:0/1482316748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909410f520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f908c009ca0 tx=0x7f908c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 -- 172.21.15.6:0/1482316748 shutdown_connections 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 --2- 172.21.15.6:0/1482316748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909410f520 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 --2- 172.21.15.6:0/1482316748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90941083a0 0x7f90941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 --2- 172.21.15.6:0/1482316748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9094102a60 0x7f9094102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 -- 172.21.15.6:0/1482316748 >> 172.21.15.6:0/1482316748 conn(0x7f9094079730 msgr2=0x7f9094079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 -- 172.21.15.6:0/1482316748 shutdown_connections 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.110+0000 7f909956b640 1 -- 172.21.15.6:0/1482316748 wait complete. 2024-09-21T07:58:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.111+0000 7f909956b640 1 Processor -- start 2024-09-21T07:58:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.111+0000 7f909956b640 1 -- start start 2024-09-21T07:58:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.111+0000 7f909956b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 0x7f909419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f909956b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90941083a0 0x7f909419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f909956b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f909956b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9094112860 con 0x7f9094108cf0 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f909956b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90941126e0 con 0x7f9094102a60 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f909956b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f90941129e0 con 0x7f90941083a0 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40388/0 (socket says 172.21.15.6:40388) 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 -- 172.21.15.6:0/2884090496 learned_addr learned my addr 172.21.15.6:0/2884090496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90927fc640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90941083a0 0x7f909419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f9092ffd640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 0x7f909419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 -- 172.21.15.6:0/2884090496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90941083a0 msgr2=0x7f909419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90941083a0 0x7f909419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 -- 172.21.15.6:0/2884090496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 msgr2=0x7f909419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 0x7f909419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 -- 172.21.15.6:0/2884090496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90941a0270 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f9092ffd640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 0x7f909419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f90937fe640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f908c005cc0 tx=0x7f908c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.112+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c032e00 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.113+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f908c0044d0 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.113+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90941a0500 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.113+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c030b70 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.113+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90941a6cc0 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.114+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9094102e70 con 0x7f9094108cf0 2024-09-21T07:58:18.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.115+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f908c030d10 con 0x7f9094108cf0 2024-09-21T07:58:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.117+0000 7f907bfff640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 0x7f907c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.117+0000 7f9092ffd640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 0x7f907c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.117+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f908c1083d0 con 0x7f9094108cf0 2024-09-21T07:58:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.117+0000 7f9092ffd640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 0x7f907c0b8af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90840058c0 tx=0x7f9084005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.120+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f908c0cf020 con 0x7f9094108cf0 2024-09-21T07:58:18.307 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 systemd[1]: Starting Ceph mds.f for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.348+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f909419b430 con 0x7f9094108cf0 2024-09-21T07:58:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.348+0000 7f907bfff640 1 -- 172.21.15.6:0/2884090496 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7f909419b430 con 0x7f9094108cf0 2024-09-21T07:58:18.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:18.350 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"btime":"2024-09-21T07:58:16:620783+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:58:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.350+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 msgr2=0x7f907c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.350+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 0x7f907c0b8af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90840058c0 tx=0x7f9084005850 comp rx=0 tx=0).stop 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.350+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 msgr2=0x7f909419fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.350+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f908c005cc0 tx=0x7f908c032a10 comp rx=0 tx=0).stop 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 shutdown_connections 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f907c0b65e0 0x7f907c0b8af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90941083a0 0x7f909419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9094108cf0 0x7f909419fb40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 --2- 172.21.15.6:0/2884090496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9094102a60 0x7f909419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 >> 172.21.15.6:0/2884090496 conn(0x7f9094079730 msgr2=0x7f9094101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 shutdown_connections 2024-09-21T07:58:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:18.351+0000 7f909956b640 1 -- 172.21.15.6:0/2884090496 wait complete. 2024-09-21T07:58:18.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:18 smithi145 ceph-mon[34049]: Deploying daemon mds.f on smithi145 2024-09-21T07:58:18.597 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:18 smithi145 ceph-mon[34049]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:18.597 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 podman[62348]: 2024-09-21 07:58:18.32438411 +0000 UTC m=+0.015861195 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:18.597 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 podman[62348]: 2024-09-21 07:58:18.468391815 +0000 UTC m=+0.159868875 container create 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:58:18.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:18 smithi119 ceph-mon[33564]: Deploying daemon mds.f on smithi145 2024-09-21T07:58:18.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:18 smithi119 ceph-mon[33564]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:18.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:18 smithi006 ceph-mon[30970]: Deploying daemon mds.f on smithi145 2024-09-21T07:58:18.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:18 smithi006 ceph-mon[30970]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:19.193 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 podman[62348]: 2024-09-21 07:58:18.71283003 +0000 UTC m=+0.404307101 container init 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:58:19.194 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 podman[62348]: 2024-09-21 07:58:18.715614764 +0000 UTC m=+0.407091827 container start 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:58:19.194 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 ceph-mds[62367]: -- 172.21.15.145:0/4247472591 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601e6097c20 con 0x5601ea23fa80 2024-09-21T07:58:19.194 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f[62363]: starting mds.f at 2024-09-21T07:58:19.194 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 bash[62348]: 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc 2024-09-21T07:58:19.194 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 07:58:18 smithi145 systemd[1]: Started Ceph mds.f for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:19.584 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2884090496' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:19 smithi145 ceph-mon[34049]: Deploying daemon mds.c on smithi145 2024-09-21T07:58:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2884090496' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:19.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:19 smithi119 ceph-mon[33564]: Deploying daemon mds.c on smithi145 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2884090496' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:19 smithi006 ceph-mon[30970]: Deploying daemon mds.c on smithi145 2024-09-21T07:58:20.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:20 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.145:6834/1223773032,v1:172.21.15.145:6835/1223773032] up:boot 2024-09-21T07:58:20.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:20 smithi145 ceph-mon[34049]: fsmap 6 up:standby 2024-09-21T07:58:20.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:20 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:58:20.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:20 smithi145 ceph-mon[34049]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:20 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.145:6834/1223773032,v1:172.21.15.145:6835/1223773032] up:boot 2024-09-21T07:58:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:20 smithi119 ceph-mon[33564]: fsmap 6 up:standby 2024-09-21T07:58:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:20 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:58:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:20 smithi119 ceph-mon[33564]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:20.693 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:20 smithi145 systemd[1]: Starting Ceph mds.c for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:20 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.145:6834/1223773032,v1:172.21.15.145:6835/1223773032] up:boot 2024-09-21T07:58:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:20 smithi006 ceph-mon[30970]: fsmap 6 up:standby 2024-09-21T07:58:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:20 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:58:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:20 smithi006 ceph-mon[30970]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:21.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:21.093 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:20 smithi145 podman[62615]: 2024-09-21 07:58:20.719678729 +0000 UTC m=+0.016001991 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:21.093 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:20 smithi145 podman[62615]: 2024-09-21 07:58:20.83954142 +0000 UTC m=+0.135864672 container create e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T07:58:21.094 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 podman[62615]: 2024-09-21 07:58:21.092709054 +0000 UTC m=+0.389032315 container init e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:58:21.296 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:21.444 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 podman[62615]: 2024-09-21 07:58:21.095571765 +0000 UTC m=+0.391895027 container start e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T07:58:21.445 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 ceph-mds[62634]: -- 172.21.15.145:0/1919927033 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea85a93860 con 0x55ea89c3b600 2024-09-21T07:58:21.445 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c[62630]: starting mds.c at 2024-09-21T07:58:21.445 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 bash[62615]: e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 2024-09-21T07:58:21.445 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 07:58:21 smithi145 systemd[1]: Started Ceph mds.c for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:21.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 -- 172.21.15.6:0/1643521149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 msgr2=0x7fd300103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:21.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 --2- 172.21.15.6:0/1643521149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd300103f70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009900 tx=0x7fd2fc02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:21.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 -- 172.21.15.6:0/1643521149 shutdown_connections 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 --2- 172.21.15.6:0/1643521149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3001094a0 0x7fd3001098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 --2- 172.21.15.6:0/1643521149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd300109df0 0x7fd300110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 --2- 172.21.15.6:0/1643521149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd300103f70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 -- 172.21.15.6:0/1643521149 >> 172.21.15.6:0/1643521149 conn(0x7fd30007b850 msgr2=0x7fd30007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 -- 172.21.15.6:0/1643521149 shutdown_connections 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.808+0000 7fd3076c3640 1 -- 172.21.15.6:0/1643521149 wait complete. 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 Processor -- start 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 -- start start 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3001094a0 0x7fd30019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd300109df0 0x7fd30019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd300113960 con 0x7fd300103b60 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001137e0 con 0x7fd3001094a0 2024-09-21T07:58:21.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd3076c3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd300113ae0 con 0x7fd300109df0 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd30545f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd30545f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40396/0 (socket says 172.21.15.6:40396) 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd30545f640 1 -- 172.21.15.6:0/2175052331 learned_addr learned my addr 172.21.15.6:0/2175052331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.809+0000 7fd304c5e640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3001094a0 0x7fd30019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd305c60640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd300109df0 0x7fd30019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 -- 172.21.15.6:0/2175052331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd300109df0 msgr2=0x7fd30019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd300109df0 0x7fd30019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 -- 172.21.15.6:0/2175052331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3001094a0 msgr2=0x7fd30019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3001094a0 0x7fd30019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 -- 172.21.15.6:0/2175052331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3001a03a0 con 0x7fd300103b60 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd30545f640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009230 tx=0x7fd2fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc03f030 con 0x7fd300103b60 2024-09-21T07:58:21.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001a0630 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2fc003a80 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc035070 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.810+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a6df0 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.811+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd300103f70 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.813+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fd2fc042030 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.814+0000 7fd2f27fc640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 0x7fd2ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.814+0000 7fd304c5e640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 0x7fd2ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.814+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd2fc107ae0 con 0x7fd300103b60 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.814+0000 7fd304c5e640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 0x7fd2ec0b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd300106610 tx=0x7fd2f4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:21.817+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2fc0d2a80 con 0x7fd300103b60 2024-09-21T07:58:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.043+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd30010bbf0 con 0x7fd300103b60 2024-09-21T07:58:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.044+0000 7fd2f27fc640 1 -- 172.21.15.6:0/2175052331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7fd2fc0d79c0 con 0x7fd300103b60 2024-09-21T07:58:22.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:22.045 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-21T07:58:21:320252+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T07:58:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-21T07:58:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 msgr2=0x7fd2ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 0x7fd2ec0b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd300106610 tx=0x7fd2f4005f90 comp rx=0 tx=0).stop 2024-09-21T07:58:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 msgr2=0x7fd30019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009230 tx=0x7fd2fc004270 comp rx=0 tx=0).stop 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 shutdown_connections 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2ec0b6560 0x7fd2ec0b8a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd300109df0 0x7fd30019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3001094a0 0x7fd30019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 --2- 172.21.15.6:0/2175052331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd300103b60 0x7fd30019a430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 >> 172.21.15.6:0/2175052331 conn(0x7fd30007b850 msgr2=0x7fd300107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 shutdown_connections 2024-09-21T07:58:22.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:22.046+0000 7fd3076c3640 1 -- 172.21.15.6:0/2175052331 wait complete. 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:22.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:22.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: Deploying daemon mds.h on smithi119 2024-09-21T07:58:22.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.145:6836/2301419443,v1:172.21.15.145:6837/2301419443] up:boot 2024-09-21T07:58:22.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: fsmap 7 up:standby 2024-09-21T07:58:22.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:58:22.431 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:22 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2175052331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:22.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: Deploying daemon mds.h on smithi119 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.145:6836/2301419443,v1:172.21.15.145:6837/2301419443] up:boot 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: fsmap 7 up:standby 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:58:22.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:22 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2175052331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:22.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: Deploying daemon mds.h on smithi119 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.145:6836/2301419443,v1:172.21.15.145:6837/2301419443] up:boot 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: fsmap 7 up:standby 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:58:22.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:22 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2175052331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:23.236 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 systemd[1]: Starting Ceph mds.h for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:23.510 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:23 smithi119 ceph-mon[33564]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:23.511 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 podman[62738]: 2024-09-21 07:58:23.276849833 +0000 UTC m=+0.015708024 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:23.511 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 podman[62738]: 2024-09-21 07:58:23.384196099 +0000 UTC m=+0.123054272 container create 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T07:58:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:23 smithi145 ceph-mon[34049]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:23 smithi006 ceph-mon[30970]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:23.908 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 podman[62738]: 2024-09-21 07:58:23.636942099 +0000 UTC m=+0.375800287 container init 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T07:58:23.909 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 podman[62738]: 2024-09-21 07:58:23.639880721 +0000 UTC m=+0.378738894 container start 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:58:23.909 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 ceph-mds[62757]: -- 172.21.15.119:0/2783544111 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585a942d860 con 0x5585ad5d5180 2024-09-21T07:58:23.909 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h[62753]: starting mds.h at 2024-09-21T07:58:23.909 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 bash[62738]: 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 2024-09-21T07:58:23.909 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 07:58:23 smithi119 systemd[1]: Started Ceph mds.h for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:24.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:25.139 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: Deploying daemon mds.i on smithi145 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6836/649850898,v1:172.21.15.119:6837/649850898] up:boot 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: fsmap 8 up:standby 2024-09-21T07:58:25.140 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:24 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:58:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: Deploying daemon mds.i on smithi145 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6836/649850898,v1:172.21.15.119:6837/649850898] up:boot 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: fsmap 8 up:standby 2024-09-21T07:58:25.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:24 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:58:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: Deploying daemon mds.i on smithi145 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6836/649850898,v1:172.21.15.119:6837/649850898] up:boot 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: fsmap 8 up:standby 2024-09-21T07:58:25.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:24 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.517+0000 7f2c03996640 1 -- 172.21.15.6:0/3294688368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc1094a0 msgr2=0x7f2bfc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.517+0000 7f2c03996640 1 --2- 172.21.15.6:0/3294688368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc1098b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009900 tx=0x7f2bec02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 -- 172.21.15.6:0/3294688368 shutdown_connections 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 --2- 172.21.15.6:0/3294688368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc109df0 0x7f2bfc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 --2- 172.21.15.6:0/3294688368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc1098b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 --2- 172.21.15.6:0/3294688368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc103b60 0x7f2bfc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 -- 172.21.15.6:0/3294688368 >> 172.21.15.6:0/3294688368 conn(0x7f2bfc07b850 msgr2=0x7f2bfc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 -- 172.21.15.6:0/3294688368 shutdown_connections 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 -- 172.21.15.6:0/3294688368 wait complete. 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 Processor -- start 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.518+0000 7f2c03996640 1 -- start start 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc109df0 0x7f2bfc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc113960 con 0x7f2bfc103b60 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1137e0 con 0x7f2bfc1094a0 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c03996640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc113ae0 con 0x7f2bfc109df0 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40418/0 (socket says 172.21.15.6:40418) 2024-09-21T07:58:25.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 -- 172.21.15.6:0/598750609 learned_addr learned my addr 172.21.15.6:0/598750609 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01f33640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc109df0 0x7f2bfc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c00f31640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 -- 172.21.15.6:0/598750609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc109df0 msgr2=0x7f2bfc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc109df0 0x7f2bfc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 -- 172.21.15.6:0/598750609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc1094a0 msgr2=0x7f2bfc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 -- 172.21.15.6:0/598750609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc1a86f0 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2c01732640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800e9f0 tx=0x7f2bf800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.519+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800cd80 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.520+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc1a89e0 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.520+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bf80108c0 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.520+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc1a8f40 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.520+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80187c0 con 0x7f2bfc103b60 2024-09-21T07:58:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.521+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc103f70 con 0x7f2bfc103b60 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.522+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2bf8010430 con 0x7f2bfc103b60 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.523+0000 7f2bf27fc640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 0x7f2be80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.523+0000 7f2c00f31640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 0x7f2be80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.523+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f2bf80e73a0 con 0x7f2bfc103b60 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.524+0000 7f2c00f31640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 0x7f2be80b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bec005940 tx=0x7f2bec0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:25.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.528+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bf80b2340 con 0x7f2bfc103b60 2024-09-21T07:58:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.753+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bfc02e640 con 0x7f2bfc103b60 2024-09-21T07:58:25.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.753+0000 7f2bf27fc640 1 -- 172.21.15.6:0/598750609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f2bf80b7280 con 0x7f2bfc103b60 2024-09-21T07:58:25.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:25.755 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"btime":"2024-09-21T07:58:24:235125+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T07:58:25.755 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 msgr2=0x7f2be80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 0x7f2be80b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bec005940 tx=0x7f2bec0058d0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 msgr2=0x7f2bfc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800e9f0 tx=0x7f2bf800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 shutdown_connections 2024-09-21T07:58:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2be80b6560 0x7f2be80b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bfc109df0 0x7f2bfc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc1094a0 0x7f2bfc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 --2- 172.21.15.6:0/598750609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bfc103b60 0x7f2bfc075710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 >> 172.21.15.6:0/598750609 conn(0x7f2bfc07b850 msgr2=0x7f2bfc1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 shutdown_connections 2024-09-21T07:58:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:25.756+0000 7f2c03996640 1 -- 172.21.15.6:0/598750609 wait complete. 2024-09-21T07:58:25.811 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:25 smithi145 systemd[1]: Starting Ceph mds.i for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:26.070 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:25 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/598750609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:26.079 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:25 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/598750609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:26.079 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:25 smithi145 podman[62883]: 2024-09-21 07:58:25.82236703 +0000 UTC m=+0.015808766 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:26.079 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:25 smithi145 podman[62883]: 2024-09-21 07:58:25.944378168 +0000 UTC m=+0.137819884 container create b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:58:26.168 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:25 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/598750609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:26.698 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 podman[62883]: 2024-09-21 07:58:26.209587323 +0000 UTC m=+0.403029056 container init b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:58:26.716 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 podman[62883]: 2024-09-21 07:58:26.213433494 +0000 UTC m=+0.406875212 container start b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T07:58:26.717 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mds[62902]: -- 172.21.15.145:0/4052215119 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df4cf6f860 con 0x55df51117180 2024-09-21T07:58:26.717 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: starting mds.i at 2024-09-21T07:58:26.717 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 bash[62883]: b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da 2024-09-21T07:58:26.717 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 07:58:26 smithi145 systemd[1]: Started Ceph mds.i for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:27.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:26 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:27.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:27.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:26 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:27.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:26 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:28.137 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:27 smithi006 ceph-mon[30970]: Deploying daemon mds.g on smithi006 2024-09-21T07:58:28.137 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:27 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.145:6838/3378332428,v1:172.21.15.145:6839/3378332428] up:boot 2024-09-21T07:58:28.138 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:27 smithi006 ceph-mon[30970]: fsmap 9 up:standby 2024-09-21T07:58:28.138 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:27 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:58:28.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:27 smithi119 ceph-mon[33564]: Deploying daemon mds.g on smithi006 2024-09-21T07:58:28.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:27 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.145:6838/3378332428,v1:172.21.15.145:6839/3378332428] up:boot 2024-09-21T07:58:28.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:27 smithi119 ceph-mon[33564]: fsmap 9 up:standby 2024-09-21T07:58:28.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:27 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:58:28.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:27 smithi145 ceph-mon[34049]: Deploying daemon mds.g on smithi006 2024-09-21T07:58:28.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:27 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.145:6838/3378332428,v1:172.21.15.145:6839/3378332428] up:boot 2024-09-21T07:58:28.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:27 smithi145 ceph-mon[34049]: fsmap 9 up:standby 2024-09-21T07:58:28.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:27 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:58:28.461 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 systemd[1]: Starting Ceph mds.g for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:28.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:28.815 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 podman[73239]: 2024-09-21 07:58:28.447433386 +0000 UTC m=+0.016826762 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:28.815 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 podman[73239]: 2024-09-21 07:58:28.561648727 +0000 UTC m=+0.131042090 container create e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:58:28.815 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 podman[73239]: 2024-09-21 07:58:28.814462395 +0000 UTC m=+0.383855765 container init e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T07:58:28.996 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:28 smithi006 ceph-mon[30970]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 podman[73239]: 2024-09-21 07:58:28.817902894 +0000 UTC m=+0.387296257 container start e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 ceph-mds[73301]: -- 172.21.15.6:0/2002658535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564162267860 con 0x56416640fa80 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g[73272]: starting mds.g at 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 bash[73239]: e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 2024-09-21T07:58:29.118 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 07:58:28 smithi006 systemd[1]: Started Ceph mds.g for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:28 smithi119 ceph-mon[33564]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:28 smithi145 ceph-mon[34049]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2337982078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04103b60 msgr2=0x7fcb04103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2337982078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04103b60 0x7fcb04103f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009900 tx=0x7fcaf402a410 comp rx=0 tx=0).stop 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2337982078 shutdown_connections 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2337982078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb041094a0 0x7fcb041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2337982078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb04109df0 0x7fcb04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2337982078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04103b60 0x7fcb04103f70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2337982078 >> 172.21.15.6:0/2337982078 conn(0x7fcb0407b850 msgr2=0x7fcb0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2337982078 shutdown_connections 2024-09-21T07:58:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.495+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2337982078 wait complete. 2024-09-21T07:58:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 Processor -- start 2024-09-21T07:58:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 -- start start 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb04103b60 0x7fcb04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb041094a0 0x7fcb04075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04113a20 con 0x7fcb04109df0 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb041138a0 con 0x7fcb041094a0 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb0aad9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04113ba0 con 0x7fcb04103b60 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb09076640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb09076640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42312/0 (socket says 172.21.15.6:42312) 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb09076640 1 -- 172.21.15.6:0/2331849577 learned_addr learned my addr 172.21.15.6:0/2331849577 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb08875640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb04103b60 0x7fcb04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.496+0000 7fcb03fff640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb041094a0 0x7fcb04075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 -- 172.21.15.6:0/2331849577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb04103b60 msgr2=0x7fcb04075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb04103b60 0x7fcb04075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 -- 172.21.15.6:0/2331849577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb041094a0 msgr2=0x7fcb04075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb041094a0 0x7fcb04075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 -- 172.21.15.6:0/2331849577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb041a8810 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb09076640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00b970 tx=0x7fcafc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc019070 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcafc014440 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb041a8b00 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0075d0 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.497+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb041a9070 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.498+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb04103ff0 con 0x7fcb04109df0 2024-09-21T07:58:29.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.500+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fcafc01c070 con 0x7fcb04109df0 2024-09-21T07:58:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.501+0000 7fcb01ffb640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 0x7fcaec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.501+0000 7fcb08875640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 0x7fcaec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.501+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcafc0e6940 con 0x7fcb04109df0 2024-09-21T07:58:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.501+0000 7fcb08875640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 0x7fcaec0b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcb04077160 tx=0x7fcaf40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:29.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.504+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcafc0b18e0 con 0x7fcb04109df0 2024-09-21T07:58:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.738+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb04076a10 con 0x7fcb04109df0 2024-09-21T07:58:29.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.738+0000 7fcb01ffb640 1 -- 172.21.15.6:0/2331849577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7fcafc0b6820 con 0x7fcb04109df0 2024-09-21T07:58:29.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:29.740 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"btime":"2024-09-21T07:58:26:810007+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:58:29.740 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 msgr2=0x7fcaec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 0x7fcaec0b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcb04077160 tx=0x7fcaf40058d0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 msgr2=0x7fcb04076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00b970 tx=0x7fcafc00be30 comp rx=0 tx=0).stop 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 shutdown_connections 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaec0b6560 0x7fcaec0b8a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb04109df0 0x7fcb04076190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb041094a0 0x7fcb04075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 --2- 172.21.15.6:0/2331849577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb04103b60 0x7fcb04075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.740+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 >> 172.21.15.6:0/2331849577 conn(0x7fcb0407b850 msgr2=0x7fcb041076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.741+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 shutdown_connections 2024-09-21T07:58:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:29.741+0000 7fcb0aad9640 1 -- 172.21.15.6:0/2331849577 wait complete. 2024-09-21T07:58:30.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:30.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: Deploying daemon mds.a on smithi006 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2331849577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.6:6838/387284597,v1:172.21.15.6:6839/387284597] up:boot 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: fsmap 10 up:standby 2024-09-21T07:58:30.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:29 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:30.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:30.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: Deploying daemon mds.a on smithi006 2024-09-21T07:58:30.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2331849577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:30.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.6:6838/387284597,v1:172.21.15.6:6839/387284597] up:boot 2024-09-21T07:58:30.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: fsmap 10 up:standby 2024-09-21T07:58:30.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:29 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:30.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:30.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: Deploying daemon mds.a on smithi006 2024-09-21T07:58:30.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2331849577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:30.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.6:6838/387284597,v1:172.21.15.6:6839/387284597] up:boot 2024-09-21T07:58:30.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: fsmap 10 up:standby 2024-09-21T07:58:30.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:29 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:58:31.167 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:30 smithi006 ceph-mon[30970]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:30 smithi119 ceph-mon[33564]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:30 smithi145 ceph-mon[34049]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:32.211 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 systemd[1]: Starting Ceph mds.a for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T07:58:32.499 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 podman[73623]: 2024-09-21 07:58:32.13298316 +0000 UTC m=+0.016529044 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:58:32.499 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 podman[73623]: 2024-09-21 07:58:32.253237742 +0000 UTC m=+0.136783611 container create 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T07:58:32.499 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 podman[73623]: 2024-09-21 07:58:32.498048888 +0000 UTC m=+0.381594764 container init 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T07:58:32.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:32.914 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 podman[73623]: 2024-09-21 07:58:32.501214387 +0000 UTC m=+0.384760261 container start 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:58:32.914 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mds[73642]: -- 172.21.15.6:0/3356814115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559530ff3860 con 0x55953519b180 2024-09-21T07:58:32.914 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a[73638]: starting mds.a at 2024-09-21T07:58:32.914 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 bash[73623]: 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 2024-09-21T07:58:32.914 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 07:58:32 smithi006 systemd[1]: Started Ceph mds.a for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:32 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:33.299 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:32 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 -- 172.21.15.6:0/3983479563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c103b60 msgr2=0x7f672c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 --2- 172.21.15.6:0/3983479563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c103b60 0x7f672c103f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f671c009860 tx=0x7f671c02a340 comp rx=0 tx=0).stop 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 -- 172.21.15.6:0/3983479563 shutdown_connections 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 --2- 172.21.15.6:0/3983479563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 --2- 172.21.15.6:0/3983479563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c109df0 0x7f672c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 --2- 172.21.15.6:0/3983479563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c103b60 0x7f672c103f70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 -- 172.21.15.6:0/3983479563 >> 172.21.15.6:0/3983479563 conn(0x7f672c07b850 msgr2=0x7f672c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 -- 172.21.15.6:0/3983479563 shutdown_connections 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 -- 172.21.15.6:0/3983479563 wait complete. 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.305+0000 7f6731aba640 1 Processor -- start 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 -- start start 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 0x7f672c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f672c113960 con 0x7f672c103b60 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f672c1137e0 con 0x7f672c109df0 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f6731aba640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f672c113ae0 con 0x7f672c1094a0 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42348/0 (socket says 172.21.15.6:42348) 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 -- 172.21.15.6:0/1364777129 learned_addr learned my addr 172.21.15.6:0/1364777129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672bfff640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 0x7f672c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672affd640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 -- 172.21.15.6:0/1364777129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 msgr2=0x7f672c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 -- 172.21.15.6:0/1364777129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 msgr2=0x7f672c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 0x7f672c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672b7fe640 1 -- 172.21.15.6:0/1364777129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c1a03c0 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672affd640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.306+0000 7f672bfff640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 0x7f672c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f672b7fe640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f671c0057c0 tx=0x7f671c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c040020 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c1a0650 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c032df0 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c037040 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.307+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c1a6e10 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.308+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c103f70 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.310+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f671c043020 con 0x7f672c103b60 2024-09-21T07:58:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.310+0000 7f6728ff9640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 0x7f67140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.310+0000 7f672affd640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 0x7f67140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.310+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f671c107470 con 0x7f672c103b60 2024-09-21T07:58:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.311+0000 7f672affd640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 0x7f67140b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67200058c0 tx=0x7f6720005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.313+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f671c04a020 con 0x7f672c103b60 2024-09-21T07:58:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:33.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:58:33.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:58:33.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:32 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.540+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f672c19b580 con 0x7f672c103b60 2024-09-21T07:58:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.541+0000 7f6728ff9640 1 -- 172.21.15.6:0/1364777129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7f671c0ce0d0 con 0x7f672c103b60 2024-09-21T07:58:33.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:33.543 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"btime":"2024-09-21T07:58:32:987807+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:58:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-09-21T07:58:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 msgr2=0x7f67140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 0x7f67140b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67200058c0 tx=0x7f6720005850 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 msgr2=0x7f672c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f671c0057c0 tx=0x7f671c030d60 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 shutdown_connections 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f67140b6560 0x7f67140b8a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672c1094a0 0x7f672c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f672c109df0 0x7f672c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 --2- 172.21.15.6:0/1364777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f672c103b60 0x7f672c19a450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 >> 172.21.15.6:0/1364777129 conn(0x7f672c07b850 msgr2=0x7f672c107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 shutdown_connections 2024-09-21T07:58:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:33.543+0000 7f6731aba640 1 -- 172.21.15.6:0/1364777129 wait complete. 2024-09-21T07:58:34.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:33 smithi006 ceph-mon[30970]: Deploying daemon mds.b on smithi119 2024-09-21T07:58:34.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:33 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.6:6840/1772436480,v1:172.21.15.6:6841/1772436480] up:boot 2024-09-21T07:58:34.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:33 smithi006 ceph-mon[30970]: fsmap 11 up:standby 2024-09-21T07:58:34.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:33 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:58:34.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:33 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1364777129' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:34.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:33 smithi119 ceph-mon[33564]: Deploying daemon mds.b on smithi119 2024-09-21T07:58:34.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:33 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.6:6840/1772436480,v1:172.21.15.6:6841/1772436480] up:boot 2024-09-21T07:58:34.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:33 smithi119 ceph-mon[33564]: fsmap 11 up:standby 2024-09-21T07:58:34.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:33 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:58:34.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:33 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1364777129' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:34.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:33 smithi145 ceph-mon[34049]: Deploying daemon mds.b on smithi119 2024-09-21T07:58:34.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:33 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.6:6840/1772436480,v1:172.21.15.6:6841/1772436480] up:boot 2024-09-21T07:58:34.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:33 smithi145 ceph-mon[34049]: fsmap 11 up:standby 2024-09-21T07:58:34.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:33 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:58:34.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:33 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1364777129' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:34.908 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:34 smithi119 podman[63007]: 2024-09-21 07:58:34.856180425 +0000 UTC m=+0.119678551 container create 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:58:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:35 smithi119 ceph-mon[33564]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:35.409 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 podman[63007]: 2024-09-21 07:58:35.117738125 +0000 UTC m=+0.381236250 container init 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T07:58:35.409 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 podman[63007]: 2024-09-21 07:58:35.120769687 +0000 UTC m=+0.384267813 container start 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T07:58:35.409 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 ceph-mds[63025]: -- 172.21.15.119:0/2474450326 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612525ab860 con 0x561256753a80 2024-09-21T07:58:35.409 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: starting mds.b at 2024-09-21T07:58:35.409 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 bash[63007]: 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 2024-09-21T07:58:35.410 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:35 smithi119 systemd[1]: Started Ceph mds.b for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T07:58:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:35 smithi145 ceph-mon[34049]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:35 smithi006 ceph-mon[30970]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:36.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:boot 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: fsmap 12 up:standby 2024-09-21T07:58:36.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:36 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:58:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:36.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:boot 2024-09-21T07:58:36.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: fsmap 12 up:standby 2024-09-21T07:58:36.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:36 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:boot 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: fsmap 12 up:standby 2024-09-21T07:58:36.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:36 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 -- 172.21.15.6:0/1721433233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 msgr2=0x7f36b810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 --2- 172.21.15.6:0/1721433233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b810d8b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009900 tx=0x7f36ac02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 -- 172.21.15.6:0/1721433233 shutdown_connections 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 --2- 172.21.15.6:0/1721433233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 0x7f36b8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 --2- 172.21.15.6:0/1721433233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b810d8b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 --2- 172.21.15.6:0/1721433233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 0x7f36b8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 -- 172.21.15.6:0/1721433233 >> 172.21.15.6:0/1721433233 conn(0x7f36b8079730 msgr2=0x7f36b8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 -- 172.21.15.6:0/1721433233 shutdown_connections 2024-09-21T07:58:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.984+0000 7f36bedad640 1 -- 172.21.15.6:0/1721433233 wait complete. 2024-09-21T07:58:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.985+0000 7f36bedad640 1 Processor -- start 2024-09-21T07:58:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.985+0000 7f36bedad640 1 -- start start 2024-09-21T07:58:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 0x7f36b819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 0x7f36b819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8113920 con 0x7f36b8105270 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36b81137a0 con 0x7f36b8104840 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bedad640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8113aa0 con 0x7f36b810ddf0 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46742/0 (socket says 172.21.15.6:46742) 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 -- 172.21.15.6:0/3989498071 learned_addr learned my addr 172.21.15.6:0/3989498071 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bcb49640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 0x7f36b819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36bd34a640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 0x7f36b819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 -- 172.21.15.6:0/3989498071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 msgr2=0x7f36b819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 0x7f36b819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 -- 172.21.15.6:0/3989498071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 msgr2=0x7f36b819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 0x7f36b819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 -- 172.21.15.6:0/3989498071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b81a0360 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.986+0000 7f36b7fff640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36ac005940 tx=0x7f36ac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.987+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac03f030 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.987+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b81a05f0 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.987+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36ac003a80 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.987+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac035070 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.987+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b81a6db0 con 0x7f36b8105270 2024-09-21T07:58:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.988+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b8104c50 con 0x7f36b8105270 2024-09-21T07:58:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.989+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f36ac042030 con 0x7f36b8105270 2024-09-21T07:58:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.990+0000 7f36b5ffb640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 0x7f36a00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.990+0000 7f36bcb49640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 0x7f36a00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.990+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f36ac107520 con 0x7f36b8105270 2024-09-21T07:58:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.991+0000 7f36bcb49640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 0x7f36a00b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36b806bc00 tx=0x7f36a800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:36.995+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36ac0ce0e0 con 0x7f36b8105270 2024-09-21T07:58:37.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.254+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36b8108fa0 con 0x7f36b8105270 2024-09-21T07:58:37.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.254+0000 7f36b5ffb640 1 -- 172.21.15.6:0/3989498071 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f36ac0d24c0 con 0x7f36b8105270 2024-09-21T07:58:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:37.256 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"btime":"2024-09-21T07:58:36:005664+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24713,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T07:58:37.257 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 msgr2=0x7f36a00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 0x7f36a00b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36b806bc00 tx=0x7f36a800b390 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 msgr2=0x7f36b819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36ac005940 tx=0x7f36ac0040e0 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 shutdown_connections 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36a00b6560 0x7f36a00b8a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36b810ddf0 0x7f36b819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36b8105270 0x7f36b819a990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 --2- 172.21.15.6:0/3989498071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b8104840 0x7f36b819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 >> 172.21.15.6:0/3989498071 conn(0x7f36b8079730 msgr2=0x7f36b81009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 shutdown_connections 2024-09-21T07:58:37.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:37.258+0000 7f36bedad640 1 -- 172.21.15.6:0/3989498071 wait complete. 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.624 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:37 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3989498071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:37 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3989498071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3989498071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:37.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.552 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:38 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:38 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:38.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:38 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:38.936 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:39.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:39 smithi006 ceph-mon[30970]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:39.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:39 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 -- 172.21.15.6:0/2634911333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c104a30 msgr2=0x7f124c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 --2- 172.21.15.6:0/2634911333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c104a30 0x7f124c104e40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1248009900 tx=0x7f124802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 -- 172.21.15.6:0/2634911333 shutdown_connections 2024-09-21T07:58:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 --2- 172.21.15.6:0/2634911333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c10de60 0x7f124c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 --2- 172.21.15.6:0/2634911333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c105380 0x7f124c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 --2- 172.21.15.6:0/2634911333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c104a30 0x7f124c104e40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 -- 172.21.15.6:0/2634911333 >> 172.21.15.6:0/2634911333 conn(0x7f124c0797b0 msgr2=0x7f124c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 -- 172.21.15.6:0/2634911333 shutdown_connections 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.408+0000 7f1254284640 1 -- 172.21.15.6:0/2634911333 wait complete. 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 Processor -- start 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 -- start start 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c104a30 0x7f124c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c10de60 0x7f124c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f124c113970 con 0x7f124c105380 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f124c1137f0 con 0x7f124c10de60 2024-09-21T07:58:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.409+0000 7f1254284640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f124c113af0 con 0x7f124c104a30 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46756/0 (socket says 172.21.15.6:46756) 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 -- 172.21.15.6:0/318546941 learned_addr learned my addr 172.21.15.6:0/318546941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f1252020640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c104a30 0x7f124c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f1252821640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c10de60 0x7f124c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 -- 172.21.15.6:0/318546941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c104a30 msgr2=0x7f124c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c104a30 0x7f124c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 -- 172.21.15.6:0/318546941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c10de60 msgr2=0x7f124c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c10de60 0x7f124c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 -- 172.21.15.6:0/318546941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c1a0270 con 0x7f124c105380 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f125181f640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f123c00c8c0 tx=0x7f123c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c007bb0 con 0x7f124c105380 2024-09-21T07:58:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f123c007d50 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c0186a0 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124c1a0560 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.410+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124c1a6d80 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.411+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124c104e40 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.413+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f123c00fa00 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.414+0000 7f12437fe640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 0x7f12380b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.414+0000 7f1252020640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 0x7f12380b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.414+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f123c0e71e0 con 0x7f124c105380 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.414+0000 7f1252020640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 0x7f12380b8b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f12480057c0 tx=0x7f12480058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.417+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f123c014030 con 0x7f124c105380 2024-09-21T07:58:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.614+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f124c1089e0 con 0x7f124c105380 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.614+0000 7f12437fe640 1 -- 172.21.15.6:0/318546941 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f123c0adf50 con 0x7f124c105380 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-09-21T07:58:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-09-21T07:58:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T07:58:39.617 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 msgr2=0x7f12380b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 0x7f12380b8b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f12480057c0 tx=0x7f12480058d0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 msgr2=0x7f124c19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f123c00c8c0 tx=0x7f123c00cd80 comp rx=0 tx=0).stop 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 shutdown_connections 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12380b6610 0x7f12380b8b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c10de60 0x7f124c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c105380 0x7f124c19a960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 --2- 172.21.15.6:0/318546941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f124c104a30 0x7f124c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 >> 172.21.15.6:0/318546941 conn(0x7f124c0797b0 msgr2=0x7f124c0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 shutdown_connections 2024-09-21T07:58:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:39.617+0000 7f1254284640 1 -- 172.21.15.6:0/318546941 wait complete. 2024-09-21T07:58:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:39 smithi119 ceph-mon[33564]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:39 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:39 smithi145 ceph-mon[34049]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:39 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:40.330 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:40 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/318546941' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:58:40.331 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:58:40.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:58:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:40.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:40 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/318546941' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:58:40.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:40 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/318546941' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:58:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 -- 172.21.15.6:0/1242537787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314103b60 msgr2=0x7f2314103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 --2- 172.21.15.6:0/1242537787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314103b60 0x7f2314103f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f230c009ca0 tx=0x7f230c02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 -- 172.21.15.6:0/1242537787 shutdown_connections 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 --2- 172.21.15.6:0/1242537787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 0x7f23141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 --2- 172.21.15.6:0/1242537787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314109df0 0x7f2314110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 --2- 172.21.15.6:0/1242537787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314103b60 0x7f2314103f70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 -- 172.21.15.6:0/1242537787 >> 172.21.15.6:0/1242537787 conn(0x7f231407b850 msgr2=0x7f231407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 -- 172.21.15.6:0/1242537787 shutdown_connections 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.146+0000 7f231ac40640 1 -- 172.21.15.6:0/1242537787 wait complete. 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 Processor -- start 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 -- start start 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314103b60 0x7f231419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 0x7f231419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2314113a20 con 0x7f2314109df0 2024-09-21T07:58:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23141138a0 con 0x7f2314103b60 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f231ac40640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2314113ba0 con 0x7f23141094a0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.147+0000 7f23191dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46766/0 (socket says 172.21.15.6:46766) 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 -- 172.21.15.6:0/2426727919 learned_addr learned my addr 172.21.15.6:0/2426727919 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23189dc640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314103b60 0x7f231419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f2313fff640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 0x7f231419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 -- 172.21.15.6:0/2426727919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 msgr2=0x7f231419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 0x7f231419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 -- 172.21.15.6:0/2426727919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314103b60 msgr2=0x7f231419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314103b60 0x7f231419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 -- 172.21.15.6:0/2426727919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23141a04c0 con 0x7f2314109df0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f23191dd640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2304009fd0 tx=0x7f230400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304011830 con 0x7f2314109df0 2024-09-21T07:58:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2304016070 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304010d20 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.148+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23141a07b0 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.149+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23141a6f10 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.150+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2314103ff0 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.151+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f23040119d0 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.152+0000 7f2311ffb640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 0x7f22fc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.152+0000 7f23189dc640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 0x7f22fc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.152+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f23040e6bf0 con 0x7f2314109df0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.152+0000 7f23189dc640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 0x7f22fc0b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f230c031fd0 tx=0x7f230c0097c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.155+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23040ad850 con 0x7f2314109df0 2024-09-21T07:58:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:41.343+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f231402e640 con 0x7f2314109df0 2024-09-21T07:58:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:41.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:41 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:41 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:41.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:41.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:41.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:41.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:41 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:58:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.315+0000 7f2311ffb640 1 -- 172.21.15.6:0/2426727919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f23040b1c30 con 0x7f2314109df0 2024-09-21T07:58:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 msgr2=0x7f22fc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 0x7f22fc0b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f230c031fd0 tx=0x7f230c0097c0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 msgr2=0x7f231419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2304009fd0 tx=0x7f230400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 shutdown_connections 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22fc0b6560 0x7f22fc0b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23141094a0 0x7f231419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2314109df0 0x7f231419fd90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 --2- 172.21.15.6:0/2426727919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2314103b60 0x7f231419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.319+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 >> 172.21.15.6:0/2426727919 conn(0x7f231407b850 msgr2=0x7f23141076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.320+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 shutdown_connections 2024-09-21T07:58:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:42.320+0000 7f231ac40640 1 -- 172.21.15.6:0/2426727919 wait complete. 2024-09-21T07:58:42.636 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:42 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:58:42.637 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:42 smithi006 ceph-mon[30970]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:42.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:42 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:58:42.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:42 smithi119 ceph-mon[33564]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:42 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:58:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:42 smithi145 ceph-mon[34049]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:42.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T07:58:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:43.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:58:43.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:43 smithi006 ceph-mon[30970]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:58:43.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:43 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:58:43.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:43 smithi119 ceph-mon[33564]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:58:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2426727919' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:58:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:43 smithi145 ceph-mon[34049]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:58:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.750+0000 7ff8142bd640 1 -- 172.21.15.6:0/1682471131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 msgr2=0x7ff80c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.750+0000 7ff8142bd640 1 --2- 172.21.15.6:0/1682471131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c1087b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009900 tx=0x7ff7fc02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 -- 172.21.15.6:0/1682471131 shutdown_connections 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 --2- 172.21.15.6:0/1682471131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c108cf0 0x7ff80c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 --2- 172.21.15.6:0/1682471131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c1087b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 --2- 172.21.15.6:0/1682471131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c102a60 0x7ff80c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 -- 172.21.15.6:0/1682471131 >> 172.21.15.6:0/1682471131 conn(0x7ff80c079730 msgr2=0x7ff80c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 -- 172.21.15.6:0/1682471131 shutdown_connections 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.751+0000 7ff8142bd640 1 -- 172.21.15.6:0/1682471131 wait complete. 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 Processor -- start 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 -- start start 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c102a60 0x7ff80c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 0x7ff80c19eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c112810 con 0x7ff80c1083a0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c112690 con 0x7ff80c108cf0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff8142bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c112990 con 0x7ff80c102a60 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46782/0 (socket says 172.21.15.6:46782) 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 -- 172.21.15.6:0/908521719 learned_addr learned my addr 172.21.15.6:0/908521719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff812059640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c102a60 0x7ff80c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff81285a640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 0x7ff80c19eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 -- 172.21.15.6:0/908521719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c102a60 msgr2=0x7ff80c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c102a60 0x7ff80c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 -- 172.21.15.6:0/908521719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 msgr2=0x7ff80c19eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 0x7ff80c19eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff811858640 1 -- 172.21.15.6:0/908521719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c19f1d0 con 0x7ff80c1083a0 2024-09-21T07:58:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.752+0000 7ff81285a640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 0x7ff80c19eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff811858640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc005940 tx=0x7ff7fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc03f030 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7fc003c90 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c19f460 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc035070 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.753+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1a5c20 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.754+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff80c103ce0 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.756+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7ff7fc042030 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.757+0000 7ff8037fe640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 0x7ff7f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.757+0000 7ff812059640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 0x7ff7f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.757+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7ff7fc107a60 con 0x7ff80c1083a0 2024-09-21T07:58:43.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.757+0000 7ff812059640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 0x7ff7f80b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff80800bbe0 tx=0x7ff80800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:43.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.760+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7fc0ce550 con 0x7ff80c1083a0 2024-09-21T07:58:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:43.947+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ff80c10aae0 con 0x7ff80c1083a0 2024-09-21T07:58:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.328+0000 7ff8037fe640 1 -- 172.21.15.6:0/908521719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v73) ==== 171+0+0 (secure 0 0 0) 0x7ff7fc0d2930 con 0x7ff80c1083a0 2024-09-21T07:58:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-09-21T07:58:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 msgr2=0x7ff7f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 0x7ff7f80b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff80800bbe0 tx=0x7ff80800b390 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 msgr2=0x7ff80c199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc005940 tx=0x7ff7fc0042f0 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 shutdown_connections 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7f80b6560 0x7ff7f80b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff80c108cf0 0x7ff80c19eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80c1083a0 0x7ff80c199800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 --2- 172.21.15.6:0/908521719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff80c102a60 0x7ff80c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 >> 172.21.15.6:0/908521719 conn(0x7ff80c079730 msgr2=0x7ff80c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 shutdown_connections 2024-09-21T07:58:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:44.331+0000 7ff8142bd640 1 -- 172.21.15.6:0/908521719 wait complete. 2024-09-21T07:58:44.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:44 smithi145 ceph-mon[34049]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:58:44.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:44 smithi145 ceph-mon[34049]: pgmap v261: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:44.594 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:44 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:58:44.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:44 smithi006 ceph-mon[30970]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:58:44.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:44 smithi006 ceph-mon[30970]: pgmap v261: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:44.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:44 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:58:44.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:44 smithi119 ceph-mon[33564]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:58:44.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:44 smithi119 ceph-mon[33564]: pgmap v261: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:44.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:44 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:58:45.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:58:45.292 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:45.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:45 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:58:45.589 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:45 smithi006 ceph-mon[30970]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:58:45.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:45 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:58:45.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:45 smithi119 ceph-mon[33564]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:58:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:45 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/908521719' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:58:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:45 smithi145 ceph-mon[34049]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:58:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 -- 172.21.15.6:0/2370990361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 msgr2=0x7f45a81055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/2370990361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81055d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4594009900 tx=0x7f459402a410 comp rx=0 tx=0).stop 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 -- 172.21.15.6:0/2370990361 shutdown_connections 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/2370990361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 0x7f45a810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/2370990361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81055d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/2370990361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 0x7f45a81035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 -- 172.21.15.6:0/2370990361 >> 172.21.15.6:0/2370990361 conn(0x7f45a8079f90 msgr2=0x7f45a807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 -- 172.21.15.6:0/2370990361 shutdown_connections 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.833+0000 7f45aeb5e640 1 -- 172.21.15.6:0/2370990361 wait complete. 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 Processor -- start 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 -- start start 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 0x7f45a8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 0x7f45a819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45a81128c0 con 0x7f45a81051c0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8112740 con 0x7f45a81031b0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45aeb5e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8112a40 con 0x7f45a8105b10 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46804/0 (socket says 172.21.15.6:46804) 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 -- 172.21.15.6:0/142267861 learned_addr learned my addr 172.21.15.6:0/142267861 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45ac8fa640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 0x7f45a8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45ad0fb640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 0x7f45a819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 -- 172.21.15.6:0/142267861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 msgr2=0x7f45a819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 0x7f45a819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 -- 172.21.15.6:0/142267861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 msgr2=0x7f45a8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 0x7f45a8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.834+0000 7f45a7fff640 1 -- 172.21.15.6:0/142267861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a819f2a0 con 0x7f45a81051c0 2024-09-21T07:58:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45a7fff640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4594004770 tx=0x7f4594004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459403f030 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a819f530 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4594004440 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594035070 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.835+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a8101e10 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.836+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a8103f30 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.838+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f4594042030 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.838+0000 7f45a5ffb640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 0x7f45980bac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.839+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7f4594107a30 con 0x7f45a81051c0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.839+0000 7f45ac8fa640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 0x7f45980bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.839+0000 7f45ac8fa640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 0x7f45980bac80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f459c005d00 tx=0x7f459c00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:45.842+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45940d2780 con 0x7f45a81051c0 2024-09-21T07:58:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.068+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f45a8102830 con 0x7f45a81051c0 2024-09-21T07:58:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.346+0000 7f45a5ffb640 1 -- 172.21.15.6:0/142267861 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f45940d76c0 con 0x7f45a81051c0 2024-09-21T07:58:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.348+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 msgr2=0x7f45980bac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.348+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 0x7f45980bac80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f459c005d00 tx=0x7f459c00b410 comp rx=0 tx=0).stop 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.348+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 msgr2=0x7f45a81998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4594004770 tx=0x7f4594004040 comp rx=0 tx=0).stop 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 shutdown_connections 2024-09-21T07:58:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f45980b8770 0x7f45980bac80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45a8105b10 0x7f45a819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45a81051c0 0x7f45a81998d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 --2- 172.21.15.6:0/142267861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a81031b0 0x7f45a8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 >> 172.21.15.6:0/142267861 conn(0x7f45a8079f90 msgr2=0x7f45a8106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 shutdown_connections 2024-09-21T07:58:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:46.349+0000 7f45aeb5e640 1 -- 172.21.15.6:0/142267861 wait complete. 2024-09-21T07:58:46.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:46 smithi119 ceph-mon[33564]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:58:46.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:46 smithi119 ceph-mon[33564]: pgmap v264: 97 pgs: 26 creating+peering, 54 unknown, 17 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:46.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:46 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:58:46.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:46 smithi119 ceph-mon[33564]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:58:46.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:46 smithi006 ceph-mon[30970]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:58:46.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:46 smithi006 ceph-mon[30970]: pgmap v264: 97 pgs: 26 creating+peering, 54 unknown, 17 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:46.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:46 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:58:46.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:46 smithi006 ceph-mon[30970]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:58:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:46 smithi145 ceph-mon[34049]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:58:46.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:46 smithi145 ceph-mon[34049]: pgmap v264: 97 pgs: 26 creating+peering, 54 unknown, 17 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:58:46.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:46 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:58:46.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:46 smithi145 ceph-mon[34049]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:58:46.991 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T07:58:46.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T07:58:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:47.645 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:47 smithi006 ceph-mon[30970]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:58:47.645 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:58:47.645 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:47 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:58:47.645 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:47 smithi006 ceph-mon[30970]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:58:47.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:47 smithi119 ceph-mon[33564]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:58:47.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:58:47.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:47 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:58:47.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:47 smithi119 ceph-mon[33564]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:58:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:47 smithi145 ceph-mon[34049]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:58:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/142267861' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:58:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:47 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:58:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:47 smithi145 ceph-mon[34049]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.894+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3547067009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c1083b0 msgr2=0x7f899c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.894+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3547067009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c1083b0 0x7f899c1087c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8988009900 tx=0x7f898802a410 comp rx=0 tx=0).stop 2024-09-21T07:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3547067009 shutdown_connections 2024-09-21T07:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3547067009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c108d00 0x7f899c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3547067009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c1083b0 0x7f899c1087c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3547067009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 0x7f899c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3547067009 >> 172.21.15.6:0/3547067009 conn(0x7f899c079710 msgr2=0x7f899c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3547067009 shutdown_connections 2024-09-21T07:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.895+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3547067009 wait complete. 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 Processor -- start 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 -- start start 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 0x7f899c111a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c1083b0 0x7f899c110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f899c113990 con 0x7f899c108d00 2024-09-21T07:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f899c113810 con 0x7f899c1083b0 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a2bf4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f899c113b10 con 0x7f899c102a70 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a1191640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a1191640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50610/0 (socket says 172.21.15.6:50610) 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f89a1191640 1 -- 172.21.15.6:0/3374567226 learned_addr learned my addr 172.21.15.6:0/3374567226 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.896+0000 7f899bfff640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c1083b0 0x7f899c110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a0990640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 0x7f899c111a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 -- 172.21.15.6:0/3374567226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 msgr2=0x7f899c111a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 0x7f899c111a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 -- 172.21.15.6:0/3374567226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c1083b0 msgr2=0x7f899c110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c1083b0 0x7f899c110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 -- 172.21.15.6:0/3374567226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c110d70 con 0x7f899c108d00 2024-09-21T07:58:47.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a1191640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f899400eaa0 tx=0x7f899400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:47.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400cdb0 con 0x7f899c108d00 2024-09-21T07:58:47.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8994005020 con 0x7f899c108d00 2024-09-21T07:58:47.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c1ace00 con 0x7f899c108d00 2024-09-21T07:58:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.897+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940116d0 con 0x7f899c108d00 2024-09-21T07:58:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.898+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c1ad260 con 0x7f899c108d00 2024-09-21T07:58:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.898+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c103cf0 con 0x7f899c108d00 2024-09-21T07:58:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.901+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f89940051d0 con 0x7f899c108d00 2024-09-21T07:58:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.902+0000 7f8999ffb640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 0x7f898c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.902+0000 7f89a0990640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 0x7f898c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.902+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f89940e77b0 con 0x7f899c108d00 2024-09-21T07:58:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.902+0000 7f89a0990640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 0x7f898c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f899c19e310 tx=0x7f899000b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:47.905+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8994016030 con 0x7f899c108d00 2024-09-21T07:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.102+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f899c111310 con 0x7f899c108d00 2024-09-21T07:58:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.359+0000 7f8999ffb640 1 -- 172.21.15.6:0/3374567226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v76) ==== 157+0+0 (secure 0 0 0) 0x7f89940b23e0 con 0x7f899c108d00 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.361+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 msgr2=0x7f898c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.361+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 0x7f898c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f899c19e310 tx=0x7f899000b410 comp rx=0 tx=0).stop 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.361+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 msgr2=0x7f899c110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.361+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f899400eaa0 tx=0x7f899400ef60 comp rx=0 tx=0).stop 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 shutdown_connections 2024-09-21T07:58:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f898c0b6560 0x7f898c0b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c108d00 0x7f899c110550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899c1083b0 0x7f899c110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 --2- 172.21.15.6:0/3374567226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f899c102a70 0x7f899c111a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 >> 172.21.15.6:0/3374567226 conn(0x7f899c079710 msgr2=0x7f899c106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 shutdown_connections 2024-09-21T07:58:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:48.362+0000 7f89a2bf4640 1 -- 172.21.15.6:0/3374567226 wait complete. 2024-09-21T07:58:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:48 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:active 2024-09-21T07:58:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:48 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:48 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:48 smithi119 ceph-mon[33564]: pgmap v266: 97 pgs: 26 creating+peering, 17 unknown, 54 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 243 B/s wr, 0 op/s 2024-09-21T07:58:48.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:48 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:58:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:48 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:active 2024-09-21T07:58:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:48 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:48 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:48 smithi145 ceph-mon[34049]: pgmap v266: 97 pgs: 26 creating+peering, 17 unknown, 54 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 243 B/s wr, 0 op/s 2024-09-21T07:58:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:48 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:58:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:48 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] up:active 2024-09-21T07:58:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:48 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:48 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:48 smithi006 ceph-mon[30970]: pgmap v266: 97 pgs: 26 creating+peering, 17 unknown, 54 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 243 B/s wr, 0 op/s 2024-09-21T07:58:48.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:48 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:58:49.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:58:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:49.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:49 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:58:49.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:49 smithi006 ceph-mon[30970]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:58:49.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:49 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:58:49.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:49 smithi119 ceph-mon[33564]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:58:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:49 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3374567226' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:58:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:49 smithi145 ceph-mon[34049]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:58:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 -- 172.21.15.6:0/150109811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 msgr2=0x7fdea4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 --2- 172.21.15.6:0/150109811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea4102e90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde98009900 tx=0x7fde9802a410 comp rx=0 tx=0).stop 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 -- 172.21.15.6:0/150109811 shutdown_connections 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 --2- 172.21.15.6:0/150109811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 0x7fdea41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 --2- 172.21.15.6:0/150109811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 0x7fdea410f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 --2- 172.21.15.6:0/150109811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea4102e90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 -- 172.21.15.6:0/150109811 >> 172.21.15.6:0/150109811 conn(0x7fdea4079720 msgr2=0x7fdea4079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 -- 172.21.15.6:0/150109811 shutdown_connections 2024-09-21T07:58:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 -- 172.21.15.6:0/150109811 wait complete. 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.860+0000 7fdeaad80640 1 Processor -- start 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 -- start start 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 0x7fdea419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 0x7fdea419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdea4112990 con 0x7fdea4102a80 2024-09-21T07:58:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdea4112810 con 0x7fdea4108e20 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdeaad80640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdea4112b10 con 0x7fdea41084d0 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50622/0 (socket says 172.21.15.6:50622) 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 -- 172.21.15.6:0/254110518 learned_addr learned my addr 172.21.15.6:0/254110518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea3fff640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 0x7fdea419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea931d640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 0x7fdea419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 -- 172.21.15.6:0/254110518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 msgr2=0x7fdea419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 0x7fdea419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 -- 172.21.15.6:0/254110518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 msgr2=0x7fdea419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:49.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 0x7fdea419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.861+0000 7fdea8b1c640 1 -- 172.21.15.6:0/254110518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea41a0540 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdea8b1c640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde98009230 tx=0x7fde98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9803f030 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde98003a80 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea41a07d0 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98035070 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.862+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea41a6f90 con 0x7fdea4102a80 2024-09-21T07:58:49.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.863+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea4103d00 con 0x7fdea4102a80 2024-09-21T07:58:49.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.865+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fde98042030 con 0x7fdea4102a80 2024-09-21T07:58:49.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.866+0000 7fdea1ffb640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 0x7fde940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:49.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.866+0000 7fdea3fff640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 0x7fde940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:49.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.866+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8492+0+0 (secure 0 0 0) 0x7fde98107f90 con 0x7fdea4102a80 2024-09-21T07:58:49.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.867+0000 7fdea3fff640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 0x7fde940b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdea4079be0 tx=0x7fde9000b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:49.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:49.870+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde980d2aa0 con 0x7fdea4102a80 2024-09-21T07:58:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:50.059+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdea419b700 con 0x7fdea4102a80 2024-09-21T07:58:50.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:50 smithi119 ceph-mon[33564]: pgmap v268: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-21T07:58:50.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:50 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:58:50.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:50 smithi145 ceph-mon[34049]: pgmap v268: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-21T07:58:50.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:50 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:58:50.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:50 smithi006 ceph-mon[30970]: pgmap v268: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-21T07:58:50.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:50 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:58:51.372 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 07:58:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: 2024-09-21T07:58:51.013+0000 7f0ee8660640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:58:51.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.378+0000 7fdea1ffb640 1 -- 172.21.15.6:0/254110518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v78) ==== 228+0+0 (secure 0 0 0) 0x7fde980d5e20 con 0x7fdea4102a80 2024-09-21T07:58:51.381 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2024-09-21T07:58:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 msgr2=0x7fde940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 0x7fde940b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdea4079be0 tx=0x7fde9000b410 comp rx=0 tx=0).stop 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 msgr2=0x7fdea419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde98009230 tx=0x7fde98004270 comp rx=0 tx=0).stop 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 shutdown_connections 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde940b6560 0x7fde940b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdea41084d0 0x7fdea419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdea4108e20 0x7fdea419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 --2- 172.21.15.6:0/254110518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea4102a80 0x7fdea419a5d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 >> 172.21.15.6:0/254110518 conn(0x7fdea4079720 msgr2=0x7fdea4101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 shutdown_connections 2024-09-21T07:58:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:51.382+0000 7fdeaad80640 1 -- 172.21.15.6:0/254110518 wait complete. 2024-09-21T07:58:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:51 smithi119 ceph-mon[33564]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:58:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:51 smithi145 ceph-mon[34049]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:58:51.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:51 smithi006 ceph-mon[30970]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:58:52.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T07:58:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:52.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:52 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:58:52.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:52 smithi119 ceph-mon[33564]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:58:52.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:52 smithi119 ceph-mon[33564]: pgmap v271: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:58:52.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:52 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:58:52.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:52 smithi006 ceph-mon[30970]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:58:52.667 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:52 smithi006 ceph-mon[30970]: pgmap v271: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:58:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:52 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/254110518' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:58:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:52 smithi145 ceph-mon[34049]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:58:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:52 smithi145 ceph-mon[34049]: pgmap v271: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 -- 172.21.15.6:0/2147360666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c102ae0 msgr2=0x7f505c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 --2- 172.21.15.6:0/2147360666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c102ae0 0x7f505c102ef0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f504c009900 tx=0x7f504c02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 -- 172.21.15.6:0/2147360666 shutdown_connections 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 --2- 172.21.15.6:0/2147360666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c108d20 0x7f505c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 --2- 172.21.15.6:0/2147360666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 --2- 172.21.15.6:0/2147360666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c102ae0 0x7f505c102ef0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.900+0000 7f5061638640 1 -- 172.21.15.6:0/2147360666 >> 172.21.15.6:0/2147360666 conn(0x7f505c079760 msgr2=0x7f505c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.901+0000 7f5061638640 1 -- 172.21.15.6:0/2147360666 shutdown_connections 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.901+0000 7f5061638640 1 -- 172.21.15.6:0/2147360666 wait complete. 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.901+0000 7f5061638640 1 Processor -- start 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.901+0000 7f5061638640 1 -- start start 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c102ae0 0x7f505c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f505c112840 con 0x7f505c108d20 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f505c1126c0 con 0x7f505c1083d0 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5061638640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f505c1129c0 con 0x7f505c102ae0 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50640/0 (socket says 172.21.15.6:50640) 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 -- 172.21.15.6:0/912043694 learned_addr learned my addr 172.21.15.6:0/912043694 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505affd640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c102ae0 0x7f505c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5053fff640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 -- 172.21.15.6:0/912043694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c102ae0 msgr2=0x7f505c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c102ae0 0x7f505c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 -- 172.21.15.6:0/912043694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 msgr2=0x7f505c19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 -- 172.21.15.6:0/912043694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c1a0210 con 0x7f505c108d20 2024-09-21T07:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5053fff640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f505b7fe640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f505400eaa0 tx=0x7f505400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.902+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505400cdb0 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.903+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c1a0500 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.903+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5054005020 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.903+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50540116d0 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.903+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c1a6d20 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.904+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505c103d10 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.905+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f5054004a40 con 0x7f505c108d20 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.906+0000 7f5058ff9640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 0x7f50480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.907+0000 7f505affd640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 0x7f50480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.907+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8985+0+0 (secure 0 0 0) 0x7f50540e7b70 con 0x7f505c108d20 2024-09-21T07:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.907+0000 7f505affd640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 0x7f50480b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f504c0057c0 tx=0x7f504c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:52.910+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5054016030 con 0x7f505c108d20 2024-09-21T07:58:53.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.097+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f505c102ef0 con 0x7f505c108d20 2024-09-21T07:58:53.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.392+0000 7f5058ff9640 1 -- 172.21.15.6:0/912043694 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v80) ==== 169+0+0 (secure 0 0 0) 0x7f505c102ef0 con 0x7f505c108d20 2024-09-21T07:58:53.395 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 msgr2=0x7f50480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 0x7f50480b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f504c0057c0 tx=0x7f504c0058d0 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 msgr2=0x7f505c19fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f505400eaa0 tx=0x7f505400ef60 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 shutdown_connections 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f50480b6590 0x7f50480b8aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f505c108d20 0x7f505c19fba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f505c1083d0 0x7f505c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 --2- 172.21.15.6:0/912043694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f505c102ae0 0x7f505c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 >> 172.21.15.6:0/912043694 conn(0x7f505c079760 msgr2=0x7f505c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 shutdown_connections 2024-09-21T07:58:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:53.396+0000 7f5061638640 1 -- 172.21.15.6:0/912043694 wait complete. 2024-09-21T07:58:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:53 smithi119 ceph-mon[33564]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:58:53.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:58:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:53 smithi145 ceph-mon[34049]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:58:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:58:53.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:53 smithi006 ceph-mon[30970]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:58:53.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:58:54.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T07:58:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:54.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:58:54.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:54 smithi119 ceph-mon[33564]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:58:54.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:54 smithi119 ceph-mon[33564]: pgmap v274: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-21T07:58:54.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:58:54.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:54 smithi145 ceph-mon[34049]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:58:54.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:54 smithi145 ceph-mon[34049]: pgmap v274: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-21T07:58:54.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/912043694' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:58:54.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:54 smithi006 ceph-mon[30970]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:58:54.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:54 smithi006 ceph-mon[30970]: pgmap v274: 129 pgs: 5 creating+peering, 16 unknown, 108 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 -- 172.21.15.6:0/3918049658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828102a80 msgr2=0x7fc828102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 --2- 172.21.15.6:0/3918049658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828102a80 0x7fc828102e90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc818009900 tx=0x7fc81802a410 comp rx=0 tx=0).stop 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 -- 172.21.15.6:0/3918049658 shutdown_connections 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 --2- 172.21.15.6:0/3918049658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 0x7fc8281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 --2- 172.21.15.6:0/3918049658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828108d10 0x7fc82810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 --2- 172.21.15.6:0/3918049658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828102a80 0x7fc828102e90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 -- 172.21.15.6:0/3918049658 >> 172.21.15.6:0/3918049658 conn(0x7fc828079740 msgr2=0x7fc828079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 -- 172.21.15.6:0/3918049658 shutdown_connections 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.849+0000 7fc82e217640 1 -- 172.21.15.6:0/3918049658 wait complete. 2024-09-21T07:58:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 Processor -- start 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 -- start start 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 0x7fc8281992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 0x7fc828199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc828112830 con 0x7fc828108d10 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281126b0 con 0x7fc828102a80 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc82e217640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281129b0 con 0x7fc8281083c0 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.850+0000 7fc827fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50666/0 (socket says 172.21.15.6:50666) 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 -- 172.21.15.6:0/4192785395 learned_addr learned my addr 172.21.15.6:0/4192785395 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc826ffd640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 0x7fc828199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc8277fe640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 0x7fc8281992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 -- 172.21.15.6:0/4192785395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 msgr2=0x7fc828199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 0x7fc828199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 -- 172.21.15.6:0/4192785395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 msgr2=0x7fc8281992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 0x7fc8281992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 -- 172.21.15.6:0/4192785395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82819f210 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc8277fe640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 0x7fc8281992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc827fff640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc82000eb10 tx=0x7fc82000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820004b20 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc820004cc0 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82819f500 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820005260 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.851+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82806bb40 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.852+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc828103d00 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.854+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc8200115d0 con 0x7fc828108d10 2024-09-21T07:58:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.855+0000 7fc824ff9640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 0x7fc8100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.855+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8985+0+0 (secure 0 0 0) 0x7fc8200e9df0 con 0x7fc828108d10 2024-09-21T07:58:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.855+0000 7fc8277fe640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 0x7fc8100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.856+0000 7fc8277fe640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 0x7fc8100b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc818006010 tx=0x7fc818000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:54.859+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8200b0390 con 0x7fc828108d10 2024-09-21T07:58:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.086+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc828102e90 con 0x7fc828108d10 2024-09-21T07:58:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.406+0000 7fc824ff9640 1 -- 172.21.15.6:0/4192785395 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fc828102e90 con 0x7fc828108d10 2024-09-21T07:58:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 4 to fsmap 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 msgr2=0x7fc8100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 0x7fc8100b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc818006010 tx=0x7fc818000bc0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 msgr2=0x7fc82819eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc82000eb10 tx=0x7fc82000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 shutdown_connections 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8100b6560 0x7fc8100b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8281083c0 0x7fc828199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc828108d10 0x7fc82819eae0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 --2- 172.21.15.6:0/4192785395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc828102a80 0x7fc8281992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 >> 172.21.15.6:0/4192785395 conn(0x7fc828079740 msgr2=0x7fc8281015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 shutdown_connections 2024-09-21T07:58:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:55.409+0000 7fc82e217640 1 -- 172.21.15.6:0/4192785395 wait complete. 2024-09-21T07:58:55.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:55 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:58:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:55 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:58:55.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:55 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:58:56.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:56 smithi119 ceph-mon[33564]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:58:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:56 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:58:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:56 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:56 smithi119 ceph-mon[33564]: pgmap v276: 129 pgs: 5 creating+peering, 8 unknown, 116 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:56.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:56 smithi145 ceph-mon[34049]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:58:56.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:56 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:58:56.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:56 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:56.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:56 smithi145 ceph-mon[34049]: pgmap v276: 129 pgs: 5 creating+peering, 8 unknown, 116 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:56.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:56 smithi006 ceph-mon[30970]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:58:56.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:56 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4192785395' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:58:56.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:56 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:58:56.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:56 smithi006 ceph-mon[30970]: pgmap v276: 129 pgs: 5 creating+peering, 8 unknown, 116 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 -- 172.21.15.6:0/4133813854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc107bd0 msgr2=0x7f69bc107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 --2- 172.21.15.6:0/4133813854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc107bd0 0x7f69bc107fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009900 tx=0x7f69ac02a410 comp rx=0 tx=0).stop 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 -- 172.21.15.6:0/4133813854 shutdown_connections 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 --2- 172.21.15.6:0/4133813854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 0x7f69bc10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 --2- 172.21.15.6:0/4133813854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc107bd0 0x7f69bc107fe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 --2- 172.21.15.6:0/4133813854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc102290 0x7f69bc1026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 -- 172.21.15.6:0/4133813854 >> 172.21.15.6:0/4133813854 conn(0x7f69bc079ea0 msgr2=0x7f69bc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 -- 172.21.15.6:0/4133813854 shutdown_connections 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.805+0000 7f69c3544640 1 -- 172.21.15.6:0/4133813854 wait complete. 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 Processor -- start 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 -- start start 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 0x7f69bc19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 0x7f69bc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc111810 con 0x7f69bc102290 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc111690 con 0x7f69bc108520 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c3544640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc111990 con 0x7f69bc107bd0 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53334/0 (socket says 172.21.15.6:53334) 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 -- 172.21.15.6:0/3676239067 learned_addr learned my addr 172.21.15.6:0/3676239067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c1ae1640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 0x7f69bc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c0adf640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 0x7f69bc19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 -- 172.21.15.6:0/3676239067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 msgr2=0x7f69bc19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 0x7f69bc19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 -- 172.21.15.6:0/3676239067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 msgr2=0x7f69bc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 0x7f69bc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c12e0640 1 -- 172.21.15.6:0/3676239067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc1a03e0 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.806+0000 7f69c0adf640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 0x7f69bc19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69c12e0640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69b800ea20 tx=0x7f69b800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b800cd40 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc1a06d0 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b80168a0 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b800b780 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.807+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc1a6e30 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.808+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc1026a0 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.810+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f69b8016a50 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.811+0000 7f69b27fc640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 0x7f69a80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.811+0000 7f69c0adf640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 0x7f69a80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.811+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f69b80e7950 con 0x7f69bc102290 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.812+0000 7f69c0adf640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 0x7f69a80b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69ac006010 tx=0x7f69ac000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:56.814+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69b80aded0 con 0x7f69bc102290 2024-09-21T07:58:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.041+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69bc19b5a0 con 0x7f69bc102290 2024-09-21T07:58:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.042+0000 7f69b27fc640 1 -- 172.21.15.6:0/3676239067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11830 (secure 0 0 0) 0x7f69b80b22b0 con 0x7f69bc102290 2024-09-21T07:58:57.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:57.045 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-21T07:58:55:400600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:58:55.089024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T07:58:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-21T07:58:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 msgr2=0x7f69a80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 0x7f69a80b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69ac006010 tx=0x7f69ac000bc0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 msgr2=0x7f69bc19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69b800ea20 tx=0x7f69b800eee0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 shutdown_connections 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f69a80b6560 0x7f69a80b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69bc107bd0 0x7f69bc19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69bc108520 0x7f69bc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 --2- 172.21.15.6:0/3676239067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69bc102290 0x7f69bc19a470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 >> 172.21.15.6:0/3676239067 conn(0x7f69bc079ea0 msgr2=0x7f69bc103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 shutdown_connections 2024-09-21T07:58:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:57.045+0000 7f69c3544640 1 -- 172.21.15.6:0/3676239067 wait complete. 2024-09-21T07:58:57.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:57 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3676239067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:57.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:57 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3676239067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:57.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:58:57.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:57 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3676239067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:58.131 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:58.526 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:58 smithi006 ceph-mon[30970]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 -- 172.21.15.6:0/2269007160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc1094a0 msgr2=0x7f1cdc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/2269007160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc1098b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009900 tx=0x7f1cc402a410 comp rx=0 tx=0).stop 2024-09-21T07:58:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 -- 172.21.15.6:0/2269007160 shutdown_connections 2024-09-21T07:58:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/2269007160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc109df0 0x7f1cdc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/2269007160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc1098b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/2269007160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc103b60 0x7f1cdc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.615+0000 7f1ce0a16640 1 -- 172.21.15.6:0/2269007160 >> 172.21.15.6:0/2269007160 conn(0x7f1cdc07b850 msgr2=0x7f1cdc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.616+0000 7f1ce0a16640 1 -- 172.21.15.6:0/2269007160 shutdown_connections 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.616+0000 7f1ce0a16640 1 -- 172.21.15.6:0/2269007160 wait complete. 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.616+0000 7f1ce0a16640 1 Processor -- start 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 -- start start 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 0x7f1cdc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc113960 con 0x7f1cdc103b60 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc1137e0 con 0x7f1cdc109df0 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1ce0a16640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc113ae0 con 0x7f1cdc1094a0 2024-09-21T07:58:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53350/0 (socket says 172.21.15.6:53350) 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 -- 172.21.15.6:0/225546791 learned_addr learned my addr 172.21.15.6:0/225546791 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cd1d9b640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cdad9d640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 0x7f1cdc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 -- 172.21.15.6:0/225546791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc1094a0 msgr2=0x7f1cdc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 -- 172.21.15.6:0/225546791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 msgr2=0x7f1cdc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 0x7f1cdc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 -- 172.21.15.6:0/225546791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc1a02e0 con 0x7f1cdc103b60 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cdad9d640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 0x7f1cdc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.617+0000 7f1cda59c640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00d950 tx=0x7f1ccc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.618+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc017070 con 0x7f1cdc103b60 2024-09-21T07:58:58.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.618+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc009c30 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.618+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc1a05d0 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.618+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00f620 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.618+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc1a6df0 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.619+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc103f70 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.620+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f1ccc005030 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.621+0000 7f1cd3fff640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 0x7f1cc80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.621+0000 7f1cd1d9b640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 0x7f1cc80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.621+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f1ccc0e7230 con 0x7f1cdc103b60 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.622+0000 7f1cd1d9b640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 0x7f1cc80b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005940 tx=0x7f1cc40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.624+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ccc0ad7b0 con 0x7f1cdc103b60 2024-09-21T07:58:58.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:58 smithi145 ceph-mon[34049]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.813+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cdc19b560 con 0x7f1cdc103b60 2024-09-21T07:58:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.814+0000 7f1cd3fff640 1 -- 172.21.15.6:0/225546791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24489 (secure 0 0 0) 0x7f1ccc0b1b90 con 0x7f1cdc103b60 2024-09-21T07:58:58.817 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:58:58.817 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":81,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:58:55.088802+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:58:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 msgr2=0x7f1cc80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 0x7f1cc80b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005940 tx=0x7f1cc40058d0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 msgr2=0x7f1cdc19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00d950 tx=0x7f1ccc00de10 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 shutdown_connections 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1cc80b6590 0x7f1cc80b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1cdc1094a0 0x7f1cdc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cdc109df0 0x7f1cdc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 --2- 172.21.15.6:0/225546791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cdc103b60 0x7f1cdc19a430 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 >> 172.21.15.6:0/225546791 conn(0x7f1cdc07b850 msgr2=0x7f1cdc1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 shutdown_connections 2024-09-21T07:58:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:58:58.817+0000 7f1ce0a16640 1 -- 172.21.15.6:0/225546791 wait complete. 2024-09-21T07:58:58.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:58 smithi119 ceph-mon[33564]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:58:59.523 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:58:59 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/225546791' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:58:59.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:58:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:58:59 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/225546791' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:58:59.814 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:58:59.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:58:59 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/225546791' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 -- 172.21.15.6:0/2713644920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3608102a60 msgr2=0x7f3608102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 --2- 172.21.15.6:0/2713644920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3608102a60 0x7f3608102e70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3604009900 tx=0x7f360402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 -- 172.21.15.6:0/2713644920 shutdown_connections 2024-09-21T07:59:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 --2- 172.21.15.6:0/2713644920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608108cf0 0x7f360810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 --2- 172.21.15.6:0/2713644920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36081083a0 0x7f36081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 --2- 172.21.15.6:0/2713644920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3608102a60 0x7f3608102e70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.291+0000 7f360fb09640 1 -- 172.21.15.6:0/2713644920 >> 172.21.15.6:0/2713644920 conn(0x7f3608079730 msgr2=0x7f3608079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.292+0000 7f360fb09640 1 -- 172.21.15.6:0/2713644920 shutdown_connections 2024-09-21T07:59:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.292+0000 7f360fb09640 1 -- 172.21.15.6:0/2713644920 wait complete. 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.292+0000 7f360fb09640 1 Processor -- start 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.292+0000 7f360fb09640 1 -- start start 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608102a60 0x7f360819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 0x7f360819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3608113930 con 0x7f36081083a0 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36081137b0 con 0x7f3608108cf0 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3608113ab0 con 0x7f3608102a60 2024-09-21T07:59:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53362/0 (socket says 172.21.15.6:53362) 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 -- 172.21.15.6:0/2216742793 learned_addr learned my addr 172.21.15.6:0/2216742793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360e0a6640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 0x7f360819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d8a5640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608102a60 0x7f360819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 -- 172.21.15.6:0/2216742793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608102a60 msgr2=0x7f360819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608102a60 0x7f360819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 -- 172.21.15.6:0/2216742793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 msgr2=0x7f360819fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 0x7f360819fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 -- 172.21.15.6:0/2216742793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36081a02d0 con 0x7f36081083a0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360e0a6640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 0x7f360819fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360d0a4640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d770 tx=0x7f35f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8017070 con 0x7f36081083a0 2024-09-21T07:59:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f8009c30 con 0x7f36081083a0 2024-09-21T07:59:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36081a05c0 con 0x7f36081083a0 2024-09-21T07:59:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.293+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f800f620 con 0x7f36081083a0 2024-09-21T07:59:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.294+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081a6d20 con 0x7f36081083a0 2024-09-21T07:59:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.294+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608102e70 con 0x7f36081083a0 2024-09-21T07:59:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.296+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f35f801a070 con 0x7f36081083a0 2024-09-21T07:59:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.297+0000 7f35feffd640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 0x7f35f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.297+0000 7f360d8a5640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 0x7f35f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.297+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f35f80e7280 con 0x7f36081083a0 2024-09-21T07:59:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.298+0000 7f360d8a5640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 0x7f35f40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3604000c00 tx=0x7f3604009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:00.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.300+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35f8009de0 con 0x7f36081083a0 2024-09-21T07:59:00.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:00 smithi006 ceph-mon[30970]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.496+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f360819b490 con 0x7f36081083a0 2024-09-21T07:59:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.497+0000 7f35feffd640 1 -- 172.21.15.6:0/2216742793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24489 (secure 0 0 0) 0x7f360819b490 con 0x7f36081083a0 2024-09-21T07:59:00.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:00.500 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":81,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:58:55.088802+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 msgr2=0x7f35f40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 0x7f35f40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3604000c00 tx=0x7f3604009680 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 msgr2=0x7f360819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d770 tx=0x7f35f800dc30 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 shutdown_connections 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35f40b6560 0x7f35f40b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3608108cf0 0x7f360819fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36081083a0 0x7f360819a900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 --2- 172.21.15.6:0/2216742793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608102a60 0x7f360819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 >> 172.21.15.6:0/2216742793 conn(0x7f3608079730 msgr2=0x7f3608101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 shutdown_connections 2024-09-21T07:59:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:00.500+0000 7f360fb09640 1 -- 172.21.15.6:0/2216742793 wait complete. 2024-09-21T07:59:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:00 smithi145 ceph-mon[34049]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:00.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:00 smithi119 ceph-mon[33564]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:01.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:59:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:01.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:01 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2216742793' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:01.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:01 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2216742793' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:01 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2216742793' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 -- 172.21.15.6:0/2606877052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 msgr2=0x7f930410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 --2- 172.21.15.6:0/2606877052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930410f540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009ca0 tx=0x7f92fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 -- 172.21.15.6:0/2606877052 shutdown_connections 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 --2- 172.21.15.6:0/2606877052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 0x7f93041087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 --2- 172.21.15.6:0/2606877052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930410f540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 --2- 172.21.15.6:0/2606877052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 0x7f9304102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 -- 172.21.15.6:0/2606877052 >> 172.21.15.6:0/2606877052 conn(0x7f9304079740 msgr2=0x7f9304079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 -- 172.21.15.6:0/2606877052 shutdown_connections 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.951+0000 7f930b42b640 1 -- 172.21.15.6:0/2606877052 wait complete. 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 Processor -- start 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 -- start start 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 0x7f930419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 0x7f930419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f93041139a0 con 0x7f9304108d10 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9304113820 con 0x7f9304102a80 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f930b42b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9304113b20 con 0x7f93041083c0 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f93099c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.952+0000 7f93099c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53384/0 (socket says 172.21.15.6:53384) 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 -- 172.21.15.6:0/570514373 learned_addr learned my addr 172.21.15.6:0/570514373 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93091c7640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 0x7f930419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93089c6640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 0x7f930419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 -- 172.21.15.6:0/570514373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 msgr2=0x7f930419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 0x7f930419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 -- 172.21.15.6:0/570514373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 msgr2=0x7f930419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 0x7f930419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 -- 172.21.15.6:0/570514373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93041a02c0 con 0x7f9304108d10 2024-09-21T07:59:01.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f93099c8640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f92fc005cc0 tx=0x7f92fc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc032e00 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92fc0044d0 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93041a0550 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc030b70 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.953+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93041a6d10 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.954+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9304103d00 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.956+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f92fc030d10 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.957+0000 7f92fa7fc640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 0x7f92f00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.957+0000 7f93091c7640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 0x7f92f00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.957+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9017+0+0 (secure 0 0 0) 0x7f92fc108ab0 con 0x7f9304108d10 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.957+0000 7f93091c7640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 0x7f92f00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f930000bbe0 tx=0x7f930000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:01.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:01.960+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92fc0cf0c0 con 0x7f9304108d10 2024-09-21T07:59:02.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.183+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f930410ab40 con 0x7f9304108d10 2024-09-21T07:59:02.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.184+0000 7f92fa7fc640 1 -- 172.21.15.6:0/570514373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11830 (secure 0 0 0) 0x7f92fc0d34a0 con 0x7f9304108d10 2024-09-21T07:59:02.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:02.187 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-21T07:58:55:400600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24694,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:58:55.089024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T07:59:02.187 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 msgr2=0x7f92f00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 0x7f92f00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f930000bbe0 tx=0x7f930000b390 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 msgr2=0x7f930419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f92fc005cc0 tx=0x7f92fc032a10 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 shutdown_connections 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92f00b6560 0x7f92f00b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93041083c0 0x7f930419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9304108d10 0x7f930419fb90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 --2- 172.21.15.6:0/570514373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9304102a80 0x7f930419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 >> 172.21.15.6:0/570514373 conn(0x7f9304079740 msgr2=0x7f9304104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 shutdown_connections 2024-09-21T07:59:02.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:02.186+0000 7f930b42b640 1 -- 172.21.15.6:0/570514373 wait complete. 2024-09-21T07:59:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:59:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T07:59:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:59:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T07:59:02.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:02.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/570514373' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:02.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/570514373' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:59:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T07:59:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:59:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:02.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/570514373' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:03.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T07:59:03.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T07:59:03.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T07:59:03.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:59:03.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:59:03.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:03 smithi006 ceph-mon[30970]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:59:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 -- 172.21.15.6:0/1646391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 msgr2=0x7f9bcc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 --2- 172.21.15.6:0/1646391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc10f520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009ca0 tx=0x7f9bc402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 -- 172.21.15.6:0/1646391041 shutdown_connections 2024-09-21T07:59:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 --2- 172.21.15.6:0/1646391041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 --2- 172.21.15.6:0/1646391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc10f520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 --2- 172.21.15.6:0/1646391041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc102a60 0x7f9bcc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 -- 172.21.15.6:0/1646391041 >> 172.21.15.6:0/1646391041 conn(0x7f9bcc079730 msgr2=0x7f9bcc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 -- 172.21.15.6:0/1646391041 shutdown_connections 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.845+0000 7f9bd3448640 1 -- 172.21.15.6:0/1646391041 wait complete. 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 Processor -- start 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 -- start start 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 0x7f9bcc19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc113980 con 0x7f9bcc108cf0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc113800 con 0x7f9bcc1083a0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.846+0000 7f9bd3448640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc113b00 con 0x7f9bcc102a60 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53410/0 (socket says 172.21.15.6:53410) 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 -- 172.21.15.6:0/3087583141 learned_addr learned my addr 172.21.15.6:0/3087583141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd11e4640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 0x7f9bcc19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd09e3640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 -- 172.21.15.6:0/3087583141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 msgr2=0x7f9bcc19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 0x7f9bcc19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 -- 172.21.15.6:0/3087583141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 msgr2=0x7f9bcc19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 -- 172.21.15.6:0/3087583141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc1a2520 con 0x7f9bcc108cf0 2024-09-21T07:59:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd09e3640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd11e4640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 0x7f9bcc19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd19e5640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4005cc0 tx=0x7f9bc4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4032e00 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bc40044d0 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4030b70 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.847+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc1a27b0 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.848+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc1a8f70 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.849+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bcc103ce0 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.850+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f9bc4030d10 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.851+0000 7f9bc27fc640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 0x7f9bb80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.851+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f9bc4108c00 con 0x7f9bcc108cf0 2024-09-21T07:59:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.851+0000 7f9bd11e4640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 0x7f9bb80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.852+0000 7f9bd11e4640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 0x7f9bb80b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80058c0 tx=0x7f9bc8005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:03.854+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bc40cf060 con 0x7f9bcc108cf0 2024-09-21T07:59:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:59:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T07:59:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:59:03.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:03 smithi119 ceph-mon[33564]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:59:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:59:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:59:03.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:03 smithi145 ceph-mon[34049]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:59:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.043+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bcc1a9140 con 0x7f9bcc108cf0 2024-09-21T07:59:04.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.046+0000 7f9bc27fc640 1 -- 172.21.15.6:0/3087583141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7f9bc40d3440 con 0x7f9bcc108cf0 2024-09-21T07:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.048+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 msgr2=0x7f9bb80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.048+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 0x7f9bb80b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80058c0 tx=0x7f9bc8005850 comp rx=0 tx=0).stop 2024-09-21T07:59:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.048+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 msgr2=0x7f9bcc1a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.048+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4005cc0 tx=0x7f9bc4032a10 comp rx=0 tx=0).stop 2024-09-21T07:59:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 shutdown_connections 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9bb80b6560 0x7f9bb80b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bcc108cf0 0x7f9bcc1a1df0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc1083a0 0x7f9bcc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 --2- 172.21.15.6:0/3087583141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bcc102a60 0x7f9bcc19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 >> 172.21.15.6:0/3087583141 conn(0x7f9bcc079730 msgr2=0x7f9bcc104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 shutdown_connections 2024-09-21T07:59:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:04.049+0000 7f9bd3448640 1 -- 172.21.15.6:0/3087583141 wait complete. 2024-09-21T07:59:04.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:04 smithi006 ceph-mon[30970]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:59:04.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:04 smithi006 ceph-mon[30970]: pgmap v282: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:04.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:04 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3087583141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:04.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:58:46.069948+0000', 'modified': '2024-09-21T07:58:55.089024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24713}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24713': {'gid': 24713, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/1644051507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1644051507}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1644051507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24713, 'qdb_cluster': [24713]} 2024-09-21T07:59:04.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:59:04.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:59:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:04 smithi119 ceph-mon[33564]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:59:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:04 smithi119 ceph-mon[33564]: pgmap v282: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:04.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:04 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3087583141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:04.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:04 smithi145 ceph-mon[34049]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:59:04.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:04 smithi145 ceph-mon[34049]: pgmap v282: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:59:04.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:04 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3087583141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 -- 172.21.15.6:0/3800866662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 msgr2=0x7f4c1c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3800866662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c10d8b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009900 tx=0x7f4c0402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 -- 172.21.15.6:0/3800866662 shutdown_connections 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3800866662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c10ddf0 0x7f4c1c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3800866662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c10d8b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3800866662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c104840 0x7f4c1c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 -- 172.21.15.6:0/3800866662 >> 172.21.15.6:0/3800866662 conn(0x7f4c1c079730 msgr2=0x7f4c1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 -- 172.21.15.6:0/3800866662 shutdown_connections 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.505+0000 7f4c221f6640 1 -- 172.21.15.6:0/3800866662 wait complete. 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.506+0000 7f4c221f6640 1 Processor -- start 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.506+0000 7f4c221f6640 1 -- start start 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c104840 0x7f4c1c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c10ddf0 0x7f4c1c19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c113920 con 0x7f4c1c105270 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c1137a0 con 0x7f4c1c104840 2024-09-21T07:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c113aa0 con 0x7f4c1c10ddf0 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53424/0 (socket says 172.21.15.6:53424) 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 -- 172.21.15.6:0/3588843109 learned_addr learned my addr 172.21.15.6:0/3588843109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c104840 0x7f4c1c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c10ddf0 0x7f4c1c19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 -- 172.21.15.6:0/3588843109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c10ddf0 msgr2=0x7f4c1c19fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c10ddf0 0x7f4c1c19fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 -- 172.21.15.6:0/3588843109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c104840 msgr2=0x7f4c1c19a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c104840 0x7f4c1c19a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 -- 172.21.15.6:0/3588843109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c1a0300 con 0x7f4c1c105270 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005940 tx=0x7f4c040040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c197fa640 1 -- 172.21.15.6:0/3588843109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0403f030 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c1a0590 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c197fa640 1 -- 172.21.15.6:0/3588843109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c04003a80 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.507+0000 7f4c197fa640 1 -- 172.21.15.6:0/3588843109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035070 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.508+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c1a6d50 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.510+0000 7f4c197fa640 1 -- 172.21.15.6:0/3588843109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f4c04042030 con 0x7f4c1c105270 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.510+0000 7f4c2876a740 1 Processor -- start 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 -- start start 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 0x55b448284440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448284980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b4481fbc10 con 0x55b447eddf60 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b4481eb040 con 0x55b447eb50a0 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c2876a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b4481eee50 con 0x55b447ebd280 2024-09-21T07:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53426/0 (socket says 172.21.15.6:53426) 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 -- 172.21.15.6:0/2915575482 learned_addr learned my addr 172.21.15.6:0/2915575482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448284980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 0x55b448284440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c197fa640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 0x7f4c080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 -- 172.21.15.6:0/2915575482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 msgr2=0x55b448284980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448284980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 -- 172.21.15.6:0/2915575482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 msgr2=0x55b448284440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 0x55b448284440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.511+0000 7f4c1bfff640 1 -- 172.21.15.6:0/2915575482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b447f49540 con 0x55b447eddf60 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 0x55b448284440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c197fa640 1 -- 172.21.15.6:0/3588843109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f4c04107cc0 con 0x7f4c1c105270 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 0x7f4c080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009ee0 tx=0x7f4c14010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be989d6130af9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c11ffb640 1 -- 172.21.15.6:0/2915575482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14021070 con 0x55b447eddf60 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c11ffb640 1 -- 172.21.15.6:0/2915575482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c140113e0 con 0x55b447eddf60 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.512+0000 7f4c11ffb640 1 -- 172.21.15.6:0/2915575482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14016070 con 0x55b447eddf60 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- 172.21.15.6:0/2915575482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 msgr2=0x55b448283f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 0x7f4c080b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c1401e000 tx=0x7f4c14021000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009ee0 tx=0x7f4c14010740 comp rx=0 tx=0).stop 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- 172.21.15.6:0/2915575482 shutdown_connections 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448284980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eb50a0 0x55b448284440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2915575482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eddf60 0x55b448283f00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- 172.21.15.6:0/2915575482 >> 172.21.15.6:0/2915575482 conn(0x55b447ed2350 msgr2=0x55b448281df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- 172.21.15.6:0/2915575482 shutdown_connections 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- 172.21.15.6:0/2915575482 wait complete. 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.513+0000 7f4c2876a740 1 -- start start 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 Processor -- start 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448294340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b44829fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b44804c5f0 con 0x55b447eb50a0 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b448186010 con 0x55b447eddf60 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b448296a40 con 0x55b447ebd280 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c2876a740 10 client.0 _ll_register_callbacks cb 0x55b4481e5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53434/0 (socket says 172.21.15.6:53434) 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/1891342022 learned_addr learned my addr 172.21.15.6:0/1891342022 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448294340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.514+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b44829fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/1891342022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 msgr2=0x55b448294340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448294340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 msgr2=0x55b44829fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b44829fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/1891342022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4481b3a00 con 0x55b447eb50a0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00be30 tx=0x7f4c0c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317224553396b596 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4bfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c012860 con 0x55b447eb50a0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c140113e0 con 0x55b447eb50a0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f4c0c012a00 con 0x55b447eb50a0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4c0c026050 con 0x55b447eb50a0 2024-09-21T07:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c2876a740 10 client.14952 fetch_fsmap learned FSMap version 17 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55b4482a2970 con 0x55b447eb50a0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.515+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c140113e0 con 0x55b447eb50a0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4c0c00f3d0 con 0x55b447eb50a0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 10 client.14952 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 10 client.14952 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 20 client.14952 populate_metadata read hostname 'smithi006' 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e9c8e0 0x55b4482a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 4 client.14952 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4481fdb60 con 0x55b447e9c8e0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.516+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e9c8e0 0x55b4482a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.517+0000 7f4bfaffd640 10 client.14952 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.517+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e9c8e0 0x55b4482a6410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36e9bd2b7b96d5c server_cookie=7c61a729ecc697f8 in_seq=0 out_seq=0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.517+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1891342022 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4481fdb60 con 0x55b447e9c8e0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.517+0000 7f4bfaffd640 10 client.14952 handle_command_reply: tid=0 2024-09-21T07:59:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.517+0000 7f4c2876a740 1 client.14952 shutdown 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 msgr2=0x55b448293e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00be30 tx=0x7f4c0c0117b0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 shutdown_connections 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e9c8e0 0x55b4482a6410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447ebd280 0x55b448294340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b44829fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1891342022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b448293e00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 >> 172.21.15.6:0/1891342022 conn(0x55b447ed2350 msgr2=0x55b4482858f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4bfaffd640 0 client.14952 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 shutdown_connections 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 1 -- 172.21.15.6:0/1891342022 wait complete. 2024-09-21T07:59:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.518+0000 7f4c2876a740 20 client.14952 trim_cache size 0 max 16384 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 Processor -- start 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 -- start start 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 0x55b4482a0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eddf60 0x55b44828ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a4750 con 0x55b447eb50a0 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a4e20 con 0x55b447ebd280 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c2876a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a54f0 con 0x55b447eddf60 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.536+0000 7f4c1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53438/0 (socket says 172.21.15.6:53438) 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/2964995660 learned_addr learned my addr 172.21.15.6:0/2964995660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 0x55b4482a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eddf60 0x55b44828ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/2964995660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eddf60 msgr2=0x55b44828ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eddf60 0x55b44828ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/2964995660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 msgr2=0x55b4482a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 0x55b4482a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 -- 172.21.15.6:0/2964995660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b448292100 con 0x55b447eb50a0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 0x55b4482a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c001eb0 tx=0x7f4c0c0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f53cfb051ac3d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c117fa640 1 -- 172.21.15.6:0/2964995660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c023040 con 0x55b447eb50a0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c117fa640 1 -- 172.21.15.6:0/2964995660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c00fdf0 con 0x55b447eb50a0 2024-09-21T07:59:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.537+0000 7f4c117fa640 1 -- 172.21.15.6:0/2964995660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c004660 con 0x55b447eb50a0 2024-09-21T07:59:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 -- 172.21.15.6:0/2964995660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 msgr2=0x55b44829fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c001eb0 tx=0x7f4c0c0058f0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 -- 172.21.15.6:0/2964995660 shutdown_connections 2024-09-21T07:59:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eddf60 0x55b44828ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447ebd280 0x55b4482a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 --2- 172.21.15.6:0/2964995660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447eb50a0 0x55b44829fce0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 -- 172.21.15.6:0/2964995660 >> 172.21.15.6:0/2964995660 conn(0x55b447ed2350 msgr2=0x55b448293de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 -- 172.21.15.6:0/2964995660 shutdown_connections 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.538+0000 7f4c2876a740 1 -- 172.21.15.6:0/2964995660 wait complete. 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 -- start start 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 Processor -- start 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 0x55b4482a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b4482a9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a6290 con 0x55b447ebd280 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a5bc0 con 0x55b447eddf60 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b4482a6960 con 0x55b447eb50a0 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c2876a740 10 client.0 _ll_register_callbacks cb 0x7f4c0c00b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53444/0 (socket says 172.21.15.6:53444) 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.539+0000 7f4c12ffd640 1 -- 172.21.15.6:0/1914460287 learned_addr learned my addr 172.21.15.6:0/1914460287 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 0x55b4482a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c1bfff640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b4482a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 -- 172.21.15.6:0/1914460287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 msgr2=0x55b4482a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 0x55b4482a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 -- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 msgr2=0x55b4482a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b4482a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 -- 172.21.15.6:0/1914460287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4482adf10 con 0x55b447ebd280 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 0x55b4482a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c12ffd640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cd9b0 tx=0x7f4c0402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f9dd65188772f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4bfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04049040 con 0x55b447ebd280 2024-09-21T07:59:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f4c040d2070 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c00fdf0 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4c04109040 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c2876a740 10 client.14958 fetch_fsmap learned FSMap version 17 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.540+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55b448311bd0 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c00fdf0 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4c040d6fb0 con 0x55b447ebd280 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 10 client.14958 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 10 client.14958 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 20 client.14958 populate_metadata read hostname 'smithi006' 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e71c90 0x55b448315500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 4 client.14958 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "status"}) -- 0x55b4481f9610 con 0x55b447e71c90 2024-09-21T07:59:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.541+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e71c90 0x55b448315500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c1b7fe640 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e71c90 0x55b448315500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c3eddb8b5bc7a8 server_cookie=59e3d3ab112d133b in_seq=0 out_seq=0 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4bfaffd640 10 client.14958 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4bfaffd640 1 -- 172.21.15.6:0/1914460287 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b4481f9610 con 0x55b447e71c90 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4bfaffd640 10 client.14958 handle_command_reply: tid=0 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 client.14958 shutdown 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 msgr2=0x55b4482a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cd9b0 tx=0x7f4c0402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 shutdown_connections 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b447e71c90 0x55b448315500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b447eddf60 0x55b4482a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b447ebd280 0x55b4482a8c40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 --2- 172.21.15.6:0/1914460287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b447eb50a0 0x55b4482a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4bfaffd640 0 client.14958 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T07:59:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 >> 172.21.15.6:0/1914460287 conn(0x55b447ed2350 msgr2=0x55b448292310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 shutdown_connections 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 1 -- 172.21.15.6:0/1914460287 wait complete. 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.542+0000 7f4c2876a740 20 client.14958 trim_cache size 0 max 16384 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24713, 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-21T07:59:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 19.195564649000001, 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 83, 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 81, 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 30.387573529000001 2024-09-21T07:59:05.551 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 msgr2=0x7f4c080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 0x7f4c080b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c1401e000 tx=0x7f4c14021000 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 msgr2=0x7f4c1c19a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005940 tx=0x7f4c040040e0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 shutdown_connections 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c080b6560 0x7f4c080b8a70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c1c10ddf0 0x7f4c1c19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c1c105270 0x7f4c1c19a930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 --2- 172.21.15.6:0/3588843109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c1c104840 0x7f4c1c19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 >> 172.21.15.6:0/3588843109 conn(0x7f4c1c079730 msgr2=0x7f4c1c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 shutdown_connections 2024-09-21T07:59:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:05.543+0000 7f4c221f6640 1 -- 172.21.15.6:0/3588843109 wait complete. 2024-09-21T07:59:06.259 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:59:06.259 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:06.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T07:59:06.517 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:06.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:06 smithi119 ceph-mon[33564]: pgmap v283: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T07:59:06.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:06 smithi006 ceph-mon[30970]: pgmap v283: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T07:59:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:06 smithi145 ceph-mon[34049]: pgmap v283: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 -- 172.21.15.6:0/4252527560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf4105300 msgr2=0x7efbf410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/4252527560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf4105300 0x7efbf410d850 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009900 tx=0x7efbe802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 -- 172.21.15.6:0/4252527560 shutdown_connections 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/4252527560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf410de10 0x7efbf4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/4252527560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf4105300 0x7efbf410d850 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/4252527560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf41049b0 0x7efbf4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 -- 172.21.15.6:0/4252527560 >> 172.21.15.6:0/4252527560 conn(0x7efbf4079730 msgr2=0x7efbf4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 -- 172.21.15.6:0/4252527560 shutdown_connections 2024-09-21T07:59:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.020+0000 7efbfb0e8640 1 -- 172.21.15.6:0/4252527560 wait complete. 2024-09-21T07:59:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 Processor -- start 2024-09-21T07:59:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 -- start start 2024-09-21T07:59:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf41049b0 0x7efbf419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 0x7efbf419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efbf4113920 con 0x7efbf410de10 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efbf41137a0 con 0x7efbf41049b0 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbfb0e8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efbf4113aa0 con 0x7efbf4105300 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbf9685640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.021+0000 7efbf9685640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40828/0 (socket says 172.21.15.6:40828) 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 -- 172.21.15.6:0/3973365582 learned_addr learned my addr 172.21.15.6:0/3973365582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf8e84640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf41049b0 0x7efbf419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf3fff640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 0x7efbf419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 -- 172.21.15.6:0/3973365582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 msgr2=0x7efbf419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 0x7efbf419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 -- 172.21.15.6:0/3973365582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf41049b0 msgr2=0x7efbf419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf41049b0 0x7efbf419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 -- 172.21.15.6:0/3973365582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf41a0360 con 0x7efbf410de10 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf3fff640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 0x7efbf419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf9685640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efbec00cad0 tx=0x7efbec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec00ae20 con 0x7efbf410de10 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf41a0650 con 0x7efbf410de10 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efbec005020 con 0x7efbf410de10 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.022+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec00f6b0 con 0x7efbf410de10 2024-09-21T07:59:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.023+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf41a6db0 con 0x7efbf410de10 2024-09-21T07:59:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.024+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf4104dc0 con 0x7efbf410de10 2024-09-21T07:59:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.025+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7efbec0051d0 con 0x7efbf410de10 2024-09-21T07:59:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.026+0000 7efbf1ffb640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 0x7efbdc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.026+0000 7efbf8e84640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 0x7efbdc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.026+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7efbec0e7b00 con 0x7efbf410de10 2024-09-21T07:59:07.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.026+0000 7efbf8e84640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 0x7efbdc0b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005fd0 tx=0x7efbe400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:07.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.029+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efbec014030 con 0x7efbf410de10 2024-09-21T07:59:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.260+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efbf419b520 con 0x7efbf410de10 2024-09-21T07:59:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.261+0000 7efbf1ffb640 1 -- 172.21.15.6:0/3973365582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7efbf419b520 con 0x7efbf410de10 2024-09-21T07:59:07.263 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 msgr2=0x7efbdc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 0x7efbdc0b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005fd0 tx=0x7efbe400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 msgr2=0x7efbf419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efbec00cad0 tx=0x7efbec00cf90 comp rx=0 tx=0).stop 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 shutdown_connections 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efbdc0b6560 0x7efbdc0b8a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efbf4105300 0x7efbf419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efbf410de10 0x7efbf419fc30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 --2- 172.21.15.6:0/3973365582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbf41049b0 0x7efbf419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 >> 172.21.15.6:0/3973365582 conn(0x7efbf4079730 msgr2=0x7efbf4100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 shutdown_connections 2024-09-21T07:59:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:07.263+0000 7efbfb0e8640 1 -- 172.21.15.6:0/3973365582 wait complete. 2024-09-21T07:59:07.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:07 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3973365582' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:59:07.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:07 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3973365582' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:59:07.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:07 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3973365582' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:59:08.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:59:08.020 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:59:08.020 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:59:08.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:08.020 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:59:08.038 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42205sec preferred_lft 42205sec 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:59:08.039 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:59:08.040 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-21T07:59:08.040 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:59:08.040 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:59:08.040 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T07:59:08.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:59:08.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-09-21T07:59:08.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-09-21T07:59:08.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:59:08.041 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T07:59:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:59:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:08.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:08.261 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:59:08.286 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-21T07:59:08.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:08.288 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-21T07:59:08.359 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-21T07:59:08.359 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:59:08.359 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:59:08.359 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:59:08.359 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:59:08.360 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T07:59:08.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:59:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:08.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:08.653 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-21T07:59:08.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:08.669 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-21T07:59:08.725 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:59:08.725 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T07:59:08.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:59:08.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T07:59:08.725 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T07:59:08.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:59:08.822 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:08 smithi006 ceph-mon[30970]: pgmap v284: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:08.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:08.845 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T07:59:08.845 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:59:08.845 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T07:59:08.846 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T07:59:08.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:59:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:08 smithi119 ceph-mon[33564]: pgmap v284: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:08 smithi145 ceph-mon[34049]: pgmap v284: 129 pgs: 3 peering, 126 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:08.975 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:59:08.975 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T07:59:08.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-21T07:59:08.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:59:08.976 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T07:59:09.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:59:09.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:09.055 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T07:59:09.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:59:09.055 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:09.084 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:59:09.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:59:09.084 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:09.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-21T07:59:09.207 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-21T07:59:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-21T07:59:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/a20f934e0dbd8fc6f0d2c73ed9d9373ca1730a82b09de146e35c9a22234bcb32/merged 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00d8313383251f90a9c9a02e29741cb4b7f3a85ecbcce39d9947dc83ad8bff15/merged 2024-09-21T07:59:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/f061c8f7ea0f26d2819a7a949e8be5ecf800619e3d4b440056bd413e67a2aa2b/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/e45ff3be6e06861133c983d1828a8b3aec8808deb936db22cdd9fe0255bd8de5/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/05326b152013b3a6fae6e0549d70b60c2be598596ee8f38fcf28e637346b7b1c/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ea3efb7402493d1001343d8eccb202a075b76eb9f07d4a44bb418acc31598cc9/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/7a3ec3c34cb66b91a94c1553d3c5ccd6ca10ae48ab20fa62652ce9aec8828acc/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/3995b3f08c5f3a842f18656ff777df5295e89808913f6781c960a0555933272b/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/d56aa35cc29b7c2705436bc695ed4b0cd848fa798ed1e2752308a788266f78e9/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/97610741785e7be078ec91ce87819054fe9871596699122451403f170deb22cf/merged 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:59:09.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:09.268 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-21T07:59:09.320 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T07:59:09.321 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T07:59:09.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-21T07:59:09.391 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-21T07:59:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:59:09.450 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/a20f934e0dbd8fc6f0d2c73ed9d9373ca1730a82b09de146e35c9a22234bcb32/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00d8313383251f90a9c9a02e29741cb4b7f3a85ecbcce39d9947dc83ad8bff15/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/f061c8f7ea0f26d2819a7a949e8be5ecf800619e3d4b440056bd413e67a2aa2b/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/e45ff3be6e06861133c983d1828a8b3aec8808deb936db22cdd9fe0255bd8de5/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/05326b152013b3a6fae6e0549d70b60c2be598596ee8f38fcf28e637346b7b1c/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ea3efb7402493d1001343d8eccb202a075b76eb9f07d4a44bb418acc31598cc9/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/7a3ec3c34cb66b91a94c1553d3c5ccd6ca10ae48ab20fa62652ce9aec8828acc/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/3995b3f08c5f3a842f18656ff777df5295e89808913f6781c960a0555933272b/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/d56aa35cc29b7c2705436bc695ed4b0cd848fa798ed1e2752308a788266f78e9/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/97610741785e7be078ec91ce87819054fe9871596699122451403f170deb22cf/merged 2024-09-21T07:59:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-21T07:59:09.452 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:59:09.452 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:59:09.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:09.452 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-21T07:59:09.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2024-09-21T07:59:09.480+0000 7f963bafb480 -1 init, newargv = 0x7f9620004360 newargc=15 2024-09-21T07:59:09.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76697]: starting ceph client 2024-09-21T07:59:09.489 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76697]: starting fuse 2024-09-21T07:59:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:120 2024-09-21T07:59:09.500 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-21T07:59:09.501 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-21T07:59:09.502 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T07:59:09.503 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T07:59:09.504 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2024-09-21T07:59:09.505 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-21T07:59:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.76697.asok 2024-09-21T07:59:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:09.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76697.asok 2024-09-21T07:59:09.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:09.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76697.asok status 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "76697", 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T07:59:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 14970, 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 14970 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4040862851 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-21T07:59:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4040862851 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.14970 192.168.0.1:0/4040862851", 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/4040862851", 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 17, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 83, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-21T07:59:09.780 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T07:59:09.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:09.787 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-21T07:59:09.787 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:09.802 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-21T07:59:09.803 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:09.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:09.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:09.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T07:59:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:59:09.983 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2024-09-21T07:59:09.983 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T07:59:09.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:59:09.990 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:59:09.990 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:59:10.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:59:10.306 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:10 smithi006 ceph-mon[30970]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:10.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 -- 172.21.15.6:0/1949626257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 msgr2=0x7f2638103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1949626257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f2638103f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2628009900 tx=0x7f262802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 -- 172.21.15.6:0/1949626257 shutdown_connections 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1949626257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2638109e10 0x7f2638110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1949626257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26381094c0 0x7f26381098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1949626257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f2638103f90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 -- 172.21.15.6:0/1949626257 >> 172.21.15.6:0/1949626257 conn(0x7f26380ff5b0 msgr2=0x7f2638101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 -- 172.21.15.6:0/1949626257 shutdown_connections 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.764+0000 7f263c8ae640 1 -- 172.21.15.6:0/1949626257 wait complete. 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.765+0000 7f263c8ae640 1 Processor -- start 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.765+0000 7f263c8ae640 1 -- start start 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 0x7f263819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2638109e10 0x7f263819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26381139e0 con 0x7f2638103b80 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2638113860 con 0x7f2638109e10 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263c8ae640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2638113b60 con 0x7f26381094c0 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40848/0 (socket says 172.21.15.6:40848) 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 -- 172.21.15.6:0/1222285439 learned_addr learned my addr 172.21.15.6:0/1222285439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f2636d9d640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2638109e10 0x7f263819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f2635d9b640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 0x7f263819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 -- 172.21.15.6:0/1222285439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 msgr2=0x7f263819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 0x7f263819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 -- 172.21.15.6:0/1222285439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2638109e10 msgr2=0x7f263819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2638109e10 0x7f263819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 -- 172.21.15.6:0/1222285439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26381a0440 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f2635d9b640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 0x7f263819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.766+0000 7f263659c640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2628009a20 tx=0x7f2628004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.767+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262803f030 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.767+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26280035f0 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.767+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26381a06d0 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.767+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628035070 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.767+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26381a6e90 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.768+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2638104e00 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.769+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2628003aa0 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.770+0000 7f26277fe640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 0x7f26200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.770+0000 7f2635d9b640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 0x7f26200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.770+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f2628108300 con 0x7f2638103b80 2024-09-21T07:59:10.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.771+0000 7f2635d9b640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 0x7f26200b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2638102cb0 tx=0x7f262c005ec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:10.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.775+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26280ce760 con 0x7f2638103b80 2024-09-21T07:59:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:10 smithi119 ceph-mon[33564]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:10 smithi145 ceph-mon[34049]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 75 B/s, 0 objects/s recovering 2024-09-21T07:59:10.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.975+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f263802e640 con 0x7f2638103b80 2024-09-21T07:59:10.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.975+0000 7f26277fe640 1 -- 172.21.15.6:0/1222285439 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v83) ==== 81+0+871 (secure 0 0 0) 0x7f26280d2b40 con 0x7f2638103b80 2024-09-21T07:59:10.977 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2176108638 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/548693640 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1495310432 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3861437943 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1282952085 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/558991039 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:10.978 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3295809902 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:10.979 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4039375936 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:10.979 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1669454132 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:10.979 INFO:teuthology.orchestra.run.smithi006.stderr:listed 15 entries 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 msgr2=0x7f26200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 0x7f26200b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2638102cb0 tx=0x7f262c005ec0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 msgr2=0x7f263819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2628009a20 tx=0x7f2628004270 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 shutdown_connections 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26200b6560 0x7f26200b8a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26381094c0 0x7f263819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2638109e10 0x7f263819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 --2- 172.21.15.6:0/1222285439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2638103b80 0x7f263819a4d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 >> 172.21.15.6:0/1222285439 conn(0x7f26380ff5b0 msgr2=0x7f2638108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 shutdown_connections 2024-09-21T07:59:10.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:10.977+0000 7f263c8ae640 1 -- 172.21.15.6:0/1222285439 wait complete. 2024-09-21T07:59:11.802 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:59:11.802 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:59:11.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:59:11.887 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1222285439' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1222285439' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1222285439' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 -- 172.21.15.6:0/423078531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff550103bc0 msgr2=0x7ff550103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 --2- 172.21.15.6:0/423078531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff550103bc0 0x7ff550103fd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff540009900 tx=0x7ff54002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 -- 172.21.15.6:0/423078531 shutdown_connections 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 --2- 172.21.15.6:0/423078531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550109e00 0x7ff550110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 --2- 172.21.15.6:0/423078531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5501094b0 0x7ff5501098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 --2- 172.21.15.6:0/423078531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff550103bc0 0x7ff550103fd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 -- 172.21.15.6:0/423078531 >> 172.21.15.6:0/423078531 conn(0x7ff55007b910 msgr2=0x7ff55007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 -- 172.21.15.6:0/423078531 shutdown_connections 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.632+0000 7ff556142640 1 -- 172.21.15.6:0/423078531 wait complete. 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 Processor -- start 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 -- start start 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 0x7ff55019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550109e00 0x7ff55019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff550113970 con 0x7ff5501094b0 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5501137f0 con 0x7ff550109e00 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff556142640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff550113af0 con 0x7ff550103bc0 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff54effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff54effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40876/0 (socket says 172.21.15.6:40876) 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff54effd640 1 -- 172.21.15.6:0/2473003181 learned_addr learned my addr 172.21.15.6:0/2473003181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff54ffff640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550109e00 0x7ff55019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.633+0000 7ff54f7fe640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 0x7ff55019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 -- 172.21.15.6:0/2473003181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 msgr2=0x7ff55019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 0x7ff55019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 -- 172.21.15.6:0/2473003181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550109e00 msgr2=0x7ff55019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550109e00 0x7ff55019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 -- 172.21.15.6:0/2473003181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501a01f0 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54f7fe640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 0x7ff55019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54effd640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c8c0 tx=0x7ff54400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544007bb0 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff544007d50 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5501a04e0 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5440186a0 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.634+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5501a6d00 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.635+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff550103fd0 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.637+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7ff54400fa00 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.637+0000 7ff54cff9640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 0x7ff5380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.638+0000 7ff54f7fe640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 0x7ff5380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.638+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7ff5440e7a80 con 0x7ff5501094b0 2024-09-21T07:59:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.638+0000 7ff54f7fe640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 0x7ff5380b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff540000c00 tx=0x7ff540005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.641+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff544014030 con 0x7ff5501094b0 2024-09-21T07:59:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.842+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff55019b470 con 0x7ff5501094b0 2024-09-21T07:59:12.845 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:12 smithi006 ceph-mon[30970]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 66 B/s, 0 objects/s recovering 2024-09-21T07:59:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.843+0000 7ff54cff9640 1 -- 172.21.15.6:0/2473003181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v83) ==== 81+0+871 (secure 0 0 0) 0x7ff5440adf70 con 0x7ff5501094b0 2024-09-21T07:59:12.846 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2176108638 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:12.846 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:12.846 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:12.846 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/548693640 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1495310432 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3861437943 2024-09-22T07:50:30.675598+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1282952085 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/558991039 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3295809902 2024-09-22T07:50:57.944225+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4039375936 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:12.847 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1669454132 2024-09-22T07:52:01.430168+0000 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:listed 15 entries 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 msgr2=0x7ff5380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 0x7ff5380b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff540000c00 tx=0x7ff540005a20 comp rx=0 tx=0).stop 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 msgr2=0x7ff55019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c8c0 tx=0x7ff54400cd80 comp rx=0 tx=0).stop 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 shutdown_connections 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff5380b6590 0x7ff5380b8aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550109e00 0x7ff55019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5501094b0 0x7ff55019a8e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 --2- 172.21.15.6:0/2473003181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff550103bc0 0x7ff55019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 >> 172.21.15.6:0/2473003181 conn(0x7ff55007b910 msgr2=0x7ff550107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 shutdown_connections 2024-09-21T07:59:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:12.845+0000 7ff556142640 1 -- 172.21.15.6:0/2473003181 wait complete. 2024-09-21T07:59:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:12 smithi119 ceph-mon[33564]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 66 B/s, 0 objects/s recovering 2024-09-21T07:59:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:12 smithi145 ceph-mon[34049]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 66 B/s, 0 objects/s recovering 2024-09-21T07:59:13.631 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-21T07:59:13.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:13.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:59:13.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76697]: fuse finished with error 0 and tester_r 0 2024-09-21T07:59:13.702 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:59:13.858 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2473003181' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2473003181' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2473003181' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:59:14.879 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:14 smithi006 ceph-mon[30970]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 405 B/s wr, 0 op/s; 59 B/s, 0 objects/s recovering 2024-09-21T07:59:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:14 smithi119 ceph-mon[33564]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 405 B/s wr, 0 op/s; 59 B/s, 0 objects/s recovering 2024-09-21T07:59:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:14 smithi145 ceph-mon[34049]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 405 B/s wr, 0 op/s; 59 B/s, 0 objects/s recovering 2024-09-21T07:59:16.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:16 smithi119 ceph-mon[33564]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T07:59:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:16 smithi145 ceph-mon[34049]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T07:59:16.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:16 smithi006 ceph-mon[30970]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T07:59:18.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:18 smithi119 ceph-mon[33564]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-09-21T07:59:18.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:18 smithi145 ceph-mon[34049]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-09-21T07:59:18.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:18 smithi006 ceph-mon[30970]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 48 B/s, 0 objects/s recovering 2024-09-21T07:59:19.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T07:59:19.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:59:19.805 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T07:59:19.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:20.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 -- 172.21.15.6:0/34140588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 msgr2=0x7f19a410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 --2- 172.21.15.6:0/34140588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a410d880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1990009900 tx=0x7f199002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:20.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 -- 172.21.15.6:0/34140588 shutdown_connections 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 --2- 172.21.15.6:0/34140588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 0x7f19a4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 --2- 172.21.15.6:0/34140588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a410d880 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 --2- 172.21.15.6:0/34140588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 0x7f19a4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 -- 172.21.15.6:0/34140588 >> 172.21.15.6:0/34140588 conn(0x7f19a4079750 msgr2=0x7f19a4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 -- 172.21.15.6:0/34140588 shutdown_connections 2024-09-21T07:59:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.618+0000 7f19aaf22640 1 -- 172.21.15.6:0/34140588 wait complete. 2024-09-21T07:59:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.619+0000 7f19aaf22640 1 Processor -- start 2024-09-21T07:59:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.619+0000 7f19aaf22640 1 -- start start 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 0x7f19a419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 0x7f19a419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4113950 con 0x7f19a4105330 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f19a41137d0 con 0x7f19a410de40 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19aaf22640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4113ad0 con 0x7f19a41049e0 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37556/0 (socket says 172.21.15.6:37556) 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 -- 172.21.15.6:0/2518566026 learned_addr learned my addr 172.21.15.6:0/2518566026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a94bf640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 0x7f19a419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a8cbe640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 0x7f19a419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 -- 172.21.15.6:0/2518566026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 msgr2=0x7f19a419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 0x7f19a419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 -- 172.21.15.6:0/2518566026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 msgr2=0x7f19a419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 0x7f19a419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.620+0000 7f19a3fff640 1 -- 172.21.15.6:0/2518566026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a41a0310 con 0x7f19a4105330 2024-09-21T07:59:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.621+0000 7f19a3fff640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1990005940 tx=0x7f19900040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.624+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199003f030 con 0x7f19a4105330 2024-09-21T07:59:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.624+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1990003a80 con 0x7f19a4105330 2024-09-21T07:59:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.624+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a41a05a0 con 0x7f19a4105330 2024-09-21T07:59:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.624+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990035070 con 0x7f19a4105330 2024-09-21T07:59:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.624+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41a6d60 con 0x7f19a4105330 2024-09-21T07:59:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.625+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a406c280 con 0x7f19a4105330 2024-09-21T07:59:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.628+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f1990042030 con 0x7f19a4105330 2024-09-21T07:59:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.628+0000 7f19a1ffb640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 0x7f19940b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.629+0000 7f19a8cbe640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 0x7f19940b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.629+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f1990107f70 con 0x7f19a4105330 2024-09-21T07:59:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.629+0000 7f19a8cbe640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 0x7f19940b8af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a406c980 tx=0x7f199800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.632+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19900d27b0 con 0x7f19a4105330 2024-09-21T07:59:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.821+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19a4108f70 con 0x7f19a4105330 2024-09-21T07:59:20.823 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:20 smithi006 ceph-mon[30970]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.823+0000 7f19a1ffb640 1 -- 172.21.15.6:0/2518566026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7f19900d76f0 con 0x7f19a4105330 2024-09-21T07:59:20.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:20.825 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 msgr2=0x7f19940b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 0x7f19940b8af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a406c980 tx=0x7f199800b390 comp rx=0 tx=0).stop 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 msgr2=0x7f19a419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1990005940 tx=0x7f19900040e0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 shutdown_connections 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f19940b65e0 0x7f19940b8af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a410de40 0x7f19a419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a4105330 0x7f19a419a940 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 --2- 172.21.15.6:0/2518566026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19a41049e0 0x7f19a419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 >> 172.21.15.6:0/2518566026 conn(0x7f19a4079750 msgr2=0x7f19a4100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.825+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 shutdown_connections 2024-09-21T07:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:20.826+0000 7f19aaf22640 1 -- 172.21.15.6:0/2518566026 wait complete. 2024-09-21T07:59:20.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:20 smithi119 ceph-mon[33564]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:20.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:20 smithi145 ceph-mon[34049]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:21.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2518566026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2518566026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2518566026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 -- 172.21.15.6:0/911492162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a8102a80 msgr2=0x7fb4a8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 --2- 172.21.15.6:0/911492162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a8102a80 0x7fb4a8102e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb498009900 tx=0x7fb49802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 -- 172.21.15.6:0/911492162 shutdown_connections 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 --2- 172.21.15.6:0/911492162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a81083c0 0x7fb4a81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 --2- 172.21.15.6:0/911492162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 --2- 172.21.15.6:0/911492162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a8102a80 0x7fb4a8102e90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 -- 172.21.15.6:0/911492162 >> 172.21.15.6:0/911492162 conn(0x7fb4a8079740 msgr2=0x7fb4a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 -- 172.21.15.6:0/911492162 shutdown_connections 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.362+0000 7fb4acb69640 1 -- 172.21.15.6:0/911492162 wait complete. 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 Processor -- start 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 -- start start 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a8102a80 0x7fb4a819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a8112830 con 0x7fb4a81083c0 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81126b0 con 0x7fb4a8108d10 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4acb69640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81129b0 con 0x7fb4a8102a80 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37572/0 (socket says 172.21.15.6:37572) 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.363+0000 7fb4a5d9b640 1 -- 172.21.15.6:0/456609766 learned_addr learned my addr 172.21.15.6:0/456609766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a659c640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a8102a80 0x7fb4a819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a6d9d640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 -- 172.21.15.6:0/456609766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a8102a80 msgr2=0x7fb4a819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a8102a80 0x7fb4a819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 -- 172.21.15.6:0/456609766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 msgr2=0x7fb4a819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 -- 172.21.15.6:0/456609766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a81a6430 con 0x7fb4a81083c0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a6d9d640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4a5d9b640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb49000d740 tx=0x7fb49000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490017070 con 0x7fb4a81083c0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb49000de50 con 0x7fb4a81083c0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a81a6720 con 0x7fb4a81083c0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490004c60 con 0x7fb4a81083c0 2024-09-21T07:59:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.364+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a81a6c10 con 0x7fb4a81083c0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.365+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a8103d00 con 0x7fb4a81083c0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.367+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fb490004e00 con 0x7fb4a81083c0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.368+0000 7fb49f7fe640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 0x7fb4940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.368+0000 7fb4a659c640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 0x7fb4940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.368+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fb4900e7600 con 0x7fb4a81083c0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.368+0000 7fb4a659c640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 0x7fb4940b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.371+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4900ada60 con 0x7fb4a81083c0 2024-09-21T07:59:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.561+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4a8102e90 con 0x7fb4a81083c0 2024-09-21T07:59:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.563+0000 7fb49f7fe640 1 -- 172.21.15.6:0/456609766 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7fb4900b1e40 con 0x7fb4a81083c0 2024-09-21T07:59:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:22.565 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 msgr2=0x7fb4940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 0x7fb4940b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498009680 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 msgr2=0x7fb4a819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb49000d740 tx=0x7fb49000dc00 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 shutdown_connections 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4940b6560 0x7fb4940b8a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4a8108d10 0x7fb4a819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4a81083c0 0x7fb4a819b740 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 --2- 172.21.15.6:0/456609766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4a8102a80 0x7fb4a819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 >> 172.21.15.6:0/456609766 conn(0x7fb4a8079740 msgr2=0x7fb4a81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 shutdown_connections 2024-09-21T07:59:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:22.565+0000 7fb4acb69640 1 -- 172.21.15.6:0/456609766 wait complete. 2024-09-21T07:59:22.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:22 smithi119 ceph-mon[33564]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:22.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:22 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/456609766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:22.925 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:22 smithi006 ceph-mon[30970]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:22.925 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:22 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/456609766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:22.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:22 smithi145 ceph-mon[34049]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:22.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:22 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/456609766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:23.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:59:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 -- 172.21.15.6:0/3597341120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc108cf0 msgr2=0x7feedc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 --2- 172.21.15.6:0/3597341120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc108cf0 0x7feedc10f520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feed4009ca0 tx=0x7feed402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 -- 172.21.15.6:0/3597341120 shutdown_connections 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 --2- 172.21.15.6:0/3597341120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc1083a0 0x7feedc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 --2- 172.21.15.6:0/3597341120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc108cf0 0x7feedc10f520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 --2- 172.21.15.6:0/3597341120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc102a60 0x7feedc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 -- 172.21.15.6:0/3597341120 >> 172.21.15.6:0/3597341120 conn(0x7feedc079730 msgr2=0x7feedc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 -- 172.21.15.6:0/3597341120 shutdown_connections 2024-09-21T07:59:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.132+0000 7feee1f69640 1 -- 172.21.15.6:0/3597341120 wait complete. 2024-09-21T07:59:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 Processor -- start 2024-09-21T07:59:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 -- start start 2024-09-21T07:59:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc1083a0 0x7feedc0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 0x7feedc0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feedc112860 con 0x7feedc102a60 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feedc1126e0 con 0x7feedc1083a0 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.133+0000 7feee1f69640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feedc1129e0 con 0x7feedc108cf0 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37598/0 (socket says 172.21.15.6:37598) 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 -- 172.21.15.6:0/1159834801 learned_addr learned my addr 172.21.15.6:0/1159834801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feed2ffd640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc1083a0 0x7feedc0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedbfff640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 0x7feedc0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 -- 172.21.15.6:0/1159834801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 msgr2=0x7feedc0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 0x7feedc0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 -- 172.21.15.6:0/1159834801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc1083a0 msgr2=0x7feedc0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc1083a0 0x7feedc0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 -- 172.21.15.6:0/1159834801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc100340 con 0x7feedc102a60 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedbfff640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 0x7feedc0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feedb7fe640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c890 tx=0x7feecc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc004220 con 0x7feedc102a60 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feecc007e40 con 0x7feedc102a60 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc004a00 con 0x7feedc102a60 2024-09-21T07:59:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc1acce0 con 0x7feedc102a60 2024-09-21T07:59:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.134+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc1ad1c0 con 0x7feedc102a60 2024-09-21T07:59:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.135+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc102e70 con 0x7feedc102a60 2024-09-21T07:59:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.137+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7feecc0079b0 con 0x7feedc102a60 2024-09-21T07:59:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.138+0000 7feed97fa640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 0x7feec80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.138+0000 7feed2ffd640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 0x7feec80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.138+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7feecc0e78e0 con 0x7feedc102a60 2024-09-21T07:59:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.139+0000 7feed2ffd640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 0x7feec80b8af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feedc079c50 tx=0x7feec400c4a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.141+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feecc014030 con 0x7feedc102a60 2024-09-21T07:59:24.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.373+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feedc100970 con 0x7feedc102a60 2024-09-21T07:59:24.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.642+0000 7feed97fa640 1 -- 172.21.15.6:0/1159834801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7feecc0add60 con 0x7feedc102a60 2024-09-21T07:59:24.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 msgr2=0x7feec80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:24.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 0x7feec80b8af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feedc079c50 tx=0x7feec400c4a0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 msgr2=0x7feedc101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c890 tx=0x7feecc00cd50 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 shutdown_connections 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7feec80b65e0 0x7feec80b8af0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feedc108cf0 0x7feedc0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feedc1083a0 0x7feedc0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 --2- 172.21.15.6:0/1159834801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc102a60 0x7feedc101080 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 >> 172.21.15.6:0/1159834801 conn(0x7feedc079730 msgr2=0x7feedc06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 shutdown_connections 2024-09-21T07:59:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:24.645+0000 7feee1f69640 1 -- 172.21.15.6:0/1159834801 wait complete. 2024-09-21T07:59:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:24 smithi119 ceph-mon[33564]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:24 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:59:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:24 smithi145 ceph-mon[34049]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:24 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:59:24.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:24 smithi006 ceph-mon[30970]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:59:24.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:24 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:59:25.453 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T07:59:25.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:59:25.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:25 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:59:25.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:25 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:25.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:25 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:59:25.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:25 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:25 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1159834801' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:59:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:25 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 -- 172.21.15.6:0/2812560572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 msgr2=0x7fc06c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 --2- 172.21.15.6:0/2812560572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1087b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc058009900 tx=0x7fc05802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 -- 172.21.15.6:0/2812560572 shutdown_connections 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 --2- 172.21.15.6:0/2812560572 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 0x7fc06c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 --2- 172.21.15.6:0/2812560572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1087b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 --2- 172.21.15.6:0/2812560572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 0x7fc06c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 -- 172.21.15.6:0/2812560572 >> 172.21.15.6:0/2812560572 conn(0x7fc06c079730 msgr2=0x7fc06c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 -- 172.21.15.6:0/2812560572 shutdown_connections 2024-09-21T07:59:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.202+0000 7fc072fd7640 1 -- 172.21.15.6:0/2812560572 wait complete. 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 Processor -- start 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 -- start start 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 0x7fc06c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 0x7fc06c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c112810 con 0x7fc06c1083a0 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c112690 con 0x7fc06c102a60 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc072fd7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c112990 con 0x7fc06c108cf0 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37618/0 (socket says 172.21.15.6:37618) 2024-09-21T07:59:26.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc06bfff640 1 -- 172.21.15.6:0/1953930299 learned_addr learned my addr 172.21.15.6:0/1953930299 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc071574640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 0x7fc06c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.203+0000 7fc070d73640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 0x7fc06c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 -- 172.21.15.6:0/1953930299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 msgr2=0x7fc06c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 0x7fc06c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 -- 172.21.15.6:0/1953930299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 msgr2=0x7fc06c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 0x7fc06c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 -- 172.21.15.6:0/1953930299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c19f290 con 0x7fc06c1083a0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc06bfff640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc058005940 tx=0x7fc0580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05803f030 con 0x7fc06c1083a0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc058003c90 con 0x7fc06c1083a0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c19f520 con 0x7fc06c1083a0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058035070 con 0x7fc06c1083a0 2024-09-21T07:59:26.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.204+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c1a5ce0 con 0x7fc06c1083a0 2024-09-21T07:59:26.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.205+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06c103ce0 con 0x7fc06c1083a0 2024-09-21T07:59:26.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.207+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc058042030 con 0x7fc06c1083a0 2024-09-21T07:59:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.208+0000 7fc069ffb640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 0x7fc05c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.208+0000 7fc070d73640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 0x7fc05c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.208+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fc058108040 con 0x7fc06c1083a0 2024-09-21T07:59:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.209+0000 7fc070d73640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 0x7fc05c0b8a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0600058c0 tx=0x7fc06000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.212+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0580d2880 con 0x7fc06c1083a0 2024-09-21T07:59:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.439+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc06c102e70 con 0x7fc06c1083a0 2024-09-21T07:59:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.652+0000 7fc069ffb640 1 -- 172.21.15.6:0/1953930299 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fc06c102e70 con 0x7fc06c1083a0 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 msgr2=0x7fc05c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 0x7fc05c0b8a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0600058c0 tx=0x7fc06000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 msgr2=0x7fc06c1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc058005940 tx=0x7fc0580042f0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 shutdown_connections 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc05c0b6560 0x7fc05c0b8a70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc06c108cf0 0x7fc06c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc06c1083a0 0x7fc06c1998c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 --2- 172.21.15.6:0/1953930299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc06c102a60 0x7fc06c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 >> 172.21.15.6:0/1953930299 conn(0x7fc06c079730 msgr2=0x7fc06c104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 shutdown_connections 2024-09-21T07:59:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:26.655+0000 7fc072fd7640 1 -- 172.21.15.6:0/1953930299 wait complete. 2024-09-21T07:59:26.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:26 smithi006 ceph-mon[30970]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:59:26.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:26 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:59:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:26 smithi145 ceph-mon[34049]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:59:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:26 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:59:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:26 smithi119 ceph-mon[33564]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:59:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:26 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:59:27.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:59:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:27 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:59:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:27 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:27 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:27.914 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:27 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:59:27.914 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:27 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:27.914 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:27 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:27 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1953930299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:59:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:27 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:59:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:27 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 -- 172.21.15.6:0/2485362701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b001083c0 msgr2=0x7f4b001087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/2485362701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b001083c0 0x7f4b001087d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009900 tx=0x7f4af402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 -- 172.21.15.6:0/2485362701 shutdown_connections 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/2485362701 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 0x7f4b0010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/2485362701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b001083c0 0x7f4b001087d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/2485362701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b00102a80 0x7f4b00102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 -- 172.21.15.6:0/2485362701 >> 172.21.15.6:0/2485362701 conn(0x7f4b00079740 msgr2=0x7f4b00079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 -- 172.21.15.6:0/2485362701 shutdown_connections 2024-09-21T07:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.119+0000 7f4b05ab0640 1 -- 172.21.15.6:0/2485362701 wait complete. 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 Processor -- start 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 -- start start 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b001083c0 0x7f4b000ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 0x7f4b00100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00112830 con 0x7f4b00102a80 2024-09-21T07:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001126b0 con 0x7f4b001083c0 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4b05ab0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4b001129b0 con 0x7f4b00108d10 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.120+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38220/0 (socket says 172.21.15.6:38220) 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 -- 172.21.15.6:0/4186331223 learned_addr learned my addr 172.21.15.6:0/4186331223 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4afeffd640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b001083c0 0x7f4b000ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4afffff640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 0x7f4b00100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 -- 172.21.15.6:0/4186331223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 msgr2=0x7f4b00100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 0x7f4b00100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 -- 172.21.15.6:0/4186331223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b001083c0 msgr2=0x7f4b000ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b001083c0 0x7f4b000ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 -- 172.21.15.6:0/4186331223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b001a8600 con 0x7f4b00102a80 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4aff7fe640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d950 tx=0x7f4af000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0017070 con 0x7f4b00102a80 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b001a88f0 con 0x7f4b00102a80 2024-09-21T07:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4af0009c30 con 0x7f4b00102a80 2024-09-21T07:59:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af000f620 con 0x7f4b00102a80 2024-09-21T07:59:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.121+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b001a8e00 con 0x7f4b00102a80 2024-09-21T07:59:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.122+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b00103d00 con 0x7f4b00102a80 2024-09-21T07:59:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.124+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f4af0010460 con 0x7f4b00102a80 2024-09-21T07:59:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.125+0000 7f4afcff9640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 0x7f4ae80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.125+0000 7f4afeffd640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 0x7f4ae80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.125+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f4af00e7300 con 0x7f4b00102a80 2024-09-21T07:59:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.125+0000 7f4afeffd640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 0x7f4ae80b8a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af4004770 tx=0x7f4af40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.128+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4af0009de0 con 0x7f4b00102a80 2024-09-21T07:59:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.355+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f4b00100990 con 0x7f4b00102a80 2024-09-21T07:59:28.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.673+0000 7f4afcff9640 1 -- 172.21.15.6:0/4186331223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f4af00b1b40 con 0x7f4b00102a80 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 msgr2=0x7f4ae80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 0x7f4ae80b8a70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af4004770 tx=0x7f4af40058d0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 msgr2=0x7f4b000ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d950 tx=0x7f4af000de10 comp rx=0 tx=0).stop 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 shutdown_connections 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4ae80b6560 0x7f4ae80b8a70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b00108d10 0x7f4b00100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b001083c0 0x7f4b000ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 --2- 172.21.15.6:0/4186331223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b00102a80 0x7f4b000ff690 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 >> 172.21.15.6:0/4186331223 conn(0x7f4b00079740 msgr2=0x7f4b0006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 shutdown_connections 2024-09-21T07:59:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:28.675+0000 7f4b05ab0640 1 -- 172.21.15.6:0/4186331223 wait complete. 2024-09-21T07:59:28.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:28 smithi145 ceph-mon[34049]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:28.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:28 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:59:28.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:28 smithi006 ceph-mon[30970]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:28.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:28 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:59:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:28 smithi119 ceph-mon[33564]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:28 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:59:29.360 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T07:59:29.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:59:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:59:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:29 smithi145 ceph-mon[34049]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:29.948 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:59:29.949 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:29 smithi006 ceph-mon[30970]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:30.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4186331223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:59:30.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:29 smithi119 ceph-mon[33564]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 -- 172.21.15.6:0/1495369985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 msgr2=0x7f17a8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 --2- 172.21.15.6:0/1495369985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a8102ef0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1798009900 tx=0x7f179802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 -- 172.21.15.6:0/1495369985 shutdown_connections 2024-09-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 --2- 172.21.15.6:0/1495369985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 0x7f17a81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 --2- 172.21.15.6:0/1495369985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 0x7f17a810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 --2- 172.21.15.6:0/1495369985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a8102ef0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 -- 172.21.15.6:0/1495369985 >> 172.21.15.6:0/1495369985 conn(0x7f17a8079760 msgr2=0x7f17a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 -- 172.21.15.6:0/1495369985 shutdown_connections 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.163+0000 7f17adff9640 1 -- 172.21.15.6:0/1495369985 wait complete. 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 Processor -- start 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 -- start start 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 0x7f17a819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 0x7f17a819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8113960 con 0x7f17a8102ae0 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f17a81137e0 con 0x7f17a8108d20 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17adff9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8113ae0 con 0x7f17a81083d0 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38242/0 (socket says 172.21.15.6:38242) 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.164+0000 7f17a77fe640 1 -- 172.21.15.6:0/1585342214 learned_addr learned my addr 172.21.15.6:0/1585342214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a6ffd640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 0x7f17a819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a7fff640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 0x7f17a819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 -- 172.21.15.6:0/1585342214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 msgr2=0x7f17a819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 0x7f17a819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 -- 172.21.15.6:0/1585342214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 msgr2=0x7f17a819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 0x7f17a819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 -- 172.21.15.6:0/1585342214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a81a0320 con 0x7f17a8102ae0 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a77fe640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1798009230 tx=0x7f1798004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179803f030 con 0x7f17a8102ae0 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1798003a80 con 0x7f17a8102ae0 2024-09-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a81a05b0 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798035070 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.165+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a81a6d70 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.167+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a8103d10 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.168+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f1798042030 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.169+0000 7f17a4ff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 0x7f17900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.169+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f1798108220 con 0x7f17a8102ae0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.169+0000 7f17a6ffd640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 0x7f17900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.170+0000 7f17a6ffd640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 0x7f17900b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17a8079ed0 tx=0x7f179c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.172+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17980d2a00 con 0x7f17a8102ae0 2024-09-21T07:59:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.383+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f17a8063800 con 0x7f17900b6560 2024-09-21T07:59:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.405+0000 7f17a4ff9640 1 -- 172.21.15.6:0/1585342214 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f17a8063800 con 0x7f17900b6560 2024-09-21T07:59:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 msgr2=0x7f17900b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 0x7f17900b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17a8079ed0 tx=0x7f179c00b390 comp rx=0 tx=0).stop 2024-09-21T07:59:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 msgr2=0x7f17a819a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1798009230 tx=0x7f1798004270 comp rx=0 tx=0).stop 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 shutdown_connections 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17900b6560 0x7f17900b8a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17a81083d0 0x7f17a819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a8108d20 0x7f17a819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 --2- 172.21.15.6:0/1585342214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a8102ae0 0x7f17a819a3b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 >> 172.21.15.6:0/1585342214 conn(0x7f17a8079760 msgr2=0x7f17a8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 shutdown_connections 2024-09-21T07:59:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:30.408+0000 7f17adff9640 1 -- 172.21.15.6:0/1585342214 wait complete. 2024-09-21T07:59:30.687 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:59:30.389+0000 7f6aa8fa4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:59:30.687 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:59:30.389+0000 7f6aa8fa4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:59:30.687 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:59:30.389+0000 7f6aa8fa4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:59:30.687 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:59:30.389+0000 7f6aa8fa4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:59:30.687 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T07:59:30.389+0000 7f6aa8fa4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:59:30.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:30 smithi145 ceph-mon[34049]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:30.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:30 smithi006 ceph-mon[30970]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:31.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:59:31.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:30 smithi119 ceph-mon[33564]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 85 B/s wr, 0 op/s 2024-09-21T07:59:31.389 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:31.783 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:31 smithi006 ceph-mon[30970]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 -- 172.21.15.6:0/3419716955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b410ddf0 msgr2=0x7f50b4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 --2- 172.21.15.6:0/3419716955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b410ddf0 0x7f50b4110300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009900 tx=0x7f50ac02a410 comp rx=0 tx=0).stop 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 -- 172.21.15.6:0/3419716955 shutdown_connections 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 --2- 172.21.15.6:0/3419716955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b410ddf0 0x7f50b4110300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 --2- 172.21.15.6:0/3419716955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b4105270 0x7f50b410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 --2- 172.21.15.6:0/3419716955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4104840 0x7f50b4104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 -- 172.21.15.6:0/3419716955 >> 172.21.15.6:0/3419716955 conn(0x7f50b4079730 msgr2=0x7f50b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 -- 172.21.15.6:0/3419716955 shutdown_connections 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.880+0000 7f50b9787640 1 -- 172.21.15.6:0/3419716955 wait complete. 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 Processor -- start 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 -- start start 2024-09-21T07:59:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4105270 0x7f50b419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b410ddf0 0x7f50b419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50b4113970 con 0x7f50b4104840 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f50b41137f0 con 0x7f50b410ddf0 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.881+0000 7f50b9787640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f50b4113af0 con 0x7f50b4105270 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38268/0 (socket says 172.21.15.6:38268) 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 -- 172.21.15.6:0/2190687660 learned_addr learned my addr 172.21.15.6:0/2190687660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b37fe640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b410ddf0 0x7f50b419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b27fc640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4105270 0x7f50b419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 -- 172.21.15.6:0/2190687660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4105270 msgr2=0x7f50b419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4105270 0x7f50b419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 -- 172.21.15.6:0/2190687660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b410ddf0 msgr2=0x7f50b419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b410ddf0 0x7f50b419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 -- 172.21.15.6:0/2190687660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b41a0290 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b2ffd640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50a400d770 tx=0x7f50a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4017070 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b41a0580 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50a4009c30 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.882+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4003c50 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.883+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b41a6ce0 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.884+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b4104c50 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.885+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f50a4003df0 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.886+0000 7f509bfff640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 0x7f509c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.886+0000 7f50b27fc640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 0x7f509c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.886+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f50a40e7700 con 0x7f50b4104840 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.887+0000 7f50b27fc640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 0x7f509c0b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50b410f910 tx=0x7f50a8009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:31.889+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50a4009de0 con 0x7f50b4104840 2024-09-21T07:59:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.114+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f50b4108080 con 0x7f509c0b65f0 2024-09-21T07:59:32.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.144+0000 7f509bfff640 1 -- 172.21.15.6:0/2190687660 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f50b4108080 con 0x7f509c0b65f0 2024-09-21T07:59:32.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 msgr2=0x7f509c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 0x7f509c0b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50b410f910 tx=0x7f50a8009680 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 msgr2=0x7f50b419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50a400d770 tx=0x7f50a400dc30 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 shutdown_connections 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f509c0b65f0 0x7f509c0b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50b4105270 0x7f50b419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50b410ddf0 0x7f50b419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 --2- 172.21.15.6:0/2190687660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b4104840 0x7f50b419a320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 >> 172.21.15.6:0/2190687660 conn(0x7f50b4079730 msgr2=0x7f50b4107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 shutdown_connections 2024-09-21T07:59:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:32.146+0000 7f50b9787640 1 -- 172.21.15.6:0/2190687660 wait complete. 2024-09-21T07:59:32.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:31 smithi119 ceph-mon[33564]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:32.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:31 smithi145 ceph-mon[34049]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:32.840 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:32 smithi006 ceph-mon[30970]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T07:59:32.840 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:32 smithi006 ceph-mon[30970]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:59:32.840 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:32 smithi006 ceph-mon[30970]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:32.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:59:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:32 smithi119 ceph-mon[33564]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T07:59:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:32 smithi119 ceph-mon[33564]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:59:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:32 smithi119 ceph-mon[33564]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:32 smithi145 ceph-mon[34049]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T07:59:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:32 smithi145 ceph-mon[34049]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:59:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:32 smithi145 ceph-mon[34049]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 -- 172.21.15.6:0/1719596399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14109df0 msgr2=0x7f3a14110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/1719596399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14109df0 0x7f3a14110620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009ca0 tx=0x7f3a0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 -- 172.21.15.6:0/1719596399 shutdown_connections 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/1719596399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14109df0 0x7f3a14110620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/1719596399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a141094a0 0x7f3a141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/1719596399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a14103b60 0x7f3a14103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.623+0000 7f3a1a35d640 1 -- 172.21.15.6:0/1719596399 >> 172.21.15.6:0/1719596399 conn(0x7f3a1407b850 msgr2=0x7f3a1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.624+0000 7f3a1a35d640 1 -- 172.21.15.6:0/1719596399 shutdown_connections 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.624+0000 7f3a1a35d640 1 -- 172.21.15.6:0/1719596399 wait complete. 2024-09-21T07:59:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.624+0000 7f3a1a35d640 1 Processor -- start 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.624+0000 7f3a1a35d640 1 -- start start 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 0x7f3a1419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 0x7f3a1419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141139b0 con 0x7f3a14103b60 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14113830 con 0x7f3a14109df0 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a1a35d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14113b30 con 0x7f3a141094a0 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38288/0 (socket says 172.21.15.6:38288) 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 -- 172.21.15.6:0/2218716078 learned_addr learned my addr 172.21.15.6:0/2218716078 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a188fa640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 0x7f3a1419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a137fe640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 0x7f3a1419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 -- 172.21.15.6:0/2218716078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 msgr2=0x7f3a1419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 0x7f3a1419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 -- 172.21.15.6:0/2218716078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 msgr2=0x7f3a1419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 0x7f3a1419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 -- 172.21.15.6:0/2218716078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a141a0430 con 0x7f3a14103b60 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a188fa640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 0x7f3a1419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a137fe640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 0x7f3a1419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.625+0000 7f3a13fff640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c970 tx=0x7f3a0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.626+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04007bb0 con 0x7f3a14103b60 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.626+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a04007d50 con 0x7f3a14103b60 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.626+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a141a0720 con 0x7f3a14103b60 2024-09-21T07:59:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.626+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004e40 con 0x7f3a14103b60 2024-09-21T07:59:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.626+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a141a6e80 con 0x7f3a14103b60 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.627+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a14103f70 con 0x7f3a14103b60 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.628+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3a04005020 con 0x7f3a14103b60 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.629+0000 7f3a117fa640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.630+0000 7f3a137fe640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.630+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f3a040e7780 con 0x7f3a14103b60 2024-09-21T07:59:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.630+0000 7f3a137fe640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005fd0 tx=0x7f3a08005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.634+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a04014030 con 0x7f3a14103b60 2024-09-21T07:59:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.853+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3a14063800 con 0x7f39fc0b65f0 2024-09-21T07:59:33.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.859+0000 7f3a117fa640 1 -- 172.21.15.6:0/2218716078 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3a14063800 con 0x7f39fc0b65f0 2024-09-21T07:59:33.861 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_0/938de8c1-dac3-4f59-a07f-a5df9e5aee00 2024-09-21T07:59:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 msgr2=0x7f39fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005fd0 tx=0x7f3a08005850 comp rx=0 tx=0).stop 2024-09-21T07:59:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 msgr2=0x7f3a1419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c970 tx=0x7f3a0400ce30 comp rx=0 tx=0).stop 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 shutdown_connections 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a141094a0 0x7f3a1419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14109df0 0x7f3a1419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 --2- 172.21.15.6:0/2218716078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a14103b60 0x7f3a1419a4c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 >> 172.21.15.6:0/2218716078 conn(0x7f3a1407b850 msgr2=0x7f3a14105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 shutdown_connections 2024-09-21T07:59:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:33.862+0000 7f3a1a35d640 1 -- 172.21.15.6:0/2218716078 wait complete. 2024-09-21T07:59:34.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:59:34.820 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:34.942 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:34 smithi006 ceph-mon[30970]: pgmap v297: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T07:59:34.942 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:34 smithi006 ceph-mon[30970]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:34 smithi119 ceph-mon[33564]: pgmap v297: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T07:59:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:34 smithi119 ceph-mon[33564]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:34 smithi145 ceph-mon[34049]: pgmap v297: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T07:59:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:34 smithi145 ceph-mon[34049]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 -- 172.21.15.6:0/624910020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108420 msgr2=0x7f1248108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 --2- 172.21.15.6:0/624910020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108420 0x7f1248108830 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f123c009900 tx=0x7f123c02a410 comp rx=0 tx=0).stop 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 -- 172.21.15.6:0/624910020 shutdown_connections 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 --2- 172.21.15.6:0/624910020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108d70 0x7f124810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 --2- 172.21.15.6:0/624910020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108420 0x7f1248108830 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 --2- 172.21.15.6:0/624910020 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 0x7f1248102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 -- 172.21.15.6:0/624910020 >> 172.21.15.6:0/624910020 conn(0x7f1248079770 msgr2=0x7f1248079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 -- 172.21.15.6:0/624910020 shutdown_connections 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.333+0000 7f124ce99640 1 -- 172.21.15.6:0/624910020 wait complete. 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.334+0000 7f124ce99640 1 Processor -- start 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.334+0000 7f124ce99640 1 -- start start 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 0x7f1248199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108420 0x7f12481998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12481128e0 con 0x7f1248108d70 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1248112760 con 0x7f1248108420 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124ce99640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1248112a60 con 0x7f1248102ae0 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38316/0 (socket says 172.21.15.6:38316) 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 -- 172.21.15.6:0/3122046480 learned_addr learned my addr 172.21.15.6:0/3122046480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f124659c640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 0x7f1248199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1245d9b640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108420 0x7f12481998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 -- 172.21.15.6:0/3122046480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 msgr2=0x7f1248199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 0x7f1248199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 -- 172.21.15.6:0/3122046480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108420 msgr2=0x7f12481998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108420 0x7f12481998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.335+0000 7f1246d9d640 1 -- 172.21.15.6:0/3122046480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124819f2c0 con 0x7f1248108d70 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.336+0000 7f1246d9d640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f124000ebb0 tx=0x7f1240007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.336+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240007ca0 con 0x7f1248108d70 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.336+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1240007e40 con 0x7f1248108d70 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.337+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240005760 con 0x7f1248108d70 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.337+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124819f550 con 0x7f1248108d70 2024-09-21T07:59:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.337+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124806bb60 con 0x7f1248108d70 2024-09-21T07:59:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.338+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1248103d60 con 0x7f1248108d70 2024-09-21T07:59:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.339+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f1240004a40 con 0x7f1248108d70 2024-09-21T07:59:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.340+0000 7f12377fe640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 0x7f12300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.340+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f12400e8e00 con 0x7f1248108d70 2024-09-21T07:59:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.340+0000 7f124659c640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 0x7f12300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.341+0000 7f124659c640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 0x7f12300b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1238009bd0 tx=0x7f1238005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:35.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.345+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12400b34e0 con 0x7f1248108d70 2024-09-21T07:59:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.563+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f124806bdc0 con 0x7f12300b6670 2024-09-21T07:59:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.592+0000 7f12377fe640 1 -- 172.21.15.6:0/3122046480 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f124806bdc0 con 0x7f12300b6670 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 msgr2=0x7f12300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 0x7f12300b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1238009bd0 tx=0x7f1238005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 msgr2=0x7f124819eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f124000ebb0 tx=0x7f1240007590 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 shutdown_connections 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f12300b6670 0x7f12300b8b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1248108d70 0x7f124819eb90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1248108420 0x7f12481998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 --2- 172.21.15.6:0/3122046480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1248102ae0 0x7f1248199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 >> 172.21.15.6:0/3122046480 conn(0x7f1248079770 msgr2=0x7f1248104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 shutdown_connections 2024-09-21T07:59:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:35.594+0000 7f124ce99640 1 -- 172.21.15.6:0/3122046480 wait complete. 2024-09-21T07:59:36.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:59:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:36.990 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:36 smithi006 ceph-mon[30970]: pgmap v298: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-21T07:59:36.991 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:36 smithi006 ceph-mon[30970]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:36 smithi119 ceph-mon[33564]: pgmap v298: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-21T07:59:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:36 smithi119 ceph-mon[33564]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:36 smithi145 ceph-mon[34049]: pgmap v298: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-21T07:59:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:36 smithi145 ceph-mon[34049]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 -- 172.21.15.6:0/130113148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e8102ae0 msgr2=0x7f35e8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/130113148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e8102ae0 0x7f35e8102ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009900 tx=0x7f35d802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 -- 172.21.15.6:0/130113148 shutdown_connections 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/130113148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8108d20 0x7f35e810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/130113148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e81083d0 0x7f35e81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/130113148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e8102ae0 0x7f35e8102ef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.210+0000 7f35ecaf3640 1 -- 172.21.15.6:0/130113148 >> 172.21.15.6:0/130113148 conn(0x7f35e8079760 msgr2=0x7f35e8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.211+0000 7f35ecaf3640 1 -- 172.21.15.6:0/130113148 shutdown_connections 2024-09-21T07:59:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.211+0000 7f35ecaf3640 1 -- 172.21.15.6:0/130113148 wait complete. 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.211+0000 7f35ecaf3640 1 Processor -- start 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.211+0000 7f35ecaf3640 1 -- start start 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8102ae0 0x7f35e819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e8108d20 0x7f35e819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112840 con 0x7f35e81083d0 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81126c0 con 0x7f35e8108d20 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35ecaf3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81129c0 con 0x7f35e8102ae0 2024-09-21T07:59:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34862/0 (socket says 172.21.15.6:34862) 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 -- 172.21.15.6:0/2922177043 learned_addr learned my addr 172.21.15.6:0/2922177043 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35e659c640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8102ae0 0x7f35e819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35e6d9d640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e8108d20 0x7f35e819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 -- 172.21.15.6:0/2922177043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8102ae0 msgr2=0x7f35e819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8102ae0 0x7f35e819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 -- 172.21.15.6:0/2922177043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e8108d20 msgr2=0x7f35e819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e8108d20 0x7f35e819fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.212+0000 7f35dffff640 1 -- 172.21.15.6:0/2922177043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e81a0230 con 0x7f35e81083d0 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35dffff640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c970 tx=0x7f35d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0014070 con 0x7f35e81083d0 2024-09-21T07:59:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d0004440 con 0x7f35e81083d0 2024-09-21T07:59:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0003d40 con 0x7f35e81083d0 2024-09-21T07:59:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e81a0520 con 0x7f35e81083d0 2024-09-21T07:59:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.213+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e81a6d40 con 0x7f35e81083d0 2024-09-21T07:59:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.214+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8103d10 con 0x7f35e81083d0 2024-09-21T07:59:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.215+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f35d0017070 con 0x7f35e81083d0 2024-09-21T07:59:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.216+0000 7f35df7fe640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 0x7f35d40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.217+0000 7f35e659c640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 0x7f35d40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.217+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f35d00e73d0 con 0x7f35e81083d0 2024-09-21T07:59:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.217+0000 7f35e659c640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 0x7f35d40b8b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35d80057c0 tx=0x7f35d80058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.221+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35d001e030 con 0x7f35e81083d0 2024-09-21T07:59:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.436+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f35e8106370 con 0x7f35d40b6620 2024-09-21T07:59:37.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.442+0000 7f35df7fe640 1 -- 172.21.15.6:0/2922177043 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f35e8106370 con 0x7f35d40b6620 2024-09-21T07:59:37.443 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_1/d69e2418-5652-4823-8518-ea7ccbd49804 2024-09-21T07:59:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 msgr2=0x7f35d40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 0x7f35d40b8b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35d80057c0 tx=0x7f35d80058d0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 msgr2=0x7f35e819a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c970 tx=0x7f35d000ce30 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 shutdown_connections 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35d40b6620 0x7f35d40b8b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e8108d20 0x7f35e819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e81083d0 0x7f35e819a920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 --2- 172.21.15.6:0/2922177043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35e8102ae0 0x7f35e819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 >> 172.21.15.6:0/2922177043 conn(0x7f35e8079760 msgr2=0x7f35e8101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.444+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 shutdown_connections 2024-09-21T07:59:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:37.445+0000 7f35ecaf3640 1 -- 172.21.15.6:0/2922177043 wait complete. 2024-09-21T07:59:38.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:59:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:38.790 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:38 smithi006 ceph-mon[30970]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:38.790 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:38 smithi006 ceph-mon[30970]: pgmap v299: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-21T07:59:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 -- 172.21.15.6:0/2810490942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d41049d0 msgr2=0x7f41d4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 --2- 172.21.15.6:0/2810490942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d41049d0 0x7f41d4104de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009900 tx=0x7f41c402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 -- 172.21.15.6:0/2810490942 shutdown_connections 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 --2- 172.21.15.6:0/2810490942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 0x7f41d410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 --2- 172.21.15.6:0/2810490942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d410de30 0x7f41d4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 --2- 172.21.15.6:0/2810490942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d41049d0 0x7f41d4104de0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 -- 172.21.15.6:0/2810490942 >> 172.21.15.6:0/2810490942 conn(0x7f41d4079740 msgr2=0x7f41d4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 -- 172.21.15.6:0/2810490942 shutdown_connections 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.882+0000 7f41da3c3640 1 -- 172.21.15.6:0/2810490942 wait complete. 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 Processor -- start 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 -- start start 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 0x7f41d419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 0x7f41d419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4113940 con 0x7f41d410de30 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41137c0 con 0x7f41d41049d0 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41da3c3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4113ac0 con 0x7f41d4105320 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.883+0000 7f41d8960640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34876/0 (socket says 172.21.15.6:34876) 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 -- 172.21.15.6:0/1527483360 learned_addr learned my addr 172.21.15.6:0/1527483360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d37fe640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 0x7f41d419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d3fff640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 0x7f41d419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 -- 172.21.15.6:0/1527483360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 msgr2=0x7f41d419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 0x7f41d419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 -- 172.21.15.6:0/1527483360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 msgr2=0x7f41d419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 0x7f41d419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 -- 172.21.15.6:0/1527483360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41a0320 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d3fff640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 0x7f41d419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d8960640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eb10 tx=0x7f41cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc004b20 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41cc004cc0 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d41a0610 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc010690 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.884+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41a6d70 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.885+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d406c240 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.887+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f41cc005000 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.888+0000 7f41d17fa640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 0x7f41bc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.888+0000 7f41d3fff640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 0x7f41bc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.888+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f41cc0e81a0 con 0x7f41d410de30 2024-09-21T07:59:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.888+0000 7f41d3fff640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 0x7f41bc0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006010 tx=0x7f41c4005de0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:38.891+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41cc056710 con 0x7f41d410de30 2024-09-21T07:59:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.116+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41d4104de0 con 0x7f41d410de30 2024-09-21T07:59:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.117+0000 7f41d17fa640 1 -- 172.21.15.6:0/1527483360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f41cc0ae440 con 0x7f41d410de30 2024-09-21T07:59:39.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:39.119 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T07:59:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.119+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 msgr2=0x7f41bc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.119+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 0x7f41bc0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006010 tx=0x7f41c4005de0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.119+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 msgr2=0x7f41d419fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.119+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eb10 tx=0x7f41cc00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 shutdown_connections 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41bc0b65f0 0x7f41bc0b8b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41d4105320 0x7f41d419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d410de30 0x7f41d419fbf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 --2- 172.21.15.6:0/1527483360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d41049d0 0x7f41d419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 >> 172.21.15.6:0/1527483360 conn(0x7f41d4079740 msgr2=0x7f41d4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 shutdown_connections 2024-09-21T07:59:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:39.120+0000 7f41da3c3640 1 -- 172.21.15.6:0/1527483360 wait complete. 2024-09-21T07:59:39.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:38 smithi119 ceph-mon[33564]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:39.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:38 smithi119 ceph-mon[33564]: pgmap v299: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-21T07:59:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:38 smithi145 ceph-mon[34049]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:59:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:38 smithi145 ceph-mon[34049]: pgmap v299: 129 pgs: 129 active+clean; 603 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-21T07:59:39.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:40.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:39 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1527483360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:40.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:39 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1527483360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:40.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:39 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1527483360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 -- 172.21.15.6:0/3244943575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64301049b0 msgr2=0x7f6430104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 --2- 172.21.15.6:0/3244943575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64301049b0 0x7f6430104dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6424009900 tx=0x7f642402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 -- 172.21.15.6:0/3244943575 shutdown_connections 2024-09-21T07:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 --2- 172.21.15.6:0/3244943575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f643010de10 0x7f6430110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 --2- 172.21.15.6:0/3244943575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6430105300 0x7f643010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 --2- 172.21.15.6:0/3244943575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64301049b0 0x7f6430104dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 -- 172.21.15.6:0/3244943575 >> 172.21.15.6:0/3244943575 conn(0x7f6430079730 msgr2=0x7f6430079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 -- 172.21.15.6:0/3244943575 shutdown_connections 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.585+0000 7f6437b6b640 1 -- 172.21.15.6:0/3244943575 wait complete. 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 Processor -- start 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 -- start start 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64301049b0 0x7f64301026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643010de10 0x7f6430103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6430113920 con 0x7f6430105300 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64301137a0 con 0x7f643010de10 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6437b6b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6430113aa0 con 0x7f64301049b0 2024-09-21T07:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6435106640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6435106640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34892/0 (socket says 172.21.15.6:34892) 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6435106640 1 -- 172.21.15.6:0/2487855810 learned_addr learned my addr 172.21.15.6:0/2487855810 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6435907640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64301049b0 0x7f64301026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.586+0000 7f6436108640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643010de10 0x7f6430103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 -- 172.21.15.6:0/2487855810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64301049b0 msgr2=0x7f64301026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64301049b0 0x7f64301026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 -- 172.21.15.6:0/2487855810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643010de10 msgr2=0x7f6430103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643010de10 0x7f6430103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 -- 172.21.15.6:0/2487855810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301a86b0 con 0x7f6430105300 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6435106640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f642c00e9f0 tx=0x7f642c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c00ccc0 con 0x7f6430105300 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301a89a0 con 0x7f6430105300 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f642c0108c0 con 0x7f6430105300 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c018750 con 0x7f6430105300 2024-09-21T07:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.587+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301a8eb0 con 0x7f6430105300 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.588+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643006b560 con 0x7f6430105300 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.590+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f642c010430 con 0x7f6430105300 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.591+0000 7f6422ffd640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 0x7f641c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.592+0000 7f6435907640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 0x7f641c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.592+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f642c0e8190 con 0x7f6430105300 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.592+0000 7f6435907640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 0x7f641c0b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6424004770 tx=0x7f64240058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.595+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f642c0b2810 con 0x7f6430105300 2024-09-21T07:59:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.815+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6430104dc0 con 0x7f6430105300 2024-09-21T07:59:40.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:40 smithi006 ceph-mon[30970]: pgmap v300: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:40.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:40 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.817+0000 7f6422ffd640 1 -- 172.21.15.6:0/2487855810 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7f642c0b7750 con 0x7f6430105300 2024-09-21T07:59:40.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:40.819 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 msgr2=0x7f641c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 0x7f641c0b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6424004770 tx=0x7f64240058d0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 msgr2=0x7f6430102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f642c00e9f0 tx=0x7f642c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 shutdown_connections 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f641c0b65f0 0x7f641c0b8b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643010de10 0x7f6430103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430105300 0x7f6430102c30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 --2- 172.21.15.6:0/2487855810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64301049b0 0x7f64301026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 >> 172.21.15.6:0/2487855810 conn(0x7f6430079730 msgr2=0x7f6430100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 shutdown_connections 2024-09-21T07:59:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:40.819+0000 7f6437b6b640 1 -- 172.21.15.6:0/2487855810 wait complete. 2024-09-21T07:59:41.055 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:40 smithi145 ceph-mon[34049]: pgmap v300: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:41.055 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:40 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:41.073 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:40 smithi119 ceph-mon[33564]: pgmap v300: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:41.073 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:40 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:41.520 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:59:41.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:59:42.002 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:41 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2487855810' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:42.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:41 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2487855810' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:42.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:41 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2487855810' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/250366997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 msgr2=0x7f1e2810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/250366997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2810f540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009be0 tx=0x7f1e2002a6c0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/250366997 shutdown_connections 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/250366997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e281083c0 0x7f1e281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/250366997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2810f540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/250366997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28102a80 0x7f1e28102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/250366997 >> 172.21.15.6:0/250366997 conn(0x7f1e28079740 msgr2=0x7f1e28079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/250366997 shutdown_connections 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.741+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/250366997 wait complete. 2024-09-21T07:59:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 Processor -- start 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 -- start start 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e28102a80 0x7f1e28199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e281083c0 0x7f1e281999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28112830 con 0x7f1e28108d10 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281126b0 con 0x7f1e281083c0 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.742+0000 7f1e2f0a7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281129b0 con 0x7f1e28102a80 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34904/0 (socket says 172.21.15.6:34904) 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 -- 172.21.15.6:0/4131709743 learned_addr learned my addr 172.21.15.6:0/4131709743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2ce43640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e28102a80 0x7f1e28199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e27fff640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e281083c0 0x7f1e281999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 -- 172.21.15.6:0/4131709743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e28102a80 msgr2=0x7f1e28199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e28102a80 0x7f1e28199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 -- 172.21.15.6:0/4131709743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e281083c0 msgr2=0x7f1e281999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e281083c0 0x7f1e281999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 -- 172.21.15.6:0/4131709743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2819f370 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2d644640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e20004af0 tx=0x7f1e20030c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20041020 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e20037040 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2819f600 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.743+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20036070 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.744+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e281a5dc0 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.745+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e28103d00 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.747+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f1e20044020 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.748+0000 7f1e25ffb640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 0x7f1e100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.748+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f1e20108530 con 0x7f1e28108d10 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.748+0000 7f1e2ce43640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 0x7f1e100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.748+0000 7f1e2ce43640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 0x7f1e100b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005d00 tx=0x7f1e1800b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.751+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e2004b020 con 0x7f1e28108d10 2024-09-21T07:59:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.960+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e28063800 con 0x7f1e100b65f0 2024-09-21T07:59:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.967+0000 7f1e25ffb640 1 -- 172.21.15.6:0/4131709743 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340497 (secure 0 0 0) 0x7f1e28063800 con 0x7f1e100b65f0 2024-09-21T07:59:42.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T07:59:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 msgr2=0x7f1e100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 0x7f1e100b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e18005d00 tx=0x7f1e1800b410 comp rx=0 tx=0).stop 2024-09-21T07:59:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 msgr2=0x7f1e2819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e20004af0 tx=0x7f1e20030c50 comp rx=0 tx=0).stop 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 shutdown_connections 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1e100b65f0 0x7f1e100b8b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e28108d10 0x7f1e2819ec40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e281083c0 0x7f1e281999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 --2- 172.21.15.6:0/4131709743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e28102a80 0x7f1e28199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.971+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 >> 172.21.15.6:0/4131709743 conn(0x7f1e28079740 msgr2=0x7f1e281045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.972+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 shutdown_connections 2024-09-21T07:59:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:42.972+0000 7f1e2f0a7640 1 -- 172.21.15.6:0/4131709743 wait complete. 2024-09-21T07:59:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:42 smithi119 ceph-mon[33564]: pgmap v301: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:42 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:42 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:42 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:42 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:42 smithi145 ceph-mon[34049]: pgmap v301: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:42 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:42 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:42 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:42 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:42 smithi006 ceph-mon[30970]: pgmap v301: 129 pgs: 129 active+clean; 624 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T07:59:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:42 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:42 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:42 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:42 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:43.658 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-21T07:59:41.538008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638881,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":136,"num_write":195,"num_write_kb":2223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351980,"kb_used_data":11028,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589844,"statfs":{"total":1151940427776,"available":1151580000256,"internally_reserved":0,"allocated":11292672,"data_stored":7680236,"data_compressed":391689,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43873,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":58,"num_write":23,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003996"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.458738+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T07:59:03.458738+0000","last_peered":"2024-09-21T07:59:03.458738+0000","last_clean":"2024-09-21T07:59:03.458738+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T07:59:03.458738+0000","last_undegraded":"2024-09-21T07:59:03.458738+0000","last_fullsized":"2024-09-21T07:59:03.458738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445067+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T07:59:03.445067+0000","last_peered":"2024-09-21T07:59:03.445067+0000","last_clean":"2024-09-21T07:59:03.445067+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T07:59:03.445067+0000","last_undegraded":"2024-09-21T07:59:03.445067+0000","last_fullsized":"2024-09-21T07:59:03.445067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443273+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T07:59:03.443273+0000","last_peered":"2024-09-21T07:59:03.443273+0000","last_clean":"2024-09-21T07:59:03.443273+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T07:59:03.443273+0000","last_undegraded":"2024-09-21T07:59:03.443273+0000","last_fullsized":"2024-09-21T07:59:03.443273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445885+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T07:59:03.445885+0000","last_peered":"2024-09-21T07:59:03.445885+0000","last_clean":"2024-09-21T07:59:03.445885+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T07:59:03.445885+0000","last_undegraded":"2024-09-21T07:59:03.445885+0000","last_fullsized":"2024-09-21T07:59:03.445885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444986+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T07:59:03.444986+0000","last_peered":"2024-09-21T07:59:03.444986+0000","last_clean":"2024-09-21T07:59:03.444986+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T07:59:03.444986+0000","last_undegraded":"2024-09-21T07:59:03.444986+0000","last_fullsized":"2024-09-21T07:59:03.444986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.451686+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T07:59:03.451686+0000","last_peered":"2024-09-21T07:59:03.451686+0000","last_clean":"2024-09-21T07:59:03.451686+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T07:59:03.451686+0000","last_undegraded":"2024-09-21T07:59:03.451686+0000","last_fullsized":"2024-09-21T07:59:03.451686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440968+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T07:59:03.440968+0000","last_peered":"2024-09-21T07:59:03.440968+0000","last_clean":"2024-09-21T07:59:03.440968+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T07:59:03.440968+0000","last_undegraded":"2024-09-21T07:59:03.440968+0000","last_fullsized":"2024-09-21T07:59:03.440968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705125+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T07:59:03.705125+0000","last_peered":"2024-09-21T07:59:03.705125+0000","last_clean":"2024-09-21T07:59:03.705125+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T07:59:03.705125+0000","last_undegraded":"2024-09-21T07:59:03.705125+0000","last_fullsized":"2024-09-21T07:59:03.705125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452945+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T07:59:03.452945+0000","last_peered":"2024-09-21T07:59:03.452945+0000","last_clean":"2024-09-21T07:59:03.452945+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T07:59:03.452945+0000","last_undegraded":"2024-09-21T07:59:03.452945+0000","last_fullsized":"2024-09-21T07:59:03.452945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440780+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T07:59:03.440780+0000","last_peered":"2024-09-21T07:59:03.440780+0000","last_clean":"2024-09-21T07:59:03.440780+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T07:59:03.440780+0000","last_undegraded":"2024-09-21T07:59:03.440780+0000","last_fullsized":"2024-09-21T07:59:03.440780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444538+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T07:59:03.444538+0000","last_peered":"2024-09-21T07:59:03.444538+0000","last_clean":"2024-09-21T07:59:03.444538+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T07:59:03.444538+0000","last_undegraded":"2024-09-21T07:59:03.444538+0000","last_fullsized":"2024-09-21T07:59:03.444538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452286+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T07:59:03.452286+0000","last_peered":"2024-09-21T07:59:03.452286+0000","last_clean":"2024-09-21T07:59:03.452286+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T07:59:03.452286+0000","last_undegraded":"2024-09-21T07:59:03.452286+0000","last_fullsized":"2024-09-21T07:59:03.452286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443359+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T07:59:03.443359+0000","last_peered":"2024-09-21T07:59:03.443359+0000","last_clean":"2024-09-21T07:59:03.443359+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T07:59:03.443359+0000","last_undegraded":"2024-09-21T07:59:03.443359+0000","last_fullsized":"2024-09-21T07:59:03.443359+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440516+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T07:59:03.440516+0000","last_peered":"2024-09-21T07:59:03.440516+0000","last_clean":"2024-09-21T07:59:03.440516+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T07:59:03.440516+0000","last_undegraded":"2024-09-21T07:59:03.440516+0000","last_fullsized":"2024-09-21T07:59:03.440516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452288+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T07:59:03.452288+0000","last_peered":"2024-09-21T07:59:03.452288+0000","last_clean":"2024-09-21T07:59:03.452288+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T07:59:03.452288+0000","last_undegraded":"2024-09-21T07:59:03.452288+0000","last_fullsized":"2024-09-21T07:59:03.452288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443243+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T07:59:03.443243+0000","last_peered":"2024-09-21T07:59:03.443243+0000","last_clean":"2024-09-21T07:59:03.443243+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T07:59:03.443243+0000","last_undegraded":"2024-09-21T07:59:03.443243+0000","last_fullsized":"2024-09-21T07:59:03.443243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443387+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T07:59:03.443387+0000","last_peered":"2024-09-21T07:59:03.443387+0000","last_clean":"2024-09-21T07:59:03.443387+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T07:59:03.443387+0000","last_undegraded":"2024-09-21T07:59:03.443387+0000","last_fullsized":"2024-09-21T07:59:03.443387+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452566+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T07:59:03.452566+0000","last_peered":"2024-09-21T07:59:03.452566+0000","last_clean":"2024-09-21T07:59:03.452566+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T07:59:03.452566+0000","last_undegraded":"2024-09-21T07:59:03.452566+0000","last_fullsized":"2024-09-21T07:59:03.452566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445380+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T07:59:03.445380+0000","last_peered":"2024-09-21T07:59:03.445380+0000","last_clean":"2024-09-21T07:59:03.445380+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T07:59:03.445380+0000","last_undegraded":"2024-09-21T07:59:03.445380+0000","last_fullsized":"2024-09-21T07:59:03.445380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444128+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T07:59:03.444128+0000","last_peered":"2024-09-21T07:59:03.444128+0000","last_clean":"2024-09-21T07:59:03.444128+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T07:59:03.444128+0000","last_undegraded":"2024-09-21T07:59:03.444128+0000","last_fullsized":"2024-09-21T07:59:03.444128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445284+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T07:59:03.445284+0000","last_peered":"2024-09-21T07:59:03.445284+0000","last_clean":"2024-09-21T07:59:03.445284+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T07:59:03.445284+0000","last_undegraded":"2024-09-21T07:59:03.445284+0000","last_fullsized":"2024-09-21T07:59:03.445284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440040+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T07:59:03.440040+0000","last_peered":"2024-09-21T07:59:03.440040+0000","last_clean":"2024-09-21T07:59:03.440040+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T07:59:03.440040+0000","last_undegraded":"2024-09-21T07:59:03.440040+0000","last_fullsized":"2024-09-21T07:59:03.440040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705434+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T07:59:03.705434+0000","last_peered":"2024-09-21T07:59:03.705434+0000","last_clean":"2024-09-21T07:59:03.705434+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T07:59:03.705434+0000","last_undegraded":"2024-09-21T07:59:03.705434+0000","last_fullsized":"2024-09-21T07:59:03.705434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452491+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T07:59:03.452491+0000","last_peered":"2024-09-21T07:59:03.452491+0000","last_clean":"2024-09-21T07:59:03.452491+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T07:59:03.452491+0000","last_undegraded":"2024-09-21T07:59:03.452491+0000","last_fullsized":"2024-09-21T07:59:03.452491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445522+0000","last_change":"2024-09-21T07:58:45.365398+0000","last_active":"2024-09-21T07:59:03.445522+0000","last_peered":"2024-09-21T07:59:03.445522+0000","last_clean":"2024-09-21T07:59:03.445522+0000","last_became_active":"2024-09-21T07:58:45.365056+0000","last_became_peered":"2024-09-21T07:58:45.365056+0000","last_unstale":"2024-09-21T07:59:03.445522+0000","last_undegraded":"2024-09-21T07:59:03.445522+0000","last_fullsized":"2024-09-21T07:59:03.445522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:43.623974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452590+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T07:59:03.452590+0000","last_peered":"2024-09-21T07:59:03.452590+0000","last_clean":"2024-09-21T07:59:03.452590+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T07:59:03.452590+0000","last_undegraded":"2024-09-21T07:59:03.452590+0000","last_fullsized":"2024-09-21T07:59:03.452590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443526+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T07:59:03.443526+0000","last_peered":"2024-09-21T07:59:03.443526+0000","last_clean":"2024-09-21T07:59:03.443526+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T07:59:03.443526+0000","last_undegraded":"2024-09-21T07:59:03.443526+0000","last_fullsized":"2024-09-21T07:59:03.443526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445321+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T07:59:03.445321+0000","last_peered":"2024-09-21T07:59:03.445321+0000","last_clean":"2024-09-21T07:59:03.445321+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T07:59:03.445321+0000","last_undegraded":"2024-09-21T07:59:03.445321+0000","last_fullsized":"2024-09-21T07:59:03.445321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:35.359917+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T07:59:35.359917+0000","last_peered":"2024-09-21T07:59:35.359917+0000","last_clean":"2024-09-21T07:59:35.359917+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T07:59:35.359917+0000","last_undegraded":"2024-09-21T07:59:35.359917+0000","last_fullsized":"2024-09-21T07:59:35.359917+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443252+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T07:59:03.443252+0000","last_peered":"2024-09-21T07:59:03.443252+0000","last_clean":"2024-09-21T07:59:03.443252+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T07:59:03.443252+0000","last_undegraded":"2024-09-21T07:59:03.443252+0000","last_fullsized":"2024-09-21T07:59:03.443252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439993+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T07:59:03.439993+0000","last_peered":"2024-09-21T07:59:03.439993+0000","last_clean":"2024-09-21T07:59:03.439993+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T07:59:03.439993+0000","last_undegraded":"2024-09-21T07:59:03.439993+0000","last_fullsized":"2024-09-21T07:59:03.439993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.441105+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T07:59:03.441105+0000","last_peered":"2024-09-21T07:59:03.441105+0000","last_clean":"2024-09-21T07:59:03.441105+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T07:59:03.441105+0000","last_undegraded":"2024-09-21T07:59:03.441105+0000","last_fullsized":"2024-09-21T07:59:03.441105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444436+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T07:59:03.444436+0000","last_peered":"2024-09-21T07:59:03.444436+0000","last_clean":"2024-09-21T07:59:03.444436+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T07:59:03.444436+0000","last_undegraded":"2024-09-21T07:59:03.444436+0000","last_fullsized":"2024-09-21T07:59:03.444436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442870+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T07:59:03.442870+0000","last_peered":"2024-09-21T07:59:03.442870+0000","last_clean":"2024-09-21T07:59:03.442870+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T07:59:03.442870+0000","last_undegraded":"2024-09-21T07:59:03.442870+0000","last_fullsized":"2024-09-21T07:59:03.442870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443701+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T07:59:03.443701+0000","last_peered":"2024-09-21T07:59:03.443701+0000","last_clean":"2024-09-21T07:59:03.443701+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T07:59:03.443701+0000","last_undegraded":"2024-09-21T07:59:03.443701+0000","last_fullsized":"2024-09-21T07:59:03.443701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440079+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T07:59:03.440079+0000","last_peered":"2024-09-21T07:59:03.440079+0000","last_clean":"2024-09-21T07:59:03.440079+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T07:59:03.440079+0000","last_undegraded":"2024-09-21T07:59:03.440079+0000","last_fullsized":"2024-09-21T07:59:03.440079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443427+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T07:59:03.443427+0000","last_peered":"2024-09-21T07:59:03.443427+0000","last_clean":"2024-09-21T07:59:03.443427+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T07:59:03.443427+0000","last_undegraded":"2024-09-21T07:59:03.443427+0000","last_fullsized":"2024-09-21T07:59:03.443427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443578+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T07:59:03.443578+0000","last_peered":"2024-09-21T07:59:03.443578+0000","last_clean":"2024-09-21T07:59:03.443578+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T07:59:03.443578+0000","last_undegraded":"2024-09-21T07:59:03.443578+0000","last_fullsized":"2024-09-21T07:59:03.443578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439727+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T07:59:03.439727+0000","last_peered":"2024-09-21T07:59:03.439727+0000","last_clean":"2024-09-21T07:59:03.439727+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T07:59:03.439727+0000","last_undegraded":"2024-09-21T07:59:03.439727+0000","last_fullsized":"2024-09-21T07:59:03.439727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445084+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T07:59:03.445084+0000","last_peered":"2024-09-21T07:59:03.445084+0000","last_clean":"2024-09-21T07:59:03.445084+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T07:59:03.445084+0000","last_undegraded":"2024-09-21T07:59:03.445084+0000","last_fullsized":"2024-09-21T07:59:03.445084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439334+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T07:59:03.439334+0000","last_peered":"2024-09-21T07:59:03.439334+0000","last_clean":"2024-09-21T07:59:03.439334+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T07:59:03.439334+0000","last_undegraded":"2024-09-21T07:59:03.439334+0000","last_fullsized":"2024-09-21T07:59:03.439334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440221+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T07:59:03.440221+0000","last_peered":"2024-09-21T07:59:03.440221+0000","last_clean":"2024-09-21T07:59:03.440221+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T07:59:03.440221+0000","last_undegraded":"2024-09-21T07:59:03.440221+0000","last_fullsized":"2024-09-21T07:59:03.440221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439186+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T07:59:03.439186+0000","last_peered":"2024-09-21T07:59:03.439186+0000","last_clean":"2024-09-21T07:59:03.439186+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T07:59:03.439186+0000","last_undegraded":"2024-09-21T07:59:03.439186+0000","last_fullsized":"2024-09-21T07:59:03.439186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443060+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T07:59:03.443060+0000","last_peered":"2024-09-21T07:59:03.443060+0000","last_clean":"2024-09-21T07:59:03.443060+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T07:59:03.443060+0000","last_undegraded":"2024-09-21T07:59:03.443060+0000","last_fullsized":"2024-09-21T07:59:03.443060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450388+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T07:59:03.450388+0000","last_peered":"2024-09-21T07:59:03.450388+0000","last_clean":"2024-09-21T07:59:03.450388+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T07:59:03.450388+0000","last_undegraded":"2024-09-21T07:59:03.450388+0000","last_fullsized":"2024-09-21T07:59:03.450388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444394+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T07:59:03.444394+0000","last_peered":"2024-09-21T07:59:03.444394+0000","last_clean":"2024-09-21T07:59:03.444394+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T07:59:03.444394+0000","last_undegraded":"2024-09-21T07:59:03.444394+0000","last_fullsized":"2024-09-21T07:59:03.444394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453176+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T07:59:03.453176+0000","last_peered":"2024-09-21T07:59:03.453176+0000","last_clean":"2024-09-21T07:59:03.453176+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T07:59:03.453176+0000","last_undegraded":"2024-09-21T07:59:03.453176+0000","last_fullsized":"2024-09-21T07:59:03.453176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":108,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443280+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T07:59:03.443280+0000","last_peered":"2024-09-21T07:59:03.443280+0000","last_clean":"2024-09-21T07:59:03.443280+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T07:59:03.443280+0000","last_undegraded":"2024-09-21T07:59:03.443280+0000","last_fullsized":"2024-09-21T07:59:03.443280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453003+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T07:59:03.453003+0000","last_peered":"2024-09-21T07:59:03.453003+0000","last_clean":"2024-09-21T07:59:03.453003+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T07:59:03.453003+0000","last_undegraded":"2024-09-21T07:59:03.453003+0000","last_fullsized":"2024-09-21T07:59:03.453003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444151+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T07:59:03.444151+0000","last_peered":"2024-09-21T07:59:03.444151+0000","last_clean":"2024-09-21T07:59:03.444151+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T07:59:03.444151+0000","last_undegraded":"2024-09-21T07:59:03.444151+0000","last_fullsized":"2024-09-21T07:59:03.444151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444352+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T07:59:03.444352+0000","last_peered":"2024-09-21T07:59:03.444352+0000","last_clean":"2024-09-21T07:59:03.444352+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T07:59:03.444352+0000","last_undegraded":"2024-09-21T07:59:03.444352+0000","last_fullsized":"2024-09-21T07:59:03.444352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.704956+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T07:59:03.704956+0000","last_peered":"2024-09-21T07:59:03.704956+0000","last_clean":"2024-09-21T07:59:03.704956+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T07:59:03.704956+0000","last_undegraded":"2024-09-21T07:59:03.704956+0000","last_fullsized":"2024-09-21T07:59:03.704956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442999+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T07:59:03.442999+0000","last_peered":"2024-09-21T07:59:03.442999+0000","last_clean":"2024-09-21T07:59:03.442999+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T07:59:03.442999+0000","last_undegraded":"2024-09-21T07:59:03.442999+0000","last_fullsized":"2024-09-21T07:59:03.442999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445685+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T07:59:03.445685+0000","last_peered":"2024-09-21T07:59:03.445685+0000","last_clean":"2024-09-21T07:59:03.445685+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T07:59:03.445685+0000","last_undegraded":"2024-09-21T07:59:03.445685+0000","last_fullsized":"2024-09-21T07:59:03.445685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444065+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T07:59:03.444065+0000","last_peered":"2024-09-21T07:59:03.444065+0000","last_clean":"2024-09-21T07:59:03.444065+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T07:59:03.444065+0000","last_undegraded":"2024-09-21T07:59:03.444065+0000","last_fullsized":"2024-09-21T07:59:03.444065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444029+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T07:59:03.444029+0000","last_peered":"2024-09-21T07:59:03.444029+0000","last_clean":"2024-09-21T07:59:03.444029+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T07:59:03.444029+0000","last_undegraded":"2024-09-21T07:59:03.444029+0000","last_fullsized":"2024-09-21T07:59:03.444029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440104+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T07:59:03.440104+0000","last_peered":"2024-09-21T07:59:03.440104+0000","last_clean":"2024-09-21T07:59:03.440104+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T07:59:03.440104+0000","last_undegraded":"2024-09-21T07:59:03.440104+0000","last_fullsized":"2024-09-21T07:59:03.440104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443043+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T07:59:03.443043+0000","last_peered":"2024-09-21T07:59:03.443043+0000","last_clean":"2024-09-21T07:59:03.443043+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T07:59:03.443043+0000","last_undegraded":"2024-09-21T07:59:03.443043+0000","last_fullsized":"2024-09-21T07:59:03.443043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445131+0000","last_change":"2024-09-21T07:58:45.364547+0000","last_active":"2024-09-21T07:59:03.445131+0000","last_peered":"2024-09-21T07:59:03.445131+0000","last_clean":"2024-09-21T07:59:03.445131+0000","last_became_active":"2024-09-21T07:58:45.364193+0000","last_became_peered":"2024-09-21T07:58:45.364193+0000","last_unstale":"2024-09-21T07:59:03.445131+0000","last_undegraded":"2024-09-21T07:59:03.445131+0000","last_fullsized":"2024-09-21T07:59:03.445131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:33.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:04.718407+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T07:59:04.718407+0000","last_peered":"2024-09-21T07:59:04.718407+0000","last_clean":"2024-09-21T07:59:04.718407+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T07:59:04.718407+0000","last_undegraded":"2024-09-21T07:59:04.718407+0000","last_fullsized":"2024-09-21T07:59:04.718407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442496+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T07:59:03.442496+0000","last_peered":"2024-09-21T07:59:03.442496+0000","last_clean":"2024-09-21T07:59:03.442496+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T07:59:03.442496+0000","last_undegraded":"2024-09-21T07:59:03.442496+0000","last_fullsized":"2024-09-21T07:59:03.442496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442783+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T07:59:03.442783+0000","last_peered":"2024-09-21T07:59:03.442783+0000","last_clean":"2024-09-21T07:59:03.442783+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T07:59:03.442783+0000","last_undegraded":"2024-09-21T07:59:03.442783+0000","last_fullsized":"2024-09-21T07:59:03.442783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.714271+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T07:59:03.714271+0000","last_peered":"2024-09-21T07:59:03.714271+0000","last_clean":"2024-09-21T07:59:03.714271+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T07:59:03.714271+0000","last_undegraded":"2024-09-21T07:59:03.714271+0000","last_fullsized":"2024-09-21T07:59:03.714271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440092+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T07:59:03.440092+0000","last_peered":"2024-09-21T07:59:03.440092+0000","last_clean":"2024-09-21T07:59:03.440092+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T07:59:03.440092+0000","last_undegraded":"2024-09-21T07:59:03.440092+0000","last_fullsized":"2024-09-21T07:59:03.440092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442835+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T07:59:03.442835+0000","last_peered":"2024-09-21T07:59:03.442835+0000","last_clean":"2024-09-21T07:59:03.442835+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T07:59:03.442835+0000","last_undegraded":"2024-09-21T07:59:03.442835+0000","last_fullsized":"2024-09-21T07:59:03.442835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452213+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T07:59:03.452213+0000","last_peered":"2024-09-21T07:59:03.452213+0000","last_clean":"2024-09-21T07:59:03.452213+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T07:59:03.452213+0000","last_undegraded":"2024-09-21T07:59:03.452213+0000","last_fullsized":"2024-09-21T07:59:03.452213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445411+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T07:59:03.445411+0000","last_peered":"2024-09-21T07:59:03.445411+0000","last_clean":"2024-09-21T07:59:03.445411+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T07:59:03.445411+0000","last_undegraded":"2024-09-21T07:59:03.445411+0000","last_fullsized":"2024-09-21T07:59:03.445411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444494+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T07:59:03.444494+0000","last_peered":"2024-09-21T07:59:03.444494+0000","last_clean":"2024-09-21T07:59:03.444494+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T07:59:03.444494+0000","last_undegraded":"2024-09-21T07:59:03.444494+0000","last_fullsized":"2024-09-21T07:59:03.444494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443077+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T07:59:03.443077+0000","last_peered":"2024-09-21T07:59:03.443077+0000","last_clean":"2024-09-21T07:59:03.443077+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T07:59:03.443077+0000","last_undegraded":"2024-09-21T07:59:03.443077+0000","last_fullsized":"2024-09-21T07:59:03.443077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444586+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T07:59:03.444586+0000","last_peered":"2024-09-21T07:59:03.444586+0000","last_clean":"2024-09-21T07:59:03.444586+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T07:59:03.444586+0000","last_undegraded":"2024-09-21T07:59:03.444586+0000","last_fullsized":"2024-09-21T07:59:03.444586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439466+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T07:59:03.439466+0000","last_peered":"2024-09-21T07:59:03.439466+0000","last_clean":"2024-09-21T07:59:03.439466+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T07:59:03.439466+0000","last_undegraded":"2024-09-21T07:59:03.439466+0000","last_fullsized":"2024-09-21T07:59:03.439466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444284+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T07:59:03.444284+0000","last_peered":"2024-09-21T07:59:03.444284+0000","last_clean":"2024-09-21T07:59:03.444284+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T07:59:03.444284+0000","last_undegraded":"2024-09-21T07:59:03.444284+0000","last_fullsized":"2024-09-21T07:59:03.444284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444414+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T07:59:03.444414+0000","last_peered":"2024-09-21T07:59:03.444414+0000","last_clean":"2024-09-21T07:59:03.444414+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T07:59:03.444414+0000","last_undegraded":"2024-09-21T07:59:03.444414+0000","last_fullsized":"2024-09-21T07:59:03.444414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440830+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T07:59:03.440830+0000","last_peered":"2024-09-21T07:59:03.440830+0000","last_clean":"2024-09-21T07:59:03.440830+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T07:59:03.440830+0000","last_undegraded":"2024-09-21T07:59:03.440830+0000","last_fullsized":"2024-09-21T07:59:03.440830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'23","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:37.694471+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T07:59:37.694471+0000","last_peered":"2024-09-21T07:59:37.694471+0000","last_clean":"2024-09-21T07:59:37.694471+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T07:59:37.694471+0000","last_undegraded":"2024-09-21T07:59:37.694471+0000","last_fullsized":"2024-09-21T07:59:37.694471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47481,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":61,"num_write":23,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450144+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T07:59:03.450144+0000","last_peered":"2024-09-21T07:59:03.450144+0000","last_clean":"2024-09-21T07:59:03.450144+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T07:59:03.450144+0000","last_undegraded":"2024-09-21T07:59:03.450144+0000","last_fullsized":"2024-09-21T07:59:03.450144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705197+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T07:59:03.705197+0000","last_peered":"2024-09-21T07:59:03.705197+0000","last_clean":"2024-09-21T07:59:03.705197+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T07:59:03.705197+0000","last_undegraded":"2024-09-21T07:59:03.705197+0000","last_fullsized":"2024-09-21T07:59:03.705197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445501+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T07:59:03.445501+0000","last_peered":"2024-09-21T07:59:03.445501+0000","last_clean":"2024-09-21T07:59:03.445501+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T07:59:03.445501+0000","last_undegraded":"2024-09-21T07:59:03.445501+0000","last_fullsized":"2024-09-21T07:59:03.445501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453031+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T07:59:03.453031+0000","last_peered":"2024-09-21T07:59:03.453031+0000","last_clean":"2024-09-21T07:59:03.453031+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T07:59:03.453031+0000","last_undegraded":"2024-09-21T07:59:03.453031+0000","last_fullsized":"2024-09-21T07:59:03.453031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445114+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T07:59:03.445114+0000","last_peered":"2024-09-21T07:59:03.445114+0000","last_clean":"2024-09-21T07:59:03.445114+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T07:59:03.445114+0000","last_undegraded":"2024-09-21T07:59:03.445114+0000","last_fullsized":"2024-09-21T07:59:03.445114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444216+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T07:59:03.444216+0000","last_peered":"2024-09-21T07:59:03.444216+0000","last_clean":"2024-09-21T07:59:03.444216+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T07:59:03.444216+0000","last_undegraded":"2024-09-21T07:59:03.444216+0000","last_fullsized":"2024-09-21T07:59:03.444216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.456084+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T07:59:03.456084+0000","last_peered":"2024-09-21T07:59:03.456084+0000","last_clean":"2024-09-21T07:59:03.456084+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T07:59:03.456084+0000","last_undegraded":"2024-09-21T07:59:03.456084+0000","last_fullsized":"2024-09-21T07:59:03.456084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705586+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T07:59:03.705586+0000","last_peered":"2024-09-21T07:59:03.705586+0000","last_clean":"2024-09-21T07:59:03.705586+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T07:59:03.705586+0000","last_undegraded":"2024-09-21T07:59:03.705586+0000","last_fullsized":"2024-09-21T07:59:03.705586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442869+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T07:59:03.442869+0000","last_peered":"2024-09-21T07:59:03.442869+0000","last_clean":"2024-09-21T07:59:03.442869+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T07:59:03.442869+0000","last_undegraded":"2024-09-21T07:59:03.442869+0000","last_fullsized":"2024-09-21T07:59:03.442869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443813+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T07:59:03.443813+0000","last_peered":"2024-09-21T07:59:03.443813+0000","last_clean":"2024-09-21T07:59:03.443813+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T07:59:03.443813+0000","last_undegraded":"2024-09-21T07:59:03.443813+0000","last_fullsized":"2024-09-21T07:59:03.443813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445264+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T07:59:03.445264+0000","last_peered":"2024-09-21T07:59:03.445264+0000","last_clean":"2024-09-21T07:59:03.445264+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T07:59:03.445264+0000","last_undegraded":"2024-09-21T07:59:03.445264+0000","last_fullsized":"2024-09-21T07:59:03.445264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443343+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T07:59:03.443343+0000","last_peered":"2024-09-21T07:59:03.443343+0000","last_clean":"2024-09-21T07:59:03.443343+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T07:59:03.443343+0000","last_undegraded":"2024-09-21T07:59:03.443343+0000","last_fullsized":"2024-09-21T07:59:03.443343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445279+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T07:59:03.445279+0000","last_peered":"2024-09-21T07:59:03.445279+0000","last_clean":"2024-09-21T07:59:03.445279+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T07:59:03.445279+0000","last_undegraded":"2024-09-21T07:59:03.445279+0000","last_fullsized":"2024-09-21T07:59:03.445279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447239+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T07:59:03.447239+0000","last_peered":"2024-09-21T07:59:03.447239+0000","last_clean":"2024-09-21T07:59:03.447239+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T07:59:03.447239+0000","last_undegraded":"2024-09-21T07:59:03.447239+0000","last_fullsized":"2024-09-21T07:59:03.447239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443541+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T07:59:03.443541+0000","last_peered":"2024-09-21T07:59:03.443541+0000","last_clean":"2024-09-21T07:59:03.443541+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T07:59:03.443541+0000","last_undegraded":"2024-09-21T07:59:03.443541+0000","last_fullsized":"2024-09-21T07:59:03.443541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439202+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T07:59:03.439202+0000","last_peered":"2024-09-21T07:59:03.439202+0000","last_clean":"2024-09-21T07:59:03.439202+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T07:59:03.439202+0000","last_undegraded":"2024-09-21T07:59:03.439202+0000","last_fullsized":"2024-09-21T07:59:03.439202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443529+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T07:59:03.443529+0000","last_peered":"2024-09-21T07:59:03.443529+0000","last_clean":"2024-09-21T07:59:03.443529+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T07:59:03.443529+0000","last_undegraded":"2024-09-21T07:59:03.443529+0000","last_fullsized":"2024-09-21T07:59:03.443529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443294+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T07:59:03.443294+0000","last_peered":"2024-09-21T07:59:03.443294+0000","last_clean":"2024-09-21T07:59:03.443294+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T07:59:03.443294+0000","last_undegraded":"2024-09-21T07:59:03.443294+0000","last_fullsized":"2024-09-21T07:59:03.443294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445049+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T07:59:03.445049+0000","last_peered":"2024-09-21T07:59:03.445049+0000","last_clean":"2024-09-21T07:59:03.445049+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T07:59:03.445049+0000","last_undegraded":"2024-09-21T07:59:03.445049+0000","last_fullsized":"2024-09-21T07:59:03.445049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.454917+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T07:59:03.454917+0000","last_peered":"2024-09-21T07:59:03.454917+0000","last_clean":"2024-09-21T07:59:03.454917+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T07:59:03.454917+0000","last_undegraded":"2024-09-21T07:59:03.454917+0000","last_fullsized":"2024-09-21T07:59:03.454917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440210+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T07:59:03.440210+0000","last_peered":"2024-09-21T07:59:03.440210+0000","last_clean":"2024-09-21T07:59:03.440210+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T07:59:03.440210+0000","last_undegraded":"2024-09-21T07:59:03.440210+0000","last_fullsized":"2024-09-21T07:59:03.440210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444643+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T07:59:03.444643+0000","last_peered":"2024-09-21T07:59:03.444643+0000","last_clean":"2024-09-21T07:59:03.444643+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T07:59:03.444643+0000","last_undegraded":"2024-09-21T07:59:03.444643+0000","last_fullsized":"2024-09-21T07:59:03.444643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445263+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T07:59:03.445263+0000","last_peered":"2024-09-21T07:59:03.445263+0000","last_clean":"2024-09-21T07:59:03.445263+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T07:59:03.445263+0000","last_undegraded":"2024-09-21T07:59:03.445263+0000","last_fullsized":"2024-09-21T07:59:03.445263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443818+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T07:59:03.443818+0000","last_peered":"2024-09-21T07:59:03.443818+0000","last_clean":"2024-09-21T07:59:03.443818+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T07:59:03.443818+0000","last_undegraded":"2024-09-21T07:59:03.443818+0000","last_fullsized":"2024-09-21T07:59:03.443818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443264+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T07:59:03.443264+0000","last_peered":"2024-09-21T07:59:03.443264+0000","last_clean":"2024-09-21T07:59:03.443264+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T07:59:03.443264+0000","last_undegraded":"2024-09-21T07:59:03.443264+0000","last_fullsized":"2024-09-21T07:59:03.443264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444190+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T07:59:03.444190+0000","last_peered":"2024-09-21T07:59:03.444190+0000","last_clean":"2024-09-21T07:59:03.444190+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T07:59:03.444190+0000","last_undegraded":"2024-09-21T07:59:03.444190+0000","last_fullsized":"2024-09-21T07:59:03.444190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439899+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T07:59:03.439899+0000","last_peered":"2024-09-21T07:59:03.439899+0000","last_clean":"2024-09-21T07:59:03.439899+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T07:59:03.439899+0000","last_undegraded":"2024-09-21T07:59:03.439899+0000","last_fullsized":"2024-09-21T07:59:03.439899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.446005+0000","last_change":"2024-09-21T07:58:45.354855+0000","last_active":"2024-09-21T07:59:03.446005+0000","last_peered":"2024-09-21T07:59:03.446005+0000","last_clean":"2024-09-21T07:59:03.446005+0000","last_became_active":"2024-09-21T07:58:45.354501+0000","last_became_peered":"2024-09-21T07:58:45.354501+0000","last_unstale":"2024-09-21T07:59:03.446005+0000","last_undegraded":"2024-09-21T07:59:03.446005+0000","last_fullsized":"2024-09-21T07:59:03.446005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:06.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445517+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T07:59:03.445517+0000","last_peered":"2024-09-21T07:59:03.445517+0000","last_clean":"2024-09-21T07:59:03.445517+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T07:59:03.445517+0000","last_undegraded":"2024-09-21T07:59:03.445517+0000","last_fullsized":"2024-09-21T07:59:03.445517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.449110+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T07:59:03.449110+0000","last_peered":"2024-09-21T07:59:03.449110+0000","last_clean":"2024-09-21T07:59:03.449110+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T07:59:03.449110+0000","last_undegraded":"2024-09-21T07:59:03.449110+0000","last_fullsized":"2024-09-21T07:59:03.449110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443580+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T07:59:03.443580+0000","last_peered":"2024-09-21T07:59:03.443580+0000","last_clean":"2024-09-21T07:59:03.443580+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T07:59:03.443580+0000","last_undegraded":"2024-09-21T07:59:03.443580+0000","last_fullsized":"2024-09-21T07:59:03.443580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443996+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T07:59:03.443996+0000","last_peered":"2024-09-21T07:59:03.443996+0000","last_clean":"2024-09-21T07:59:03.443996+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T07:59:03.443996+0000","last_undegraded":"2024-09-21T07:59:03.443996+0000","last_fullsized":"2024-09-21T07:59:03.443996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705097+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T07:59:03.705097+0000","last_peered":"2024-09-21T07:59:03.705097+0000","last_clean":"2024-09-21T07:59:03.705097+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T07:59:03.705097+0000","last_undegraded":"2024-09-21T07:59:03.705097+0000","last_fullsized":"2024-09-21T07:59:03.705097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439849+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T07:59:03.439849+0000","last_peered":"2024-09-21T07:59:03.439849+0000","last_clean":"2024-09-21T07:59:03.439849+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T07:59:03.439849+0000","last_undegraded":"2024-09-21T07:59:03.439849+0000","last_fullsized":"2024-09-21T07:59:03.439849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444724+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T07:59:03.444724+0000","last_peered":"2024-09-21T07:59:03.444724+0000","last_clean":"2024-09-21T07:59:03.444724+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T07:59:03.444724+0000","last_undegraded":"2024-09-21T07:59:03.444724+0000","last_fullsized":"2024-09-21T07:59:03.444724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444838+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T07:59:03.444838+0000","last_peered":"2024-09-21T07:59:03.444838+0000","last_clean":"2024-09-21T07:59:03.444838+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T07:59:03.444838+0000","last_undegraded":"2024-09-21T07:59:03.444838+0000","last_fullsized":"2024-09-21T07:59:03.444838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444923+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T07:59:03.444923+0000","last_peered":"2024-09-21T07:59:03.444923+0000","last_clean":"2024-09-21T07:59:03.444923+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T07:59:03.444923+0000","last_undegraded":"2024-09-21T07:59:03.444923+0000","last_fullsized":"2024-09-21T07:59:03.444923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447524+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T07:59:03.447524+0000","last_peered":"2024-09-21T07:59:03.447524+0000","last_clean":"2024-09-21T07:59:03.447524+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T07:59:03.447524+0000","last_undegraded":"2024-09-21T07:59:03.447524+0000","last_fullsized":"2024-09-21T07:59:03.447524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705287+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T07:59:03.705287+0000","last_peered":"2024-09-21T07:59:03.705287+0000","last_clean":"2024-09-21T07:59:03.705287+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T07:59:03.705287+0000","last_undegraded":"2024-09-21T07:59:03.705287+0000","last_fullsized":"2024-09-21T07:59:03.705287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443459+0000","last_change":"2024-09-21T07:58:45.368360+0000","last_active":"2024-09-21T07:59:03.443459+0000","last_peered":"2024-09-21T07:59:03.443459+0000","last_clean":"2024-09-21T07:59:03.443459+0000","last_became_active":"2024-09-21T07:58:45.368034+0000","last_became_peered":"2024-09-21T07:58:45.368034+0000","last_unstale":"2024-09-21T07:59:03.443459+0000","last_undegraded":"2024-09-21T07:59:03.443459+0000","last_fullsized":"2024-09-21T07:59:03.443459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.483376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443741+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T07:59:03.443741+0000","last_peered":"2024-09-21T07:59:03.443741+0000","last_clean":"2024-09-21T07:59:03.443741+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T07:59:03.443741+0000","last_undegraded":"2024-09-21T07:59:03.443741+0000","last_fullsized":"2024-09-21T07:59:03.443741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439734+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T07:59:03.439734+0000","last_peered":"2024-09-21T07:59:03.439734+0000","last_clean":"2024-09-21T07:59:03.439734+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T07:59:03.439734+0000","last_undegraded":"2024-09-21T07:59:03.439734+0000","last_fullsized":"2024-09-21T07:59:03.439734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450293+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T07:59:03.450293+0000","last_peered":"2024-09-21T07:59:03.450293+0000","last_clean":"2024-09-21T07:59:03.450293+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T07:59:03.450293+0000","last_undegraded":"2024-09-21T07:59:03.450293+0000","last_fullsized":"2024-09-21T07:59:03.450293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444014+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T07:59:03.444014+0000","last_peered":"2024-09-21T07:59:03.444014+0000","last_clean":"2024-09-21T07:59:03.444014+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T07:59:03.444014+0000","last_undegraded":"2024-09-21T07:59:03.444014+0000","last_fullsized":"2024-09-21T07:59:03.444014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443496+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T07:59:03.443496+0000","last_peered":"2024-09-21T07:59:03.443496+0000","last_clean":"2024-09-21T07:59:03.443496+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T07:59:03.443496+0000","last_undegraded":"2024-09-21T07:59:03.443496+0000","last_fullsized":"2024-09-21T07:59:03.443496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705634+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T07:59:03.705634+0000","last_peered":"2024-09-21T07:59:03.705634+0000","last_clean":"2024-09-21T07:59:03.705634+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T07:59:03.705634+0000","last_undegraded":"2024-09-21T07:59:03.705634+0000","last_fullsized":"2024-09-21T07:59:03.705634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443437+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T07:59:03.443437+0000","last_peered":"2024-09-21T07:59:03.443437+0000","last_clean":"2024-09-21T07:59:03.443437+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T07:59:03.443437+0000","last_undegraded":"2024-09-21T07:59:03.443437+0000","last_fullsized":"2024-09-21T07:59:03.443437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444256+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T07:59:03.444256+0000","last_peered":"2024-09-21T07:59:03.444256+0000","last_clean":"2024-09-21T07:59:03.444256+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T07:59:03.444256+0000","last_undegraded":"2024-09-21T07:59:03.444256+0000","last_fullsized":"2024-09-21T07:59:03.444256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443447+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T07:59:03.443447+0000","last_peered":"2024-09-21T07:59:03.443447+0000","last_clean":"2024-09-21T07:59:03.443447+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T07:59:03.443447+0000","last_undegraded":"2024-09-21T07:59:03.443447+0000","last_fullsized":"2024-09-21T07:59:03.443447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440206+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T07:59:03.440206+0000","last_peered":"2024-09-21T07:59:03.440206+0000","last_clean":"2024-09-21T07:59:03.440206+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T07:59:03.440206+0000","last_undegraded":"2024-09-21T07:59:03.440206+0000","last_fullsized":"2024-09-21T07:59:03.440206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452580+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T07:59:03.452580+0000","last_peered":"2024-09-21T07:59:03.452580+0000","last_clean":"2024-09-21T07:59:03.452580+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T07:59:03.452580+0000","last_undegraded":"2024-09-21T07:59:03.452580+0000","last_fullsized":"2024-09-21T07:59:03.452580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444308+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T07:59:03.444308+0000","last_peered":"2024-09-21T07:59:03.444308+0000","last_clean":"2024-09-21T07:59:03.444308+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T07:59:03.444308+0000","last_undegraded":"2024-09-21T07:59:03.444308+0000","last_fullsized":"2024-09-21T07:59:03.444308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445389+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T07:59:03.445389+0000","last_peered":"2024-09-21T07:59:03.445389+0000","last_clean":"2024-09-21T07:59:03.445389+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T07:59:03.445389+0000","last_undegraded":"2024-09-21T07:59:03.445389+0000","last_fullsized":"2024-09-21T07:59:03.445389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447490+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T07:59:03.447490+0000","last_peered":"2024-09-21T07:59:03.447490+0000","last_clean":"2024-09-21T07:59:03.447490+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T07:59:03.447490+0000","last_undegraded":"2024-09-21T07:59:03.447490+0000","last_fullsized":"2024-09-21T07:59:03.447490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48279,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":35,"num_read_kb":67,"num_write":70,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":161220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":480962,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1114305,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103201,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":485036,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":485036,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1074822,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":476262,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":1066812,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":480380,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":476366,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":540160,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":523743,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":476352,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":47481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":47675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:59:43.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:59:43.941 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:44.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:43 smithi145 ceph-mon[34049]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:44.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:43 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:43 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.205 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:43 smithi006 ceph-mon[30970]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:44.205 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:43 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.205 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:43 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:43 smithi119 ceph-mon[33564]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:44.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:43 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:43 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 -- 172.21.15.6:0/488585038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c104870 msgr2=0x7f236c104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 --2- 172.21.15.6:0/488585038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c104870 0x7f236c104c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2368009900 tx=0x7f236802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 -- 172.21.15.6:0/488585038 shutdown_connections 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 --2- 172.21.15.6:0/488585038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c10de20 0x7f236c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 --2- 172.21.15.6:0/488585038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c1052a0 0x7f236c10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 --2- 172.21.15.6:0/488585038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c104870 0x7f236c104c80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 -- 172.21.15.6:0/488585038 >> 172.21.15.6:0/488585038 conn(0x7f236c079730 msgr2=0x7f236c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 -- 172.21.15.6:0/488585038 shutdown_connections 2024-09-21T07:59:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.479+0000 7f2373285640 1 -- 172.21.15.6:0/488585038 wait complete. 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 Processor -- start 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 -- start start 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c104870 0x7f236c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c10de20 0x7f236c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f236c113940 con 0x7f236c1052a0 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f236c1137c0 con 0x7f236c10de20 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2373285640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f236c113ac0 con 0x7f236c104870 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34920/0 (socket says 172.21.15.6:34920) 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 -- 172.21.15.6:0/1029048494 learned_addr learned my addr 172.21.15.6:0/1029048494 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2371021640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c104870 0x7f236c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2371822640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c10de20 0x7f236c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 -- 172.21.15.6:0/1029048494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c104870 msgr2=0x7f236c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c104870 0x7f236c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 -- 172.21.15.6:0/1029048494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c10de20 msgr2=0x7f236c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.480+0000 7f2370820640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c10de20 0x7f236c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f2370820640 1 -- 172.21.15.6:0/1029048494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c1a2480 con 0x7f236c1052a0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f2370820640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c8c0 tx=0x7f235c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c007bb0 con 0x7f236c1052a0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c1a2770 con 0x7f236c1052a0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f235c007d50 con 0x7f236c1052a0 2024-09-21T07:59:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c018660 con 0x7f236c1052a0 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.481+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1a8f90 con 0x7f236c1052a0 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.482+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c06c160 con 0x7f236c1052a0 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.484+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f235c00fa00 con 0x7f236c1052a0 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.485+0000 7f23627fc640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 0x7f23580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.485+0000 7f2371021640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 0x7f23580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.485+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f235c0e7c30 con 0x7f236c1052a0 2024-09-21T07:59:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.485+0000 7f2371021640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 0x7f23580b8b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f23680057c0 tx=0x7f23680058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.488+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f235c014030 con 0x7f236c1052a0 2024-09-21T07:59:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.696+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f236c063800 con 0x7f23580b6620 2024-09-21T07:59:44.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.707+0000 7f23627fc640 1 -- 172.21.15.6:0/1029048494 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340499 (secure 0 0 0) 0x7f236c063800 con 0x7f23580b6620 2024-09-21T07:59:44.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 msgr2=0x7f23580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 0x7f23580b8b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f23680057c0 tx=0x7f23680058d0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 msgr2=0x7f236c19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c8c0 tx=0x7f235c00cd80 comp rx=0 tx=0).stop 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 shutdown_connections 2024-09-21T07:59:44.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f23580b6620 0x7f23580b8b30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f236c10de20 0x7f236c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f236c1052a0 0x7f236c19cb70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 --2- 172.21.15.6:0/1029048494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f236c104870 0x7f236c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 >> 172.21.15.6:0/1029048494 conn(0x7f236c079730 msgr2=0x7f236c109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 shutdown_connections 2024-09-21T07:59:44.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:44.711+0000 7f2373285640 1 -- 172.21.15.6:0/1029048494 wait complete. 2024-09-21T07:59:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:44 smithi145 ceph-mon[34049]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T07:59:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:44 smithi006 ceph-mon[30970]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T07:59:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:45.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-21T07:59:43.538589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655264,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":127,"num_read_kb":157,"num_write":206,"num_write_kb":2243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352012,"kb_used_data":11060,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589812,"statfs":{"total":1151940427776,"available":1151579967488,"internally_reserved":0,"allocated":11325440,"data_stored":7713002,"data_compressed":391689,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60256,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":75,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003996"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.458738+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T07:59:03.458738+0000","last_peered":"2024-09-21T07:59:03.458738+0000","last_clean":"2024-09-21T07:59:03.458738+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T07:59:03.458738+0000","last_undegraded":"2024-09-21T07:59:03.458738+0000","last_fullsized":"2024-09-21T07:59:03.458738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445067+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T07:59:03.445067+0000","last_peered":"2024-09-21T07:59:03.445067+0000","last_clean":"2024-09-21T07:59:03.445067+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T07:59:03.445067+0000","last_undegraded":"2024-09-21T07:59:03.445067+0000","last_fullsized":"2024-09-21T07:59:03.445067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443273+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T07:59:03.443273+0000","last_peered":"2024-09-21T07:59:03.443273+0000","last_clean":"2024-09-21T07:59:03.443273+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T07:59:03.443273+0000","last_undegraded":"2024-09-21T07:59:03.443273+0000","last_fullsized":"2024-09-21T07:59:03.443273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445885+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T07:59:03.445885+0000","last_peered":"2024-09-21T07:59:03.445885+0000","last_clean":"2024-09-21T07:59:03.445885+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T07:59:03.445885+0000","last_undegraded":"2024-09-21T07:59:03.445885+0000","last_fullsized":"2024-09-21T07:59:03.445885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444986+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T07:59:03.444986+0000","last_peered":"2024-09-21T07:59:03.444986+0000","last_clean":"2024-09-21T07:59:03.444986+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T07:59:03.444986+0000","last_undegraded":"2024-09-21T07:59:03.444986+0000","last_fullsized":"2024-09-21T07:59:03.444986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.451686+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T07:59:03.451686+0000","last_peered":"2024-09-21T07:59:03.451686+0000","last_clean":"2024-09-21T07:59:03.451686+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T07:59:03.451686+0000","last_undegraded":"2024-09-21T07:59:03.451686+0000","last_fullsized":"2024-09-21T07:59:03.451686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440968+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T07:59:03.440968+0000","last_peered":"2024-09-21T07:59:03.440968+0000","last_clean":"2024-09-21T07:59:03.440968+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T07:59:03.440968+0000","last_undegraded":"2024-09-21T07:59:03.440968+0000","last_fullsized":"2024-09-21T07:59:03.440968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705125+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T07:59:03.705125+0000","last_peered":"2024-09-21T07:59:03.705125+0000","last_clean":"2024-09-21T07:59:03.705125+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T07:59:03.705125+0000","last_undegraded":"2024-09-21T07:59:03.705125+0000","last_fullsized":"2024-09-21T07:59:03.705125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452945+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T07:59:03.452945+0000","last_peered":"2024-09-21T07:59:03.452945+0000","last_clean":"2024-09-21T07:59:03.452945+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T07:59:03.452945+0000","last_undegraded":"2024-09-21T07:59:03.452945+0000","last_fullsized":"2024-09-21T07:59:03.452945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440780+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T07:59:03.440780+0000","last_peered":"2024-09-21T07:59:03.440780+0000","last_clean":"2024-09-21T07:59:03.440780+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T07:59:03.440780+0000","last_undegraded":"2024-09-21T07:59:03.440780+0000","last_fullsized":"2024-09-21T07:59:03.440780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444538+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T07:59:03.444538+0000","last_peered":"2024-09-21T07:59:03.444538+0000","last_clean":"2024-09-21T07:59:03.444538+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T07:59:03.444538+0000","last_undegraded":"2024-09-21T07:59:03.444538+0000","last_fullsized":"2024-09-21T07:59:03.444538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452286+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T07:59:03.452286+0000","last_peered":"2024-09-21T07:59:03.452286+0000","last_clean":"2024-09-21T07:59:03.452286+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T07:59:03.452286+0000","last_undegraded":"2024-09-21T07:59:03.452286+0000","last_fullsized":"2024-09-21T07:59:03.452286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443359+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T07:59:03.443359+0000","last_peered":"2024-09-21T07:59:03.443359+0000","last_clean":"2024-09-21T07:59:03.443359+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T07:59:03.443359+0000","last_undegraded":"2024-09-21T07:59:03.443359+0000","last_fullsized":"2024-09-21T07:59:03.443359+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440516+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T07:59:03.440516+0000","last_peered":"2024-09-21T07:59:03.440516+0000","last_clean":"2024-09-21T07:59:03.440516+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T07:59:03.440516+0000","last_undegraded":"2024-09-21T07:59:03.440516+0000","last_fullsized":"2024-09-21T07:59:03.440516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452288+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T07:59:03.452288+0000","last_peered":"2024-09-21T07:59:03.452288+0000","last_clean":"2024-09-21T07:59:03.452288+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T07:59:03.452288+0000","last_undegraded":"2024-09-21T07:59:03.452288+0000","last_fullsized":"2024-09-21T07:59:03.452288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443243+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T07:59:03.443243+0000","last_peered":"2024-09-21T07:59:03.443243+0000","last_clean":"2024-09-21T07:59:03.443243+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T07:59:03.443243+0000","last_undegraded":"2024-09-21T07:59:03.443243+0000","last_fullsized":"2024-09-21T07:59:03.443243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443387+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T07:59:03.443387+0000","last_peered":"2024-09-21T07:59:03.443387+0000","last_clean":"2024-09-21T07:59:03.443387+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T07:59:03.443387+0000","last_undegraded":"2024-09-21T07:59:03.443387+0000","last_fullsized":"2024-09-21T07:59:03.443387+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452566+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T07:59:03.452566+0000","last_peered":"2024-09-21T07:59:03.452566+0000","last_clean":"2024-09-21T07:59:03.452566+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T07:59:03.452566+0000","last_undegraded":"2024-09-21T07:59:03.452566+0000","last_fullsized":"2024-09-21T07:59:03.452566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445380+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T07:59:03.445380+0000","last_peered":"2024-09-21T07:59:03.445380+0000","last_clean":"2024-09-21T07:59:03.445380+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T07:59:03.445380+0000","last_undegraded":"2024-09-21T07:59:03.445380+0000","last_fullsized":"2024-09-21T07:59:03.445380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444128+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T07:59:03.444128+0000","last_peered":"2024-09-21T07:59:03.444128+0000","last_clean":"2024-09-21T07:59:03.444128+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T07:59:03.444128+0000","last_undegraded":"2024-09-21T07:59:03.444128+0000","last_fullsized":"2024-09-21T07:59:03.444128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445284+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T07:59:03.445284+0000","last_peered":"2024-09-21T07:59:03.445284+0000","last_clean":"2024-09-21T07:59:03.445284+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T07:59:03.445284+0000","last_undegraded":"2024-09-21T07:59:03.445284+0000","last_fullsized":"2024-09-21T07:59:03.445284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440040+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T07:59:03.440040+0000","last_peered":"2024-09-21T07:59:03.440040+0000","last_clean":"2024-09-21T07:59:03.440040+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T07:59:03.440040+0000","last_undegraded":"2024-09-21T07:59:03.440040+0000","last_fullsized":"2024-09-21T07:59:03.440040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705434+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T07:59:03.705434+0000","last_peered":"2024-09-21T07:59:03.705434+0000","last_clean":"2024-09-21T07:59:03.705434+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T07:59:03.705434+0000","last_undegraded":"2024-09-21T07:59:03.705434+0000","last_fullsized":"2024-09-21T07:59:03.705434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452491+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T07:59:03.452491+0000","last_peered":"2024-09-21T07:59:03.452491+0000","last_clean":"2024-09-21T07:59:03.452491+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T07:59:03.452491+0000","last_undegraded":"2024-09-21T07:59:03.452491+0000","last_fullsized":"2024-09-21T07:59:03.452491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445522+0000","last_change":"2024-09-21T07:58:45.365398+0000","last_active":"2024-09-21T07:59:03.445522+0000","last_peered":"2024-09-21T07:59:03.445522+0000","last_clean":"2024-09-21T07:59:03.445522+0000","last_became_active":"2024-09-21T07:58:45.365056+0000","last_became_peered":"2024-09-21T07:58:45.365056+0000","last_unstale":"2024-09-21T07:59:03.445522+0000","last_undegraded":"2024-09-21T07:59:03.445522+0000","last_fullsized":"2024-09-21T07:59:03.445522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:43.623974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452590+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T07:59:03.452590+0000","last_peered":"2024-09-21T07:59:03.452590+0000","last_clean":"2024-09-21T07:59:03.452590+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T07:59:03.452590+0000","last_undegraded":"2024-09-21T07:59:03.452590+0000","last_fullsized":"2024-09-21T07:59:03.452590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443526+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T07:59:03.443526+0000","last_peered":"2024-09-21T07:59:03.443526+0000","last_clean":"2024-09-21T07:59:03.443526+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T07:59:03.443526+0000","last_undegraded":"2024-09-21T07:59:03.443526+0000","last_fullsized":"2024-09-21T07:59:03.443526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445321+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T07:59:03.445321+0000","last_peered":"2024-09-21T07:59:03.445321+0000","last_clean":"2024-09-21T07:59:03.445321+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T07:59:03.445321+0000","last_undegraded":"2024-09-21T07:59:03.445321+0000","last_fullsized":"2024-09-21T07:59:03.445321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:38.360884+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T07:59:38.360884+0000","last_peered":"2024-09-21T07:59:38.360884+0000","last_clean":"2024-09-21T07:59:38.360884+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T07:59:38.360884+0000","last_undegraded":"2024-09-21T07:59:38.360884+0000","last_fullsized":"2024-09-21T07:59:38.360884+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443252+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T07:59:03.443252+0000","last_peered":"2024-09-21T07:59:03.443252+0000","last_clean":"2024-09-21T07:59:03.443252+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T07:59:03.443252+0000","last_undegraded":"2024-09-21T07:59:03.443252+0000","last_fullsized":"2024-09-21T07:59:03.443252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439993+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T07:59:03.439993+0000","last_peered":"2024-09-21T07:59:03.439993+0000","last_clean":"2024-09-21T07:59:03.439993+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T07:59:03.439993+0000","last_undegraded":"2024-09-21T07:59:03.439993+0000","last_fullsized":"2024-09-21T07:59:03.439993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.441105+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T07:59:03.441105+0000","last_peered":"2024-09-21T07:59:03.441105+0000","last_clean":"2024-09-21T07:59:03.441105+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T07:59:03.441105+0000","last_undegraded":"2024-09-21T07:59:03.441105+0000","last_fullsized":"2024-09-21T07:59:03.441105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444436+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T07:59:03.444436+0000","last_peered":"2024-09-21T07:59:03.444436+0000","last_clean":"2024-09-21T07:59:03.444436+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T07:59:03.444436+0000","last_undegraded":"2024-09-21T07:59:03.444436+0000","last_fullsized":"2024-09-21T07:59:03.444436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442870+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T07:59:03.442870+0000","last_peered":"2024-09-21T07:59:03.442870+0000","last_clean":"2024-09-21T07:59:03.442870+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T07:59:03.442870+0000","last_undegraded":"2024-09-21T07:59:03.442870+0000","last_fullsized":"2024-09-21T07:59:03.442870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443701+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T07:59:03.443701+0000","last_peered":"2024-09-21T07:59:03.443701+0000","last_clean":"2024-09-21T07:59:03.443701+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T07:59:03.443701+0000","last_undegraded":"2024-09-21T07:59:03.443701+0000","last_fullsized":"2024-09-21T07:59:03.443701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440079+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T07:59:03.440079+0000","last_peered":"2024-09-21T07:59:03.440079+0000","last_clean":"2024-09-21T07:59:03.440079+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T07:59:03.440079+0000","last_undegraded":"2024-09-21T07:59:03.440079+0000","last_fullsized":"2024-09-21T07:59:03.440079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443427+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T07:59:03.443427+0000","last_peered":"2024-09-21T07:59:03.443427+0000","last_clean":"2024-09-21T07:59:03.443427+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T07:59:03.443427+0000","last_undegraded":"2024-09-21T07:59:03.443427+0000","last_fullsized":"2024-09-21T07:59:03.443427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443578+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T07:59:03.443578+0000","last_peered":"2024-09-21T07:59:03.443578+0000","last_clean":"2024-09-21T07:59:03.443578+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T07:59:03.443578+0000","last_undegraded":"2024-09-21T07:59:03.443578+0000","last_fullsized":"2024-09-21T07:59:03.443578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439727+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T07:59:03.439727+0000","last_peered":"2024-09-21T07:59:03.439727+0000","last_clean":"2024-09-21T07:59:03.439727+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T07:59:03.439727+0000","last_undegraded":"2024-09-21T07:59:03.439727+0000","last_fullsized":"2024-09-21T07:59:03.439727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445084+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T07:59:03.445084+0000","last_peered":"2024-09-21T07:59:03.445084+0000","last_clean":"2024-09-21T07:59:03.445084+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T07:59:03.445084+0000","last_undegraded":"2024-09-21T07:59:03.445084+0000","last_fullsized":"2024-09-21T07:59:03.445084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439334+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T07:59:03.439334+0000","last_peered":"2024-09-21T07:59:03.439334+0000","last_clean":"2024-09-21T07:59:03.439334+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T07:59:03.439334+0000","last_undegraded":"2024-09-21T07:59:03.439334+0000","last_fullsized":"2024-09-21T07:59:03.439334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440221+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T07:59:03.440221+0000","last_peered":"2024-09-21T07:59:03.440221+0000","last_clean":"2024-09-21T07:59:03.440221+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T07:59:03.440221+0000","last_undegraded":"2024-09-21T07:59:03.440221+0000","last_fullsized":"2024-09-21T07:59:03.440221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439186+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T07:59:03.439186+0000","last_peered":"2024-09-21T07:59:03.439186+0000","last_clean":"2024-09-21T07:59:03.439186+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T07:59:03.439186+0000","last_undegraded":"2024-09-21T07:59:03.439186+0000","last_fullsized":"2024-09-21T07:59:03.439186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443060+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T07:59:03.443060+0000","last_peered":"2024-09-21T07:59:03.443060+0000","last_clean":"2024-09-21T07:59:03.443060+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T07:59:03.443060+0000","last_undegraded":"2024-09-21T07:59:03.443060+0000","last_fullsized":"2024-09-21T07:59:03.443060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450388+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T07:59:03.450388+0000","last_peered":"2024-09-21T07:59:03.450388+0000","last_clean":"2024-09-21T07:59:03.450388+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T07:59:03.450388+0000","last_undegraded":"2024-09-21T07:59:03.450388+0000","last_fullsized":"2024-09-21T07:59:03.450388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444394+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T07:59:03.444394+0000","last_peered":"2024-09-21T07:59:03.444394+0000","last_clean":"2024-09-21T07:59:03.444394+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T07:59:03.444394+0000","last_undegraded":"2024-09-21T07:59:03.444394+0000","last_fullsized":"2024-09-21T07:59:03.444394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453176+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T07:59:03.453176+0000","last_peered":"2024-09-21T07:59:03.453176+0000","last_clean":"2024-09-21T07:59:03.453176+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T07:59:03.453176+0000","last_undegraded":"2024-09-21T07:59:03.453176+0000","last_fullsized":"2024-09-21T07:59:03.453176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":108,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443280+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T07:59:03.443280+0000","last_peered":"2024-09-21T07:59:03.443280+0000","last_clean":"2024-09-21T07:59:03.443280+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T07:59:03.443280+0000","last_undegraded":"2024-09-21T07:59:03.443280+0000","last_fullsized":"2024-09-21T07:59:03.443280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453003+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T07:59:03.453003+0000","last_peered":"2024-09-21T07:59:03.453003+0000","last_clean":"2024-09-21T07:59:03.453003+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T07:59:03.453003+0000","last_undegraded":"2024-09-21T07:59:03.453003+0000","last_fullsized":"2024-09-21T07:59:03.453003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444151+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T07:59:03.444151+0000","last_peered":"2024-09-21T07:59:03.444151+0000","last_clean":"2024-09-21T07:59:03.444151+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T07:59:03.444151+0000","last_undegraded":"2024-09-21T07:59:03.444151+0000","last_fullsized":"2024-09-21T07:59:03.444151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444352+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T07:59:03.444352+0000","last_peered":"2024-09-21T07:59:03.444352+0000","last_clean":"2024-09-21T07:59:03.444352+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T07:59:03.444352+0000","last_undegraded":"2024-09-21T07:59:03.444352+0000","last_fullsized":"2024-09-21T07:59:03.444352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.704956+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T07:59:03.704956+0000","last_peered":"2024-09-21T07:59:03.704956+0000","last_clean":"2024-09-21T07:59:03.704956+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T07:59:03.704956+0000","last_undegraded":"2024-09-21T07:59:03.704956+0000","last_fullsized":"2024-09-21T07:59:03.704956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442999+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T07:59:03.442999+0000","last_peered":"2024-09-21T07:59:03.442999+0000","last_clean":"2024-09-21T07:59:03.442999+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T07:59:03.442999+0000","last_undegraded":"2024-09-21T07:59:03.442999+0000","last_fullsized":"2024-09-21T07:59:03.442999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445685+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T07:59:03.445685+0000","last_peered":"2024-09-21T07:59:03.445685+0000","last_clean":"2024-09-21T07:59:03.445685+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T07:59:03.445685+0000","last_undegraded":"2024-09-21T07:59:03.445685+0000","last_fullsized":"2024-09-21T07:59:03.445685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444065+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T07:59:03.444065+0000","last_peered":"2024-09-21T07:59:03.444065+0000","last_clean":"2024-09-21T07:59:03.444065+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T07:59:03.444065+0000","last_undegraded":"2024-09-21T07:59:03.444065+0000","last_fullsized":"2024-09-21T07:59:03.444065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444029+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T07:59:03.444029+0000","last_peered":"2024-09-21T07:59:03.444029+0000","last_clean":"2024-09-21T07:59:03.444029+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T07:59:03.444029+0000","last_undegraded":"2024-09-21T07:59:03.444029+0000","last_fullsized":"2024-09-21T07:59:03.444029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440104+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T07:59:03.440104+0000","last_peered":"2024-09-21T07:59:03.440104+0000","last_clean":"2024-09-21T07:59:03.440104+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T07:59:03.440104+0000","last_undegraded":"2024-09-21T07:59:03.440104+0000","last_fullsized":"2024-09-21T07:59:03.440104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443043+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T07:59:03.443043+0000","last_peered":"2024-09-21T07:59:03.443043+0000","last_clean":"2024-09-21T07:59:03.443043+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T07:59:03.443043+0000","last_undegraded":"2024-09-21T07:59:03.443043+0000","last_fullsized":"2024-09-21T07:59:03.443043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445131+0000","last_change":"2024-09-21T07:58:45.364547+0000","last_active":"2024-09-21T07:59:03.445131+0000","last_peered":"2024-09-21T07:59:03.445131+0000","last_clean":"2024-09-21T07:59:03.445131+0000","last_became_active":"2024-09-21T07:58:45.364193+0000","last_became_peered":"2024-09-21T07:58:45.364193+0000","last_unstale":"2024-09-21T07:59:03.445131+0000","last_undegraded":"2024-09-21T07:59:03.445131+0000","last_fullsized":"2024-09-21T07:59:03.445131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:33.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:04.718407+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T07:59:04.718407+0000","last_peered":"2024-09-21T07:59:04.718407+0000","last_clean":"2024-09-21T07:59:04.718407+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T07:59:04.718407+0000","last_undegraded":"2024-09-21T07:59:04.718407+0000","last_fullsized":"2024-09-21T07:59:04.718407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442496+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T07:59:03.442496+0000","last_peered":"2024-09-21T07:59:03.442496+0000","last_clean":"2024-09-21T07:59:03.442496+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T07:59:03.442496+0000","last_undegraded":"2024-09-21T07:59:03.442496+0000","last_fullsized":"2024-09-21T07:59:03.442496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442783+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T07:59:03.442783+0000","last_peered":"2024-09-21T07:59:03.442783+0000","last_clean":"2024-09-21T07:59:03.442783+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T07:59:03.442783+0000","last_undegraded":"2024-09-21T07:59:03.442783+0000","last_fullsized":"2024-09-21T07:59:03.442783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.714271+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T07:59:03.714271+0000","last_peered":"2024-09-21T07:59:03.714271+0000","last_clean":"2024-09-21T07:59:03.714271+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T07:59:03.714271+0000","last_undegraded":"2024-09-21T07:59:03.714271+0000","last_fullsized":"2024-09-21T07:59:03.714271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440092+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T07:59:03.440092+0000","last_peered":"2024-09-21T07:59:03.440092+0000","last_clean":"2024-09-21T07:59:03.440092+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T07:59:03.440092+0000","last_undegraded":"2024-09-21T07:59:03.440092+0000","last_fullsized":"2024-09-21T07:59:03.440092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442835+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T07:59:03.442835+0000","last_peered":"2024-09-21T07:59:03.442835+0000","last_clean":"2024-09-21T07:59:03.442835+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T07:59:03.442835+0000","last_undegraded":"2024-09-21T07:59:03.442835+0000","last_fullsized":"2024-09-21T07:59:03.442835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452213+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T07:59:03.452213+0000","last_peered":"2024-09-21T07:59:03.452213+0000","last_clean":"2024-09-21T07:59:03.452213+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T07:59:03.452213+0000","last_undegraded":"2024-09-21T07:59:03.452213+0000","last_fullsized":"2024-09-21T07:59:03.452213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445411+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T07:59:03.445411+0000","last_peered":"2024-09-21T07:59:03.445411+0000","last_clean":"2024-09-21T07:59:03.445411+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T07:59:03.445411+0000","last_undegraded":"2024-09-21T07:59:03.445411+0000","last_fullsized":"2024-09-21T07:59:03.445411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444494+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T07:59:03.444494+0000","last_peered":"2024-09-21T07:59:03.444494+0000","last_clean":"2024-09-21T07:59:03.444494+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T07:59:03.444494+0000","last_undegraded":"2024-09-21T07:59:03.444494+0000","last_fullsized":"2024-09-21T07:59:03.444494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443077+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T07:59:03.443077+0000","last_peered":"2024-09-21T07:59:03.443077+0000","last_clean":"2024-09-21T07:59:03.443077+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T07:59:03.443077+0000","last_undegraded":"2024-09-21T07:59:03.443077+0000","last_fullsized":"2024-09-21T07:59:03.443077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444586+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T07:59:03.444586+0000","last_peered":"2024-09-21T07:59:03.444586+0000","last_clean":"2024-09-21T07:59:03.444586+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T07:59:03.444586+0000","last_undegraded":"2024-09-21T07:59:03.444586+0000","last_fullsized":"2024-09-21T07:59:03.444586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439466+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T07:59:03.439466+0000","last_peered":"2024-09-21T07:59:03.439466+0000","last_clean":"2024-09-21T07:59:03.439466+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T07:59:03.439466+0000","last_undegraded":"2024-09-21T07:59:03.439466+0000","last_fullsized":"2024-09-21T07:59:03.439466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444284+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T07:59:03.444284+0000","last_peered":"2024-09-21T07:59:03.444284+0000","last_clean":"2024-09-21T07:59:03.444284+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T07:59:03.444284+0000","last_undegraded":"2024-09-21T07:59:03.444284+0000","last_fullsized":"2024-09-21T07:59:03.444284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444414+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T07:59:03.444414+0000","last_peered":"2024-09-21T07:59:03.444414+0000","last_clean":"2024-09-21T07:59:03.444414+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T07:59:03.444414+0000","last_undegraded":"2024-09-21T07:59:03.444414+0000","last_fullsized":"2024-09-21T07:59:03.444414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440830+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T07:59:03.440830+0000","last_peered":"2024-09-21T07:59:03.440830+0000","last_clean":"2024-09-21T07:59:03.440830+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T07:59:03.440830+0000","last_undegraded":"2024-09-21T07:59:03.440830+0000","last_fullsized":"2024-09-21T07:59:03.440830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:42.703110+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T07:59:42.703110+0000","last_peered":"2024-09-21T07:59:42.703110+0000","last_clean":"2024-09-21T07:59:42.703110+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T07:59:42.703110+0000","last_undegraded":"2024-09-21T07:59:42.703110+0000","last_fullsized":"2024-09-21T07:59:42.703110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":82,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450144+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T07:59:03.450144+0000","last_peered":"2024-09-21T07:59:03.450144+0000","last_clean":"2024-09-21T07:59:03.450144+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T07:59:03.450144+0000","last_undegraded":"2024-09-21T07:59:03.450144+0000","last_fullsized":"2024-09-21T07:59:03.450144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705197+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T07:59:03.705197+0000","last_peered":"2024-09-21T07:59:03.705197+0000","last_clean":"2024-09-21T07:59:03.705197+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T07:59:03.705197+0000","last_undegraded":"2024-09-21T07:59:03.705197+0000","last_fullsized":"2024-09-21T07:59:03.705197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445501+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T07:59:03.445501+0000","last_peered":"2024-09-21T07:59:03.445501+0000","last_clean":"2024-09-21T07:59:03.445501+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T07:59:03.445501+0000","last_undegraded":"2024-09-21T07:59:03.445501+0000","last_fullsized":"2024-09-21T07:59:03.445501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.453031+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T07:59:03.453031+0000","last_peered":"2024-09-21T07:59:03.453031+0000","last_clean":"2024-09-21T07:59:03.453031+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T07:59:03.453031+0000","last_undegraded":"2024-09-21T07:59:03.453031+0000","last_fullsized":"2024-09-21T07:59:03.453031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445114+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T07:59:03.445114+0000","last_peered":"2024-09-21T07:59:03.445114+0000","last_clean":"2024-09-21T07:59:03.445114+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T07:59:03.445114+0000","last_undegraded":"2024-09-21T07:59:03.445114+0000","last_fullsized":"2024-09-21T07:59:03.445114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444216+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T07:59:03.444216+0000","last_peered":"2024-09-21T07:59:03.444216+0000","last_clean":"2024-09-21T07:59:03.444216+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T07:59:03.444216+0000","last_undegraded":"2024-09-21T07:59:03.444216+0000","last_fullsized":"2024-09-21T07:59:03.444216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.456084+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T07:59:03.456084+0000","last_peered":"2024-09-21T07:59:03.456084+0000","last_clean":"2024-09-21T07:59:03.456084+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T07:59:03.456084+0000","last_undegraded":"2024-09-21T07:59:03.456084+0000","last_fullsized":"2024-09-21T07:59:03.456084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705586+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T07:59:03.705586+0000","last_peered":"2024-09-21T07:59:03.705586+0000","last_clean":"2024-09-21T07:59:03.705586+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T07:59:03.705586+0000","last_undegraded":"2024-09-21T07:59:03.705586+0000","last_fullsized":"2024-09-21T07:59:03.705586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.442869+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T07:59:03.442869+0000","last_peered":"2024-09-21T07:59:03.442869+0000","last_clean":"2024-09-21T07:59:03.442869+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T07:59:03.442869+0000","last_undegraded":"2024-09-21T07:59:03.442869+0000","last_fullsized":"2024-09-21T07:59:03.442869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443813+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T07:59:03.443813+0000","last_peered":"2024-09-21T07:59:03.443813+0000","last_clean":"2024-09-21T07:59:03.443813+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T07:59:03.443813+0000","last_undegraded":"2024-09-21T07:59:03.443813+0000","last_fullsized":"2024-09-21T07:59:03.443813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445264+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T07:59:03.445264+0000","last_peered":"2024-09-21T07:59:03.445264+0000","last_clean":"2024-09-21T07:59:03.445264+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T07:59:03.445264+0000","last_undegraded":"2024-09-21T07:59:03.445264+0000","last_fullsized":"2024-09-21T07:59:03.445264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443343+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T07:59:03.443343+0000","last_peered":"2024-09-21T07:59:03.443343+0000","last_clean":"2024-09-21T07:59:03.443343+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T07:59:03.443343+0000","last_undegraded":"2024-09-21T07:59:03.443343+0000","last_fullsized":"2024-09-21T07:59:03.443343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445279+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T07:59:03.445279+0000","last_peered":"2024-09-21T07:59:03.445279+0000","last_clean":"2024-09-21T07:59:03.445279+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T07:59:03.445279+0000","last_undegraded":"2024-09-21T07:59:03.445279+0000","last_fullsized":"2024-09-21T07:59:03.445279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447239+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T07:59:03.447239+0000","last_peered":"2024-09-21T07:59:03.447239+0000","last_clean":"2024-09-21T07:59:03.447239+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T07:59:03.447239+0000","last_undegraded":"2024-09-21T07:59:03.447239+0000","last_fullsized":"2024-09-21T07:59:03.447239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443541+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T07:59:03.443541+0000","last_peered":"2024-09-21T07:59:03.443541+0000","last_clean":"2024-09-21T07:59:03.443541+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T07:59:03.443541+0000","last_undegraded":"2024-09-21T07:59:03.443541+0000","last_fullsized":"2024-09-21T07:59:03.443541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439202+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T07:59:03.439202+0000","last_peered":"2024-09-21T07:59:03.439202+0000","last_clean":"2024-09-21T07:59:03.439202+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T07:59:03.439202+0000","last_undegraded":"2024-09-21T07:59:03.439202+0000","last_fullsized":"2024-09-21T07:59:03.439202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443529+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T07:59:03.443529+0000","last_peered":"2024-09-21T07:59:03.443529+0000","last_clean":"2024-09-21T07:59:03.443529+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T07:59:03.443529+0000","last_undegraded":"2024-09-21T07:59:03.443529+0000","last_fullsized":"2024-09-21T07:59:03.443529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443294+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T07:59:03.443294+0000","last_peered":"2024-09-21T07:59:03.443294+0000","last_clean":"2024-09-21T07:59:03.443294+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T07:59:03.443294+0000","last_undegraded":"2024-09-21T07:59:03.443294+0000","last_fullsized":"2024-09-21T07:59:03.443294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445049+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T07:59:03.445049+0000","last_peered":"2024-09-21T07:59:03.445049+0000","last_clean":"2024-09-21T07:59:03.445049+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T07:59:03.445049+0000","last_undegraded":"2024-09-21T07:59:03.445049+0000","last_fullsized":"2024-09-21T07:59:03.445049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.454917+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T07:59:03.454917+0000","last_peered":"2024-09-21T07:59:03.454917+0000","last_clean":"2024-09-21T07:59:03.454917+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T07:59:03.454917+0000","last_undegraded":"2024-09-21T07:59:03.454917+0000","last_fullsized":"2024-09-21T07:59:03.454917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440210+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T07:59:03.440210+0000","last_peered":"2024-09-21T07:59:03.440210+0000","last_clean":"2024-09-21T07:59:03.440210+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T07:59:03.440210+0000","last_undegraded":"2024-09-21T07:59:03.440210+0000","last_fullsized":"2024-09-21T07:59:03.440210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444643+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T07:59:03.444643+0000","last_peered":"2024-09-21T07:59:03.444643+0000","last_clean":"2024-09-21T07:59:03.444643+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T07:59:03.444643+0000","last_undegraded":"2024-09-21T07:59:03.444643+0000","last_fullsized":"2024-09-21T07:59:03.444643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445263+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T07:59:03.445263+0000","last_peered":"2024-09-21T07:59:03.445263+0000","last_clean":"2024-09-21T07:59:03.445263+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T07:59:03.445263+0000","last_undegraded":"2024-09-21T07:59:03.445263+0000","last_fullsized":"2024-09-21T07:59:03.445263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443818+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T07:59:03.443818+0000","last_peered":"2024-09-21T07:59:03.443818+0000","last_clean":"2024-09-21T07:59:03.443818+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T07:59:03.443818+0000","last_undegraded":"2024-09-21T07:59:03.443818+0000","last_fullsized":"2024-09-21T07:59:03.443818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443264+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T07:59:03.443264+0000","last_peered":"2024-09-21T07:59:03.443264+0000","last_clean":"2024-09-21T07:59:03.443264+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T07:59:03.443264+0000","last_undegraded":"2024-09-21T07:59:03.443264+0000","last_fullsized":"2024-09-21T07:59:03.443264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444190+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T07:59:03.444190+0000","last_peered":"2024-09-21T07:59:03.444190+0000","last_clean":"2024-09-21T07:59:03.444190+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T07:59:03.444190+0000","last_undegraded":"2024-09-21T07:59:03.444190+0000","last_fullsized":"2024-09-21T07:59:03.444190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439899+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T07:59:03.439899+0000","last_peered":"2024-09-21T07:59:03.439899+0000","last_clean":"2024-09-21T07:59:03.439899+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T07:59:03.439899+0000","last_undegraded":"2024-09-21T07:59:03.439899+0000","last_fullsized":"2024-09-21T07:59:03.439899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.446005+0000","last_change":"2024-09-21T07:58:45.354855+0000","last_active":"2024-09-21T07:59:03.446005+0000","last_peered":"2024-09-21T07:59:03.446005+0000","last_clean":"2024-09-21T07:59:03.446005+0000","last_became_active":"2024-09-21T07:58:45.354501+0000","last_became_peered":"2024-09-21T07:58:45.354501+0000","last_unstale":"2024-09-21T07:59:03.446005+0000","last_undegraded":"2024-09-21T07:59:03.446005+0000","last_fullsized":"2024-09-21T07:59:03.446005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:06.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445517+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T07:59:03.445517+0000","last_peered":"2024-09-21T07:59:03.445517+0000","last_clean":"2024-09-21T07:59:03.445517+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T07:59:03.445517+0000","last_undegraded":"2024-09-21T07:59:03.445517+0000","last_fullsized":"2024-09-21T07:59:03.445517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.449110+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T07:59:03.449110+0000","last_peered":"2024-09-21T07:59:03.449110+0000","last_clean":"2024-09-21T07:59:03.449110+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T07:59:03.449110+0000","last_undegraded":"2024-09-21T07:59:03.449110+0000","last_fullsized":"2024-09-21T07:59:03.449110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443580+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T07:59:03.443580+0000","last_peered":"2024-09-21T07:59:03.443580+0000","last_clean":"2024-09-21T07:59:03.443580+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T07:59:03.443580+0000","last_undegraded":"2024-09-21T07:59:03.443580+0000","last_fullsized":"2024-09-21T07:59:03.443580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443996+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T07:59:03.443996+0000","last_peered":"2024-09-21T07:59:03.443996+0000","last_clean":"2024-09-21T07:59:03.443996+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T07:59:03.443996+0000","last_undegraded":"2024-09-21T07:59:03.443996+0000","last_fullsized":"2024-09-21T07:59:03.443996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705097+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T07:59:03.705097+0000","last_peered":"2024-09-21T07:59:03.705097+0000","last_clean":"2024-09-21T07:59:03.705097+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T07:59:03.705097+0000","last_undegraded":"2024-09-21T07:59:03.705097+0000","last_fullsized":"2024-09-21T07:59:03.705097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439849+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T07:59:03.439849+0000","last_peered":"2024-09-21T07:59:03.439849+0000","last_clean":"2024-09-21T07:59:03.439849+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T07:59:03.439849+0000","last_undegraded":"2024-09-21T07:59:03.439849+0000","last_fullsized":"2024-09-21T07:59:03.439849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444724+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T07:59:03.444724+0000","last_peered":"2024-09-21T07:59:03.444724+0000","last_clean":"2024-09-21T07:59:03.444724+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T07:59:03.444724+0000","last_undegraded":"2024-09-21T07:59:03.444724+0000","last_fullsized":"2024-09-21T07:59:03.444724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444838+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T07:59:03.444838+0000","last_peered":"2024-09-21T07:59:03.444838+0000","last_clean":"2024-09-21T07:59:03.444838+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T07:59:03.444838+0000","last_undegraded":"2024-09-21T07:59:03.444838+0000","last_fullsized":"2024-09-21T07:59:03.444838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444923+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T07:59:03.444923+0000","last_peered":"2024-09-21T07:59:03.444923+0000","last_clean":"2024-09-21T07:59:03.444923+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T07:59:03.444923+0000","last_undegraded":"2024-09-21T07:59:03.444923+0000","last_fullsized":"2024-09-21T07:59:03.444923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447524+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T07:59:03.447524+0000","last_peered":"2024-09-21T07:59:03.447524+0000","last_clean":"2024-09-21T07:59:03.447524+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T07:59:03.447524+0000","last_undegraded":"2024-09-21T07:59:03.447524+0000","last_fullsized":"2024-09-21T07:59:03.447524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705287+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T07:59:03.705287+0000","last_peered":"2024-09-21T07:59:03.705287+0000","last_clean":"2024-09-21T07:59:03.705287+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T07:59:03.705287+0000","last_undegraded":"2024-09-21T07:59:03.705287+0000","last_fullsized":"2024-09-21T07:59:03.705287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443459+0000","last_change":"2024-09-21T07:58:45.368360+0000","last_active":"2024-09-21T07:59:03.443459+0000","last_peered":"2024-09-21T07:59:03.443459+0000","last_clean":"2024-09-21T07:59:03.443459+0000","last_became_active":"2024-09-21T07:58:45.368034+0000","last_became_peered":"2024-09-21T07:58:45.368034+0000","last_unstale":"2024-09-21T07:59:03.443459+0000","last_undegraded":"2024-09-21T07:59:03.443459+0000","last_fullsized":"2024-09-21T07:59:03.443459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.483376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443741+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T07:59:03.443741+0000","last_peered":"2024-09-21T07:59:03.443741+0000","last_clean":"2024-09-21T07:59:03.443741+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T07:59:03.443741+0000","last_undegraded":"2024-09-21T07:59:03.443741+0000","last_fullsized":"2024-09-21T07:59:03.443741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.439734+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T07:59:03.439734+0000","last_peered":"2024-09-21T07:59:03.439734+0000","last_clean":"2024-09-21T07:59:03.439734+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T07:59:03.439734+0000","last_undegraded":"2024-09-21T07:59:03.439734+0000","last_fullsized":"2024-09-21T07:59:03.439734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.450293+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T07:59:03.450293+0000","last_peered":"2024-09-21T07:59:03.450293+0000","last_clean":"2024-09-21T07:59:03.450293+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T07:59:03.450293+0000","last_undegraded":"2024-09-21T07:59:03.450293+0000","last_fullsized":"2024-09-21T07:59:03.450293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444014+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T07:59:03.444014+0000","last_peered":"2024-09-21T07:59:03.444014+0000","last_clean":"2024-09-21T07:59:03.444014+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T07:59:03.444014+0000","last_undegraded":"2024-09-21T07:59:03.444014+0000","last_fullsized":"2024-09-21T07:59:03.444014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443496+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T07:59:03.443496+0000","last_peered":"2024-09-21T07:59:03.443496+0000","last_clean":"2024-09-21T07:59:03.443496+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T07:59:03.443496+0000","last_undegraded":"2024-09-21T07:59:03.443496+0000","last_fullsized":"2024-09-21T07:59:03.443496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.705634+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T07:59:03.705634+0000","last_peered":"2024-09-21T07:59:03.705634+0000","last_clean":"2024-09-21T07:59:03.705634+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T07:59:03.705634+0000","last_undegraded":"2024-09-21T07:59:03.705634+0000","last_fullsized":"2024-09-21T07:59:03.705634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443437+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T07:59:03.443437+0000","last_peered":"2024-09-21T07:59:03.443437+0000","last_clean":"2024-09-21T07:59:03.443437+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T07:59:03.443437+0000","last_undegraded":"2024-09-21T07:59:03.443437+0000","last_fullsized":"2024-09-21T07:59:03.443437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444256+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T07:59:03.444256+0000","last_peered":"2024-09-21T07:59:03.444256+0000","last_clean":"2024-09-21T07:59:03.444256+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T07:59:03.444256+0000","last_undegraded":"2024-09-21T07:59:03.444256+0000","last_fullsized":"2024-09-21T07:59:03.444256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.443447+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T07:59:03.443447+0000","last_peered":"2024-09-21T07:59:03.443447+0000","last_clean":"2024-09-21T07:59:03.443447+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T07:59:03.443447+0000","last_undegraded":"2024-09-21T07:59:03.443447+0000","last_fullsized":"2024-09-21T07:59:03.443447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.440206+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T07:59:03.440206+0000","last_peered":"2024-09-21T07:59:03.440206+0000","last_clean":"2024-09-21T07:59:03.440206+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T07:59:03.440206+0000","last_undegraded":"2024-09-21T07:59:03.440206+0000","last_fullsized":"2024-09-21T07:59:03.440206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.452580+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T07:59:03.452580+0000","last_peered":"2024-09-21T07:59:03.452580+0000","last_clean":"2024-09-21T07:59:03.452580+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T07:59:03.452580+0000","last_undegraded":"2024-09-21T07:59:03.452580+0000","last_fullsized":"2024-09-21T07:59:03.452580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.444308+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T07:59:03.444308+0000","last_peered":"2024-09-21T07:59:03.444308+0000","last_clean":"2024-09-21T07:59:03.444308+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T07:59:03.444308+0000","last_undegraded":"2024-09-21T07:59:03.444308+0000","last_fullsized":"2024-09-21T07:59:03.444308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.445389+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T07:59:03.445389+0000","last_peered":"2024-09-21T07:59:03.445389+0000","last_clean":"2024-09-21T07:59:03.445389+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T07:59:03.445389+0000","last_undegraded":"2024-09-21T07:59:03.445389+0000","last_fullsized":"2024-09-21T07:59:03.445389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T07:59:03.447490+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T07:59:03.447490+0000","last_peered":"2024-09-21T07:59:03.447490+0000","last_clean":"2024-09-21T07:59:03.447490+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T07:59:03.447490+0000","last_undegraded":"2024-09-21T07:59:03.447490+0000","last_fullsized":"2024-09-21T07:59:03.447490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64662,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":46,"num_read_kb":88,"num_write":81,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":193986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":480962,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1130688,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":485036,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":485036,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1074822,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":476262,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":1066812,"data_compressed":59559,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":480380,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":476366,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":540160,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":540126,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":476352,"data_compressed":23668,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:59:45.409 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:59:45.409 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:59:45.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:59:45.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:44 smithi119 ceph-mon[33564]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T07:59:45.410 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:45.411 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:45.411 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T07:59:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:46.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:45 smithi006 ceph-mon[30970]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 -- 172.21.15.6:0/3105563675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 msgr2=0x7f03681098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 --2- 172.21.15.6:0/3105563675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f03681098c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0350009900 tx=0x7f035002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 -- 172.21.15.6:0/3105563675 shutdown_connections 2024-09-21T07:59:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 --2- 172.21.15.6:0/3105563675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368109e00 0x7f0368110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 --2- 172.21.15.6:0/3105563675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f03681098c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 --2- 172.21.15.6:0/3105563675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368103b70 0x7f0368103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 -- 172.21.15.6:0/3105563675 >> 172.21.15.6:0/3105563675 conn(0x7f03680ff5a0 msgr2=0x7f03681019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 -- 172.21.15.6:0/3105563675 shutdown_connections 2024-09-21T07:59:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 -- 172.21.15.6:0/3105563675 wait complete. 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.163+0000 7f036d6ff640 1 Processor -- start 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 -- start start 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 0x7f036819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368109e00 0x7f036819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0368113970 con 0x7f03681094b0 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f03681137f0 con 0x7f0368103b70 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f036d6ff640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0368113af0 con 0x7f0368109e00 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f035e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f035e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34948/0 (socket says 172.21.15.6:34948) 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f035e7fc640 1 -- 172.21.15.6:0/2005551975 learned_addr learned my addr 172.21.15.6:0/2005551975 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f0366ffd640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 0x7f036819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.164+0000 7f03677fe640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368109e00 0x7f036819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 -- 172.21.15.6:0/2005551975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368109e00 msgr2=0x7f036819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368109e00 0x7f036819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 -- 172.21.15.6:0/2005551975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 msgr2=0x7f036819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 0x7f036819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 -- 172.21.15.6:0/2005551975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03681a0330 con 0x7f03681094b0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f0366ffd640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 0x7f036819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f035e7fc640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0350005940 tx=0x7f0350005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035003f030 con 0x7f03681094b0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03681a05c0 con 0x7f03681094b0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03500043d0 con 0x7f03681094b0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350035070 con 0x7f03681094b0 2024-09-21T07:59:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.165+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03680755f0 con 0x7f03681094b0 2024-09-21T07:59:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.166+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0368104df0 con 0x7f03681094b0 2024-09-21T07:59:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.168+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f0350042030 con 0x7f03681094b0 2024-09-21T07:59:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.168+0000 7f0364ff9640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 0x7f03540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.169+0000 7f0366ffd640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 0x7f03540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.169+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f0350108040 con 0x7f03681094b0 2024-09-21T07:59:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.169+0000 7f0366ffd640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 0x7f03540b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0358009fc0 tx=0x7f0358005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.172+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03500d2720 con 0x7f03681094b0 2024-09-21T07:59:46.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:45 smithi145 ceph-mon[34049]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:46.309 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:45 smithi119 ceph-mon[33564]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:59:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.436+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0368103f80 con 0x7f03681094b0 2024-09-21T07:59:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.440+0000 7f0364ff9640 1 -- 172.21.15.6:0/2005551975 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f03500d7660 con 0x7f03681094b0 2024-09-21T07:59:46.441 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-09-21T07:59:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDyfO5m2cUYGhAAYl4UwcvjU7m+sg53fSmyVQ== 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.442+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 msgr2=0x7f03540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 0x7f03540b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0358009fc0 tx=0x7f0358005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 msgr2=0x7f036819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0350005940 tx=0x7f0350005e10 comp rx=0 tx=0).stop 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 shutdown_connections 2024-09-21T07:59:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f03540b65f0 0x7f03540b8b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0368109e00 0x7f036819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03681094b0 0x7f036819a960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 --2- 172.21.15.6:0/2005551975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0368103b70 0x7f036819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 >> 172.21.15.6:0/2005551975 conn(0x7f03680ff5a0 msgr2=0x7f03681019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 shutdown_connections 2024-09-21T07:59:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:46.443+0000 7f036d6ff640 1 -- 172.21.15.6:0/2005551975 wait complete. 2024-09-21T07:59:47.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:46 smithi006 ceph-mon[30970]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-21T07:59:47.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:46 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:59:47.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:46 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:59:47.081 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T07:59:47.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:59:47.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:59:47.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:59:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:46 smithi145 ceph-mon[34049]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-21T07:59:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:46 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:59:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:46 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:59:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:46 smithi119 ceph-mon[33564]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-21T07:59:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:46 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:59:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:46 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2005551975' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:59:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 -- 172.21.15.6:0/103175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2604105380 msgr2=0x7f260410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 --2- 172.21.15.6:0/103175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2604105380 0x7f260410d8d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009900 tx=0x7f25f802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 -- 172.21.15.6:0/103175206 shutdown_connections 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 --2- 172.21.15.6:0/103175206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260410de60 0x7f2604110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 --2- 172.21.15.6:0/103175206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2604105380 0x7f260410d8d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 --2- 172.21.15.6:0/103175206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 0x7f2604104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 -- 172.21.15.6:0/103175206 >> 172.21.15.6:0/103175206 conn(0x7f2604079760 msgr2=0x7f2604079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 -- 172.21.15.6:0/103175206 shutdown_connections 2024-09-21T07:59:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.925+0000 7f26093ca640 1 -- 172.21.15.6:0/103175206 wait complete. 2024-09-21T07:59:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 Processor -- start 2024-09-21T07:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 -- start start 2024-09-21T07:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 0x7f2604102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2604105380 0x7f2604102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2604113950 con 0x7f260410de60 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26041137d0 con 0x7f2604105380 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.926+0000 7f26093ca640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2604113ad0 con 0x7f2604104a30 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f2602ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 0x7f2604102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33972/0 (socket says 172.21.15.6:33972) 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 -- 172.21.15.6:0/464104953 learned_addr learned my addr 172.21.15.6:0/464104953 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26027fc640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2604105380 0x7f2604102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 -- 172.21.15.6:0/464104953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 msgr2=0x7f2604102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 0x7f2604102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 -- 172.21.15.6:0/464104953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2604105380 msgr2=0x7f2604102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2604105380 0x7f2604102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 -- 172.21.15.6:0/464104953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26041a86c0 con 0x7f260410de60 2024-09-21T07:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26037fe640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e970 tx=0x7f25fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00ccc0 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25fc00ce60 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26041a89b0 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc010430 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.927+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26041a8e70 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.929+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260406c1f0 con 0x7f260410de60 2024-09-21T07:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.930+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f25fc004ef0 con 0x7f260410de60 2024-09-21T07:59:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.931+0000 7f25ebfff640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 0x7f25ec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.931+0000 7f2602ffd640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 0x7f25ec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.931+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f25fc0e7ed0 con 0x7f260410de60 2024-09-21T07:59:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.932+0000 7f2602ffd640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 0x7f25ec0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26041041c0 tx=0x7f25f4009670 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:47.934+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25fc056710 con 0x7f260410de60 2024-09-21T07:59:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.121+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2604104e40 con 0x7f260410de60 2024-09-21T07:59:48.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.121+0000 7f25ebfff640 1 -- 172.21.15.6:0/464104953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f2604104e40 con 0x7f260410de60 2024-09-21T07:59:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 msgr2=0x7f25ec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 0x7f25ec0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26041041c0 tx=0x7f25f4009670 comp rx=0 tx=0).stop 2024-09-21T07:59:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 msgr2=0x7f26041031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e970 tx=0x7f25fc00ed70 comp rx=0 tx=0).stop 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 shutdown_connections 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25ec0b65f0 0x7f25ec0b8b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260410de60 0x7f26041031f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2604105380 0x7f2604102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 --2- 172.21.15.6:0/464104953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2604104a30 0x7f2604102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 >> 172.21.15.6:0/464104953 conn(0x7f2604079760 msgr2=0x7f26041009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 shutdown_connections 2024-09-21T07:59:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:48.125+0000 7f26093ca640 1 -- 172.21.15.6:0/464104953 wait complete. 2024-09-21T07:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout:[{"version":53,"timestamp":"2024-09-21T07:58:35.275448+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:59:48.757 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T07:59:48.758 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:59:48.758 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:59:48.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:48 smithi145 ceph-mon[34049]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-21T07:59:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:48 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/464104953' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:59:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:48 smithi006 ceph-mon[30970]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-21T07:59:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:48 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/464104953' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:59:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:48 smithi119 ceph-mon[33564]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-21T07:59:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:48 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/464104953' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 -- 172.21.15.6:0/391048596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 msgr2=0x7fed34110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 --2- 172.21.15.6:0/391048596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed34110320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009ca0 tx=0x7fed2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 -- 172.21.15.6:0/391048596 shutdown_connections 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 --2- 172.21.15.6:0/391048596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 0x7fed3410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 --2- 172.21.15.6:0/391048596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed34110320 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 --2- 172.21.15.6:0/391048596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 0x7fed34104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 -- 172.21.15.6:0/391048596 >> 172.21.15.6:0/391048596 conn(0x7fed34079740 msgr2=0x7fed34079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 -- 172.21.15.6:0/391048596 shutdown_connections 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.499+0000 7fed39680640 1 -- 172.21.15.6:0/391048596 wait complete. 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 Processor -- start 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 -- start start 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 0x7fed3419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 0x7fed3419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fed341139b0 con 0x7fed3410de10 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed34113830 con 0x7fed34104860 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.500+0000 7fed39680640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed34113b30 con 0x7fed34105290 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33984/0 (socket says 172.21.15.6:33984) 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 -- 172.21.15.6:0/3946572300 learned_addr learned my addr 172.21.15.6:0/3946572300 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed32ffd640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 0x7fed3419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed327fc640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 0x7fed3419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 -- 172.21.15.6:0/3946572300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 msgr2=0x7fed3419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 0x7fed3419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 -- 172.21.15.6:0/3946572300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 msgr2=0x7fed3419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 0x7fed3419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 -- 172.21.15.6:0/3946572300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed341a0310 con 0x7fed3410de10 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed337fe640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fed2c005cc0 tx=0x7fed2c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c032e00 con 0x7fed3410de10 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed2c0044d0 con 0x7fed3410de10 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.501+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed341a05a0 con 0x7fed3410de10 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.502+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c030b70 con 0x7fed3410de10 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.502+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341a6d60 con 0x7fed3410de10 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.503+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3406c1e0 con 0x7fed3410de10 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.505+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fed2c030d10 con 0x7fed3410de10 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.506+0000 7fed1bfff640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 0x7fed1c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.506+0000 7fed32ffd640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 0x7fed1c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.506+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fed2c108d40 con 0x7fed3410de10 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.506+0000 7fed32ffd640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 0x7fed1c0b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed3406c8e0 tx=0x7fed2400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.509+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed2c0cefe0 con 0x7fed3410de10 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.769+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fed34104c70 con 0x7fed3410de10 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.774+0000 7fed1bfff640 1 -- 172.21.15.6:0/3946572300 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296444 (secure 0 0 0) 0x7fed2c0d33c0 con 0x7fed3410de10 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 msgr2=0x7fed1c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 0x7fed1c0b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed3406c8e0 tx=0x7fed2400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 msgr2=0x7fed3419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fed2c005cc0 tx=0x7fed2c032a10 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 shutdown_connections 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fed1c0b65f0 0x7fed1c0b8b00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed34105290 0x7fed3419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed3410de10 0x7fed3419fbe0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 --2- 172.21.15.6:0/3946572300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed34104860 0x7fed3419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 >> 172.21.15.6:0/3946572300 conn(0x7fed34079740 msgr2=0x7fed340ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 shutdown_connections 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:49.777+0000 7fed39680640 1 -- 172.21.15.6:0/3946572300 wait complete. 2024-09-21T07:59:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:49 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3946572300' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:59:50.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:49 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3946572300' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:59:50.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:49 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3946572300' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:59:50.629 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"flags":0,"active_gid":14226,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1939189819},{"type":"v1","addr":"172.21.15.6:6801","nonce":1939189819}]},"active_addr":"172.21.15.6:6801/1939189819","active_change":"2024-09-21T07:52:01.430301+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24167,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1610154042}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":530598631}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2099904765}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2796729657}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2593794662}]}]} 2024-09-21T07:59:50.635 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:59:50.635 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:59:50.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:50 smithi145 ceph-mon[34049]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T07:59:51.214 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:50 smithi006 ceph-mon[30970]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T07:59:51.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 -- 172.21.15.6:0/1695885118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c105330 msgr2=0x7faf9c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/1695885118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c105330 0x7faf9c10d880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faf90009900 tx=0x7faf9002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:51.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 -- 172.21.15.6:0/1695885118 shutdown_connections 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/1695885118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c10de40 0x7faf9c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/1695885118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c105330 0x7faf9c10d880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/1695885118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 0x7faf9c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 -- 172.21.15.6:0/1695885118 >> 172.21.15.6:0/1695885118 conn(0x7faf9c079750 msgr2=0x7faf9c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 -- 172.21.15.6:0/1695885118 shutdown_connections 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.382+0000 7fafa1e0e640 1 -- 172.21.15.6:0/1695885118 wait complete. 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 Processor -- start 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 -- start start 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 0x7faf9c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c105330 0x7faf9c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c113950 con 0x7faf9c10de40 2024-09-21T07:59:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1137d0 con 0x7faf9c105330 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.383+0000 7fafa1e0e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c113ad0 con 0x7faf9c1049e0 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34002/0 (socket says 172.21.15.6:34002) 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 -- 172.21.15.6:0/471879773 learned_addr learned my addr 172.21.15.6:0/471879773 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9b7fe640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 0x7faf9c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9affd640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c105330 0x7faf9c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 -- 172.21.15.6:0/471879773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 msgr2=0x7faf9c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 0x7faf9c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 -- 172.21.15.6:0/471879773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c105330 msgr2=0x7faf9c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c105330 0x7faf9c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 -- 172.21.15.6:0/471879773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c1a03d0 con 0x7faf9c10de40 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf9bfff640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf94009fd0 tx=0x7faf9400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94017070 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c1a06c0 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf94003e00 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94010460 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.384+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1a6e20 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.385+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c06b350 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.387+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7faf94003970 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.388+0000 7faf98ff9640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 0x7faf840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.388+0000 7faf9b7fe640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 0x7faf840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.388+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7faf940e7a80 con 0x7faf9c10de40 2024-09-21T07:59:51.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.388+0000 7faf9b7fe640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 0x7faf840b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf9c06c980 tx=0x7faf8c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:51.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.391+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf940add80 con 0x7faf9c10de40 2024-09-21T07:59:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:50 smithi119 ceph-mon[33564]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T07:59:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.580+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf9c06c280 con 0x7faf9c10de40 2024-09-21T07:59:51.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.582+0000 7faf98ff9640 1 -- 172.21.15.6:0/471879773 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7faf9c06c280 con 0x7faf9c10de40 2024-09-21T07:59:51.584 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:51.584 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 msgr2=0x7faf840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 0x7faf840b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf9c06c980 tx=0x7faf8c005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 msgr2=0x7faf9c19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf94009fd0 tx=0x7faf9400b260 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 shutdown_connections 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faf840b65f0 0x7faf840b8b00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9c10de40 0x7faf9c19fca0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf9c105330 0x7faf9c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 --2- 172.21.15.6:0/471879773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf9c1049e0 0x7faf9c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 >> 172.21.15.6:0/471879773 conn(0x7faf9c079750 msgr2=0x7faf9c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 shutdown_connections 2024-09-21T07:59:51.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:51.584+0000 7fafa1e0e640 1 -- 172.21.15.6:0/471879773 wait complete. 2024-09-21T07:59:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:51 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/471879773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:51 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/471879773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:52.300 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:59:52.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:59:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:51 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/471879773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:53.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 -- 172.21.15.6:0/1716749887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0108cf0 msgr2=0x7f24b010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/1716749887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0108cf0 0x7f24b010f520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009900 tx=0x7f24a802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 -- 172.21.15.6:0/1716749887 shutdown_connections 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/1716749887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b01083a0 0x7f24b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/1716749887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0108cf0 0x7f24b010f520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/1716749887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b0102a60 0x7f24b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 -- 172.21.15.6:0/1716749887 >> 172.21.15.6:0/1716749887 conn(0x7f24b0079730 msgr2=0x7f24b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 -- 172.21.15.6:0/1716749887 shutdown_connections 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.099+0000 7f24b4c9f640 1 -- 172.21.15.6:0/1716749887 wait complete. 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 Processor -- start 2024-09-21T07:59:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 -- start start 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b01083a0 0x7f24b019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 0x7f24b019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113930 con 0x7f24b0102a60 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01137b0 con 0x7f24b01083a0 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24b4c9f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113ab0 con 0x7f24b0108cf0 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34020/0 (socket says 172.21.15.6:34020) 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.100+0000 7f24ae59c640 1 -- 172.21.15.6:0/489853731 learned_addr learned my addr 172.21.15.6:0/489853731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24aed9d640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 0x7f24b019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24add9b640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b01083a0 0x7f24b019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 -- 172.21.15.6:0/489853731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 msgr2=0x7f24b019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 0x7f24b019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 -- 172.21.15.6:0/489853731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b01083a0 msgr2=0x7f24b019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b01083a0 0x7f24b019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 -- 172.21.15.6:0/489853731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01a0310 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24aed9d640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 0x7f24b019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24ae59c640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f24a000eab0 tx=0x7f24a000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000ce40 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24a0011900 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0010990 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01a0600 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.101+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a6d60 con 0x7f24b0102a60 2024-09-21T07:59:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.102+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0102e70 con 0x7f24b0102a60 2024-09-21T07:59:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.104+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f24a0011470 con 0x7f24b0102a60 2024-09-21T07:59:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.105+0000 7f249f7fe640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 0x7f24980b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.105+0000 7f24add9b640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 0x7f24980b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.105+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f24a00e7f70 con 0x7f24b0102a60 2024-09-21T07:59:53.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.106+0000 7f24add9b640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 0x7f24980b8b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24b0105f60 tx=0x7f24a400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.108+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a0016030 con 0x7f24b0102a60 2024-09-21T07:59:53.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:52 smithi006 ceph-mon[30970]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T07:59:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.297+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24b002e640 con 0x7f24b0102a60 2024-09-21T07:59:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.299+0000 7f249f7fe640 1 -- 172.21.15.6:0/489853731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+25018 (secure 0 0 0) 0x7f24a00ae290 con 0x7f24b0102a60 2024-09-21T07:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T07:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T07:59:03.435952+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 msgr2=0x7f24980b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 0x7f24980b8b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24b0105f60 tx=0x7f24a400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 msgr2=0x7f24b019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f24a000eab0 tx=0x7f24a000ef70 comp rx=0 tx=0).stop 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 shutdown_connections 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24980b6670 0x7f24980b8b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24b0108cf0 0x7f24b019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24b01083a0 0x7f24b019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 --2- 172.21.15.6:0/489853731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0102a60 0x7f24b019a3a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 >> 172.21.15.6:0/489853731 conn(0x7f24b0079730 msgr2=0x7f24b0104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 shutdown_connections 2024-09-21T07:59:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:53.301+0000 7f24b4c9f640 1 -- 172.21.15.6:0/489853731 wait complete. 2024-09-21T07:59:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:52 smithi119 ceph-mon[33564]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T07:59:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:52 smithi145 ceph-mon[34049]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T07:59:53.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:59:53.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:59:53.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:59:53.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:59:53.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:59:53.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:59:53.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:59:53.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:59:53.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:59:53.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:59:53.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:59:53.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:59:54.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/489853731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:54.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/489853731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:54.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/489853731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:54.712 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:55.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:54 smithi006 ceph-mon[30970]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-21T07:59:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:54 smithi119 ceph-mon[33564]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-21T07:59:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:54 smithi145 ceph-mon[34049]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-21T07:59:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 -- 172.21.15.6:0/3836555729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee34105300 msgr2=0x7fee3410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 --2- 172.21.15.6:0/3836555729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee34105300 0x7fee3410d850 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee28009900 tx=0x7fee2802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 -- 172.21.15.6:0/3836555729 shutdown_connections 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 --2- 172.21.15.6:0/3836555729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3410de10 0x7fee34110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 --2- 172.21.15.6:0/3836555729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee34105300 0x7fee3410d850 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 --2- 172.21.15.6:0/3836555729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee341049b0 0x7fee34104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 -- 172.21.15.6:0/3836555729 >> 172.21.15.6:0/3836555729 conn(0x7fee34079730 msgr2=0x7fee34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 -- 172.21.15.6:0/3836555729 shutdown_connections 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.906+0000 7fee38cfb640 1 -- 172.21.15.6:0/3836555729 wait complete. 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 Processor -- start 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 -- start start 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 0x7fee3419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee34105300 0x7fee3419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3410de10 0x7fee3419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fee34113920 con 0x7fee341049b0 2024-09-21T07:59:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fee341137a0 con 0x7fee34105300 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee38cfb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fee34113aa0 con 0x7fee3410de10 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 0x7fee3419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 0x7fee3419a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34040/0 (socket says 172.21.15.6:34040) 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 -- 172.21.15.6:0/1232710045 learned_addr learned my addr 172.21.15.6:0/1232710045 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee31d9b640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee34105300 0x7fee3419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee32d9d640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3410de10 0x7fee3419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 -- 172.21.15.6:0/1232710045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3410de10 msgr2=0x7fee3419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3410de10 0x7fee3419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 -- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee34105300 msgr2=0x7fee3419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee34105300 0x7fee3419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.907+0000 7fee3259c640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee341a0260 con 0x7fee341049b0 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee32d9d640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3410de10 0x7fee3419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee3259c640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 0x7fee3419a3b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee2400c970 tx=0x7fee2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24007c10 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee24007db0 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee341a0550 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2400f7d0 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.908+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee341a6d70 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.909+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee34063b50 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.911+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fee24018480 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.911+0000 7fee237fe640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fee1c0b66a0 0x7fee1c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee31d9b640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fee1c0b66a0 0x7fee1c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fee240e80b0 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee237fe640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] conn(0x7fee1c0c1a30 0x7fee1c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee1c0c45f0 con 0x7fee1c0c1a30 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fee240e8500 con 0x7fee341049b0 2024-09-21T07:59:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee31d9b640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fee1c0b66a0 0x7fee1c0b8bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee280057c0 tx=0x7fee28000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.912+0000 7fee32d9d640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] conn(0x7fee1c0c1a30 0x7fee1c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.913+0000 7fee32d9d640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] conn(0x7fee1c0c1a30 0x7fee1c0c3f20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.913+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== osd.4 v2:172.21.15.119:6808/3176052266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee1c0c45f0 con 0x7fee1c0c1a30 2024-09-21T07:59:55.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.929+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 --> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee34063fd0 con 0x7fee1c0c1a30 2024-09-21T07:59:55.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee237fe640 1 -- 172.21.15.6:0/1232710045 <== osd.4 v2:172.21.15.119:6808/3176052266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fee34063fd0 con 0x7fee1c0c1a30 2024-09-21T07:59:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] conn(0x7fee1c0c1a30 msgr2=0x7fee1c0c3f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] conn(0x7fee1c0c1a30 0x7fee1c0c3f20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fee1c0b66a0 msgr2=0x7fee1c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fee1c0b66a0 0x7fee1c0b8bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee280057c0 tx=0x7fee28000bc0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 msgr2=0x7fee3419a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 --2- 172.21.15.6:0/1232710045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee341049b0 0x7fee3419a3b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee2400c970 tx=0x7fee2400ce30 comp rx=0 tx=0).stop 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee32d9d640 1 -- 172.21.15.6:0/1232710045 reap_dead start 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 shutdown_connections 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.930+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 >> 172.21.15.6:0/1232710045 conn(0x7fee34079730 msgr2=0x7fee34100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.931+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 shutdown_connections 2024-09-21T07:59:55.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.931+0000 7fee38cfb640 1 -- 172.21.15.6:0/1232710045 wait complete. 2024-09-21T07:59:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 -- 172.21.15.6:0/1269485125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3978108d10 msgr2=0x7f397810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 --2- 172.21.15.6:0/1269485125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3978108d10 0x7f397810f540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3970009ca0 tx=0x7f397002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 -- 172.21.15.6:0/1269485125 shutdown_connections 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 --2- 172.21.15.6:0/1269485125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3978108d10 0x7f397810f540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 --2- 172.21.15.6:0/1269485125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39781083c0 0x7f39781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 --2- 172.21.15.6:0/1269485125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3978102a80 0x7f3978102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 -- 172.21.15.6:0/1269485125 >> 172.21.15.6:0/1269485125 conn(0x7f3978079740 msgr2=0x7f3978079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 -- 172.21.15.6:0/1269485125 shutdown_connections 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 -- 172.21.15.6:0/1269485125 wait complete. 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.793+0000 7f3980717640 1 Processor -- start 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 -- start start 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3978102a80 0x7f397819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 0x7f397819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3978108d10 0x7f397819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3978112880 con 0x7f39781083c0 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3978112700 con 0x7f3978102a80 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f3980717640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3978112a00 con 0x7f3978108d10 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 0x7f397819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 0x7f397819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34034/0 (socket says 172.21.15.6:34034) 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 -- 172.21.15.6:0/2355744747 learned_addr learned my addr 172.21.15.6:0/2355744747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397ecb4640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3978108d10 0x7f397819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397e4b3640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3978102a80 0x7f397819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 -- 172.21.15.6:0/2355744747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3978108d10 msgr2=0x7f397819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3978108d10 0x7f397819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 -- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3978102a80 msgr2=0x7f397819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3978102a80 0x7f397819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397dcb2640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781a6370 con 0x7f39781083c0 2024-09-21T07:59:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.794+0000 7f397e4b3640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3978102a80 0x7f397819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f397dcb2640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 0x7f397819b6b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f396800c970 tx=0x7f396800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968014070 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3968004440 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39781a6660 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968003d40 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.795+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39781a6ba0 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.796+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3978063b50 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.798+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3968017070 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.798+0000 7f396f7fe640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39640b6620 0x7f39640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f397e4b3640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39640b6620 0x7f39640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f39680e7810 con 0x7f39781083c0 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f396f7fe640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] conn(0x7f39640c19b0 0x7f39640c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f396801ae50 con 0x7f39640c19b0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f39680e7c60 con 0x7f39781083c0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f397ecb4640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] conn(0x7f39640c19b0 0x7f39640c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.799+0000 7f397e4b3640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39640b6620 0x7f39640b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3974005fd0 tx=0x7f3974005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.800+0000 7f397ecb4640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] conn(0x7f39640c19b0 0x7f39640c3ea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.800+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== osd.10 v2:172.21.15.119:6824/597400106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f396801ae50 con 0x7f39640c19b0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.817+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 --> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3978063f50 con 0x7f39640c19b0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f396f7fe640 1 -- 172.21.15.6:0/2355744747 <== osd.10 v2:172.21.15.119:6824/597400106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3978063f50 con 0x7f39640c19b0 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] conn(0x7f39640c19b0 msgr2=0x7f39640c3ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] conn(0x7f39640c19b0 0x7f39640c3ea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39640b6620 msgr2=0x7f39640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39640b6620 0x7f39640b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3974005fd0 tx=0x7f3974005850 comp rx=0 tx=0).stop 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 msgr2=0x7f397819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 --2- 172.21.15.6:0/2355744747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39781083c0 0x7f397819b6b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f396800c970 tx=0x7f396800ce30 comp rx=0 tx=0).stop 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f397ecb4640 1 -- 172.21.15.6:0/2355744747 reap_dead start 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 shutdown_connections 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 >> 172.21.15.6:0/2355744747 conn(0x7f3978079740 msgr2=0x7f39781043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 shutdown_connections 2024-09-21T07:59:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:55.818+0000 7f3980717640 1 -- 172.21.15.6:0/2355744747 wait complete. 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3394847794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838102a60 msgr2=0x7fd838102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3394847794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838102a60 0x7fd838102e70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd828009900 tx=0x7fd82802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3394847794 shutdown_connections 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3394847794 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8381083a0 0x7fd8381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3394847794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd838108cf0 0x7fd83810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3394847794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838102a60 0x7fd838102e70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3394847794 >> 172.21.15.6:0/3394847794 conn(0x7fd838079730 msgr2=0x7fd838079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3394847794 shutdown_connections 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.211+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3394847794 wait complete. 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 Processor -- start 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 -- start start 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd838102a60 0x7fd838199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8381083a0 0x7fd838199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 0x7fd83819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd838112810 con 0x7fd838108cf0 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd838112690 con 0x7fd8381083a0 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ef2a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd838112990 con 0x7fd838102a60 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83d4c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 0x7fd83819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83d4c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 0x7fd83819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34070/0 (socket says 172.21.15.6:34070) 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83d4c7640 1 -- 172.21.15.6:0/3457434248 learned_addr learned my addr 172.21.15.6:0/3457434248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd837fff640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8381083a0 0x7fd838199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.212+0000 7fd83ccc6640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd838102a60 0x7fd838199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 -- 172.21.15.6:0/3457434248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd838102a60 msgr2=0x7fd838199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd838102a60 0x7fd838199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 -- 172.21.15.6:0/3457434248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8381083a0 msgr2=0x7fd838199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8381083a0 0x7fd838199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83819f1f0 con 0x7fd838108cf0 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83ccc6640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd838102a60 0x7fd838199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83d4c7640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 0x7fd83819eac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd83000eaa0 tx=0x7fd83000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83000cdb0 con 0x7fd838108cf0 2024-09-21T07:59:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd830005020 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83819f4e0 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8300116d0 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.213+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8381a5c40 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.214+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd838063b10 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.216+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fd8300051d0 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.216+0000 7fd835ffb640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8240b65f0 0x7fd8240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.216+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fd8300e7f00 con 0x7fd838108cf0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.216+0000 7fd83ccc6640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8240b65f0 0x7fd8240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd835ffb640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] conn(0x7fd8240c1980 0x7fd8240c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd83001ce50 con 0x7fd8240c1980 2024-09-21T07:59:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd8300e8350 con 0x7fd838108cf0 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd837fff640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] conn(0x7fd8240c1980 0x7fd8240c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd83ccc6640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8240b65f0 0x7fd8240b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.217+0000 7fd837fff640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] conn(0x7fd8240c1980 0x7fd8240c3e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.218+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== osd.6 v2:172.21.15.6:6818/3354206555 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd83001ce50 con 0x7fd8240c1980 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 --> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd838063f90 con 0x7fd8240c1980 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd835ffb640 1 -- 172.21.15.6:0/3457434248 <== osd.6 v2:172.21.15.6:6818/3354206555 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd838063f90 con 0x7fd8240c1980 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] conn(0x7fd8240c1980 msgr2=0x7fd8240c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] conn(0x7fd8240c1980 0x7fd8240c3e70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8240b65f0 msgr2=0x7fd8240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8240b65f0 0x7fd8240b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828005a20 comp rx=0 tx=0).stop 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 msgr2=0x7fd83819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 --2- 172.21.15.6:0/3457434248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd838108cf0 0x7fd83819eac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd83000eaa0 tx=0x7fd83000ef60 comp rx=0 tx=0).stop 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83d4c7640 1 -- 172.21.15.6:0/3457434248 reap_dead start 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 shutdown_connections 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 >> 172.21.15.6:0/3457434248 conn(0x7fd838079730 msgr2=0x7fd838101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.232+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 shutdown_connections 2024-09-21T07:59:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:56.233+0000 7fd83ef2a640 1 -- 172.21.15.6:0/3457434248 wait complete. 2024-09-21T07:59:57.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:56 smithi006 ceph-mon[30970]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:57.402 INFO:teuthology.orchestra.run.smithi006.stdout:180388626485 2024-09-21T07:59:57.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:59:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:56 smithi119 ceph-mon[33564]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:56 smithi145 ceph-mon[34049]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 -- 172.21.15.6:0/1754403078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850103b60 msgr2=0x7fc850103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 --2- 172.21.15.6:0/1754403078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850103b60 0x7fc850103f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc848009ca0 tx=0x7fc84802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 -- 172.21.15.6:0/1754403078 shutdown_connections 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 --2- 172.21.15.6:0/1754403078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc850109df0 0x7fc850110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 --2- 172.21.15.6:0/1754403078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8501094a0 0x7fc8501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 --2- 172.21.15.6:0/1754403078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850103b60 0x7fc850103f70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.003+0000 7fc856d06640 1 -- 172.21.15.6:0/1754403078 >> 172.21.15.6:0/1754403078 conn(0x7fc85007b850 msgr2=0x7fc85007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.004+0000 7fc856d06640 1 -- 172.21.15.6:0/1754403078 shutdown_connections 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.004+0000 7fc856d06640 1 -- 172.21.15.6:0/1754403078 wait complete. 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.004+0000 7fc856d06640 1 Processor -- start 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.004+0000 7fc856d06640 1 -- start start 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc850103b60 0x7fc85019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8501094a0 0x7fc85019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 0x7fc85019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501139b0 con 0x7fc850109df0 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc850113830 con 0x7fc8501094a0 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc856d06640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc850113b30 con 0x7fc850103b60 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 0x7fc85019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 0x7fc85019fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45724/0 (socket says 172.21.15.6:45724) 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 -- 172.21.15.6:0/979456110 learned_addr learned my addr 172.21.15.6:0/979456110 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc84ffff640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8501094a0 0x7fc85019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc854aa2640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc850103b60 0x7fc85019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 -- 172.21.15.6:0/979456110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc850103b60 msgr2=0x7fc85019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc850103b60 0x7fc85019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 -- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8501094a0 msgr2=0x7fc85019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8501094a0 0x7fc85019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501a0330 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.005+0000 7fc8552a3640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 0x7fc85019fc00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc83800d750 tx=0x7fc83800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.006+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838017070 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.006+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501a0620 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.006+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8380054b0 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.006+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838004b90 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.006+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501a6d80 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.007+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc850063b50 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.008+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fc838004d30 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc84dffb640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc83c0b65f0 0x7fc83c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc854aa2640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc83c0b65f0 0x7fc83c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7fc8380e7710 con 0x7fc850109df0 2024-09-21T07:59:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc84dffb640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] conn(0x7fc83c0c1980 0x7fc83c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc838021e50 con 0x7fc83c0c1980 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.009+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc8380e7b60 con 0x7fc850109df0 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.010+0000 7fc854aa2640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc83c0b65f0 0x7fc83c0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc848000f80 tx=0x7fc848031000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.010+0000 7fc84ffff640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] conn(0x7fc83c0c1980 0x7fc83c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.010+0000 7fc84ffff640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] conn(0x7fc83c0c1980 0x7fc83c0c3e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.011+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== osd.1 v2:172.21.15.119:6800/1612348700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc838021e50 con 0x7fc83c0c1980 2024-09-21T07:59:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:58.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.029+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 --> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc850063f50 con 0x7fc83c0c1980 2024-09-21T07:59:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc84dffb640 1 -- 172.21.15.6:0/979456110 <== osd.1 v2:172.21.15.119:6800/1612348700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc850063f50 con 0x7fc83c0c1980 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] conn(0x7fc83c0c1980 msgr2=0x7fc83c0c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] conn(0x7fc83c0c1980 0x7fc83c0c3e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc83c0b65f0 msgr2=0x7fc83c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc83c0b65f0 0x7fc83c0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc848000f80 tx=0x7fc848031000 comp rx=0 tx=0).stop 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 msgr2=0x7fc85019fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 --2- 172.21.15.6:0/979456110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc850109df0 0x7fc85019fc00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc83800d750 tx=0x7fc83800dc10 comp rx=0 tx=0).stop 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc8552a3640 1 -- 172.21.15.6:0/979456110 reap_dead start 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 shutdown_connections 2024-09-21T07:59:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.030+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 >> 172.21.15.6:0/979456110 conn(0x7fc85007b850 msgr2=0x7fc850107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.031+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 shutdown_connections 2024-09-21T07:59:58.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.031+0000 7fc856d06640 1 -- 172.21.15.6:0/979456110 wait complete. 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 -- 172.21.15.6:0/1096165467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 msgr2=0x7f3a681098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/1096165467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a681098c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a410 comp rx=0 tx=0).stop 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 -- 172.21.15.6:0/1096165467 shutdown_connections 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/1096165467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 0x7f3a68110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/1096165467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a681098c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/1096165467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a68103b70 0x7f3a68103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 -- 172.21.15.6:0/1096165467 >> 172.21.15.6:0/1096165467 conn(0x7f3a680ff5e0 msgr2=0x7f3a68101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 -- 172.21.15.6:0/1096165467 shutdown_connections 2024-09-21T07:59:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.205+0000 7f3a6e27d640 1 -- 172.21.15.6:0/1096165467 wait complete. 2024-09-21T07:59:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.206+0000 7f3a6e27d640 1 Processor -- start 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.206+0000 7f3a6e27d640 1 -- start start 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a68103b70 0x7f3a6819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a6819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 0x7f3a6819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68113970 con 0x7f3a681094b0 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681137f0 con 0x7f3a68109e00 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6e27d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68113af0 con 0x7f3a68103b70 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a6819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a6819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45742/0 (socket says 172.21.15.6:45742) 2024-09-21T07:59:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 -- 172.21.15.6:0/2396589059 learned_addr learned my addr 172.21.15.6:0/2396589059 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a67fff640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a68103b70 0x7f3a6819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6c81a640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 0x7f3a6819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 -- 172.21.15.6:0/2396589059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a68103b70 msgr2=0x7f3a6819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a68103b70 0x7f3a6819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 -- 172.21.15.6:0/2396589059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 msgr2=0x7f3a6819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 0x7f3a6819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681a0330 con 0x7f3a681094b0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a6c81a640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68109e00 0x7f3a6819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.207+0000 7f3a677fe640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a6819a960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c005940 tx=0x7f3a5c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.208+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c03f030 con 0x7f3a681094b0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.208+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a5c0043d0 con 0x7f3a681094b0 2024-09-21T07:59:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.208+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a681a05c0 con 0x7f3a681094b0 2024-09-21T07:59:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.208+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c035070 con 0x7f3a681094b0 2024-09-21T07:59:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.208+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a6d80 con 0x7f3a681094b0 2024-09-21T07:59:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.209+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a68063b50 con 0x7f3a681094b0 2024-09-21T07:59:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.211+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3a5c042030 con 0x7f3a681094b0 2024-09-21T07:59:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.211+0000 7f3a657fa640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3a500b65f0 0x7f3a500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a67fff640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3a500b65f0 0x7f3a500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f3a5c108190 con 0x7f3a681094b0 2024-09-21T07:59:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a657fa640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] conn(0x7f3a500c1980 0x7f3a500c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a5c0039d0 con 0x7f3a500c1980 2024-09-21T07:59:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c1085e0 con 0x7f3a681094b0 2024-09-21T07:59:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a6c81a640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] conn(0x7f3a500c1980 0x7f3a500c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a67fff640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3a500b65f0 0x7f3a500b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009bd0 tx=0x7f3a58005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.212+0000 7f3a6c81a640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] conn(0x7f3a500c1980 0x7f3a500c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.213+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== osd.3 v2:172.21.15.6:6810/2874010915 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a5c0039d0 con 0x7f3a500c1980 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.227+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 --> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a68063fd0 con 0x7f3a500c1980 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.227+0000 7f3a657fa640 1 -- 172.21.15.6:0/2396589059 <== osd.3 v2:172.21.15.6:6810/2874010915 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3a68063fd0 con 0x7f3a500c1980 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] conn(0x7f3a500c1980 msgr2=0x7f3a500c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] conn(0x7f3a500c1980 0x7f3a500c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3a500b65f0 msgr2=0x7f3a500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3a500b65f0 0x7f3a500b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009bd0 tx=0x7f3a58005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 msgr2=0x7f3a6819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 --2- 172.21.15.6:0/2396589059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a681094b0 0x7f3a6819a960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c005940 tx=0x7f3a5c005e10 comp rx=0 tx=0).stop 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6c81a640 1 -- 172.21.15.6:0/2396589059 reap_dead start 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 shutdown_connections 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 >> 172.21.15.6:0/2396589059 conn(0x7f3a680ff5e0 msgr2=0x7f3a68101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 shutdown_connections 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T07:59:58.228+0000 7f3a6e27d640 1 -- 172.21.15.6:0/2396589059 wait complete. 2024-09-21T07:59:59.241 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 07:59:58 smithi006 ceph-mon[30970]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 07:59:58 smithi119 ceph-mon[33564]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 07:59:58 smithi145 ceph-mon[34049]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T07:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout:270582939680 2024-09-21T07:59:59.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:59:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T07:59:59.843 INFO:teuthology.orchestra.run.smithi006.stdout:133143986239 2024-09-21T07:59:59.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T08:00:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 -- 172.21.15.6:0/2244600653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c108d20 msgr2=0x7f0d9c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2244600653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c108d20 0x7f0d9c10f550 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009ca0 tx=0x7f0d9402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 -- 172.21.15.6:0/2244600653 shutdown_connections 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2244600653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c108d20 0x7f0d9c10f550 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2244600653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2244600653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 -- 172.21.15.6:0/2244600653 >> 172.21.15.6:0/2244600653 conn(0x7f0d9c079760 msgr2=0x7f0d9c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 -- 172.21.15.6:0/2244600653 shutdown_connections 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.633+0000 7f0da30e1640 1 -- 172.21.15.6:0/2244600653 wait complete. 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 Processor -- start 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 -- start start 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d9c108d20 0x7f0d9c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1139b0 con 0x7f0d9c102ae0 2024-09-21T08:00:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c113830 con 0x7f0d9c1083d0 2024-09-21T08:00:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da30e1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c113b30 con 0x7f0d9c108d20 2024-09-21T08:00:00.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45760/0 (socket says 172.21.15.6:45760) 2024-09-21T08:00:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 -- 172.21.15.6:0/2786549952 learned_addr learned my addr 172.21.15.6:0/2786549952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0d93fff640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da167e640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d9c108d20 0x7f0d9c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 -- 172.21.15.6:0/2786549952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d9c108d20 msgr2=0x7f0d9c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d9c108d20 0x7f0d9c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 -- 172.21.15.6:0/2786549952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 msgr2=0x7f0d9c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.634+0000 7f0da0e7d640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1a0330 con 0x7f0d9c102ae0 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0da0e7d640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c19a3c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800d950 tx=0x7f0d9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98017030 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d98004020 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c1a0620 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980055d0 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.635+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1a6d80 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.636+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d9c063b50 con 0x7f0d9c102ae0 2024-09-21T08:00:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.637+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f0d98009a30 con 0x7f0d9c102ae0 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.638+0000 7f0d91ffb640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d840b6670 0x7f0d840b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.638+0000 7f0d93fff640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d840b6670 0x7f0d840b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.638+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f0d980e72d0 con 0x7f0d9c102ae0 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0d91ffb640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] conn(0x7f0d840c1a00 0x7f0d840c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d9801ae50 con 0x7f0d840c1a00 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0d980ee050 con 0x7f0d9c102ae0 2024-09-21T08:00:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0da167e640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] conn(0x7f0d840c1a00 0x7f0d840c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0d93fff640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d840b6670 0x7f0d840b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c107b10 tx=0x7f0d8c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.639+0000 7f0da167e640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] conn(0x7f0d840c1a00 0x7f0d840c3ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.640+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== osd.0 v2:172.21.15.6:6802/3344893896 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d9801ae50 con 0x7f0d840c1a00 2024-09-21T08:00:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.653+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 --> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d9c063f80 con 0x7f0d840c1a00 2024-09-21T08:00:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0d91ffb640 1 -- 172.21.15.6:0/2786549952 <== osd.0 v2:172.21.15.6:6802/3344893896 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d9c063f80 con 0x7f0d840c1a00 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] conn(0x7f0d840c1a00 msgr2=0x7f0d840c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] conn(0x7f0d840c1a00 0x7f0d840c3ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d840b6670 msgr2=0x7f0d840b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d840b6670 0x7f0d840b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c107b10 tx=0x7f0d8c00b390 comp rx=0 tx=0).stop 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 msgr2=0x7f0d9c19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 --2- 172.21.15.6:0/2786549952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c19a3c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800d950 tx=0x7f0d9800de10 comp rx=0 tx=0).stop 2024-09-21T08:00:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da167e640 1 -- 172.21.15.6:0/2786549952 reap_dead start 2024-09-21T08:00:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 shutdown_connections 2024-09-21T08:00:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 >> 172.21.15.6:0/2786549952 conn(0x7f0d9c079760 msgr2=0x7f0d9c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 shutdown_connections 2024-09-21T08:00:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:00.654+0000 7f0da30e1640 1 -- 172.21.15.6:0/2786549952 wait complete. 2024-09-21T08:00:01.030 INFO:teuthology.orchestra.run.smithi006.stdout:60129542224 2024-09-21T08:00:01.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:00 smithi006 ceph-mon[30970]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:00 smithi006 ceph-mon[30970]: overall HEALTH_OK 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 -- 172.21.15.6:0/3845586426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5708105270 msgr2=0x7f570810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 --2- 172.21.15.6:0/3845586426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5708105270 0x7f570810d8b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009900 tx=0x7f56f402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 -- 172.21.15.6:0/3845586426 shutdown_connections 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 --2- 172.21.15.6:0/3845586426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f570810ddf0 0x7f5708110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 --2- 172.21.15.6:0/3845586426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5708105270 0x7f570810d8b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 --2- 172.21.15.6:0/3845586426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5708104840 0x7f5708104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 -- 172.21.15.6:0/3845586426 >> 172.21.15.6:0/3845586426 conn(0x7f5708079730 msgr2=0x7f5708079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 -- 172.21.15.6:0/3845586426 shutdown_connections 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.219+0000 7f570ec6d640 1 -- 172.21.15.6:0/3845586426 wait complete. 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.220+0000 7f570ec6d640 1 Processor -- start 2024-09-21T08:00:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.220+0000 7f570ec6d640 1 -- start start 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5708104840 0x7f570819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5708105270 0x7f570819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 0x7f570819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5708113920 con 0x7f570810ddf0 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57081137a0 con 0x7f5708105270 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ec6d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5708113aa0 con 0x7f5708104840 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 0x7f570819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 0x7f570819fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45782/0 (socket says 172.21.15.6:45782) 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 -- 172.21.15.6:0/317010309 learned_addr learned my addr 172.21.15.6:0/317010309 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ca09640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5708104840 0x7f570819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f5707fff640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5708105270 0x7f570819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 -- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5708104840 msgr2=0x7f570819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5708104840 0x7f570819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 -- 172.21.15.6:0/317010309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5708105270 msgr2=0x7f570819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5708105270 0x7f570819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570d20a640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57081a0300 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.221+0000 7f570ca09640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5708104840 0x7f570819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f570d20a640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 0x7f570819fbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f570000eaa0 tx=0x7f570000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000cdb0 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57081a05f0 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5700005020 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000116d0 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.222+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57081a6d50 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.223+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5708063b50 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.225+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f57000051d0 con 0x7f570810ddf0 2024-09-21T08:00:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.225+0000 7f5705ffb640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56f80b65f0 0x7f56f80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f57000e7ff0 con 0x7f570810ddf0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f570ca09640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56f80b65f0 0x7f56f80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f5705ffb640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] conn(0x7f56f80c1980 0x7f56f80c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5700014ec0 con 0x7f56f80c1980 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f57000e8440 con 0x7f570810ddf0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f570ca09640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56f80b65f0 0x7f56f80b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f570806bc00 tx=0x7f56fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.226+0000 7f5707fff640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] conn(0x7f56f80c1980 0x7f56f80c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.227+0000 7f5707fff640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] conn(0x7f56f80c1980 0x7f56f80c3e70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.228+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== osd.5 v2:172.21.15.145:6808/4185277964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5700014ec0 con 0x7f56f80c1980 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.242+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 --> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5708063fd0 con 0x7f56f80c1980 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f5705ffb640 1 -- 172.21.15.6:0/317010309 <== osd.5 v2:172.21.15.145:6808/4185277964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5708063fd0 con 0x7f56f80c1980 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] conn(0x7f56f80c1980 msgr2=0x7f56f80c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] conn(0x7f56f80c1980 0x7f56f80c3e70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56f80b65f0 msgr2=0x7f56f80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56f80b65f0 0x7f56f80b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f570806bc00 tx=0x7f56fc00a2d0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 msgr2=0x7f570819fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 --2- 172.21.15.6:0/317010309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f570810ddf0 0x7f570819fbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f570000eaa0 tx=0x7f570000ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570d20a640 1 -- 172.21.15.6:0/317010309 reap_dead start 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 shutdown_connections 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 >> 172.21.15.6:0/317010309 conn(0x7f5708079730 msgr2=0x7f5708100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 shutdown_connections 2024-09-21T08:00:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.243+0000 7f570ec6d640 1 -- 172.21.15.6:0/317010309 wait complete. 2024-09-21T08:00:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:00 smithi119 ceph-mon[33564]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T08:00:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:00 smithi119 ceph-mon[33564]: overall HEALTH_OK 2024-09-21T08:00:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:00 smithi145 ceph-mon[34049]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T08:00:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:00 smithi145 ceph-mon[34049]: overall HEALTH_OK 2024-09-21T08:00:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 -- 172.21.15.6:0/2534202960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00741083c0 msgr2=0x7f00741087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 --2- 172.21.15.6:0/2534202960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00741083c0 0x7f00741087d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0064009900 tx=0x7f006402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 -- 172.21.15.6:0/2534202960 shutdown_connections 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 --2- 172.21.15.6:0/2534202960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0074108d10 0x7f007410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 --2- 172.21.15.6:0/2534202960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00741083c0 0x7f00741087d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 --2- 172.21.15.6:0/2534202960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0074102a80 0x7f0074102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.679+0000 7f007c484640 1 -- 172.21.15.6:0/2534202960 >> 172.21.15.6:0/2534202960 conn(0x7f0074079740 msgr2=0x7f0074079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.680+0000 7f007c484640 1 -- 172.21.15.6:0/2534202960 shutdown_connections 2024-09-21T08:00:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.680+0000 7f007c484640 1 -- 172.21.15.6:0/2534202960 wait complete. 2024-09-21T08:00:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.680+0000 7f007c484640 1 Processor -- start 2024-09-21T08:00:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.680+0000 7f007c484640 1 -- start start 2024-09-21T08:00:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0074102a80 0x7f007419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00741083c0 0x7f007419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 0x7f007419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112830 con 0x7f0074108d10 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00741126b0 con 0x7f00741083c0 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007c484640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f00741129b0 con 0x7f0074102a80 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 0x7f007419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 0x7f007419fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45806/0 (socket says 172.21.15.6:45806) 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 -- 172.21.15.6:0/1116546316 learned_addr learned my addr 172.21.15.6:0/1116546316 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007a220640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0074102a80 0x7f007419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f0079a1f640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00741083c0 0x7f007419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 -- 172.21.15.6:0/1116546316 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0074102a80 msgr2=0x7f007419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0074102a80 0x7f007419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 -- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00741083c0 msgr2=0x7f007419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00741083c0 0x7f007419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00741a0320 con 0x7f0074108d10 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f007aa21640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 0x7f007419fbf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f006c00eb10 tx=0x7f006c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.681+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c004b20 con 0x7f0074108d10 2024-09-21T08:00:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.682+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f006c004cc0 con 0x7f0074108d10 2024-09-21T08:00:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.682+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00741a0610 con 0x7f0074108d10 2024-09-21T08:00:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.682+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c010690 con 0x7f0074108d10 2024-09-21T08:00:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.682+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00741a6d70 con 0x7f0074108d10 2024-09-21T08:00:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.682+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0074063ad0 con 0x7f0074108d10 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.684+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f006c005000 con 0x7f0074108d10 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f006b7fe640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f00600b65f0 0x7f00600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f007a220640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f00600b65f0 0x7f00600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f006c0e8290 con 0x7f0074108d10 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f006b7fe640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] conn(0x7f00600c1980 0x7f00600c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f006c00e1a0 con 0x7f00600c1980 2024-09-21T08:00:01.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.685+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f006c0e86e0 con 0x7f0074108d10 2024-09-21T08:00:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.686+0000 7f007a220640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f00600b65f0 0x7f00600b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0070009bd0 tx=0x7f0070005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.686+0000 7f0079a1f640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] conn(0x7f00600c1980 0x7f00600c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.686+0000 7f0079a1f640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] conn(0x7f00600c1980 0x7f00600c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:01.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.687+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== osd.7 v2:172.21.15.119:6816/1355332181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f006c00e1a0 con 0x7f00600c1980 2024-09-21T08:00:01.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.700+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 --> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0074063f50 con 0x7f00600c1980 2024-09-21T08:00:01.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f006b7fe640 1 -- 172.21.15.6:0/1116546316 <== osd.7 v2:172.21.15.119:6816/1355332181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0074063f50 con 0x7f00600c1980 2024-09-21T08:00:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] conn(0x7f00600c1980 msgr2=0x7f00600c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] conn(0x7f00600c1980 0x7f00600c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f00600b65f0 msgr2=0x7f00600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f00600b65f0 0x7f00600b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0070009bd0 tx=0x7f0070005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:01.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 msgr2=0x7f007419fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.701+0000 7f007c484640 1 --2- 172.21.15.6:0/1116546316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0074108d10 0x7f007419fbf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f006c00eb10 tx=0x7f006c00c2d0 comp rx=0 tx=0).stop 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.702+0000 7f007aa21640 1 -- 172.21.15.6:0/1116546316 reap_dead start 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.702+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 shutdown_connections 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.702+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 >> 172.21.15.6:0/1116546316 conn(0x7f0074079740 msgr2=0x7f007406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.702+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 shutdown_connections 2024-09-21T08:00:01.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:01.702+0000 7f007c484640 1 -- 172.21.15.6:0/1116546316 wait complete. 2024-09-21T08:00:02.536 INFO:teuthology.orchestra.run.smithi006.stdout:201863462960 2024-09-21T08:00:02.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T08:00:02.942 INFO:teuthology.orchestra.run.smithi006.stdout:107374182469 2024-09-21T08:00:02.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 -- 172.21.15.6:0/2025623927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 msgr2=0x7fea0c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 --2- 172.21.15.6:0/2025623927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c1098d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009900 tx=0x7fe9f402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 -- 172.21.15.6:0/2025623927 shutdown_connections 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 --2- 172.21.15.6:0/2025623927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c109e10 0x7fea0c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 --2- 172.21.15.6:0/2025623927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c1098d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 --2- 172.21.15.6:0/2025623927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea0c103b80 0x7fea0c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.134+0000 7fea12371640 1 -- 172.21.15.6:0/2025623927 >> 172.21.15.6:0/2025623927 conn(0x7fea0c0ff610 msgr2=0x7fea0c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.135+0000 7fea12371640 1 -- 172.21.15.6:0/2025623927 shutdown_connections 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.135+0000 7fea12371640 1 -- 172.21.15.6:0/2025623927 wait complete. 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.135+0000 7fea12371640 1 Processor -- start 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.135+0000 7fea12371640 1 -- start start 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea0c103b80 0x7fea0c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c109e10 0x7fea0c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113980 con 0x7fea0c1094c0 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113800 con 0x7fea0c109e10 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea12371640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c113b00 con 0x7fea0c103b80 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45836/0 (socket says 172.21.15.6:45836) 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea03fff640 1 -- 172.21.15.6:0/919829435 learned_addr learned my addr 172.21.15.6:0/919829435 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea0bfff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea0c103b80 0x7fea0c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.136+0000 7fea1090e640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c109e10 0x7fea0c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 -- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea0c103b80 msgr2=0x7fea0c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea0c103b80 0x7fea0c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 -- 172.21.15.6:0/919829435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c109e10 msgr2=0x7fea0c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea0c109e10 0x7fea0c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c1a86b0 con 0x7fea0c1094c0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea03fff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c075c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4005940 tx=0x7fe9f40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f403f030 con 0x7fea0c1094c0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9f4003a80 con 0x7fea0c1094c0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0c1a8940 con 0x7fea0c1094c0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4035070 con 0x7fea0c1094c0 2024-09-21T08:00:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.137+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0c1a8e20 con 0x7fea0c1094c0 2024-09-21T08:00:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.138+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea0c063b50 con 0x7fea0c1094c0 2024-09-21T08:00:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.140+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe9f4042030 con 0x7fea0c1094c0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea09ffb640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe9f80b65f0 0x7fe9f80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9423+0+0 (secure 0 0 0) 0x7fe9f41083c0 con 0x7fea0c1094c0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea0bfff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe9f80b65f0 0x7fe9f80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea09ffb640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] conn(0x7fe9f80c1b80 0x7fe9f80c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9f4030e80 con 0x7fe9f80c1b80 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.141+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fe9f4108810 con 0x7fea0c1094c0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.142+0000 7fea1090e640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] conn(0x7fe9f80c1b80 0x7fe9f80c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.142+0000 7fea0bfff640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe9f80b65f0 0x7fe9f80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea0c077160 tx=0x7fe9fc00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.142+0000 7fea1090e640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] conn(0x7fe9f80c1b80 0x7fe9f80c4070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.143+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== osd.11 v2:172.21.15.145:6824/2180299713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9f4030e80 con 0x7fe9f80c1b80 2024-09-21T08:00:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.159+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 --> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea0c063f50 con 0x7fe9f80c1b80 2024-09-21T08:00:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.159+0000 7fea09ffb640 1 -- 172.21.15.6:0/919829435 <== osd.11 v2:172.21.15.145:6824/2180299713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fea0c063f50 con 0x7fe9f80c1b80 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] conn(0x7fe9f80c1b80 msgr2=0x7fe9f80c4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] conn(0x7fe9f80c1b80 0x7fe9f80c4070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe9f80b65f0 msgr2=0x7fe9f80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe9f80b65f0 0x7fe9f80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea0c077160 tx=0x7fe9fc00b410 comp rx=0 tx=0).stop 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 msgr2=0x7fea0c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 --2- 172.21.15.6:0/919829435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea0c1094c0 0x7fea0c075c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4005940 tx=0x7fe9f40040e0 comp rx=0 tx=0).stop 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea1090e640 1 -- 172.21.15.6:0/919829435 reap_dead start 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 shutdown_connections 2024-09-21T08:00:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 >> 172.21.15.6:0/919829435 conn(0x7fea0c0ff610 msgr2=0x7fea0c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 shutdown_connections 2024-09-21T08:00:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:03.160+0000 7fea12371640 1 -- 172.21.15.6:0/919829435 wait complete. 2024-09-21T08:00:03.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:02 smithi006 ceph-mon[30970]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T08:00:03.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T08:00:03.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T08:00:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:02 smithi119 ceph-mon[33564]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T08:00:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T08:00:03.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T08:00:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:02 smithi145 ceph-mon[34049]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T08:00:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T08:00:03.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T08:00:03.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]} : dispatch 2024-09-21T08:00:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:296352743453 2024-09-21T08:00:03.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T08:00:04.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T08:00:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T08:00:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T08:00:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T08:00:04.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:03 smithi006 ceph-mon[30970]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T08:00:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:154618822715 2024-09-21T08:00:04.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T08:00:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T08:00:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T08:00:04.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T08:00:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T08:00:04.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:03 smithi119 ceph-mon[33564]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T08:00:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T08:00:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T08:00:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T08:00:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-09-21T08:00:04.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:03 smithi145 ceph-mon[34049]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T08:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:05.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:04 smithi006 ceph-mon[30970]: pgmap v313: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:05.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:04 smithi006 ceph-mon[30970]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T08:00:05.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:04 smithi006 ceph-mon[30970]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T08:00:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:04 smithi119 ceph-mon[33564]: pgmap v313: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:04 smithi119 ceph-mon[33564]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T08:00:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:04 smithi119 ceph-mon[33564]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T08:00:05.441 INFO:teuthology.orchestra.run.smithi006.stdout:38654705749 2024-09-21T08:00:05.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T08:00:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:04 smithi145 ceph-mon[34049]: pgmap v313: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:04 smithi145 ceph-mon[34049]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T08:00:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:04 smithi145 ceph-mon[34049]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 -- 172.21.15.6:0/397992375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c105290 msgr2=0x7fac1c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 --2- 172.21.15.6:0/397992375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c105290 0x7fac1c10d8d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac10009900 tx=0x7fac1002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 -- 172.21.15.6:0/397992375 shutdown_connections 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 --2- 172.21.15.6:0/397992375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c10de10 0x7fac1c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 --2- 172.21.15.6:0/397992375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c105290 0x7fac1c10d8d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 --2- 172.21.15.6:0/397992375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 0x7fac1c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 -- 172.21.15.6:0/397992375 >> 172.21.15.6:0/397992375 conn(0x7fac1c079730 msgr2=0x7fac1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 -- 172.21.15.6:0/397992375 shutdown_connections 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.110+0000 7fac2441e640 1 -- 172.21.15.6:0/397992375 wait complete. 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 Processor -- start 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 -- start start 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 0x7fac1c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 0x7fac1c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c1139c0 con 0x7fac1c10de10 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c113840 con 0x7fac1c105290 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac2441e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c113b40 con 0x7fac1c104860 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac229bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac221ba640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 0x7fac1c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac229bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45860/0 (socket says 172.21.15.6:45860) 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.111+0000 7fac229bb640 1 -- 172.21.15.6:0/2597187251 learned_addr learned my addr 172.21.15.6:0/2597187251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac219b9640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 0x7fac1c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 -- 172.21.15.6:0/2597187251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 msgr2=0x7fac1c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 0x7fac1c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 -- 172.21.15.6:0/2597187251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 msgr2=0x7fac1c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 0x7fac1c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 -- 172.21.15.6:0/2597187251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c1a0360 con 0x7fac1c10de10 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac219b9640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 0x7fac1c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac229bb640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac14009fd0 tx=0x7fac1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14011830 con 0x7fac1c10de10 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac14016070 con 0x7fac1c10de10 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14010d20 con 0x7fac1c10de10 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c1a0650 con 0x7fac1c10de10 2024-09-21T08:00:06.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.112+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c1a6db0 con 0x7fac1c10de10 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.113+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c104c70 con 0x7fac1c10de10 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.115+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fac140119d0 con 0x7fac1c10de10 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.116+0000 7fac1b7fe640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 0x7fac040b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.116+0000 7fac221ba640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 0x7fac040b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.116+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fac140e7490 con 0x7fac1c10de10 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.116+0000 7fac221ba640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 0x7fac040b8b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac0c005fd0 tx=0x7fac0c009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.119+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac140ad7c0 con 0x7fac1c10de10 2024-09-21T08:00:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:06 smithi006 ceph-mon[30970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T08:00:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:06 smithi006 ceph-mon[30970]: Cluster is now healthy 2024-09-21T08:00:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.310+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fac1c19b520 con 0x7fac1c10de10 2024-09-21T08:00:06.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.311+0000 7fac1b7fe640 1 -- 172.21.15.6:0/2597187251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fac1c19b520 con 0x7fac1c10de10 2024-09-21T08:00:06.312 INFO:teuthology.orchestra.run.smithi006.stdout:180388626487 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 msgr2=0x7fac040b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 0x7fac040b8b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac0c005fd0 tx=0x7fac0c009680 comp rx=0 tx=0).stop 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 msgr2=0x7fac1c19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac14009fd0 tx=0x7fac1400b8e0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 shutdown_connections 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fac040b6670 0x7fac040b8b80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac1c10de10 0x7fac1c19fc30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1c105290 0x7fac1c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 --2- 172.21.15.6:0/2597187251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac1c104860 0x7fac1c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 >> 172.21.15.6:0/2597187251 conn(0x7fac1c079730 msgr2=0x7fac1c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:06.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.313+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 shutdown_connections 2024-09-21T08:00:06.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.314+0000 7fac2441e640 1 -- 172.21.15.6:0/2597187251 wait complete. 2024-09-21T08:00:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:06 smithi119 ceph-mon[33564]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T08:00:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:06 smithi119 ceph-mon[33564]: Cluster is now healthy 2024-09-21T08:00:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:06 smithi145 ceph-mon[34049]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T08:00:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:06 smithi145 ceph-mon[34049]: Cluster is now healthy 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 -- 172.21.15.6:0/3291097531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 msgr2=0x7efdf0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 --2- 172.21.15.6:0/3291097531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf0110300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efde8009900 tx=0x7efde802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 -- 172.21.15.6:0/3291097531 shutdown_connections 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 --2- 172.21.15.6:0/3291097531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf0110300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 --2- 172.21.15.6:0/3291097531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf0105270 0x7efdf010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 --2- 172.21.15.6:0/3291097531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 0x7efdf0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 -- 172.21.15.6:0/3291097531 >> 172.21.15.6:0/3291097531 conn(0x7efdf0079730 msgr2=0x7efdf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:06.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 -- 172.21.15.6:0/3291097531 shutdown_connections 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.384+0000 7efdf5706640 1 -- 172.21.15.6:0/3291097531 wait complete. 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 Processor -- start 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 -- start start 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 0x7efdf019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf0105270 0x7efdf019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf01a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0113940 con 0x7efdf010ddf0 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efdf01137c0 con 0x7efdf0105270 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdf5706640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0113ac0 con 0x7efdf0104840 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf01a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf01a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54786/0 (socket says 172.21.15.6:54786) 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdef7fe640 1 -- 172.21.15.6:0/4241011371 learned_addr learned my addr 172.21.15.6:0/4241011371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:06.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdee7fc640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf0105270 0x7efdf019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.385+0000 7efdeeffd640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 0x7efdf019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 -- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 msgr2=0x7efdf019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 0x7efdf019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 -- 172.21.15.6:0/4241011371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf0105270 msgr2=0x7efdf019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf0105270 0x7efdf019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf01a2520 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdeeffd640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdf0104840 0x7efdf019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdef7fe640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf01a1df0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efde8005ab0 tx=0x7efde80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde803f030 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde8003a80 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf01a27b0 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8035070 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.386+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf01a8f70 con 0x7efdf010ddf0 2024-09-21T08:00:06.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.387+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdf00fffb0 con 0x7efdf010ddf0 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.389+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7efde8042030 con 0x7efdf010ddf0 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdd7fff640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efdd80b65f0 0x7efdd80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdeeffd640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efdd80b65f0 0x7efdd80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7efde8108390 con 0x7efdf010ddf0 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdd7fff640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] conn(0x7efdd80c1b80 0x7efdd80c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdd80c4740 con 0x7efdd80c1b80 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7efde8108740 con 0x7efdf010ddf0 2024-09-21T08:00:06.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.390+0000 7efdeeffd640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efdd80b65f0 0x7efdd80b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efdf006bc00 tx=0x7efde0009520 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.391+0000 7efdee7fc640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] conn(0x7efdd80c1b80 0x7efdd80c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.391+0000 7efdee7fc640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] conn(0x7efdd80c1b80 0x7efdd80c4070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.392+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== osd.2 v2:172.21.15.145:6800/1447926373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdd80c4740 con 0x7efdd80c1b80 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.405+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 --> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdf006b500 con 0x7efdd80c1b80 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.406+0000 7efdd7fff640 1 -- 172.21.15.6:0/4241011371 <== osd.2 v2:172.21.15.145:6800/1447926373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efdf006b500 con 0x7efdd80c1b80 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.406+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] conn(0x7efdd80c1b80 msgr2=0x7efdd80c4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.406+0000 7efdf5706640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] conn(0x7efdd80c1b80 0x7efdd80c4070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efdd80b65f0 msgr2=0x7efdd80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efdd80b65f0 0x7efdd80b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efdf006bc00 tx=0x7efde0009520 comp rx=0 tx=0).stop 2024-09-21T08:00:06.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 msgr2=0x7efdf01a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 --2- 172.21.15.6:0/4241011371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf010ddf0 0x7efdf01a1df0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efde8005ab0 tx=0x7efde80040e0 comp rx=0 tx=0).stop 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdef7fe640 1 -- 172.21.15.6:0/4241011371 reap_dead start 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 shutdown_connections 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 >> 172.21.15.6:0/4241011371 conn(0x7efdf0079730 msgr2=0x7efdf00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 shutdown_connections 2024-09-21T08:00:06.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:06.407+0000 7efdf5706640 1 -- 172.21.15.6:0/4241011371 wait complete. 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 -- 172.21.15.6:0/479983340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908108cf0 msgr2=0x7fa90810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 --2- 172.21.15.6:0/479983340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908108cf0 0x7fa90810f520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa900009900 tx=0x7fa90002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 -- 172.21.15.6:0/479983340 shutdown_connections 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 --2- 172.21.15.6:0/479983340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908108cf0 0x7fa90810f520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 --2- 172.21.15.6:0/479983340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 0x7fa9081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 --2- 172.21.15.6:0/479983340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa908102a60 0x7fa908102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 -- 172.21.15.6:0/479983340 >> 172.21.15.6:0/479983340 conn(0x7fa908079730 msgr2=0x7fa908079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.097+0000 7fa90fba7640 1 -- 172.21.15.6:0/479983340 shutdown_connections 2024-09-21T08:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.098+0000 7fa90fba7640 1 -- 172.21.15.6:0/479983340 wait complete. 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.098+0000 7fa90fba7640 1 Processor -- start 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 -- start start 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 0x7fa90819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 0x7fa90819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa908108cf0 0x7fa90819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa908112810 con 0x7fa908102a60 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa908112690 con 0x7fa9081083a0 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90fba7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa908112990 con 0x7fa908108cf0 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 0x7fa90819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 0x7fa90819b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54812/0 (socket says 172.21.15.6:54812) 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 -- 172.21.15.6:0/1627228977 learned_addr learned my addr 172.21.15.6:0/1627228977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d142640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 0x7fa90819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90e144640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa908108cf0 0x7fa90819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 -- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa908108cf0 msgr2=0x7fa90819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa908108cf0 0x7fa90819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 -- 172.21.15.6:0/1627228977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 msgr2=0x7fa90819b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 0x7fa90819b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d943640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9081a6340 con 0x7fa908102a60 2024-09-21T08:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.099+0000 7fa90d142640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9081083a0 0x7fa90819b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa90d943640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 0x7fa90819b140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ea80 tx=0x7fa90400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400ce40 con 0x7fa908102a60 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa904005020 con 0x7fa908102a60 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9081a6630 con 0x7fa908102a60 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040116d0 con 0x7fa908102a60 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.100+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9081a6b20 con 0x7fa908102a60 2024-09-21T08:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.101+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa908063b10 con 0x7fa908102a60 2024-09-21T08:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.103+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa904004a40 con 0x7fa908102a60 2024-09-21T08:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.103+0000 7fa8feffd640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8f40b6620 0x7fa8f40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa90d142640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8f40b6620 0x7fa8f40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa9040e8060 con 0x7fa908102a60 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa8feffd640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] conn(0x7fa8f40c1bb0 0x7fa8f40c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa904018ec0 con 0x7fa8f40c1bb0 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa9040e84b0 con 0x7fa908102a60 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa90d142640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8f40b6620 0x7fa8f40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa908079d40 tx=0x7fa8f800a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.104+0000 7fa90e144640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] conn(0x7fa8f40c1bb0 0x7fa8f40c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.105+0000 7fa90e144640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] conn(0x7fa8f40c1bb0 0x7fa8f40c40a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.105+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== osd.8 v2:172.21.15.145:6816/3838836474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa904018ec0 con 0x7fa8f40c1bb0 2024-09-21T08:00:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.119+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 --> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa908063f90 con 0x7fa8f40c1bb0 2024-09-21T08:00:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa8feffd640 1 -- 172.21.15.6:0/1627228977 <== osd.8 v2:172.21.15.145:6816/3838836474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa908063f90 con 0x7fa8f40c1bb0 2024-09-21T08:00:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] conn(0x7fa8f40c1bb0 msgr2=0x7fa8f40c40a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] conn(0x7fa8f40c1bb0 0x7fa8f40c40a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8f40b6620 msgr2=0x7fa8f40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8f40b6620 0x7fa8f40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa908079d40 tx=0x7fa8f800a5c0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 msgr2=0x7fa90819b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 --2- 172.21.15.6:0/1627228977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa908102a60 0x7fa90819b140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ea80 tx=0x7fa90400ef40 comp rx=0 tx=0).stop 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90e144640 1 -- 172.21.15.6:0/1627228977 reap_dead start 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 shutdown_connections 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 >> 172.21.15.6:0/1627228977 conn(0x7fa908079730 msgr2=0x7fa908104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 shutdown_connections 2024-09-21T08:00:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.120+0000 7fa90fba7640 1 -- 172.21.15.6:0/1627228977 wait complete. 2024-09-21T08:00:07.310 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:07 smithi006 ceph-mon[30970]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-09-21T08:00:07.311 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:07 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2597187251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T08:00:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:07 smithi119 ceph-mon[33564]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-09-21T08:00:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:07 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2597187251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T08:00:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:07 smithi145 ceph-mon[34049]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-09-21T08:00:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:07 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2597187251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T08:00:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 -- 172.21.15.6:0/3319568065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8102a60 msgr2=0x7ff7a8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 --2- 172.21.15.6:0/3319568065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8102a60 0x7ff7a8102e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009900 tx=0x7ff7a402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 -- 172.21.15.6:0/3319568065 shutdown_connections 2024-09-21T08:00:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 --2- 172.21.15.6:0/3319568065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7a81083a0 0x7ff7a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 --2- 172.21.15.6:0/3319568065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7a8108cf0 0x7ff7a810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.727+0000 7ff7b0269640 1 --2- 172.21.15.6:0/3319568065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8102a60 0x7ff7a8102e70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.728+0000 7ff7b0269640 1 -- 172.21.15.6:0/3319568065 >> 172.21.15.6:0/3319568065 conn(0x7ff7a8079730 msgr2=0x7ff7a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.728+0000 7ff7b0269640 1 -- 172.21.15.6:0/3319568065 shutdown_connections 2024-09-21T08:00:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.728+0000 7ff7b0269640 1 -- 172.21.15.6:0/3319568065 wait complete. 2024-09-21T08:00:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.728+0000 7ff7b0269640 1 Processor -- start 2024-09-21T08:00:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.728+0000 7ff7b0269640 1 -- start start 2024-09-21T08:00:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7a8102a60 0x7ff7a819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7a81083a0 0x7ff7a819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 0x7ff7a819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8112810 con 0x7ff7a8108cf0 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8112690 con 0x7ff7a81083a0 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7b0269640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8112990 con 0x7ff7a8102a60 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 0x7ff7a819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 0x7ff7a819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54822/0 (socket says 172.21.15.6:54822) 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 -- 172.21.15.6:0/859426449 learned_addr learned my addr 172.21.15.6:0/859426449 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ad804640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7a81083a0 0x7ff7a819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae005640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7a8102a60 0x7ff7a819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 -- 172.21.15.6:0/859426449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7a8102a60 msgr2=0x7ff7a819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7a8102a60 0x7ff7a819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 -- 172.21.15.6:0/859426449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7a81083a0 msgr2=0x7ff7a819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7a81083a0 0x7ff7a819a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a81a02c0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.729+0000 7ff7ae806640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 0x7ff7a819fb90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000eaa0 tx=0x7ff7a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.730+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000cdb0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.730+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a81a05b0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.730+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7a0005020 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.730+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00116d0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.730+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a81a6d10 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.731+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7a8106650 con 0x7ff7a8108cf0 2024-09-21T08:00:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.732+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff7a00051d0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff79f7fe640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7940b65f0 0x7ff7940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff7ae005640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7940b65f0 0x7ff7940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff7a00e7fd0 con 0x7ff7a8108cf0 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff79f7fe640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] conn(0x7ff7940c1b80 0x7ff7940c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7a001ce50 con 0x7ff7940c1b80 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.733+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7ff7a00e8380 con 0x7ff7a8108cf0 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.734+0000 7ff7ad804640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] conn(0x7ff7940c1b80 0x7ff7940c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.734+0000 7ff7ae005640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7940b65f0 0x7ff7940b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4000c00 tx=0x7ff7a4009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.734+0000 7ff7ad804640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] conn(0x7ff7940c1b80 0x7ff7940c4070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.735+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== osd.9 v2:172.21.15.6:6826/514953614 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7a001ce50 con 0x7ff7940c1b80 2024-09-21T08:00:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.748+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 --> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7a8103ce0 con 0x7ff7940c1b80 2024-09-21T08:00:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff79f7fe640 1 -- 172.21.15.6:0/859426449 <== osd.9 v2:172.21.15.6:6826/514953614 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff7a8103ce0 con 0x7ff7940c1b80 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] conn(0x7ff7940c1b80 msgr2=0x7ff7940c4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] conn(0x7ff7940c1b80 0x7ff7940c4070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7940b65f0 msgr2=0x7ff7940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7940b65f0 0x7ff7940b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4000c00 tx=0x7ff7a4009680 comp rx=0 tx=0).stop 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 msgr2=0x7ff7a819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 --2- 172.21.15.6:0/859426449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8108cf0 0x7ff7a819fb90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000eaa0 tx=0x7ff7a000ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7ae806640 1 -- 172.21.15.6:0/859426449 reap_dead start 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 shutdown_connections 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 >> 172.21.15.6:0/859426449 conn(0x7ff7a8079730 msgr2=0x7ff7a8101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 shutdown_connections 2024-09-21T08:00:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:07.749+0000 7ff7b0269640 1 -- 172.21.15.6:0/859426449 wait complete. 2024-09-21T08:00:08.455 INFO:teuthology.orchestra.run.smithi006.stdout:77309411404 2024-09-21T08:00:08.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T08:00:08.921 INFO:teuthology.orchestra.run.smithi006.stdout:223338299437 2024-09-21T08:00:08.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T08:00:09.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:09 smithi006 ceph-mon[30970]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T08:00:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:09 smithi119 ceph-mon[33564]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T08:00:09.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626487 for osd.6 2024-09-21T08:00:09.420 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:09 smithi145 ceph-mon[34049]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T08:00:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 -- 172.21.15.6:0/83744251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 msgr2=0x7fbde8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 --2- 172.21.15.6:0/83744251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde8110300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009900 tx=0x7fbde002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 -- 172.21.15.6:0/83744251 shutdown_connections 2024-09-21T08:00:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 --2- 172.21.15.6:0/83744251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 0x7fbde810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 --2- 172.21.15.6:0/83744251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde8110300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 --2- 172.21.15.6:0/83744251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 0x7fbde8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 -- 172.21.15.6:0/83744251 >> 172.21.15.6:0/83744251 conn(0x7fbde8079730 msgr2=0x7fbde8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 -- 172.21.15.6:0/83744251 shutdown_connections 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.023+0000 7fbdf003e640 1 -- 172.21.15.6:0/83744251 wait complete. 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 Processor -- start 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 -- start start 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 0x7fbde819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 0x7fbde819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113990 con 0x7fbde810ddf0 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113810 con 0x7fbde8104840 2024-09-21T08:00:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.024+0000 7fbdf003e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113b10 con 0x7fbde8105270 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54852/0 (socket says 172.21.15.6:54852) 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 -- 172.21.15.6:0/1268271860 learned_addr learned my addr 172.21.15.6:0/1268271860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbded5d9640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 0x7fbde819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdeddda640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 0x7fbde819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 -- 172.21.15.6:0/1268271860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 msgr2=0x7fbde819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 0x7fbde819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 -- 172.21.15.6:0/1268271860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 msgr2=0x7fbde819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 0x7fbde819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 -- 172.21.15.6:0/1268271860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde81a02f0 con 0x7fbde810ddf0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdee5db640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbde002aa00 tx=0x7fbde0003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde003f070 con 0x7fbde810ddf0 2024-09-21T08:00:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbde003bd00 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde81a0580 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0035030 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.025+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde81a6d40 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.026+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde8104c50 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.028+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fbde0042070 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.029+0000 7fbde6ffd640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 0x7fbdd00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.029+0000 7fbdeddda640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 0x7fbdd00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.029+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fbde0108620 con 0x7fbde810ddf0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.029+0000 7fbdeddda640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 0x7fbdd00b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbde806bc00 tx=0x7fbdd800a590 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.032+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbde00d2c90 con 0x7fbde810ddf0 2024-09-21T08:00:10.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.222+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbde819b4b0 con 0x7fbde810ddf0 2024-09-21T08:00:10.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.223+0000 7fbde6ffd640 1 -- 172.21.15.6:0/1268271860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbde819b4b0 con 0x7fbde810ddf0 2024-09-21T08:00:10.224 INFO:teuthology.orchestra.run.smithi006.stdout:60129542226 2024-09-21T08:00:10.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 msgr2=0x7fbdd00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 0x7fbdd00b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbde806bc00 tx=0x7fbdd800a590 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 msgr2=0x7fbde819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbde002aa00 tx=0x7fbde0003cb0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 shutdown_connections 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbdd00b6670 0x7fbdd00b8b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbde8105270 0x7fbde819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbde810ddf0 0x7fbde819fbc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 --2- 172.21.15.6:0/1268271860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde8104840 0x7fbde819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 >> 172.21.15.6:0/1268271860 conn(0x7fbde8079730 msgr2=0x7fbde8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 shutdown_connections 2024-09-21T08:00:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:10.225+0000 7fbdf003e640 1 -- 172.21.15.6:0/1268271860 wait complete. 2024-09-21T08:00:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:10.500 INFO:teuthology.orchestra.run.smithi006.stdout:249108103208 2024-09-21T08:00:10.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T08:00:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:11.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:11 smithi006 ceph-mon[30970]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:11.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1268271860' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T08:00:11.358 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542224 got 60129542226 for osd.1 2024-09-21T08:00:11.358 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:11 smithi119 ceph-mon[33564]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1268271860' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T08:00:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:11 smithi145 ceph-mon[34049]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1268271860' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T08:00:11.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.525+0000 7fb05560d640 1 -- 172.21.15.6:0/804782437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050109e40 msgr2=0x7fb050110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.525+0000 7fb05560d640 1 --2- 172.21.15.6:0/804782437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050109e40 0x7fb050110670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb048009ca0 tx=0x7fb04802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 -- 172.21.15.6:0/804782437 shutdown_connections 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 --2- 172.21.15.6:0/804782437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0501094f0 0x7fb050109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 --2- 172.21.15.6:0/804782437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb050109e40 0x7fb050110670 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 --2- 172.21.15.6:0/804782437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050103bb0 0x7fb050103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 -- 172.21.15.6:0/804782437 >> 172.21.15.6:0/804782437 conn(0x7fb0500ff600 msgr2=0x7fb050101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 -- 172.21.15.6:0/804782437 shutdown_connections 2024-09-21T08:00:11.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 -- 172.21.15.6:0/804782437 wait complete. 2024-09-21T08:00:11.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 Processor -- start 2024-09-21T08:00:11.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.526+0000 7fb05560d640 1 -- start start 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050103bb0 0x7fb05019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050109e40 0x7fb05019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb050113a80 con 0x7fb0501094f0 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb050113900 con 0x7fb050109e40 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb05560d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb050113c00 con 0x7fb050103bb0 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54866/0 (socket says 172.21.15.6:54866) 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 -- 172.21.15.6:0/3181968828 learned_addr learned my addr 172.21.15.6:0/3181968828 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb04effd640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050103bb0 0x7fb05019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb04f7fe640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050109e40 0x7fb05019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 -- 172.21.15.6:0/3181968828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050103bb0 msgr2=0x7fb05019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050103bb0 0x7fb05019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 -- 172.21.15.6:0/3181968828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050109e40 msgr2=0x7fb05019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050109e40 0x7fb05019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.527+0000 7fb047fff640 1 -- 172.21.15.6:0/3181968828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501a0380 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb047fff640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb03800d750 tx=0x7fb03800db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038017070 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a0670 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb038009820 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038004bc0 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.528+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0500755f0 con 0x7fb0501094f0 2024-09-21T08:00:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.529+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb050103fc0 con 0x7fb0501094f0 2024-09-21T08:00:11.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.531+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb0380099d0 con 0x7fb0501094f0 2024-09-21T08:00:11.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.532+0000 7fb04cff9640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 0x7fb03c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.532+0000 7fb04effd640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 0x7fb03c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.532+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb0380e76b0 con 0x7fb0501094f0 2024-09-21T08:00:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.533+0000 7fb04effd640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 0x7fb03c0b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb040009990 tx=0x7fb040009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:11.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.535+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0380ad940 con 0x7fb0501094f0 2024-09-21T08:00:11.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.733+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb05010bc10 con 0x7fb0501094f0 2024-09-21T08:00:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.733+0000 7fb04cff9640 1 -- 172.21.15.6:0/3181968828 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb0380b1d20 con 0x7fb0501094f0 2024-09-21T08:00:11.735 INFO:teuthology.orchestra.run.smithi006.stdout:133143986242 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 msgr2=0x7fb03c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 0x7fb03c0b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb040009990 tx=0x7fb040009110 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 msgr2=0x7fb05019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb03800d750 tx=0x7fb03800db50 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 shutdown_connections 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb03c0b65f0 0x7fb03c0b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb050109e40 0x7fb05019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0501094f0 0x7fb05019a9b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 --2- 172.21.15.6:0/3181968828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050103bb0 0x7fb05019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 >> 172.21.15.6:0/3181968828 conn(0x7fb0500ff600 msgr2=0x7fb050101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 shutdown_connections 2024-09-21T08:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:11.735+0000 7fb05560d640 1 -- 172.21.15.6:0/3181968828 wait complete. 2024-09-21T08:00:12.336 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:12 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3181968828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T08:00:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:12 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3181968828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T08:00:12.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:12 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3181968828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T08:00:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4086135434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0109e10 msgr2=0x7fa5f0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4086135434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0109e10 0x7fa5f0110640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009ca0 tx=0x7fa5e802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4086135434 shutdown_connections 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4086135434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f01094c0 0x7fa5f01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4086135434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0109e10 0x7fa5f0110640 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4086135434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f0103b80 0x7fa5f0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.520+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4086135434 >> 172.21.15.6:0/4086135434 conn(0x7fa5f00ff5d0 msgr2=0x7fa5f0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.521+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4086135434 shutdown_connections 2024-09-21T08:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.521+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4086135434 wait complete. 2024-09-21T08:00:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.522+0000 7fa5f7de6640 1 Processor -- start 2024-09-21T08:00:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.522+0000 7fa5f7de6640 1 -- start start 2024-09-21T08:00:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f7de6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f7de6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 0x7fa5f019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f7de6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f0109e10 0x7fa5f019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f5b82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f5b82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54878/0 (socket says 172.21.15.6:54878) 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.523+0000 7fa5f5b82640 1 -- 172.21.15.6:0/4022872460 learned_addr learned my addr 172.21.15.6:0/4022872460 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f01139d0 con 0x7fa5f0103b80 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5381640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 0x7fa5f019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f6383640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f0109e10 0x7fa5f019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0113850 con 0x7fa5f01094c0 2024-09-21T08:00:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0113b50 con 0x7fa5f0109e10 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5b82640 1 -- 172.21.15.6:0/4022872460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f0109e10 msgr2=0x7fa5f019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5b82640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f0109e10 0x7fa5f019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5b82640 1 -- 172.21.15.6:0/4022872460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 msgr2=0x7fa5f019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5b82640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 0x7fa5f019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5b82640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f01a02f0 con 0x7fa5f0103b80 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.524+0000 7fa5f5381640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 0x7fa5f019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.525+0000 7fa5f5b82640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00d950 tx=0x7fa5ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.525+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec017070 con 0x7fa5f0103b80 2024-09-21T08:00:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.525+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f01a05e0 con 0x7fa5f0103b80 2024-09-21T08:00:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.525+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5ec009c30 con 0x7fa5f0103b80 2024-09-21T08:00:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.525+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f00755f0 con 0x7fa5f0103b80 2024-09-21T08:00:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.526+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00f620 con 0x7fa5f0103b80 2024-09-21T08:00:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.527+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f0103f90 con 0x7fa5f0103b80 2024-09-21T08:00:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.529+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa5ec00f7c0 con 0x7fa5f0103b80 2024-09-21T08:00:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.531+0000 7fa5e6ffd640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 0x7fa5dc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.531+0000 7fa5f5381640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 0x7fa5dc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.532+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa5ec0e7550 con 0x7fa5f0103b80 2024-09-21T08:00:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.532+0000 7fa5f5381640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 0x7fa5dc0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0106f70 tx=0x7fa5e0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.536+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5ec009de0 con 0x7fa5f0103b80 2024-09-21T08:00:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/1760854799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 msgr2=0x7ff1b0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/1760854799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b0102e70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009900 tx=0x7ff1a002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/1760854799 shutdown_connections 2024-09-21T08:00:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/1760854799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 0x7ff1b010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/1760854799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 0x7ff1b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/1760854799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b0102e70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.731+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/1760854799 >> 172.21.15.6:0/1760854799 conn(0x7ff1b0079730 msgr2=0x7ff1b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.732+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/1760854799 shutdown_connections 2024-09-21T08:00:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.732+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/1760854799 wait complete. 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.732+0000 7ff1b4f7e640 1 Processor -- start 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 -- start start 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 0x7ff1b019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 0x7ff1b01a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0112810 con 0x7ff1b0102a60 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0112690 con 0x7ff1b01083a0 2024-09-21T08:00:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1b4f7e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0112990 con 0x7ff1b0108cf0 2024-09-21T08:00:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1add9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 0x7ff1b019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54908/0 (socket says 172.21.15.6:54908) 2024-09-21T08:00:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1ae59c640 1 -- 172.21.15.6:0/3157336780 learned_addr learned my addr 172.21.15.6:0/3157336780 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.733+0000 7ff1aed9d640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 0x7ff1b01a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 -- 172.21.15.6:0/3157336780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 msgr2=0x7ff1b01a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 0x7ff1b01a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 -- 172.21.15.6:0/3157336780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 msgr2=0x7ff1b019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 0x7ff1b019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 -- 172.21.15.6:0/3157336780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b01a2560 con 0x7ff1b0102a60 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1ae59c640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009a20 tx=0x7ff1a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a003f030 con 0x7ff1b0102a60 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1a0003800 con 0x7ff1b0102a60 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.734+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b01a27f0 con 0x7ff1b0102a60 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.735+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0035070 con 0x7ff1b0102a60 2024-09-21T08:00:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.735+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b01a8fb0 con 0x7ff1b0102a60 2024-09-21T08:00:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.736+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b0103ce0 con 0x7ff1b0102a60 2024-09-21T08:00:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.740+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa5f010bc00 con 0x7fa5f0103b80 2024-09-21T08:00:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.738+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff1a0031a70 con 0x7ff1b0102a60 2024-09-21T08:00:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.739+0000 7ff1a77fe640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 0x7ff1940b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.740+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff1a0108660 con 0x7ff1b0102a60 2024-09-21T08:00:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.740+0000 7ff1add9b640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 0x7ff1940b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.741+0000 7ff1add9b640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 0x7ff1940b8c00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0100e00 tx=0x7ff19c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.743+0000 7fa5e6ffd640 1 -- 172.21.15.6:0/4022872460 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa5ec0b1bc0 con 0x7fa5f0103b80 2024-09-21T08:00:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.743+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1a00d2c70 con 0x7ff1b0102a60 2024-09-21T08:00:12.745 INFO:teuthology.orchestra.run.smithi006.stdout:201863462962 2024-09-21T08:00:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 msgr2=0x7fa5dc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 0x7fa5dc0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0106f70 tx=0x7fa5e0005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 msgr2=0x7fa5f019a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00d950 tx=0x7fa5ec00de10 comp rx=0 tx=0).stop 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 shutdown_connections 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5dc0b65f0 0x7fa5dc0b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5f0109e10 0x7fa5f019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5f01094c0 0x7fa5f019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 --2- 172.21.15.6:0/4022872460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0103b80 0x7fa5f019a380 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 >> 172.21.15.6:0/4022872460 conn(0x7fa5f00ff5d0 msgr2=0x7fa5f01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 shutdown_connections 2024-09-21T08:00:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.746+0000 7fa5f7de6640 1 -- 172.21.15.6:0/4022872460 wait complete. 2024-09-21T08:00:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.935+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff1b0105840 con 0x7ff1b0102a60 2024-09-21T08:00:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.936+0000 7ff1a77fe640 1 -- 172.21.15.6:0/3157336780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff1a00d7bb0 con 0x7ff1b0102a60 2024-09-21T08:00:12.937 INFO:teuthology.orchestra.run.smithi006.stdout:154618822717 2024-09-21T08:00:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 msgr2=0x7ff1940b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 0x7ff1940b8c00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0100e00 tx=0x7ff19c00a2d0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 msgr2=0x7ff1b019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009a20 tx=0x7ff1a0004270 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 shutdown_connections 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1940b66f0 0x7ff1940b8c00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1b0108cf0 0x7ff1b01a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1b01083a0 0x7ff1b019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 --2- 172.21.15.6:0/3157336780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b0102a60 0x7ff1b019c5f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 >> 172.21.15.6:0/3157336780 conn(0x7ff1b0079730 msgr2=0x7ff1b0101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 shutdown_connections 2024-09-21T08:00:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:12.938+0000 7ff1b4f7e640 1 -- 172.21.15.6:0/3157336780 wait complete. 2024-09-21T08:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:13 smithi006 ceph-mon[30970]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4022872460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T08:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:13 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3157336780' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T08:00:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:13 smithi119 ceph-mon[33564]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4022872460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T08:00:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:13 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3157336780' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T08:00:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:13 smithi145 ceph-mon[34049]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4022872460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T08:00:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:13 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3157336780' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T08:00:13.810 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822715 got 154618822717 for osd.5 2024-09-21T08:00:13.810 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 -- 172.21.15.6:0/3055968788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc10de10 msgr2=0x7faafc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 --2- 172.21.15.6:0/3055968788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc10de10 0x7faafc110300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009ca0 tx=0x7faaf402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 -- 172.21.15.6:0/3055968788 shutdown_connections 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 --2- 172.21.15.6:0/3055968788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc10de10 0x7faafc110300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 --2- 172.21.15.6:0/3055968788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc105300 0x7faafc10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 --2- 172.21.15.6:0/3055968788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc1049b0 0x7faafc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 -- 172.21.15.6:0/3055968788 >> 172.21.15.6:0/3055968788 conn(0x7faafc079730 msgr2=0x7faafc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 -- 172.21.15.6:0/3055968788 shutdown_connections 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.235+0000 7fab01642640 1 -- 172.21.15.6:0/3055968788 wait complete. 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 Processor -- start 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 -- start start 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc105300 0x7faafc19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 0x7faafc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faafc113970 con 0x7faafc1049b0 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.236+0000 7fab01642640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faafc1137f0 con 0x7faafc10de10 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7fab01642640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faafc113af0 con 0x7faafc105300 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54922/0 (socket says 172.21.15.6:54922) 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 -- 172.21.15.6:0/1304470318 learned_addr learned my addr 172.21.15.6:0/1304470318 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafa7fc640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc105300 0x7faafc19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafb7fe640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 0x7faafc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 -- 172.21.15.6:0/1304470318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc105300 msgr2=0x7faafc19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc105300 0x7faafc19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 -- 172.21.15.6:0/1304470318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 msgr2=0x7faafc19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 0x7faafc19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 -- 172.21.15.6:0/1304470318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1a02b0 con 0x7faafc1049b0 2024-09-21T08:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafb7fe640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 0x7faafc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faafaffd640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faaec00d950 tx=0x7faaec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec017020 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc1a05a0 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaec009c30 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec00f620 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.237+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc1a6d00 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.239+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc104dc0 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.241+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7faaec01a020 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.242+0000 7faae3fff640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 0x7faae40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.242+0000 7faafa7fc640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 0x7faae40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.242+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7faaec0e77b0 con 0x7faafc1049b0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.242+0000 7faafa7fc640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 0x7faae40b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faaf0005d90 tx=0x7faaf0005d20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.245+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faaec021070 con 0x7faafc1049b0 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 -- 172.21.15.6:0/2879669335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 msgr2=0x7f754c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 --2- 172.21.15.6:0/2879669335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c075bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f753c009900 tx=0x7f753c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 -- 172.21.15.6:0/2879669335 shutdown_connections 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 --2- 172.21.15.6:0/2879669335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c076100 0x7f754c10fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 --2- 172.21.15.6:0/2879669335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c1100f0 0x7f754c112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 --2- 172.21.15.6:0/2879669335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c075bc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 -- 172.21.15.6:0/2879669335 >> 172.21.15.6:0/2879669335 conn(0x7f754c0ff600 msgr2=0x7f754c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 -- 172.21.15.6:0/2879669335 shutdown_connections 2024-09-21T08:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.436+0000 7f755245f640 1 -- 172.21.15.6:0/2879669335 wait complete. 2024-09-21T08:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 Processor -- start 2024-09-21T08:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 -- start start 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c076100 0x7f754c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c1100f0 0x7f754c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f754c115b50 con 0x7f754c0757b0 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1159d0 con 0x7f754c076100 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f755245f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f754c115cd0 con 0x7f754c1100f0 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f754bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f754bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54928/0 (socket says 172.21.15.6:54928) 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.437+0000 7f754bfff640 1 -- 172.21.15.6:0/1157746663 learned_addr learned my addr 172.21.15.6:0/1157746663 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754b7fe640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c076100 0x7f754c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f75509fc640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c1100f0 0x7f754c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 -- 172.21.15.6:0/1157746663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c1100f0 msgr2=0x7f754c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c1100f0 0x7f754c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 -- 172.21.15.6:0/1157746663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c076100 msgr2=0x7f754c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c076100 0x7f754c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 -- 172.21.15.6:0/1157746663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1a24f0 con 0x7f754c0757b0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f754bfff640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f753c009230 tx=0x7f753c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c03f030 con 0x7f754c0757b0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.438+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c1a2780 con 0x7f754c0757b0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.439+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c003a80 con 0x7f754c0757b0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.439+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c035070 con 0x7f754c0757b0 2024-09-21T08:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.439+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1a2cb0 con 0x7f754c0757b0 2024-09-21T08:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.440+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7faafc1a70e0 con 0x7faafc1049b0 2024-09-21T08:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.440+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c076cc0 con 0x7f754c0757b0 2024-09-21T08:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.440+0000 7faae3fff640 1 -- 172.21.15.6:0/1304470318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7faaec009de0 con 0x7faafc1049b0 2024-09-21T08:00:14.442 INFO:teuthology.orchestra.run.smithi006.stdout:270582939684 2024-09-21T08:00:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.442+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f753c042030 con 0x7f754c0757b0 2024-09-21T08:00:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.442+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 msgr2=0x7faae40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.442+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 0x7faae40b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faaf0005d90 tx=0x7faaf0005d20 comp rx=0 tx=0).stop 2024-09-21T08:00:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.442+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 msgr2=0x7faafc19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.442+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faaec00d950 tx=0x7faaec00de10 comp rx=0 tx=0).stop 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 shutdown_connections 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faae40b65f0 0x7faae40b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faafc105300 0x7faafc19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faafc10de10 0x7faafc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 --2- 172.21.15.6:0/1304470318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faafc1049b0 0x7faafc19a340 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 >> 172.21.15.6:0/1304470318 conn(0x7faafc079730 msgr2=0x7faafc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 shutdown_connections 2024-09-21T08:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.443+0000 7fab01642640 1 -- 172.21.15.6:0/1304470318 wait complete. 2024-09-21T08:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.444+0000 7f75497fa640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 0x7f75340b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.444+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f753c1083f0 con 0x7f754c0757b0 2024-09-21T08:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.444+0000 7f754b7fe640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 0x7f75340b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.444+0000 7f754b7fe640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 0x7f75340b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f754c112520 tx=0x7f7540005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.447+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f754c1a2cb0 con 0x7f754c0757b0 2024-09-21T08:00:14.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.649+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f754c19d770 con 0x7f754c0757b0 2024-09-21T08:00:14.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.649+0000 7f75497fa640 1 -- 172.21.15.6:0/1157746663 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f753c0d2a60 con 0x7f754c0757b0 2024-09-21T08:00:14.651 INFO:teuthology.orchestra.run.smithi006.stdout:38654705752 2024-09-21T08:00:14.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 msgr2=0x7f75340b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 0x7f75340b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f754c112520 tx=0x7f7540005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:14.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 msgr2=0x7f754c19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f753c009230 tx=0x7f753c004270 comp rx=0 tx=0).stop 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 shutdown_connections 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75340b6620 0x7f75340b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f754c1100f0 0x7f754c1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f754c076100 0x7f754c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 --2- 172.21.15.6:0/1157746663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c0757b0 0x7f754c19c640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 >> 172.21.15.6:0/1157746663 conn(0x7f754c0ff600 msgr2=0x7f754c109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 shutdown_connections 2024-09-21T08:00:14.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.652+0000 7f755245f640 1 -- 172.21.15.6:0/1157746663 wait complete. 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 -- 172.21.15.6:0/2711478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 msgr2=0x7ffa1c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 --2- 172.21.15.6:0/2711478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c104dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009900 tx=0x7ffa0c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 -- 172.21.15.6:0/2711478859 shutdown_connections 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 --2- 172.21.15.6:0/2711478859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c105300 0x7ffa1c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 --2- 172.21.15.6:0/2711478859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c10de10 0x7ffa1c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 --2- 172.21.15.6:0/2711478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c104dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 -- 172.21.15.6:0/2711478859 >> 172.21.15.6:0/2711478859 conn(0x7ffa1c079730 msgr2=0x7ffa1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 -- 172.21.15.6:0/2711478859 shutdown_connections 2024-09-21T08:00:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.892+0000 7ffa21258640 1 -- 172.21.15.6:0/2711478859 wait complete. 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 Processor -- start 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 -- start start 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c105300 0x7ffa1c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 0x7ffa1c1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c113940 con 0x7ffa1c1049b0 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c1137c0 con 0x7ffa1c105300 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa21258640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c113ac0 con 0x7ffa1c10de10 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54942/0 (socket says 172.21.15.6:54942) 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa1ad9d640 1 -- 172.21.15.6:0/1268043610 learned_addr learned my addr 172.21.15.6:0/1268043610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa1a59c640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c105300 0x7ffa1c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.893+0000 7ffa1b59e640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 0x7ffa1c1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 -- 172.21.15.6:0/1268043610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 msgr2=0x7ffa1c1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 0x7ffa1c1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 -- 172.21.15.6:0/1268043610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c105300 msgr2=0x7ffa1c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c105300 0x7ffa1c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 -- 172.21.15.6:0/1268043610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c1a25f0 con 0x7ffa1c1049b0 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1b59e640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 0x7ffa1c1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa1ad9d640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005940 tx=0x7ffa0c005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c03f030 con 0x7ffa1c1049b0 2024-09-21T08:00:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c1a2880 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa0c0043d0 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c035070 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.894+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c1a9040 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.895+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c104dc0 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.897+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ffa0c042030 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.898+0000 7ffa03fff640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 0x7ffa040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.898+0000 7ffa1a59c640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 0x7ffa040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.898+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ffa0c108160 con 0x7ffa1c1049b0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.898+0000 7ffa1a59c640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 0x7ffa040b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c10fcc0 tx=0x7ffa10005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:14.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:14.905+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa0c0ce3f0 con 0x7ffa1c1049b0 2024-09-21T08:00:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.099+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffa1c1a9240 con 0x7ffa1c1049b0 2024-09-21T08:00:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.100+0000 7ffa03fff640 1 -- 172.21.15.6:0/1268043610 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa0c0d27d0 con 0x7ffa1c1049b0 2024-09-21T08:00:15.102 INFO:teuthology.orchestra.run.smithi006.stdout:77309411405 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 msgr2=0x7ffa040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 0x7ffa040b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c10fcc0 tx=0x7ffa10005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 msgr2=0x7ffa1c19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005940 tx=0x7ffa0c005e30 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 shutdown_connections 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa040b65f0 0x7ffa040b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1c10de10 0x7ffa1c1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa1c105300 0x7ffa1c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 --2- 172.21.15.6:0/1268043610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa1c1049b0 0x7ffa1c19c680 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.102+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 >> 172.21.15.6:0/1268043610 conn(0x7ffa1c079730 msgr2=0x7ffa1c1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.103+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 shutdown_connections 2024-09-21T08:00:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.103+0000 7ffa21258640 1 -- 172.21.15.6:0/1268043610 wait complete. 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 -- 172.21.15.6:0/4283849516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f44105270 msgr2=0x7f8f4410d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 --2- 172.21.15.6:0/4283849516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f44105270 0x7f8f4410d8b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009900 tx=0x7f8f2c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 -- 172.21.15.6:0/4283849516 shutdown_connections 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 --2- 172.21.15.6:0/4283849516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f4410ddf0 0x7f8f44110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 --2- 172.21.15.6:0/4283849516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f44105270 0x7f8f4410d8b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 --2- 172.21.15.6:0/4283849516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 0x7f8f44104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 -- 172.21.15.6:0/4283849516 >> 172.21.15.6:0/4283849516 conn(0x7f8f44079730 msgr2=0x7f8f44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 -- 172.21.15.6:0/4283849516 shutdown_connections 2024-09-21T08:00:15.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 -- 172.21.15.6:0/4283849516 wait complete. 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.176+0000 7f8f49980640 1 Processor -- start 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 -- start start 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 0x7f8f4419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 0x7f8f4419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44113970 con 0x7f8f4410ddf0 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441137f0 con 0x7f8f44104840 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f49980640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44113af0 con 0x7f8f44105270 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54958/0 (socket says 172.21.15.6:54958) 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f437fe640 1 -- 172.21.15.6:0/1610174349 learned_addr learned my addr 172.21.15.6:0/1610174349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f42ffd640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 0x7f8f4419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.177+0000 7f8f427fc640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 0x7f8f4419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 -- 172.21.15.6:0/1610174349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 msgr2=0x7f8f4419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 0x7f8f4419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 -- 172.21.15.6:0/1610174349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 msgr2=0x7f8f4419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 0x7f8f4419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 -- 172.21.15.6:0/1610174349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f441a02f0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f427fc640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 0x7f8f4419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f437fe640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e970 tx=0x7f8f3c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00ccc0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f3c00ce60 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f441a05e0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c010430 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.178+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f441a6d40 con 0x7f8f4410ddf0 2024-09-21T08:00:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.179+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4406b500 con 0x7f8f4410ddf0 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.181+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f8f3c004ef0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.182+0000 7f8f4897e640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 0x7f8f300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.182+0000 7f8f42ffd640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 0x7f8f300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.182+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8f3c0e7fc0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.182+0000 7f8f42ffd640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 0x7f8f300b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f4406bc00 tx=0x7f8f34009670 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.185+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f3c056710 con 0x7f8f4410ddf0 2024-09-21T08:00:15.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:15 smithi006 ceph-mon[30970]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:15.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:15 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1304470318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T08:00:15.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:15 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1157746663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T08:00:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.379+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8f44108fd0 con 0x7f8f4410ddf0 2024-09-21T08:00:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.380+0000 7f8f4897e640 1 -- 172.21.15.6:0/1610174349 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f3c0ae250 con 0x7f8f4410ddf0 2024-09-21T08:00:15.381 INFO:teuthology.orchestra.run.smithi006.stdout:107374182472 2024-09-21T08:00:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.382+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 msgr2=0x7f8f300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.382+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 0x7f8f300b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f4406bc00 tx=0x7f8f34009670 comp rx=0 tx=0).stop 2024-09-21T08:00:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.382+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 msgr2=0x7f8f4419fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.382+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e970 tx=0x7f8f3c00ed70 comp rx=0 tx=0).stop 2024-09-21T08:00:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 shutdown_connections 2024-09-21T08:00:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f300b65f0 0x7f8f300b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f44105270 0x7f8f4419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4410ddf0 0x7f8f4419fbc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 --2- 172.21.15.6:0/1610174349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f44104840 0x7f8f4419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 >> 172.21.15.6:0/1610174349 conn(0x7f8f44079730 msgr2=0x7f8f44100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 shutdown_connections 2024-09-21T08:00:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:15.383+0000 7f8f49980640 1 -- 172.21.15.6:0/1610174349 wait complete. 2024-09-21T08:00:15.388 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:15.390 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:15 smithi119 ceph-mon[33564]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:15 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1304470318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T08:00:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:15 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1157746663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T08:00:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:15 smithi145 ceph-mon[34049]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:00:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:15 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1304470318' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T08:00:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:15 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1157746663' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T08:00:16.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705749 got 38654705752 for osd.0 2024-09-21T08:00:16.117 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:16.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:16 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1268043610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T08:00:16.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:16 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1610174349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T08:00:16.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:16 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1268043610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T08:00:16.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:16 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1610174349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T08:00:16.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:16 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1268043610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T08:00:16.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:16 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1610174349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T08:00:16.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986239 got 133143986242 for osd.4 2024-09-21T08:00:16.606 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:17.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:17 smithi006 ceph-mon[30970]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-09-21T08:00:17.280 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462960 got 201863462962 for osd.7 2024-09-21T08:00:17.281 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:17 smithi119 ceph-mon[33564]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-09-21T08:00:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:17 smithi145 ceph-mon[34049]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-09-21T08:00:17.706 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939684 for osd.10 2024-09-21T08:00:17.706 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:18.337 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182469 got 107374182472 for osd.3 2024-09-21T08:00:18.338 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 -- 172.21.15.6:0/2076418281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c102b40 msgr2=0x7f3b5c102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/2076418281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c102b40 0x7f3b5c102f50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009900 tx=0x7f3b4c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 -- 172.21.15.6:0/2076418281 shutdown_connections 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/2076418281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c108480 0x7f3b5c108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/2076418281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 0x7f3b5c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/2076418281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c102b40 0x7f3b5c102f50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 -- 172.21.15.6:0/2076418281 >> 172.21.15.6:0/2076418281 conn(0x7f3b5c079750 msgr2=0x7f3b5c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 -- 172.21.15.6:0/2076418281 shutdown_connections 2024-09-21T08:00:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.256+0000 7f3b60bbf640 1 -- 172.21.15.6:0/2076418281 wait complete. 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 Processor -- start 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 -- start start 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c102b40 0x7f3b5c19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 0x7f3b5c19fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c112850 con 0x7f3b5c108480 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1126d0 con 0x7f3b5c108dd0 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b60bbf640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1129d0 con 0x7f3b5c102b40 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56660/0 (socket says 172.21.15.6:56660) 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.257+0000 7f3b59d9b640 1 -- 172.21.15.6:0/1391972134 learned_addr learned my addr 172.21.15.6:0/1391972134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b5a59c640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c102b40 0x7f3b5c19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b5ad9d640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 0x7f3b5c19fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 -- 172.21.15.6:0/1391972134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c102b40 msgr2=0x7f3b5c19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c102b40 0x7f3b5c19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 -- 172.21.15.6:0/1391972134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 msgr2=0x7f3b5c19fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 0x7f3b5c19fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 -- 172.21.15.6:0/1391972134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1a02c0 con 0x7f3b5c108480 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b59d9b640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d770 tx=0x7f3b4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44017070 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1a05b0 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b44009c30 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400f620 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.258+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1a6d10 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.259+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c103dc0 con 0x7f3b5c108480 2024-09-21T08:00:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.261+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3b4401a070 con 0x7f3b5c108480 2024-09-21T08:00:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.262+0000 7f3b537fe640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 0x7f3b480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.262+0000 7f3b5a59c640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 0x7f3b480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.262+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3b440e7410 con 0x7f3b5c108480 2024-09-21T08:00:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.262+0000 7f3b5a59c640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 0x7f3b480b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0057c0 tx=0x7f3b4c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.265+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b44009de0 con 0x7f3b5c108480 2024-09-21T08:00:19.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:19 smithi006 ceph-mon[30970]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.461+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3b5c19b480 con 0x7f3b5c108480 2024-09-21T08:00:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.461+0000 7f3b537fe640 1 -- 172.21.15.6:0/1391972134 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3b440b1a80 con 0x7f3b5c108480 2024-09-21T08:00:19.463 INFO:teuthology.orchestra.run.smithi006.stdout:296352743456 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 msgr2=0x7f3b480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 0x7f3b480b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0057c0 tx=0x7f3b4c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 msgr2=0x7f3b5c19a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d770 tx=0x7f3b4400dc30 comp rx=0 tx=0).stop 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 shutdown_connections 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b480b65f0 0x7f3b480b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b5c108dd0 0x7f3b5c19fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5c108480 0x7f3b5c19a8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 --2- 172.21.15.6:0/1391972134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b5c102b40 0x7f3b5c19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 >> 172.21.15.6:0/1391972134 conn(0x7f3b5c079750 msgr2=0x7f3b5c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 shutdown_connections 2024-09-21T08:00:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.464+0000 7f3b60bbf640 1 -- 172.21.15.6:0/1391972134 wait complete. 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.505+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2603902652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 msgr2=0x7fa5d81087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.505+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2603902652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81087c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009900 tx=0x7fa5c002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2603902652 shutdown_connections 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2603902652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8108d00 0x7fa5d810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2603902652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81087c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2603902652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8102ac0 0x7fa5d8102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2603902652 >> 172.21.15.6:0/2603902652 conn(0x7fa5d8079790 msgr2=0x7fa5d8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2603902652 shutdown_connections 2024-09-21T08:00:19.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.506+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2603902652 wait complete. 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 Processor -- start 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 -- start start 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8102ac0 0x7fa5d8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8108d00 0x7fa5d819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d8112870 con 0x7fa5d81083b0 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81126f0 con 0x7fa5d8102ac0 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5dd9f4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81129f0 con 0x7fa5d8108d00 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56690/0 (socket says 172.21.15.6:56690) 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5cffff640 1 -- 172.21.15.6:0/2136492082 learned_addr learned my addr 172.21.15.6:0/2136492082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:19.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.507+0000 7fa5d77fe640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8108d00 0x7fa5d819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5d6ffd640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8102ac0 0x7fa5d8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 -- 172.21.15.6:0/2136492082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8108d00 msgr2=0x7fa5d819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8108d00 0x7fa5d819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 -- 172.21.15.6:0/2136492082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8102ac0 msgr2=0x7fa5d8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8102ac0 0x7fa5d8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 -- 172.21.15.6:0/2136492082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d819f270 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5cffff640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0004770 tx=0x7fa5c0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c003f030 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5c0004440 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d819f500 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0035070 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.508+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d81a5cc0 con 0x7fa5d81083b0 2024-09-21T08:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.509+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d8103cf0 con 0x7fa5d81083b0 2024-09-21T08:00:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.511+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa5c0042030 con 0x7fa5d81083b0 2024-09-21T08:00:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.512+0000 7fa5dc9f2640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 0x7fa5c40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.512+0000 7fa5d6ffd640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 0x7fa5c40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.512+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa5c0108130 con 0x7fa5d81083b0 2024-09-21T08:00:19.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.513+0000 7fa5d6ffd640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 0x7fa5c40b8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8005fd0 tx=0x7fa5c8005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:19.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.516+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5c00ce3c0 con 0x7fa5d81083b0 2024-09-21T08:00:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:19 smithi119 ceph-mon[33564]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:19 smithi145 ceph-mon[34049]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:19.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.706+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa5d8102ed0 con 0x7fa5d81083b0 2024-09-21T08:00:19.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.707+0000 7fa5dc9f2640 1 -- 172.21.15.6:0/2136492082 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa5d8102ed0 con 0x7fa5d81083b0 2024-09-21T08:00:19.708 INFO:teuthology.orchestra.run.smithi006.stdout:249108103210 2024-09-21T08:00:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 msgr2=0x7fa5c40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 0x7fa5c40b8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8005fd0 tx=0x7fa5c8005850 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 msgr2=0x7fa5d81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0004770 tx=0x7fa5c0004040 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 shutdown_connections 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa5c40b6670 0x7fa5c40b8b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5d8108d00 0x7fa5d819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d81083b0 0x7fa5d81998a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 --2- 172.21.15.6:0/2136492082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d8102ac0 0x7fa5d8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 >> 172.21.15.6:0/2136492082 conn(0x7fa5d8079790 msgr2=0x7fa5d81044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 shutdown_connections 2024-09-21T08:00:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:19.709+0000 7fa5dd9f4640 1 -- 172.21.15.6:0/2136492082 wait complete. 2024-09-21T08:00:20.407 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103208 got 249108103210 for osd.9 2024-09-21T08:00:20.407 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:20 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1391972134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T08:00:20.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:20 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2136492082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T08:00:20.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:20 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1391972134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T08:00:20.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:20 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2136492082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T08:00:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:20 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1391972134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T08:00:20.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:20 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2136492082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T08:00:20.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743453 got 296352743456 for osd.11 2024-09-21T08:00:20.839 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:21.300 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411405 for osd.2 2024-09-21T08:00:21.300 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:21.516 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:21 smithi006 ceph-mon[30970]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:21 smithi119 ceph-mon[33564]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:21 smithi145 ceph-mon[34049]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 -- 172.21.15.6:0/2309404258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4102030 msgr2=0x7f26b4102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 --2- 172.21.15.6:0/2309404258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4102030 0x7f26b4102440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009900 tx=0x7f26a402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 -- 172.21.15.6:0/2309404258 shutdown_connections 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 --2- 172.21.15.6:0/2309404258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106bd0 0x7f26b4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 --2- 172.21.15.6:0/2309404258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4106280 0x7f26b4106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 --2- 172.21.15.6:0/2309404258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4102030 0x7f26b4102440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 -- 172.21.15.6:0/2309404258 >> 172.21.15.6:0/2309404258 conn(0x7f26b4077c60 msgr2=0x7f26b40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 -- 172.21.15.6:0/2309404258 shutdown_connections 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.759+0000 7f26b9276640 1 -- 172.21.15.6:0/2309404258 wait complete. 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 Processor -- start 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 -- start start 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4102030 0x7f26b419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106280 0x7f26b419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4113950 con 0x7f26b4106bd0 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41137d0 con 0x7f26b4102030 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b9276640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4113ad0 con 0x7f26b4106280 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56696/0 (socket says 172.21.15.6:56696) 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.760+0000 7f26b37fe640 1 -- 172.21.15.6:0/2481276461 learned_addr learned my addr 172.21.15.6:0/2481276461 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b27fc640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106280 0x7f26b419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b2ffd640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4102030 0x7f26b419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 -- 172.21.15.6:0/2481276461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106280 msgr2=0x7f26b419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106280 0x7f26b419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 -- 172.21.15.6:0/2481276461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4102030 msgr2=0x7f26b419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4102030 0x7f26b419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 -- 172.21.15.6:0/2481276461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b41a2650 con 0x7f26b4106bd0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b37fe640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00eaa0 tx=0x7f26ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00cdb0 con 0x7f26b4106bd0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26ac005020 con 0x7f26b4106bd0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b41a2940 con 0x7f26b4106bd0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0116d0 con 0x7f26b4106bd0 2024-09-21T08:00:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.761+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41a90a0 con 0x7f26b4106bd0 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.763+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4102440 con 0x7f26b4106bd0 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.764+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f26ac0051d0 con 0x7f26b4106bd0 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.765+0000 7f269bfff640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 0x7f269c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.765+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f26ac0e7ea0 con 0x7f26b4106bd0 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.765+0000 7f26b2ffd640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 0x7f269c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.766+0000 7f26b2ffd640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 0x7f269c0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004770 tx=0x7f26a40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.768+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26ac016030 con 0x7f26b4106bd0 2024-09-21T08:00:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.958+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f26b419d810 con 0x7f26b4106bd0 2024-09-21T08:00:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.958+0000 7f269bfff640 1 -- 172.21.15.6:0/2481276461 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26b419d810 con 0x7f26b4106bd0 2024-09-21T08:00:21.959 INFO:teuthology.orchestra.run.smithi006.stdout:223338299439 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 msgr2=0x7f269c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 0x7f269c0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004770 tx=0x7f26a40058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 msgr2=0x7f26b41a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00eaa0 tx=0x7f26ac00ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 shutdown_connections 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f269c0b65f0 0x7f269c0b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26b4106280 0x7f26b419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26b4106bd0 0x7f26b41a1f20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 --2- 172.21.15.6:0/2481276461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26b4102030 0x7f26b419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 >> 172.21.15.6:0/2481276461 conn(0x7f26b4077c60 msgr2=0x7f26b41072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 shutdown_connections 2024-09-21T08:00:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:21.960+0000 7f26b9276640 1 -- 172.21.15.6:0/2481276461 wait complete. 2024-09-21T08:00:22.627 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:22 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2481276461' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T08:00:22.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:22 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2481276461' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T08:00:22.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299437 got 223338299439 for osd.8 2024-09-21T08:00:22.663 DEBUG:teuthology.parallel:result is None 2024-09-21T08:00:22.663 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T08:00:22.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T08:00:22.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:22 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2481276461' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T08:00:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:23.323 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:23 smithi006 ceph-mon[30970]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 -- 172.21.15.6:0/3957841216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd301083b0 msgr2=0x7efd301087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 --2- 172.21.15.6:0/3957841216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd301083b0 0x7efd301087c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efd18009900 tx=0x7efd1802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 -- 172.21.15.6:0/3957841216 shutdown_connections 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 --2- 172.21.15.6:0/3957841216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd30108d00 0x7efd3010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 --2- 172.21.15.6:0/3957841216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd301083b0 0x7efd301087c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 --2- 172.21.15.6:0/3957841216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd30102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 -- 172.21.15.6:0/3957841216 >> 172.21.15.6:0/3957841216 conn(0x7efd30079720 msgr2=0x7efd30079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.415+0000 7efd35840640 1 -- 172.21.15.6:0/3957841216 shutdown_connections 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.416+0000 7efd35840640 1 -- 172.21.15.6:0/3957841216 wait complete. 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.416+0000 7efd35840640 1 Processor -- start 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.416+0000 7efd35840640 1 -- start start 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd3019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd301083b0 0x7efd3019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd30112870 con 0x7efd30108d00 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd301126f0 con 0x7efd301083b0 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd35840640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd301129f0 con 0x7efd30102ac0 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56710/0 (socket says 172.21.15.6:56710) 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 -- 172.21.15.6:0/3653409684 learned_addr learned my addr 172.21.15.6:0/3653409684 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2effd640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd3019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd267fc640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd301083b0 0x7efd3019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 -- 172.21.15.6:0/3653409684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 msgr2=0x7efd3019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd3019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 -- 172.21.15.6:0/3653409684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd301083b0 msgr2=0x7efd3019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd301083b0 0x7efd3019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 -- 172.21.15.6:0/3653409684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd301a03a0 con 0x7efd30108d00 2024-09-21T08:00:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2effd640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd3019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.417+0000 7efd2f7fe640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efd2800cad0 tx=0x7efd2800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.418+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2800ae20 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.418+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd28005020 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.418+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2800f6b0 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.418+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd301a0690 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.418+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd301a6df0 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.419+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd30102ed0 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.420+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7efd280051d0 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.421+0000 7efd3483e640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 0x7efd1c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.422+0000 7efd2effd640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 0x7efd1c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.422+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7efd280e7e20 con 0x7efd30108d00 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.422+0000 7efd2effd640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 0x7efd1c0b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efd200058c0 tx=0x7efd20005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.424+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd28014030 con 0x7efd30108d00 2024-09-21T08:00:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.610+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd30063800 con 0x7efd1c0b65f0 2024-09-21T08:00:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.617+0000 7efd3483e640 1 -- 172.21.15.6:0/3653409684 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340497 (secure 0 0 0) 0x7efd30063800 con 0x7efd1c0b65f0 2024-09-21T08:00:23.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:00:23.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 msgr2=0x7efd1c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 0x7efd1c0b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efd200058c0 tx=0x7efd20005850 comp rx=0 tx=0).stop 2024-09-21T08:00:23.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 msgr2=0x7efd3019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efd2800cad0 tx=0x7efd2800cf90 comp rx=0 tx=0).stop 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 shutdown_connections 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd1c0b65f0 0x7efd1c0b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd30108d00 0x7efd3019fc70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd301083b0 0x7efd3019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 --2- 172.21.15.6:0/3653409684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd30102ac0 0x7efd3019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 >> 172.21.15.6:0/3653409684 conn(0x7efd30079720 msgr2=0x7efd30101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 shutdown_connections 2024-09-21T08:00:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:23.620+0000 7efd35840640 1 -- 172.21.15.6:0/3653409684 wait complete. 2024-09-21T08:00:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:23 smithi119 ceph-mon[33564]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:23 smithi145 ceph-mon[34049]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:24.317 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T08:00:23.551206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":213,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352376,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589448,"statfs":{"total":1151940427776,"available":1151579594752,"internally_reserved":0,"allocated":11632640,"data_stored":7961747,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003691"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174047+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174047+0000","last_peered":"2024-09-21T08:00:04.174047+0000","last_clean":"2024-09-21T08:00:04.174047+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174047+0000","last_undegraded":"2024-09-21T08:00:04.174047+0000","last_fullsized":"2024-09-21T08:00:04.174047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336145+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:00:04.336145+0000","last_peered":"2024-09-21T08:00:04.336145+0000","last_clean":"2024-09-21T08:00:04.336145+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:00:04.336145+0000","last_undegraded":"2024-09-21T08:00:04.336145+0000","last_fullsized":"2024-09-21T08:00:04.336145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336271+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336271+0000","last_peered":"2024-09-21T08:00:04.336271+0000","last_clean":"2024-09-21T08:00:04.336271+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336271+0000","last_undegraded":"2024-09-21T08:00:04.336271+0000","last_fullsized":"2024-09-21T08:00:04.336271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997525+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:00:03.997525+0000","last_peered":"2024-09-21T08:00:03.997525+0000","last_clean":"2024-09-21T08:00:03.997525+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:00:03.997525+0000","last_undegraded":"2024-09-21T08:00:03.997525+0000","last_fullsized":"2024-09-21T08:00:03.997525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216625+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:00:04.216625+0000","last_peered":"2024-09-21T08:00:04.216625+0000","last_clean":"2024-09-21T08:00:04.216625+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:00:04.216625+0000","last_undegraded":"2024-09-21T08:00:04.216625+0000","last_fullsized":"2024-09-21T08:00:04.216625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073035+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:00:04.073035+0000","last_peered":"2024-09-21T08:00:04.073035+0000","last_clean":"2024-09-21T08:00:04.073035+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:00:04.073035+0000","last_undegraded":"2024-09-21T08:00:04.073035+0000","last_fullsized":"2024-09-21T08:00:04.073035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994024+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:00:03.994024+0000","last_peered":"2024-09-21T08:00:03.994024+0000","last_clean":"2024-09-21T08:00:03.994024+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:00:03.994024+0000","last_undegraded":"2024-09-21T08:00:03.994024+0000","last_fullsized":"2024-09-21T08:00:03.994024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084594+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084594+0000","last_peered":"2024-09-21T08:00:04.084594+0000","last_clean":"2024-09-21T08:00:04.084594+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084594+0000","last_undegraded":"2024-09-21T08:00:04.084594+0000","last_fullsized":"2024-09-21T08:00:04.084594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217221+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217221+0000","last_peered":"2024-09-21T08:00:04.217221+0000","last_clean":"2024-09-21T08:00:04.217221+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217221+0000","last_undegraded":"2024-09-21T08:00:04.217221+0000","last_fullsized":"2024-09-21T08:00:04.217221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335528+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:00:04.335528+0000","last_peered":"2024-09-21T08:00:04.335528+0000","last_clean":"2024-09-21T08:00:04.335528+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:00:04.335528+0000","last_undegraded":"2024-09-21T08:00:04.335528+0000","last_fullsized":"2024-09-21T08:00:04.335528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994062+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994062+0000","last_peered":"2024-09-21T08:00:03.994062+0000","last_clean":"2024-09-21T08:00:03.994062+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994062+0000","last_undegraded":"2024-09-21T08:00:03.994062+0000","last_fullsized":"2024-09-21T08:00:03.994062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217462+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217462+0000","last_peered":"2024-09-21T08:00:04.217462+0000","last_clean":"2024-09-21T08:00:04.217462+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217462+0000","last_undegraded":"2024-09-21T08:00:04.217462+0000","last_fullsized":"2024-09-21T08:00:04.217462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997953+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:00:03.997953+0000","last_peered":"2024-09-21T08:00:03.997953+0000","last_clean":"2024-09-21T08:00:03.997953+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:00:03.997953+0000","last_undegraded":"2024-09-21T08:00:03.997953+0000","last_fullsized":"2024-09-21T08:00:03.997953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335686+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335686+0000","last_peered":"2024-09-21T08:00:04.335686+0000","last_clean":"2024-09-21T08:00:04.335686+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335686+0000","last_undegraded":"2024-09-21T08:00:04.335686+0000","last_fullsized":"2024-09-21T08:00:04.335686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173844+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173844+0000","last_peered":"2024-09-21T08:00:04.173844+0000","last_clean":"2024-09-21T08:00:04.173844+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173844+0000","last_undegraded":"2024-09-21T08:00:04.173844+0000","last_fullsized":"2024-09-21T08:00:04.173844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084409+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:00:04.084409+0000","last_peered":"2024-09-21T08:00:04.084409+0000","last_clean":"2024-09-21T08:00:04.084409+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:00:04.084409+0000","last_undegraded":"2024-09-21T08:00:04.084409+0000","last_fullsized":"2024-09-21T08:00:04.084409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216461+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216461+0000","last_peered":"2024-09-21T08:00:04.216461+0000","last_clean":"2024-09-21T08:00:04.216461+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216461+0000","last_undegraded":"2024-09-21T08:00:04.216461+0000","last_fullsized":"2024-09-21T08:00:04.216461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217949+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.217949+0000","last_peered":"2024-09-21T08:00:04.217949+0000","last_clean":"2024-09-21T08:00:04.217949+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.217949+0000","last_undegraded":"2024-09-21T08:00:04.217949+0000","last_fullsized":"2024-09-21T08:00:04.217949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.219656+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:00:04.219656+0000","last_peered":"2024-09-21T08:00:04.219656+0000","last_clean":"2024-09-21T08:00:04.219656+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:00:04.219656+0000","last_undegraded":"2024-09-21T08:00:04.219656+0000","last_fullsized":"2024-09-21T08:00:04.219656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218007+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218007+0000","last_peered":"2024-09-21T08:00:04.218007+0000","last_clean":"2024-09-21T08:00:04.218007+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218007+0000","last_undegraded":"2024-09-21T08:00:04.218007+0000","last_fullsized":"2024-09-21T08:00:04.218007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994151+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994151+0000","last_peered":"2024-09-21T08:00:03.994151+0000","last_clean":"2024-09-21T08:00:03.994151+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994151+0000","last_undegraded":"2024-09-21T08:00:03.994151+0000","last_fullsized":"2024-09-21T08:00:03.994151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336111+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:00:04.336111+0000","last_peered":"2024-09-21T08:00:04.336111+0000","last_clean":"2024-09-21T08:00:04.336111+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:00:04.336111+0000","last_undegraded":"2024-09-21T08:00:04.336111+0000","last_fullsized":"2024-09-21T08:00:04.336111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173889+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:04.173889+0000","last_peered":"2024-09-21T08:00:04.173889+0000","last_clean":"2024-09-21T08:00:04.173889+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:04.173889+0000","last_undegraded":"2024-09-21T08:00:04.173889+0000","last_fullsized":"2024-09-21T08:00:04.173889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335285+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335285+0000","last_peered":"2024-09-21T08:00:04.335285+0000","last_clean":"2024-09-21T08:00:04.335285+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335285+0000","last_undegraded":"2024-09-21T08:00:04.335285+0000","last_fullsized":"2024-09-21T08:00:04.335285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993890+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:00:03.993890+0000","last_peered":"2024-09-21T08:00:03.993890+0000","last_clean":"2024-09-21T08:00:03.993890+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:00:03.993890+0000","last_undegraded":"2024-09-21T08:00:03.993890+0000","last_fullsized":"2024-09-21T08:00:03.993890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085193+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085193+0000","last_peered":"2024-09-21T08:00:04.085193+0000","last_clean":"2024-09-21T08:00:04.085193+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085193+0000","last_undegraded":"2024-09-21T08:00:04.085193+0000","last_fullsized":"2024-09-21T08:00:04.085193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997970+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.997970+0000","last_peered":"2024-09-21T08:00:03.997970+0000","last_clean":"2024-09-21T08:00:03.997970+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.997970+0000","last_undegraded":"2024-09-21T08:00:03.997970+0000","last_fullsized":"2024-09-21T08:00:03.997970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217522+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:00:04.217522+0000","last_peered":"2024-09-21T08:00:04.217522+0000","last_clean":"2024-09-21T08:00:04.217522+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:00:04.217522+0000","last_undegraded":"2024-09-21T08:00:04.217522+0000","last_fullsized":"2024-09-21T08:00:04.217522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173771+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173771+0000","last_peered":"2024-09-21T08:00:04.173771+0000","last_clean":"2024-09-21T08:00:04.173771+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173771+0000","last_undegraded":"2024-09-21T08:00:04.173771+0000","last_fullsized":"2024-09-21T08:00:04.173771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084439+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084439+0000","last_peered":"2024-09-21T08:00:04.084439+0000","last_clean":"2024-09-21T08:00:04.084439+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084439+0000","last_undegraded":"2024-09-21T08:00:04.084439+0000","last_fullsized":"2024-09-21T08:00:04.084439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217340+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:00:04.217340+0000","last_peered":"2024-09-21T08:00:04.217340+0000","last_clean":"2024-09-21T08:00:04.217340+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:00:04.217340+0000","last_undegraded":"2024-09-21T08:00:04.217340+0000","last_fullsized":"2024-09-21T08:00:04.217340+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994156+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994156+0000","last_peered":"2024-09-21T08:00:03.994156+0000","last_clean":"2024-09-21T08:00:03.994156+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994156+0000","last_undegraded":"2024-09-21T08:00:03.994156+0000","last_fullsized":"2024-09-21T08:00:03.994156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993662+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993662+0000","last_peered":"2024-09-21T08:00:03.993662+0000","last_clean":"2024-09-21T08:00:03.993662+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993662+0000","last_undegraded":"2024-09-21T08:00:03.993662+0000","last_fullsized":"2024-09-21T08:00:03.993662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072488+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:00:04.072488+0000","last_peered":"2024-09-21T08:00:04.072488+0000","last_clean":"2024-09-21T08:00:04.072488+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:00:04.072488+0000","last_undegraded":"2024-09-21T08:00:04.072488+0000","last_fullsized":"2024-09-21T08:00:04.072488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993348+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993348+0000","last_peered":"2024-09-21T08:00:03.993348+0000","last_clean":"2024-09-21T08:00:03.993348+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993348+0000","last_undegraded":"2024-09-21T08:00:03.993348+0000","last_fullsized":"2024-09-21T08:00:03.993348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994017+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994017+0000","last_peered":"2024-09-21T08:00:03.994017+0000","last_clean":"2024-09-21T08:00:03.994017+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994017+0000","last_undegraded":"2024-09-21T08:00:03.994017+0000","last_fullsized":"2024-09-21T08:00:03.994017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993221+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:00:03.993221+0000","last_peered":"2024-09-21T08:00:03.993221+0000","last_clean":"2024-09-21T08:00:03.993221+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:00:03.993221+0000","last_undegraded":"2024-09-21T08:00:03.993221+0000","last_fullsized":"2024-09-21T08:00:03.993221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993878+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993878+0000","last_peered":"2024-09-21T08:00:03.993878+0000","last_clean":"2024-09-21T08:00:03.993878+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993878+0000","last_undegraded":"2024-09-21T08:00:03.993878+0000","last_fullsized":"2024-09-21T08:00:03.993878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072929+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.072929+0000","last_peered":"2024-09-21T08:00:04.072929+0000","last_clean":"2024-09-21T08:00:04.072929+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.072929+0000","last_undegraded":"2024-09-21T08:00:04.072929+0000","last_fullsized":"2024-09-21T08:00:04.072929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335869+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:00:04.335869+0000","last_peered":"2024-09-21T08:00:04.335869+0000","last_clean":"2024-09-21T08:00:04.335869+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:00:04.335869+0000","last_undegraded":"2024-09-21T08:00:04.335869+0000","last_fullsized":"2024-09-21T08:00:04.335869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218313+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218313+0000","last_peered":"2024-09-21T08:00:04.218313+0000","last_clean":"2024-09-21T08:00:04.218313+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218313+0000","last_undegraded":"2024-09-21T08:00:04.218313+0000","last_fullsized":"2024-09-21T08:00:04.218313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994391+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994391+0000","last_peered":"2024-09-21T08:00:03.994391+0000","last_clean":"2024-09-21T08:00:03.994391+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994391+0000","last_undegraded":"2024-09-21T08:00:03.994391+0000","last_fullsized":"2024-09-21T08:00:03.994391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994579+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:00:03.994579+0000","last_peered":"2024-09-21T08:00:03.994579+0000","last_clean":"2024-09-21T08:00:03.994579+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:00:03.994579+0000","last_undegraded":"2024-09-21T08:00:03.994579+0000","last_fullsized":"2024-09-21T08:00:03.994579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994620+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994620+0000","last_peered":"2024-09-21T08:00:03.994620+0000","last_clean":"2024-09-21T08:00:03.994620+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994620+0000","last_undegraded":"2024-09-21T08:00:03.994620+0000","last_fullsized":"2024-09-21T08:00:03.994620+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216204+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216204+0000","last_peered":"2024-09-21T08:00:04.216204+0000","last_clean":"2024-09-21T08:00:04.216204+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216204+0000","last_undegraded":"2024-09-21T08:00:04.216204+0000","last_fullsized":"2024-09-21T08:00:04.216204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994290+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:00:03.994290+0000","last_peered":"2024-09-21T08:00:03.994290+0000","last_clean":"2024-09-21T08:00:03.994290+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:00:03.994290+0000","last_undegraded":"2024-09-21T08:00:03.994290+0000","last_fullsized":"2024-09-21T08:00:03.994290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073283+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:00:04.073283+0000","last_peered":"2024-09-21T08:00:04.073283+0000","last_clean":"2024-09-21T08:00:04.073283+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:00:04.073283+0000","last_undegraded":"2024-09-21T08:00:04.073283+0000","last_fullsized":"2024-09-21T08:00:04.073283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994378+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:00:03.994378+0000","last_peered":"2024-09-21T08:00:03.994378+0000","last_clean":"2024-09-21T08:00:03.994378+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:00:03.994378+0000","last_undegraded":"2024-09-21T08:00:03.994378+0000","last_fullsized":"2024-09-21T08:00:03.994378+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994097+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994097+0000","last_peered":"2024-09-21T08:00:03.994097+0000","last_clean":"2024-09-21T08:00:03.994097+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994097+0000","last_undegraded":"2024-09-21T08:00:03.994097+0000","last_fullsized":"2024-09-21T08:00:03.994097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072262+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072262+0000","last_peered":"2024-09-21T08:00:04.072262+0000","last_clean":"2024-09-21T08:00:04.072262+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072262+0000","last_undegraded":"2024-09-21T08:00:04.072262+0000","last_fullsized":"2024-09-21T08:00:04.072262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.219654+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:00:04.219654+0000","last_peered":"2024-09-21T08:00:04.219654+0000","last_clean":"2024-09-21T08:00:04.219654+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:00:04.219654+0000","last_undegraded":"2024-09-21T08:00:04.219654+0000","last_fullsized":"2024-09-21T08:00:04.219654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072350+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072350+0000","last_peered":"2024-09-21T08:00:04.072350+0000","last_clean":"2024-09-21T08:00:04.072350+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072350+0000","last_undegraded":"2024-09-21T08:00:04.072350+0000","last_fullsized":"2024-09-21T08:00:04.072350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072584+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:00:04.072584+0000","last_peered":"2024-09-21T08:00:04.072584+0000","last_clean":"2024-09-21T08:00:04.072584+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:00:04.072584+0000","last_undegraded":"2024-09-21T08:00:04.072584+0000","last_fullsized":"2024-09-21T08:00:04.072584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084599+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084599+0000","last_peered":"2024-09-21T08:00:04.084599+0000","last_clean":"2024-09-21T08:00:04.084599+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084599+0000","last_undegraded":"2024-09-21T08:00:04.084599+0000","last_fullsized":"2024-09-21T08:00:04.084599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993780+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:00:03.993780+0000","last_peered":"2024-09-21T08:00:03.993780+0000","last_clean":"2024-09-21T08:00:03.993780+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:00:03.993780+0000","last_undegraded":"2024-09-21T08:00:03.993780+0000","last_fullsized":"2024-09-21T08:00:03.993780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217468+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217468+0000","last_peered":"2024-09-21T08:00:04.217468+0000","last_clean":"2024-09-21T08:00:04.217468+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217468+0000","last_undegraded":"2024-09-21T08:00:04.217468+0000","last_fullsized":"2024-09-21T08:00:04.217468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994176+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:00:03.994176+0000","last_peered":"2024-09-21T08:00:03.994176+0000","last_clean":"2024-09-21T08:00:03.994176+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:00:03.994176+0000","last_undegraded":"2024-09-21T08:00:03.994176+0000","last_fullsized":"2024-09-21T08:00:03.994176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072796+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072796+0000","last_peered":"2024-09-21T08:00:04.072796+0000","last_clean":"2024-09-21T08:00:04.072796+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072796+0000","last_undegraded":"2024-09-21T08:00:04.072796+0000","last_fullsized":"2024-09-21T08:00:04.072796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993591+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:00:03.993591+0000","last_peered":"2024-09-21T08:00:03.993591+0000","last_clean":"2024-09-21T08:00:03.993591+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:00:03.993591+0000","last_undegraded":"2024-09-21T08:00:03.993591+0000","last_fullsized":"2024-09-21T08:00:03.993591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994222+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994222+0000","last_peered":"2024-09-21T08:00:03.994222+0000","last_clean":"2024-09-21T08:00:03.994222+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994222+0000","last_undegraded":"2024-09-21T08:00:03.994222+0000","last_fullsized":"2024-09-21T08:00:03.994222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085070+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:00:04.085070+0000","last_peered":"2024-09-21T08:00:04.085070+0000","last_clean":"2024-09-21T08:00:04.085070+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:00:04.085070+0000","last_undegraded":"2024-09-21T08:00:04.085070+0000","last_fullsized":"2024-09-21T08:00:04.085070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":193,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:22.773844+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:00:22.773844+0000","last_peered":"2024-09-21T08:00:22.773844+0000","last_clean":"2024-09-21T08:00:22.773844+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:00:22.773844+0000","last_undegraded":"2024-09-21T08:00:22.773844+0000","last_fullsized":"2024-09-21T08:00:22.773844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":129,"num_write":32,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216770+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:00:04.216770+0000","last_peered":"2024-09-21T08:00:04.216770+0000","last_clean":"2024-09-21T08:00:04.216770+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:00:04.216770+0000","last_undegraded":"2024-09-21T08:00:04.216770+0000","last_fullsized":"2024-09-21T08:00:04.216770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073275+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073275+0000","last_peered":"2024-09-21T08:00:04.073275+0000","last_clean":"2024-09-21T08:00:04.073275+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073275+0000","last_undegraded":"2024-09-21T08:00:04.073275+0000","last_fullsized":"2024-09-21T08:00:04.073275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997633+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:00:03.997633+0000","last_peered":"2024-09-21T08:00:03.997633+0000","last_clean":"2024-09-21T08:00:03.997633+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:00:03.997633+0000","last_undegraded":"2024-09-21T08:00:03.997633+0000","last_fullsized":"2024-09-21T08:00:03.997633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217384+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:00:04.217384+0000","last_peered":"2024-09-21T08:00:04.217384+0000","last_clean":"2024-09-21T08:00:04.217384+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:00:04.217384+0000","last_undegraded":"2024-09-21T08:00:04.217384+0000","last_fullsized":"2024-09-21T08:00:04.217384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217377+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217377+0000","last_peered":"2024-09-21T08:00:04.217377+0000","last_clean":"2024-09-21T08:00:04.217377+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217377+0000","last_undegraded":"2024-09-21T08:00:04.217377+0000","last_fullsized":"2024-09-21T08:00:04.217377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996840+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996840+0000","last_peered":"2024-09-21T08:00:03.996840+0000","last_clean":"2024-09-21T08:00:03.996840+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996840+0000","last_undegraded":"2024-09-21T08:00:03.996840+0000","last_fullsized":"2024-09-21T08:00:03.996840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173242+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:00:04.173242+0000","last_peered":"2024-09-21T08:00:04.173242+0000","last_clean":"2024-09-21T08:00:04.173242+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:00:04.173242+0000","last_undegraded":"2024-09-21T08:00:04.173242+0000","last_fullsized":"2024-09-21T08:00:04.173242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072745+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072745+0000","last_peered":"2024-09-21T08:00:04.072745+0000","last_clean":"2024-09-21T08:00:04.072745+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072745+0000","last_undegraded":"2024-09-21T08:00:04.072745+0000","last_fullsized":"2024-09-21T08:00:04.072745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998117+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998117+0000","last_peered":"2024-09-21T08:00:03.998117+0000","last_clean":"2024-09-21T08:00:03.998117+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998117+0000","last_undegraded":"2024-09-21T08:00:03.998117+0000","last_fullsized":"2024-09-21T08:00:03.998117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335429+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:00:04.335429+0000","last_peered":"2024-09-21T08:00:04.335429+0000","last_clean":"2024-09-21T08:00:04.335429+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:00:04.335429+0000","last_undegraded":"2024-09-21T08:00:04.335429+0000","last_fullsized":"2024-09-21T08:00:04.335429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993345+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993345+0000","last_peered":"2024-09-21T08:00:03.993345+0000","last_clean":"2024-09-21T08:00:03.993345+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993345+0000","last_undegraded":"2024-09-21T08:00:03.993345+0000","last_fullsized":"2024-09-21T08:00:03.993345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072755+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:00:04.072755+0000","last_peered":"2024-09-21T08:00:04.072755+0000","last_clean":"2024-09-21T08:00:04.072755+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:00:04.072755+0000","last_undegraded":"2024-09-21T08:00:04.072755+0000","last_fullsized":"2024-09-21T08:00:04.072755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084623+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:00:04.084623+0000","last_peered":"2024-09-21T08:00:04.084623+0000","last_clean":"2024-09-21T08:00:04.084623+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:00:04.084623+0000","last_undegraded":"2024-09-21T08:00:04.084623+0000","last_fullsized":"2024-09-21T08:00:04.084623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997877+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:00:03.997877+0000","last_peered":"2024-09-21T08:00:03.997877+0000","last_clean":"2024-09-21T08:00:03.997877+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:00:03.997877+0000","last_undegraded":"2024-09-21T08:00:03.997877+0000","last_fullsized":"2024-09-21T08:00:03.997877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994470+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:00:03.994470+0000","last_peered":"2024-09-21T08:00:03.994470+0000","last_clean":"2024-09-21T08:00:03.994470+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:00:03.994470+0000","last_undegraded":"2024-09-21T08:00:03.994470+0000","last_fullsized":"2024-09-21T08:00:03.994470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993994+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:00:03.993994+0000","last_peered":"2024-09-21T08:00:03.993994+0000","last_clean":"2024-09-21T08:00:03.993994+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:00:03.993994+0000","last_undegraded":"2024-09-21T08:00:03.993994+0000","last_fullsized":"2024-09-21T08:00:03.993994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996322+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:00:03.996322+0000","last_peered":"2024-09-21T08:00:03.996322+0000","last_clean":"2024-09-21T08:00:03.996322+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:00:03.996322+0000","last_undegraded":"2024-09-21T08:00:03.996322+0000","last_fullsized":"2024-09-21T08:00:03.996322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993881+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:00:03.993881+0000","last_peered":"2024-09-21T08:00:03.993881+0000","last_clean":"2024-09-21T08:00:03.993881+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:00:03.993881+0000","last_undegraded":"2024-09-21T08:00:03.993881+0000","last_fullsized":"2024-09-21T08:00:03.993881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174600+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:00:04.174600+0000","last_peered":"2024-09-21T08:00:04.174600+0000","last_clean":"2024-09-21T08:00:04.174600+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:00:04.174600+0000","last_undegraded":"2024-09-21T08:00:04.174600+0000","last_fullsized":"2024-09-21T08:00:04.174600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994309+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:00:03.994309+0000","last_peered":"2024-09-21T08:00:03.994309+0000","last_clean":"2024-09-21T08:00:03.994309+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:00:03.994309+0000","last_undegraded":"2024-09-21T08:00:03.994309+0000","last_fullsized":"2024-09-21T08:00:03.994309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336066+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:00:04.336066+0000","last_peered":"2024-09-21T08:00:04.336066+0000","last_clean":"2024-09-21T08:00:04.336066+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:00:04.336066+0000","last_undegraded":"2024-09-21T08:00:04.336066+0000","last_fullsized":"2024-09-21T08:00:04.336066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072401+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:00:04.072401+0000","last_peered":"2024-09-21T08:00:04.072401+0000","last_clean":"2024-09-21T08:00:04.072401+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:00:04.072401+0000","last_undegraded":"2024-09-21T08:00:04.072401+0000","last_fullsized":"2024-09-21T08:00:04.072401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335578+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:00:04.335578+0000","last_peered":"2024-09-21T08:00:04.335578+0000","last_clean":"2024-09-21T08:00:04.335578+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:00:04.335578+0000","last_undegraded":"2024-09-21T08:00:04.335578+0000","last_fullsized":"2024-09-21T08:00:04.335578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216644+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:00:04.216644+0000","last_peered":"2024-09-21T08:00:04.216644+0000","last_clean":"2024-09-21T08:00:04.216644+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:00:04.216644+0000","last_undegraded":"2024-09-21T08:00:04.216644+0000","last_fullsized":"2024-09-21T08:00:04.216644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993593+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:00:03.993593+0000","last_peered":"2024-09-21T08:00:03.993593+0000","last_clean":"2024-09-21T08:00:03.993593+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:00:03.993593+0000","last_undegraded":"2024-09-21T08:00:03.993593+0000","last_fullsized":"2024-09-21T08:00:03.993593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998135+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:00:03.998135+0000","last_peered":"2024-09-21T08:00:03.998135+0000","last_clean":"2024-09-21T08:00:03.998135+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:00:03.998135+0000","last_undegraded":"2024-09-21T08:00:03.998135+0000","last_fullsized":"2024-09-21T08:00:03.998135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994572+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:00:03.994572+0000","last_peered":"2024-09-21T08:00:03.994572+0000","last_clean":"2024-09-21T08:00:03.994572+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:00:03.994572+0000","last_undegraded":"2024-09-21T08:00:03.994572+0000","last_fullsized":"2024-09-21T08:00:03.994572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173852+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:00:04.173852+0000","last_peered":"2024-09-21T08:00:04.173852+0000","last_clean":"2024-09-21T08:00:04.173852+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:00:04.173852+0000","last_undegraded":"2024-09-21T08:00:04.173852+0000","last_fullsized":"2024-09-21T08:00:04.173852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998621+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:00:03.998621+0000","last_peered":"2024-09-21T08:00:03.998621+0000","last_clean":"2024-09-21T08:00:03.998621+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:00:03.998621+0000","last_undegraded":"2024-09-21T08:00:03.998621+0000","last_fullsized":"2024-09-21T08:00:03.998621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216277+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:00:04.216277+0000","last_peered":"2024-09-21T08:00:04.216277+0000","last_clean":"2024-09-21T08:00:04.216277+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:00:04.216277+0000","last_undegraded":"2024-09-21T08:00:04.216277+0000","last_fullsized":"2024-09-21T08:00:04.216277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998478+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:00:03.998478+0000","last_peered":"2024-09-21T08:00:03.998478+0000","last_clean":"2024-09-21T08:00:03.998478+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:00:03.998478+0000","last_undegraded":"2024-09-21T08:00:03.998478+0000","last_fullsized":"2024-09-21T08:00:03.998478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996090+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:00:03.996090+0000","last_peered":"2024-09-21T08:00:03.996090+0000","last_clean":"2024-09-21T08:00:03.996090+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:00:03.996090+0000","last_undegraded":"2024-09-21T08:00:03.996090+0000","last_fullsized":"2024-09-21T08:00:03.996090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993526+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:00:03.993526+0000","last_peered":"2024-09-21T08:00:03.993526+0000","last_clean":"2024-09-21T08:00:03.993526+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:00:03.993526+0000","last_undegraded":"2024-09-21T08:00:03.993526+0000","last_fullsized":"2024-09-21T08:00:03.993526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173531+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:00:04.173531+0000","last_peered":"2024-09-21T08:00:04.173531+0000","last_clean":"2024-09-21T08:00:04.173531+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:00:04.173531+0000","last_undegraded":"2024-09-21T08:00:04.173531+0000","last_fullsized":"2024-09-21T08:00:04.173531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994496+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:00:03.994496+0000","last_peered":"2024-09-21T08:00:03.994496+0000","last_clean":"2024-09-21T08:00:03.994496+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:00:03.994496+0000","last_undegraded":"2024-09-21T08:00:03.994496+0000","last_fullsized":"2024-09-21T08:00:03.994496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216906+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:00:04.216906+0000","last_peered":"2024-09-21T08:00:04.216906+0000","last_clean":"2024-09-21T08:00:04.216906+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:00:04.216906+0000","last_undegraded":"2024-09-21T08:00:04.216906+0000","last_fullsized":"2024-09-21T08:00:04.216906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216766+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:00:04.216766+0000","last_peered":"2024-09-21T08:00:04.216766+0000","last_clean":"2024-09-21T08:00:04.216766+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:00:04.216766+0000","last_undegraded":"2024-09-21T08:00:04.216766+0000","last_fullsized":"2024-09-21T08:00:04.216766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993837+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:00:03.993837+0000","last_peered":"2024-09-21T08:00:03.993837+0000","last_clean":"2024-09-21T08:00:03.993837+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:00:03.993837+0000","last_undegraded":"2024-09-21T08:00:03.993837+0000","last_fullsized":"2024-09-21T08:00:03.993837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217005+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:00:04.217005+0000","last_peered":"2024-09-21T08:00:04.217005+0000","last_clean":"2024-09-21T08:00:04.217005+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:00:04.217005+0000","last_undegraded":"2024-09-21T08:00:04.217005+0000","last_fullsized":"2024-09-21T08:00:04.217005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084504+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:00:04.084504+0000","last_peered":"2024-09-21T08:00:04.084504+0000","last_clean":"2024-09-21T08:00:04.084504+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:00:04.084504+0000","last_undegraded":"2024-09-21T08:00:04.084504+0000","last_fullsized":"2024-09-21T08:00:04.084504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217583+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:00:04.217583+0000","last_peered":"2024-09-21T08:00:04.217583+0000","last_clean":"2024-09-21T08:00:04.217583+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:00:04.217583+0000","last_undegraded":"2024-09-21T08:00:04.217583+0000","last_fullsized":"2024-09-21T08:00:04.217583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996751+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:00:03.996751+0000","last_peered":"2024-09-21T08:00:03.996751+0000","last_clean":"2024-09-21T08:00:03.996751+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:00:03.996751+0000","last_undegraded":"2024-09-21T08:00:03.996751+0000","last_fullsized":"2024-09-21T08:00:03.996751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996956+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:00:03.996956+0000","last_peered":"2024-09-21T08:00:03.996956+0000","last_clean":"2024-09-21T08:00:03.996956+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:00:03.996956+0000","last_undegraded":"2024-09-21T08:00:03.996956+0000","last_fullsized":"2024-09-21T08:00:03.996956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998547+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:00:03.998547+0000","last_peered":"2024-09-21T08:00:03.998547+0000","last_clean":"2024-09-21T08:00:03.998547+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:00:03.998547+0000","last_undegraded":"2024-09-21T08:00:03.998547+0000","last_fullsized":"2024-09-21T08:00:03.998547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":128,"num_read_kb":135,"num_write":88,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":1155469,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":1086190,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":564941,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":564907,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:00:24.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T08:00:24.582 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 -- 172.21.15.6:0/959012045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254108d20 msgr2=0x7f425410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 --2- 172.21.15.6:0/959012045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254108d20 0x7f425410f550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4244009ca0 tx=0x7f424402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 -- 172.21.15.6:0/959012045 shutdown_connections 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 --2- 172.21.15.6:0/959012045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42541083d0 0x7f42541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 --2- 172.21.15.6:0/959012045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254108d20 0x7f425410f550 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 --2- 172.21.15.6:0/959012045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4254102ae0 0x7f4254102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 -- 172.21.15.6:0/959012045 >> 172.21.15.6:0/959012045 conn(0x7f42540797b0 msgr2=0x7f4254079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 -- 172.21.15.6:0/959012045 shutdown_connections 2024-09-21T08:00:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.091+0000 7f425bef0640 1 -- 172.21.15.6:0/959012045 wait complete. 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 Processor -- start 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 -- start start 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 0x7f42540ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4254108d20 0x7f42541000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f42541128e0 con 0x7f4254102ae0 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4254112760 con 0x7f42541083d0 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425bef0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4254112a60 con 0x7f4254108d20 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f4259c8c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f4259c8c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56734/0 (socket says 172.21.15.6:56734) 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f4259c8c640 1 -- 172.21.15.6:0/701964466 learned_addr learned my addr 172.21.15.6:0/701964466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425948b640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 0x7f42540ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.092+0000 7f425a48d640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4254108d20 0x7f42541000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 -- 172.21.15.6:0/701964466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4254108d20 msgr2=0x7f42541000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4254108d20 0x7f42541000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 -- 172.21.15.6:0/701964466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 msgr2=0x7f42540ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 0x7f42540ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 -- 172.21.15.6:0/701964466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541a86e0 con 0x7f4254102ae0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f425948b640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 0x7f42540ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4259c8c640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f424c00e9f0 tx=0x7f424c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00cd80 con 0x7f4254102ae0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f424c0108c0 con 0x7f4254102ae0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42541a89d0 con 0x7f4254102ae0 2024-09-21T08:00:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0187c0 con 0x7f4254102ae0 2024-09-21T08:00:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.093+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541a8f10 con 0x7f4254102ae0 2024-09-21T08:00:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.094+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4254102ef0 con 0x7f4254102ae0 2024-09-21T08:00:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.096+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f424c010430 con 0x7f4254102ae0 2024-09-21T08:00:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.097+0000 7f4252ffd640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 0x7f423c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.097+0000 7f425948b640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 0x7f423c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.097+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f424c0e8340 con 0x7f4254102ae0 2024-09-21T08:00:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.097+0000 7f425948b640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 0x7f423c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4248005fd0 tx=0x7f4248005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.100+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f424c0ae5d0 con 0x7f4254102ae0 2024-09-21T08:00:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.285+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4254063800 con 0x7f423c0b65f0 2024-09-21T08:00:25.287 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:25 smithi006 ceph-mon[30970]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:25.287 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:25 smithi006 ceph-mon[30970]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:25.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.290+0000 7f4252ffd640 1 -- 172.21.15.6:0/701964466 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340497 (secure 0 0 0) 0x7f4254063800 con 0x7f423c0b65f0 2024-09-21T08:00:25.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:25.297 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:00:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.293+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 msgr2=0x7f423c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.293+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 0x7f423c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4248005fd0 tx=0x7f4248005850 comp rx=0 tx=0).stop 2024-09-21T08:00:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.293+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 msgr2=0x7f42540ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.293+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f424c00e9f0 tx=0x7f424c00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 shutdown_connections 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b65f0 0x7f423c0b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4254108d20 0x7f42541000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42541083d0 0x7f42540ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 --2- 172.21.15.6:0/701964466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254102ae0 0x7f42540ff670 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 >> 172.21.15.6:0/701964466 conn(0x7f42540797b0 msgr2=0x7f4254101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 shutdown_connections 2024-09-21T08:00:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:25.294+0000 7f425bef0640 1 -- 172.21.15.6:0/701964466 wait complete. 2024-09-21T08:00:25.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:25 smithi119 ceph-mon[33564]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:25.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:25 smithi119 ceph-mon[33564]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:25 smithi145 ceph-mon[34049]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:25 smithi145 ceph-mon[34049]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:26.053 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T08:00:23.551206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":209,"num_read_kb":204,"num_write":213,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352376,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589448,"statfs":{"total":1151940427776,"available":1151579594752,"internally_reserved":0,"allocated":11632640,"data_stored":7961747,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003691"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174047+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174047+0000","last_peered":"2024-09-21T08:00:04.174047+0000","last_clean":"2024-09-21T08:00:04.174047+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174047+0000","last_undegraded":"2024-09-21T08:00:04.174047+0000","last_fullsized":"2024-09-21T08:00:04.174047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336145+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:00:04.336145+0000","last_peered":"2024-09-21T08:00:04.336145+0000","last_clean":"2024-09-21T08:00:04.336145+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:00:04.336145+0000","last_undegraded":"2024-09-21T08:00:04.336145+0000","last_fullsized":"2024-09-21T08:00:04.336145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336271+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336271+0000","last_peered":"2024-09-21T08:00:04.336271+0000","last_clean":"2024-09-21T08:00:04.336271+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336271+0000","last_undegraded":"2024-09-21T08:00:04.336271+0000","last_fullsized":"2024-09-21T08:00:04.336271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997525+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:00:03.997525+0000","last_peered":"2024-09-21T08:00:03.997525+0000","last_clean":"2024-09-21T08:00:03.997525+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:00:03.997525+0000","last_undegraded":"2024-09-21T08:00:03.997525+0000","last_fullsized":"2024-09-21T08:00:03.997525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216625+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:00:04.216625+0000","last_peered":"2024-09-21T08:00:04.216625+0000","last_clean":"2024-09-21T08:00:04.216625+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:00:04.216625+0000","last_undegraded":"2024-09-21T08:00:04.216625+0000","last_fullsized":"2024-09-21T08:00:04.216625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073035+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:00:04.073035+0000","last_peered":"2024-09-21T08:00:04.073035+0000","last_clean":"2024-09-21T08:00:04.073035+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:00:04.073035+0000","last_undegraded":"2024-09-21T08:00:04.073035+0000","last_fullsized":"2024-09-21T08:00:04.073035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994024+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:00:03.994024+0000","last_peered":"2024-09-21T08:00:03.994024+0000","last_clean":"2024-09-21T08:00:03.994024+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:00:03.994024+0000","last_undegraded":"2024-09-21T08:00:03.994024+0000","last_fullsized":"2024-09-21T08:00:03.994024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084594+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084594+0000","last_peered":"2024-09-21T08:00:04.084594+0000","last_clean":"2024-09-21T08:00:04.084594+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084594+0000","last_undegraded":"2024-09-21T08:00:04.084594+0000","last_fullsized":"2024-09-21T08:00:04.084594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217221+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217221+0000","last_peered":"2024-09-21T08:00:04.217221+0000","last_clean":"2024-09-21T08:00:04.217221+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217221+0000","last_undegraded":"2024-09-21T08:00:04.217221+0000","last_fullsized":"2024-09-21T08:00:04.217221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335528+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:00:04.335528+0000","last_peered":"2024-09-21T08:00:04.335528+0000","last_clean":"2024-09-21T08:00:04.335528+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:00:04.335528+0000","last_undegraded":"2024-09-21T08:00:04.335528+0000","last_fullsized":"2024-09-21T08:00:04.335528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994062+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994062+0000","last_peered":"2024-09-21T08:00:03.994062+0000","last_clean":"2024-09-21T08:00:03.994062+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994062+0000","last_undegraded":"2024-09-21T08:00:03.994062+0000","last_fullsized":"2024-09-21T08:00:03.994062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217462+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217462+0000","last_peered":"2024-09-21T08:00:04.217462+0000","last_clean":"2024-09-21T08:00:04.217462+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217462+0000","last_undegraded":"2024-09-21T08:00:04.217462+0000","last_fullsized":"2024-09-21T08:00:04.217462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997953+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:00:03.997953+0000","last_peered":"2024-09-21T08:00:03.997953+0000","last_clean":"2024-09-21T08:00:03.997953+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:00:03.997953+0000","last_undegraded":"2024-09-21T08:00:03.997953+0000","last_fullsized":"2024-09-21T08:00:03.997953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335686+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335686+0000","last_peered":"2024-09-21T08:00:04.335686+0000","last_clean":"2024-09-21T08:00:04.335686+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335686+0000","last_undegraded":"2024-09-21T08:00:04.335686+0000","last_fullsized":"2024-09-21T08:00:04.335686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173844+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173844+0000","last_peered":"2024-09-21T08:00:04.173844+0000","last_clean":"2024-09-21T08:00:04.173844+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173844+0000","last_undegraded":"2024-09-21T08:00:04.173844+0000","last_fullsized":"2024-09-21T08:00:04.173844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084409+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:00:04.084409+0000","last_peered":"2024-09-21T08:00:04.084409+0000","last_clean":"2024-09-21T08:00:04.084409+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:00:04.084409+0000","last_undegraded":"2024-09-21T08:00:04.084409+0000","last_fullsized":"2024-09-21T08:00:04.084409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216461+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216461+0000","last_peered":"2024-09-21T08:00:04.216461+0000","last_clean":"2024-09-21T08:00:04.216461+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216461+0000","last_undegraded":"2024-09-21T08:00:04.216461+0000","last_fullsized":"2024-09-21T08:00:04.216461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217949+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.217949+0000","last_peered":"2024-09-21T08:00:04.217949+0000","last_clean":"2024-09-21T08:00:04.217949+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.217949+0000","last_undegraded":"2024-09-21T08:00:04.217949+0000","last_fullsized":"2024-09-21T08:00:04.217949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.219656+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:00:04.219656+0000","last_peered":"2024-09-21T08:00:04.219656+0000","last_clean":"2024-09-21T08:00:04.219656+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:00:04.219656+0000","last_undegraded":"2024-09-21T08:00:04.219656+0000","last_fullsized":"2024-09-21T08:00:04.219656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218007+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218007+0000","last_peered":"2024-09-21T08:00:04.218007+0000","last_clean":"2024-09-21T08:00:04.218007+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218007+0000","last_undegraded":"2024-09-21T08:00:04.218007+0000","last_fullsized":"2024-09-21T08:00:04.218007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994151+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994151+0000","last_peered":"2024-09-21T08:00:03.994151+0000","last_clean":"2024-09-21T08:00:03.994151+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994151+0000","last_undegraded":"2024-09-21T08:00:03.994151+0000","last_fullsized":"2024-09-21T08:00:03.994151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336111+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:00:04.336111+0000","last_peered":"2024-09-21T08:00:04.336111+0000","last_clean":"2024-09-21T08:00:04.336111+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:00:04.336111+0000","last_undegraded":"2024-09-21T08:00:04.336111+0000","last_fullsized":"2024-09-21T08:00:04.336111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173889+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:04.173889+0000","last_peered":"2024-09-21T08:00:04.173889+0000","last_clean":"2024-09-21T08:00:04.173889+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:04.173889+0000","last_undegraded":"2024-09-21T08:00:04.173889+0000","last_fullsized":"2024-09-21T08:00:04.173889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335285+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335285+0000","last_peered":"2024-09-21T08:00:04.335285+0000","last_clean":"2024-09-21T08:00:04.335285+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335285+0000","last_undegraded":"2024-09-21T08:00:04.335285+0000","last_fullsized":"2024-09-21T08:00:04.335285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993890+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:00:03.993890+0000","last_peered":"2024-09-21T08:00:03.993890+0000","last_clean":"2024-09-21T08:00:03.993890+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:00:03.993890+0000","last_undegraded":"2024-09-21T08:00:03.993890+0000","last_fullsized":"2024-09-21T08:00:03.993890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085193+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085193+0000","last_peered":"2024-09-21T08:00:04.085193+0000","last_clean":"2024-09-21T08:00:04.085193+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085193+0000","last_undegraded":"2024-09-21T08:00:04.085193+0000","last_fullsized":"2024-09-21T08:00:04.085193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997970+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.997970+0000","last_peered":"2024-09-21T08:00:03.997970+0000","last_clean":"2024-09-21T08:00:03.997970+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.997970+0000","last_undegraded":"2024-09-21T08:00:03.997970+0000","last_fullsized":"2024-09-21T08:00:03.997970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217522+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:00:04.217522+0000","last_peered":"2024-09-21T08:00:04.217522+0000","last_clean":"2024-09-21T08:00:04.217522+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:00:04.217522+0000","last_undegraded":"2024-09-21T08:00:04.217522+0000","last_fullsized":"2024-09-21T08:00:04.217522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173771+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173771+0000","last_peered":"2024-09-21T08:00:04.173771+0000","last_clean":"2024-09-21T08:00:04.173771+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173771+0000","last_undegraded":"2024-09-21T08:00:04.173771+0000","last_fullsized":"2024-09-21T08:00:04.173771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084439+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084439+0000","last_peered":"2024-09-21T08:00:04.084439+0000","last_clean":"2024-09-21T08:00:04.084439+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084439+0000","last_undegraded":"2024-09-21T08:00:04.084439+0000","last_fullsized":"2024-09-21T08:00:04.084439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217340+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:00:04.217340+0000","last_peered":"2024-09-21T08:00:04.217340+0000","last_clean":"2024-09-21T08:00:04.217340+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:00:04.217340+0000","last_undegraded":"2024-09-21T08:00:04.217340+0000","last_fullsized":"2024-09-21T08:00:04.217340+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994156+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994156+0000","last_peered":"2024-09-21T08:00:03.994156+0000","last_clean":"2024-09-21T08:00:03.994156+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994156+0000","last_undegraded":"2024-09-21T08:00:03.994156+0000","last_fullsized":"2024-09-21T08:00:03.994156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993662+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993662+0000","last_peered":"2024-09-21T08:00:03.993662+0000","last_clean":"2024-09-21T08:00:03.993662+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993662+0000","last_undegraded":"2024-09-21T08:00:03.993662+0000","last_fullsized":"2024-09-21T08:00:03.993662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072488+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:00:04.072488+0000","last_peered":"2024-09-21T08:00:04.072488+0000","last_clean":"2024-09-21T08:00:04.072488+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:00:04.072488+0000","last_undegraded":"2024-09-21T08:00:04.072488+0000","last_fullsized":"2024-09-21T08:00:04.072488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993348+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993348+0000","last_peered":"2024-09-21T08:00:03.993348+0000","last_clean":"2024-09-21T08:00:03.993348+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993348+0000","last_undegraded":"2024-09-21T08:00:03.993348+0000","last_fullsized":"2024-09-21T08:00:03.993348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994017+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994017+0000","last_peered":"2024-09-21T08:00:03.994017+0000","last_clean":"2024-09-21T08:00:03.994017+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994017+0000","last_undegraded":"2024-09-21T08:00:03.994017+0000","last_fullsized":"2024-09-21T08:00:03.994017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993221+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:00:03.993221+0000","last_peered":"2024-09-21T08:00:03.993221+0000","last_clean":"2024-09-21T08:00:03.993221+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:00:03.993221+0000","last_undegraded":"2024-09-21T08:00:03.993221+0000","last_fullsized":"2024-09-21T08:00:03.993221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993878+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993878+0000","last_peered":"2024-09-21T08:00:03.993878+0000","last_clean":"2024-09-21T08:00:03.993878+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993878+0000","last_undegraded":"2024-09-21T08:00:03.993878+0000","last_fullsized":"2024-09-21T08:00:03.993878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072929+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.072929+0000","last_peered":"2024-09-21T08:00:04.072929+0000","last_clean":"2024-09-21T08:00:04.072929+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.072929+0000","last_undegraded":"2024-09-21T08:00:04.072929+0000","last_fullsized":"2024-09-21T08:00:04.072929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335869+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:00:04.335869+0000","last_peered":"2024-09-21T08:00:04.335869+0000","last_clean":"2024-09-21T08:00:04.335869+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:00:04.335869+0000","last_undegraded":"2024-09-21T08:00:04.335869+0000","last_fullsized":"2024-09-21T08:00:04.335869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218313+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218313+0000","last_peered":"2024-09-21T08:00:04.218313+0000","last_clean":"2024-09-21T08:00:04.218313+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218313+0000","last_undegraded":"2024-09-21T08:00:04.218313+0000","last_fullsized":"2024-09-21T08:00:04.218313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994391+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994391+0000","last_peered":"2024-09-21T08:00:03.994391+0000","last_clean":"2024-09-21T08:00:03.994391+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994391+0000","last_undegraded":"2024-09-21T08:00:03.994391+0000","last_fullsized":"2024-09-21T08:00:03.994391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994579+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:00:03.994579+0000","last_peered":"2024-09-21T08:00:03.994579+0000","last_clean":"2024-09-21T08:00:03.994579+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:00:03.994579+0000","last_undegraded":"2024-09-21T08:00:03.994579+0000","last_fullsized":"2024-09-21T08:00:03.994579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994620+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994620+0000","last_peered":"2024-09-21T08:00:03.994620+0000","last_clean":"2024-09-21T08:00:03.994620+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994620+0000","last_undegraded":"2024-09-21T08:00:03.994620+0000","last_fullsized":"2024-09-21T08:00:03.994620+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216204+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216204+0000","last_peered":"2024-09-21T08:00:04.216204+0000","last_clean":"2024-09-21T08:00:04.216204+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216204+0000","last_undegraded":"2024-09-21T08:00:04.216204+0000","last_fullsized":"2024-09-21T08:00:04.216204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994290+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:00:03.994290+0000","last_peered":"2024-09-21T08:00:03.994290+0000","last_clean":"2024-09-21T08:00:03.994290+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:00:03.994290+0000","last_undegraded":"2024-09-21T08:00:03.994290+0000","last_fullsized":"2024-09-21T08:00:03.994290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073283+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:00:04.073283+0000","last_peered":"2024-09-21T08:00:04.073283+0000","last_clean":"2024-09-21T08:00:04.073283+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:00:04.073283+0000","last_undegraded":"2024-09-21T08:00:04.073283+0000","last_fullsized":"2024-09-21T08:00:04.073283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994378+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:00:03.994378+0000","last_peered":"2024-09-21T08:00:03.994378+0000","last_clean":"2024-09-21T08:00:03.994378+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:00:03.994378+0000","last_undegraded":"2024-09-21T08:00:03.994378+0000","last_fullsized":"2024-09-21T08:00:03.994378+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994097+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994097+0000","last_peered":"2024-09-21T08:00:03.994097+0000","last_clean":"2024-09-21T08:00:03.994097+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994097+0000","last_undegraded":"2024-09-21T08:00:03.994097+0000","last_fullsized":"2024-09-21T08:00:03.994097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072262+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072262+0000","last_peered":"2024-09-21T08:00:04.072262+0000","last_clean":"2024-09-21T08:00:04.072262+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072262+0000","last_undegraded":"2024-09-21T08:00:04.072262+0000","last_fullsized":"2024-09-21T08:00:04.072262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.219654+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:00:04.219654+0000","last_peered":"2024-09-21T08:00:04.219654+0000","last_clean":"2024-09-21T08:00:04.219654+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:00:04.219654+0000","last_undegraded":"2024-09-21T08:00:04.219654+0000","last_fullsized":"2024-09-21T08:00:04.219654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072350+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072350+0000","last_peered":"2024-09-21T08:00:04.072350+0000","last_clean":"2024-09-21T08:00:04.072350+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072350+0000","last_undegraded":"2024-09-21T08:00:04.072350+0000","last_fullsized":"2024-09-21T08:00:04.072350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072584+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:00:04.072584+0000","last_peered":"2024-09-21T08:00:04.072584+0000","last_clean":"2024-09-21T08:00:04.072584+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:00:04.072584+0000","last_undegraded":"2024-09-21T08:00:04.072584+0000","last_fullsized":"2024-09-21T08:00:04.072584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084599+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084599+0000","last_peered":"2024-09-21T08:00:04.084599+0000","last_clean":"2024-09-21T08:00:04.084599+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084599+0000","last_undegraded":"2024-09-21T08:00:04.084599+0000","last_fullsized":"2024-09-21T08:00:04.084599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993780+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:00:03.993780+0000","last_peered":"2024-09-21T08:00:03.993780+0000","last_clean":"2024-09-21T08:00:03.993780+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:00:03.993780+0000","last_undegraded":"2024-09-21T08:00:03.993780+0000","last_fullsized":"2024-09-21T08:00:03.993780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217468+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217468+0000","last_peered":"2024-09-21T08:00:04.217468+0000","last_clean":"2024-09-21T08:00:04.217468+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217468+0000","last_undegraded":"2024-09-21T08:00:04.217468+0000","last_fullsized":"2024-09-21T08:00:04.217468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994176+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:00:03.994176+0000","last_peered":"2024-09-21T08:00:03.994176+0000","last_clean":"2024-09-21T08:00:03.994176+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:00:03.994176+0000","last_undegraded":"2024-09-21T08:00:03.994176+0000","last_fullsized":"2024-09-21T08:00:03.994176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072796+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072796+0000","last_peered":"2024-09-21T08:00:04.072796+0000","last_clean":"2024-09-21T08:00:04.072796+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072796+0000","last_undegraded":"2024-09-21T08:00:04.072796+0000","last_fullsized":"2024-09-21T08:00:04.072796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993591+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:00:03.993591+0000","last_peered":"2024-09-21T08:00:03.993591+0000","last_clean":"2024-09-21T08:00:03.993591+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:00:03.993591+0000","last_undegraded":"2024-09-21T08:00:03.993591+0000","last_fullsized":"2024-09-21T08:00:03.993591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994222+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994222+0000","last_peered":"2024-09-21T08:00:03.994222+0000","last_clean":"2024-09-21T08:00:03.994222+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994222+0000","last_undegraded":"2024-09-21T08:00:03.994222+0000","last_fullsized":"2024-09-21T08:00:03.994222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085070+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:00:04.085070+0000","last_peered":"2024-09-21T08:00:04.085070+0000","last_clean":"2024-09-21T08:00:04.085070+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:00:04.085070+0000","last_undegraded":"2024-09-21T08:00:04.085070+0000","last_fullsized":"2024-09-21T08:00:04.085070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":193,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:22.773844+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:00:22.773844+0000","last_peered":"2024-09-21T08:00:22.773844+0000","last_clean":"2024-09-21T08:00:22.773844+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:00:22.773844+0000","last_undegraded":"2024-09-21T08:00:22.773844+0000","last_fullsized":"2024-09-21T08:00:22.773844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":129,"num_write":32,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216770+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:00:04.216770+0000","last_peered":"2024-09-21T08:00:04.216770+0000","last_clean":"2024-09-21T08:00:04.216770+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:00:04.216770+0000","last_undegraded":"2024-09-21T08:00:04.216770+0000","last_fullsized":"2024-09-21T08:00:04.216770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073275+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073275+0000","last_peered":"2024-09-21T08:00:04.073275+0000","last_clean":"2024-09-21T08:00:04.073275+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073275+0000","last_undegraded":"2024-09-21T08:00:04.073275+0000","last_fullsized":"2024-09-21T08:00:04.073275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997633+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:00:03.997633+0000","last_peered":"2024-09-21T08:00:03.997633+0000","last_clean":"2024-09-21T08:00:03.997633+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:00:03.997633+0000","last_undegraded":"2024-09-21T08:00:03.997633+0000","last_fullsized":"2024-09-21T08:00:03.997633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217384+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:00:04.217384+0000","last_peered":"2024-09-21T08:00:04.217384+0000","last_clean":"2024-09-21T08:00:04.217384+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:00:04.217384+0000","last_undegraded":"2024-09-21T08:00:04.217384+0000","last_fullsized":"2024-09-21T08:00:04.217384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217377+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217377+0000","last_peered":"2024-09-21T08:00:04.217377+0000","last_clean":"2024-09-21T08:00:04.217377+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217377+0000","last_undegraded":"2024-09-21T08:00:04.217377+0000","last_fullsized":"2024-09-21T08:00:04.217377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996840+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996840+0000","last_peered":"2024-09-21T08:00:03.996840+0000","last_clean":"2024-09-21T08:00:03.996840+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996840+0000","last_undegraded":"2024-09-21T08:00:03.996840+0000","last_fullsized":"2024-09-21T08:00:03.996840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173242+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:00:04.173242+0000","last_peered":"2024-09-21T08:00:04.173242+0000","last_clean":"2024-09-21T08:00:04.173242+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:00:04.173242+0000","last_undegraded":"2024-09-21T08:00:04.173242+0000","last_fullsized":"2024-09-21T08:00:04.173242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072745+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072745+0000","last_peered":"2024-09-21T08:00:04.072745+0000","last_clean":"2024-09-21T08:00:04.072745+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072745+0000","last_undegraded":"2024-09-21T08:00:04.072745+0000","last_fullsized":"2024-09-21T08:00:04.072745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998117+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998117+0000","last_peered":"2024-09-21T08:00:03.998117+0000","last_clean":"2024-09-21T08:00:03.998117+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998117+0000","last_undegraded":"2024-09-21T08:00:03.998117+0000","last_fullsized":"2024-09-21T08:00:03.998117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335429+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:00:04.335429+0000","last_peered":"2024-09-21T08:00:04.335429+0000","last_clean":"2024-09-21T08:00:04.335429+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:00:04.335429+0000","last_undegraded":"2024-09-21T08:00:04.335429+0000","last_fullsized":"2024-09-21T08:00:04.335429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993345+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993345+0000","last_peered":"2024-09-21T08:00:03.993345+0000","last_clean":"2024-09-21T08:00:03.993345+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993345+0000","last_undegraded":"2024-09-21T08:00:03.993345+0000","last_fullsized":"2024-09-21T08:00:03.993345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072755+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:00:04.072755+0000","last_peered":"2024-09-21T08:00:04.072755+0000","last_clean":"2024-09-21T08:00:04.072755+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:00:04.072755+0000","last_undegraded":"2024-09-21T08:00:04.072755+0000","last_fullsized":"2024-09-21T08:00:04.072755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084623+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:00:04.084623+0000","last_peered":"2024-09-21T08:00:04.084623+0000","last_clean":"2024-09-21T08:00:04.084623+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:00:04.084623+0000","last_undegraded":"2024-09-21T08:00:04.084623+0000","last_fullsized":"2024-09-21T08:00:04.084623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997877+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:00:03.997877+0000","last_peered":"2024-09-21T08:00:03.997877+0000","last_clean":"2024-09-21T08:00:03.997877+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:00:03.997877+0000","last_undegraded":"2024-09-21T08:00:03.997877+0000","last_fullsized":"2024-09-21T08:00:03.997877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994470+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:00:03.994470+0000","last_peered":"2024-09-21T08:00:03.994470+0000","last_clean":"2024-09-21T08:00:03.994470+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:00:03.994470+0000","last_undegraded":"2024-09-21T08:00:03.994470+0000","last_fullsized":"2024-09-21T08:00:03.994470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993994+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:00:03.993994+0000","last_peered":"2024-09-21T08:00:03.993994+0000","last_clean":"2024-09-21T08:00:03.993994+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:00:03.993994+0000","last_undegraded":"2024-09-21T08:00:03.993994+0000","last_fullsized":"2024-09-21T08:00:03.993994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996322+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:00:03.996322+0000","last_peered":"2024-09-21T08:00:03.996322+0000","last_clean":"2024-09-21T08:00:03.996322+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:00:03.996322+0000","last_undegraded":"2024-09-21T08:00:03.996322+0000","last_fullsized":"2024-09-21T08:00:03.996322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993881+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:00:03.993881+0000","last_peered":"2024-09-21T08:00:03.993881+0000","last_clean":"2024-09-21T08:00:03.993881+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:00:03.993881+0000","last_undegraded":"2024-09-21T08:00:03.993881+0000","last_fullsized":"2024-09-21T08:00:03.993881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174600+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:00:04.174600+0000","last_peered":"2024-09-21T08:00:04.174600+0000","last_clean":"2024-09-21T08:00:04.174600+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:00:04.174600+0000","last_undegraded":"2024-09-21T08:00:04.174600+0000","last_fullsized":"2024-09-21T08:00:04.174600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994309+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:00:03.994309+0000","last_peered":"2024-09-21T08:00:03.994309+0000","last_clean":"2024-09-21T08:00:03.994309+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:00:03.994309+0000","last_undegraded":"2024-09-21T08:00:03.994309+0000","last_fullsized":"2024-09-21T08:00:03.994309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336066+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:00:04.336066+0000","last_peered":"2024-09-21T08:00:04.336066+0000","last_clean":"2024-09-21T08:00:04.336066+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:00:04.336066+0000","last_undegraded":"2024-09-21T08:00:04.336066+0000","last_fullsized":"2024-09-21T08:00:04.336066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072401+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:00:04.072401+0000","last_peered":"2024-09-21T08:00:04.072401+0000","last_clean":"2024-09-21T08:00:04.072401+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:00:04.072401+0000","last_undegraded":"2024-09-21T08:00:04.072401+0000","last_fullsized":"2024-09-21T08:00:04.072401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335578+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:00:04.335578+0000","last_peered":"2024-09-21T08:00:04.335578+0000","last_clean":"2024-09-21T08:00:04.335578+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:00:04.335578+0000","last_undegraded":"2024-09-21T08:00:04.335578+0000","last_fullsized":"2024-09-21T08:00:04.335578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216644+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:00:04.216644+0000","last_peered":"2024-09-21T08:00:04.216644+0000","last_clean":"2024-09-21T08:00:04.216644+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:00:04.216644+0000","last_undegraded":"2024-09-21T08:00:04.216644+0000","last_fullsized":"2024-09-21T08:00:04.216644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993593+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:00:03.993593+0000","last_peered":"2024-09-21T08:00:03.993593+0000","last_clean":"2024-09-21T08:00:03.993593+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:00:03.993593+0000","last_undegraded":"2024-09-21T08:00:03.993593+0000","last_fullsized":"2024-09-21T08:00:03.993593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998135+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:00:03.998135+0000","last_peered":"2024-09-21T08:00:03.998135+0000","last_clean":"2024-09-21T08:00:03.998135+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:00:03.998135+0000","last_undegraded":"2024-09-21T08:00:03.998135+0000","last_fullsized":"2024-09-21T08:00:03.998135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994572+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:00:03.994572+0000","last_peered":"2024-09-21T08:00:03.994572+0000","last_clean":"2024-09-21T08:00:03.994572+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:00:03.994572+0000","last_undegraded":"2024-09-21T08:00:03.994572+0000","last_fullsized":"2024-09-21T08:00:03.994572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173852+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:00:04.173852+0000","last_peered":"2024-09-21T08:00:04.173852+0000","last_clean":"2024-09-21T08:00:04.173852+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:00:04.173852+0000","last_undegraded":"2024-09-21T08:00:04.173852+0000","last_fullsized":"2024-09-21T08:00:04.173852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998621+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:00:03.998621+0000","last_peered":"2024-09-21T08:00:03.998621+0000","last_clean":"2024-09-21T08:00:03.998621+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:00:03.998621+0000","last_undegraded":"2024-09-21T08:00:03.998621+0000","last_fullsized":"2024-09-21T08:00:03.998621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216277+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:00:04.216277+0000","last_peered":"2024-09-21T08:00:04.216277+0000","last_clean":"2024-09-21T08:00:04.216277+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:00:04.216277+0000","last_undegraded":"2024-09-21T08:00:04.216277+0000","last_fullsized":"2024-09-21T08:00:04.216277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998478+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:00:03.998478+0000","last_peered":"2024-09-21T08:00:03.998478+0000","last_clean":"2024-09-21T08:00:03.998478+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:00:03.998478+0000","last_undegraded":"2024-09-21T08:00:03.998478+0000","last_fullsized":"2024-09-21T08:00:03.998478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996090+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:00:03.996090+0000","last_peered":"2024-09-21T08:00:03.996090+0000","last_clean":"2024-09-21T08:00:03.996090+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:00:03.996090+0000","last_undegraded":"2024-09-21T08:00:03.996090+0000","last_fullsized":"2024-09-21T08:00:03.996090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993526+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:00:03.993526+0000","last_peered":"2024-09-21T08:00:03.993526+0000","last_clean":"2024-09-21T08:00:03.993526+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:00:03.993526+0000","last_undegraded":"2024-09-21T08:00:03.993526+0000","last_fullsized":"2024-09-21T08:00:03.993526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173531+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:00:04.173531+0000","last_peered":"2024-09-21T08:00:04.173531+0000","last_clean":"2024-09-21T08:00:04.173531+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:00:04.173531+0000","last_undegraded":"2024-09-21T08:00:04.173531+0000","last_fullsized":"2024-09-21T08:00:04.173531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994496+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:00:03.994496+0000","last_peered":"2024-09-21T08:00:03.994496+0000","last_clean":"2024-09-21T08:00:03.994496+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:00:03.994496+0000","last_undegraded":"2024-09-21T08:00:03.994496+0000","last_fullsized":"2024-09-21T08:00:03.994496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216906+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:00:04.216906+0000","last_peered":"2024-09-21T08:00:04.216906+0000","last_clean":"2024-09-21T08:00:04.216906+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:00:04.216906+0000","last_undegraded":"2024-09-21T08:00:04.216906+0000","last_fullsized":"2024-09-21T08:00:04.216906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216766+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:00:04.216766+0000","last_peered":"2024-09-21T08:00:04.216766+0000","last_clean":"2024-09-21T08:00:04.216766+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:00:04.216766+0000","last_undegraded":"2024-09-21T08:00:04.216766+0000","last_fullsized":"2024-09-21T08:00:04.216766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993837+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:00:03.993837+0000","last_peered":"2024-09-21T08:00:03.993837+0000","last_clean":"2024-09-21T08:00:03.993837+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:00:03.993837+0000","last_undegraded":"2024-09-21T08:00:03.993837+0000","last_fullsized":"2024-09-21T08:00:03.993837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217005+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:00:04.217005+0000","last_peered":"2024-09-21T08:00:04.217005+0000","last_clean":"2024-09-21T08:00:04.217005+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:00:04.217005+0000","last_undegraded":"2024-09-21T08:00:04.217005+0000","last_fullsized":"2024-09-21T08:00:04.217005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084504+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:00:04.084504+0000","last_peered":"2024-09-21T08:00:04.084504+0000","last_clean":"2024-09-21T08:00:04.084504+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:00:04.084504+0000","last_undegraded":"2024-09-21T08:00:04.084504+0000","last_fullsized":"2024-09-21T08:00:04.084504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217583+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:00:04.217583+0000","last_peered":"2024-09-21T08:00:04.217583+0000","last_clean":"2024-09-21T08:00:04.217583+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:00:04.217583+0000","last_undegraded":"2024-09-21T08:00:04.217583+0000","last_fullsized":"2024-09-21T08:00:04.217583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996751+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:00:03.996751+0000","last_peered":"2024-09-21T08:00:03.996751+0000","last_clean":"2024-09-21T08:00:03.996751+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:00:03.996751+0000","last_undegraded":"2024-09-21T08:00:03.996751+0000","last_fullsized":"2024-09-21T08:00:03.996751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996956+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:00:03.996956+0000","last_peered":"2024-09-21T08:00:03.996956+0000","last_clean":"2024-09-21T08:00:03.996956+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:00:03.996956+0000","last_undegraded":"2024-09-21T08:00:03.996956+0000","last_fullsized":"2024-09-21T08:00:03.996956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998547+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:00:03.998547+0000","last_peered":"2024-09-21T08:00:03.998547+0000","last_clean":"2024-09-21T08:00:03.998547+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:00:03.998547+0000","last_undegraded":"2024-09-21T08:00:03.998547+0000","last_fullsized":"2024-09-21T08:00:03.998547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":128,"num_read_kb":135,"num_write":88,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":1155469,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":1086190,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":564941,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":564907,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:00:26.058 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T08:00:26.059 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T08:00:26.059 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T08:00:26.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T08:00:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:26.442 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:26 smithi006 ceph-mon[30970]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:26.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:26 smithi119 ceph-mon[33564]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:26.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:26 smithi145 ceph-mon[34049]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 -- 172.21.15.6:0/43131510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484102a80 msgr2=0x7f2484102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 --2- 172.21.15.6:0/43131510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484102a80 0x7f2484102e90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2474009900 tx=0x7f247402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 -- 172.21.15.6:0/43131510 shutdown_connections 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 --2- 172.21.15.6:0/43131510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484108d10 0x7f248410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 --2- 172.21.15.6:0/43131510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24841083c0 0x7f24841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 --2- 172.21.15.6:0/43131510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484102a80 0x7f2484102e90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 -- 172.21.15.6:0/43131510 >> 172.21.15.6:0/43131510 conn(0x7f2484079740 msgr2=0x7f2484079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.825+0000 7f2488995640 1 -- 172.21.15.6:0/43131510 shutdown_connections 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.826+0000 7f2488995640 1 -- 172.21.15.6:0/43131510 wait complete. 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.826+0000 7f2488995640 1 Processor -- start 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.826+0000 7f2488995640 1 -- start start 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484102a80 0x7f248419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 0x7f248419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2484112880 con 0x7f2484108d10 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2484112700 con 0x7f2484102a80 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2488995640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2484112a00 con 0x7f24841083c0 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53392/0 (socket says 172.21.15.6:53392) 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 -- 172.21.15.6:0/3671897259 learned_addr learned my addr 172.21.15.6:0/3671897259 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2481d9b640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 0x7f248419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f248259c640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484102a80 0x7f248419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 -- 172.21.15.6:0/3671897259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 msgr2=0x7f248419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 0x7f248419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 -- 172.21.15.6:0/3671897259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484102a80 msgr2=0x7f248419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484102a80 0x7f248419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 -- 172.21.15.6:0/3671897259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24841a02f0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2481d9b640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 0x7f248419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.827+0000 7f2482d9d640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f247c00eaa0 tx=0x7f247c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.828+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c00cdb0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.828+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c005020 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.828+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24841a05e0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.828+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c0116d0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.828+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24841a6d40 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.829+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2484103d00 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.830+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f247c0051d0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.831+0000 7f24737fe640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 0x7f246c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.832+0000 7f248259c640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 0x7f246c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.832+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f247c0e7ef0 con 0x7f2484108d10 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.832+0000 7f248259c640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 0x7f246c0b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2474006010 tx=0x7f2474000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:26.835+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f247c016030 con 0x7f2484108d10 2024-09-21T08:00:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.063+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2484102e90 con 0x7f2484108d10 2024-09-21T08:00:27.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.064+0000 7f24737fe640 1 -- 172.21.15.6:0/3671897259 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2484102e90 con 0x7f2484108d10 2024-09-21T08:00:27.065 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:27.065 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 msgr2=0x7f246c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 0x7f246c0b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2474006010 tx=0x7f2474000bc0 comp rx=0 tx=0).stop 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 msgr2=0x7f248419fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f247c00eaa0 tx=0x7f247c00ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 shutdown_connections 2024-09-21T08:00:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f246c0b65f0 0x7f246c0b8b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24841083c0 0x7f248419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2484108d10 0x7f248419fbc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 --2- 172.21.15.6:0/3671897259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2484102a80 0x7f248419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 >> 172.21.15.6:0/3671897259 conn(0x7f2484079740 msgr2=0x7f2484101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 shutdown_connections 2024-09-21T08:00:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:27.066+0000 7f2488995640 1 -- 172.21.15.6:0/3671897259 wait complete. 2024-09-21T08:00:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:27 smithi006 ceph-mon[30970]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:27 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3671897259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T08:00:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:27 smithi119 ceph-mon[33564]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:27 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3671897259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T08:00:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:27 smithi145 ceph-mon[34049]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:27 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3671897259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T08:00:27.869 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T08:00:27.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 -- 172.21.15.6:0/116343552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e01094c0 msgr2=0x7ff0e01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 --2- 172.21.15.6:0/116343552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e01094c0 0x7ff0e01098d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009900 tx=0x7ff0d002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 -- 172.21.15.6:0/116343552 shutdown_connections 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 --2- 172.21.15.6:0/116343552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 0x7ff0e0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 --2- 172.21.15.6:0/116343552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e01094c0 0x7ff0e01098d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 --2- 172.21.15.6:0/116343552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0103b80 0x7ff0e0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 -- 172.21.15.6:0/116343552 >> 172.21.15.6:0/116343552 conn(0x7ff0e00ff610 msgr2=0x7ff0e0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:28.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 -- 172.21.15.6:0/116343552 shutdown_connections 2024-09-21T08:00:28.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.603+0000 7ff0e8160640 1 -- 172.21.15.6:0/116343552 wait complete. 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.604+0000 7ff0e8160640 1 Processor -- start 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.604+0000 7ff0e8160640 1 -- start start 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.604+0000 7ff0e8160640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e01094c0 0x7ff0e019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 0x7ff0e019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0113980 con 0x7ff0e0103b80 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0113800 con 0x7ff0e01094c0 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0113b00 con 0x7ff0e0109e10 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53408/0 (socket says 172.21.15.6:53408) 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 -- 172.21.15.6:0/2826621039 learned_addr learned my addr 172.21.15.6:0/2826621039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e56fb640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e01094c0 0x7ff0e019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e66fd640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 0x7ff0e019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 -- 172.21.15.6:0/2826621039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 msgr2=0x7ff0e019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 0x7ff0e019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 -- 172.21.15.6:0/2826621039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e01094c0 msgr2=0x7ff0e019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e01094c0 0x7ff0e019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 -- 172.21.15.6:0/2826621039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01a0360 con 0x7ff0e0103b80 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e5efc640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00e9f0 tx=0x7ff0dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00cd80 con 0x7ff0e0103b80 2024-09-21T08:00:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01a0650 con 0x7ff0e0103b80 2024-09-21T08:00:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0dc0108c0 con 0x7ff0e0103b80 2024-09-21T08:00:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.605+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0187c0 con 0x7ff0e0103b80 2024-09-21T08:00:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.606+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01a6db0 con 0x7ff0e0103b80 2024-09-21T08:00:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.607+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e0104e00 con 0x7ff0e0103b80 2024-09-21T08:00:28.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.609+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff0dc010430 con 0x7ff0e0103b80 2024-09-21T08:00:28.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.610+0000 7ff0d6ffd640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 0x7ff0cc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:28.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.610+0000 7ff0e56fb640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 0x7ff0cc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:28.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.610+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff0dc0e8310 con 0x7ff0e0103b80 2024-09-21T08:00:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.611+0000 7ff0e56fb640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 0x7ff0cc0b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005940 tx=0x7ff0d00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.613+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0dc0ae540 con 0x7ff0e0103b80 2024-09-21T08:00:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.843+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0e0103f90 con 0x7ff0e0103b80 2024-09-21T08:00:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.844+0000 7ff0d6ffd640 1 -- 172.21.15.6:0/2826621039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7ff0e0103f90 con 0x7ff0e0103b80 2024-09-21T08:00:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:28.846 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:00:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.846+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 msgr2=0x7ff0cc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 0x7ff0cc0b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005940 tx=0x7ff0d00058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 msgr2=0x7ff0e019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00e9f0 tx=0x7ff0dc00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 shutdown_connections 2024-09-21T08:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0cc0b65f0 0x7ff0cc0b8b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0e0109e10 0x7ff0e019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e01094c0 0x7ff0e019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 --2- 172.21.15.6:0/2826621039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0e0103b80 0x7ff0e019a3f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 >> 172.21.15.6:0/2826621039 conn(0x7ff0e00ff610 msgr2=0x7ff0e0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 shutdown_connections 2024-09-21T08:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:28.847+0000 7ff0e8160640 1 -- 172.21.15.6:0/2826621039 wait complete. 2024-09-21T08:00:29.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:29 smithi006 ceph-mon[30970]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2826621039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:29.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:29 smithi119 ceph-mon[33564]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2826621039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:29.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:29 smithi145 ceph-mon[34049]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:29.698 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2826621039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 -- 172.21.15.6:0/4160922042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa301083a0 msgr2=0x7faa301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 --2- 172.21.15.6:0/4160922042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa301083a0 0x7faa301087b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faa18009900 tx=0x7faa1802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 -- 172.21.15.6:0/4160922042 shutdown_connections 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 --2- 172.21.15.6:0/4160922042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30108cf0 0x7faa3010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 --2- 172.21.15.6:0/4160922042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa301083a0 0x7faa301087b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 --2- 172.21.15.6:0/4160922042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa30102a60 0x7faa30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 -- 172.21.15.6:0/4160922042 >> 172.21.15.6:0/4160922042 conn(0x7faa30079730 msgr2=0x7faa30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 -- 172.21.15.6:0/4160922042 shutdown_connections 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.323+0000 7faa35885640 1 -- 172.21.15.6:0/4160922042 wait complete. 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 Processor -- start 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 -- start start 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30102a60 0x7faa30199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 0x7faa301998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa30112810 con 0x7faa30108cf0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa30112690 con 0x7faa30102a60 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa35885640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faa30112990 con 0x7faa301083a0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53428/0 (socket says 172.21.15.6:53428) 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa2f7fe640 1 -- 172.21.15.6:0/276988895 learned_addr learned my addr 172.21.15.6:0/276988895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa2effd640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30102a60 0x7faa30199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.324+0000 7faa2e7fc640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 0x7faa301998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 -- 172.21.15.6:0/276988895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 msgr2=0x7faa301998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 0x7faa301998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 -- 172.21.15.6:0/276988895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30102a60 msgr2=0x7faa30199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30102a60 0x7faa30199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 -- 172.21.15.6:0/276988895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3019f2b0 con 0x7faa30108cf0 2024-09-21T08:00:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2e7fc640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 0x7faa301998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa2f7fe640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c970 tx=0x7faa2800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28007bb0 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa28007d50 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28004d50 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3019f5a0 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.325+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa301a5d00 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.326+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa30102e70 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.328+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7faa28004f70 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.328+0000 7faa34883640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 0x7faa1c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.329+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7faa280e7560 con 0x7faa30108cf0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.329+0000 7faa2effd640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 0x7faa1c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.329+0000 7faa2effd640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 0x7faa1c0b8b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faa20005fd0 tx=0x7faa20009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.333+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa28014030 con 0x7faa30108cf0 2024-09-21T08:00:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.562+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa3002e640 con 0x7faa30108cf0 2024-09-21T08:00:30.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.563+0000 7faa34883640 1 -- 172.21.15.6:0/276988895 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7faa280ad7f0 con 0x7faa30108cf0 2024-09-21T08:00:30.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:30.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:00:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 msgr2=0x7faa1c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 0x7faa1c0b8b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faa20005fd0 tx=0x7faa20009680 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 msgr2=0x7faa3019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c970 tx=0x7faa2800ce30 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 shutdown_connections 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa1c0b6670 0x7faa1c0b8b80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa301083a0 0x7faa301998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa30108cf0 0x7faa3019eb80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 --2- 172.21.15.6:0/276988895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa30102a60 0x7faa30199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 >> 172.21.15.6:0/276988895 conn(0x7faa30079730 msgr2=0x7faa30104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 shutdown_connections 2024-09-21T08:00:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:30.565+0000 7faa35885640 1 -- 172.21.15.6:0/276988895 wait complete. 2024-09-21T08:00:31.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:00:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:31 smithi119 ceph-mon[33564]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/276988895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:31 smithi145 ceph-mon[34049]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/276988895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:31.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:31 smithi006 ceph-mon[30970]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:31.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/276988895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:32.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 -- 172.21.15.6:0/1187477131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc1049e0 msgr2=0x7fb4bc104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:32.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 --2- 172.21.15.6:0/1187477131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc104df0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009900 tx=0x7fb4ac02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:32.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 -- 172.21.15.6:0/1187477131 shutdown_connections 2024-09-21T08:00:32.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 --2- 172.21.15.6:0/1187477131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc10de40 0x7fb4bc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 --2- 172.21.15.6:0/1187477131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 0x7fb4bc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 --2- 172.21.15.6:0/1187477131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc104df0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 -- 172.21.15.6:0/1187477131 >> 172.21.15.6:0/1187477131 conn(0x7fb4bc079750 msgr2=0x7fb4bc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 -- 172.21.15.6:0/1187477131 shutdown_connections 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.115+0000 7fb4c156b640 1 -- 172.21.15.6:0/1187477131 wait complete. 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 Processor -- start 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 -- start start 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 0x7fb4bc102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:32.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc113950 con 0x7fb4bc10de40 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1137d0 con 0x7fb4bc105330 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.116+0000 7fb4c156b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc113ad0 con 0x7fb4bc1049e0 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53432/0 (socket says 172.21.15.6:53432) 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 -- 172.21.15.6:0/2985994557 learned_addr learned my addr 172.21.15.6:0/2985994557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4ba7fc640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 0x7fb4bc102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4baffd640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 -- 172.21.15.6:0/2985994557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 msgr2=0x7fb4bc102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 -- 172.21.15.6:0/2985994557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 msgr2=0x7fb4bc102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 0x7fb4bc102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 -- 172.21.15.6:0/2985994557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc1a85f0 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4baffd640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4bb7fe640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400eaa0 tx=0x7fb4b400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004d20 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc1a88e0 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4b4005020 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40116d0 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.117+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc1a8dd0 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.118+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4bc06c280 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.121+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb4b40051d0 con 0x7fb4bc10de40 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.122+0000 7fb4b3fff640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 0x7fb4a80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.122+0000 7fb4baffd640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 0x7fb4a80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.122+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb4b40e7fd0 con 0x7fb4bc10de40 2024-09-21T08:00:32.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.122+0000 7fb4baffd640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 0x7fb4a80b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0057c0 tx=0x7fb4ac005de0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:32.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.125+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4b4016030 con 0x7fb4bc10de40 2024-09-21T08:00:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.318+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4bc104df0 con 0x7fb4bc10de40 2024-09-21T08:00:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.320+0000 7fb4b3fff640 1 -- 172.21.15.6:0/2985994557 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25204 (secure 0 0 0) 0x7fb4bc104df0 con 0x7fb4bc10de40 2024-09-21T08:00:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:32.322 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:00:03.985299+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 msgr2=0x7fb4a80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 0x7fb4a80b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0057c0 tx=0x7fb4ac005de0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 msgr2=0x7fb4bc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400eaa0 tx=0x7fb4b400eea0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 shutdown_connections 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4a80b65f0 0x7fb4a80b8b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4bc10de40 0x7fb4bc1031a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4bc105330 0x7fb4bc102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 --2- 172.21.15.6:0/2985994557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4bc1049e0 0x7fb4bc102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.322+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 >> 172.21.15.6:0/2985994557 conn(0x7fb4bc079750 msgr2=0x7fb4bc100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.323+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 shutdown_connections 2024-09-21T08:00:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:32.323+0000 7fb4c156b640 1 -- 172.21.15.6:0/2985994557 wait complete. 2024-09-21T08:00:33.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:33.309 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:33.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:33 smithi006 ceph-mon[30970]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:33.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:33 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2985994557' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:33 smithi119 ceph-mon[33564]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:33 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2985994557' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:33.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:33 smithi145 ceph-mon[34049]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:33.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:33 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2985994557' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:33.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 -- 172.21.15.6:0/913311608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f84109df0 msgr2=0x7f6f84110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 --2- 172.21.15.6:0/913311608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f84109df0 0x7f6f84110620 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009900 tx=0x7f6f7c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 -- 172.21.15.6:0/913311608 shutdown_connections 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 --2- 172.21.15.6:0/913311608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f841094a0 0x7f6f841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 --2- 172.21.15.6:0/913311608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f84109df0 0x7f6f84110620 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 --2- 172.21.15.6:0/913311608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 0x7f6f84103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 -- 172.21.15.6:0/913311608 >> 172.21.15.6:0/913311608 conn(0x7f6f8407b850 msgr2=0x7f6f8407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 -- 172.21.15.6:0/913311608 shutdown_connections 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.728+0000 7f6f899ed640 1 -- 172.21.15.6:0/913311608 wait complete. 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 Processor -- start 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 -- start start 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 0x7f6f8419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f84109df0 0x7f6f8419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f84113960 con 0x7f6f841094a0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f841137e0 con 0x7f6f84103b60 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.729+0000 7f6f899ed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f84113ae0 con 0x7f6f84109df0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53448/0 (socket says 172.21.15.6:53448) 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 -- 172.21.15.6:0/3302972941 learned_addr learned my addr 172.21.15.6:0/3302972941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f82ffd640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 0x7f6f8419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f837fe640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f84109df0 0x7f6f8419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 -- 172.21.15.6:0/3302972941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f84109df0 msgr2=0x7f6f8419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f84109df0 0x7f6f8419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 -- 172.21.15.6:0/3302972941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 msgr2=0x7f6f8419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 0x7f6f8419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 -- 172.21.15.6:0/3302972941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f841a01a0 con 0x7f6f841094a0 2024-09-21T08:00:33.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f827fc640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c8c0 tx=0x7f6f7800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78007bb0 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f841a0490 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f78007d50 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78018660 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.730+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f841a6cb0 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.731+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f84103f70 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.733+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f6f7800fa00 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.734+0000 7f6f889eb640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 0x7f6f6c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.734+0000 7f6f82ffd640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 0x7f6f6c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.734+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6f780e7d90 con 0x7f6f841094a0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.735+0000 7f6f82ffd640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 0x7f6f6c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f74007350 tx=0x7f6f740072e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:33.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.738+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f78014030 con 0x7f6f841094a0 2024-09-21T08:00:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.964+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8419b420 con 0x7f6f841094a0 2024-09-21T08:00:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.964+0000 7f6f889eb640 1 -- 172.21.15.6:0/3302972941 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f6f780ae0b0 con 0x7f6f841094a0 2024-09-21T08:00:33.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:33.967 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:00:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 msgr2=0x7f6f6c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 0x7f6f6c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f74007350 tx=0x7f6f740072e0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 msgr2=0x7f6f8419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c8c0 tx=0x7f6f7800cd80 comp rx=0 tx=0).stop 2024-09-21T08:00:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 shutdown_connections 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f6c0b6620 0x7f6f6c0b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f84109df0 0x7f6f8419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f841094a0 0x7f6f8419a890 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 --2- 172.21.15.6:0/3302972941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f84103b60 0x7f6f8419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 >> 172.21.15.6:0/3302972941 conn(0x7f6f8407b850 msgr2=0x7f6f84105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 shutdown_connections 2024-09-21T08:00:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:33.967+0000 7f6f899ed640 1 -- 172.21.15.6:0/3302972941 wait complete. 2024-09-21T08:00:34.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3302972941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:34.682 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3302972941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3302972941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:34.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:58:46.069948+0000', 'modified': '2024-09-21T07:59:28.356248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24713}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24694': {'gid': 24694, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6839/3378332428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3378332428}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3378332428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24713': {'gid': 24713, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/1644051507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1644051507}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1644051507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24713, 'qdb_cluster': [24713]} 2024-09-21T08:00:34.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T08:00:34.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.b status 2024-09-21T08:00:34.973 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:35.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:35 smithi006 ceph-mon[30970]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- 172.21.15.6:0/3850595504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd41083f0 msgr2=0x7fadd4108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 --2- 172.21.15.6:0/3850595504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd41083f0 0x7fadd4108800 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009900 tx=0x7fadc802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- 172.21.15.6:0/3850595504 shutdown_connections 2024-09-21T08:00:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 --2- 172.21.15.6:0/3850595504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd4108d40 0x7fadd410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 --2- 172.21.15.6:0/3850595504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd41083f0 0x7fadd4108800 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 --2- 172.21.15.6:0/3850595504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 0x7fadd4103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- 172.21.15.6:0/3850595504 >> 172.21.15.6:0/3850595504 conn(0x7fadd4079e40 msgr2=0x7fadd407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- 172.21.15.6:0/3850595504 shutdown_connections 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- 172.21.15.6:0/3850595504 wait complete. 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 Processor -- start 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.463+0000 7faddabcc640 1 -- start start 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 0x7fadd410fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd41083f0 0x7fadd4110410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fadd41139a0 con 0x7fadd4108d40 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4113820 con 0x7fadd4103110 2024-09-21T08:00:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7faddabcc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4113b20 con 0x7fadd41083f0 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53462/0 (socket says 172.21.15.6:53462) 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 -- 172.21.15.6:0/233187784 learned_addr learned my addr 172.21.15.6:0/233187784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd3fff640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd41083f0 0x7fadd4110410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd8968640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 0x7fadd410fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 -- 172.21.15.6:0/233187784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd41083f0 msgr2=0x7fadd4110410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd41083f0 0x7fadd4110410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 -- 172.21.15.6:0/233187784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 msgr2=0x7fadd410fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 0x7fadd410fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 -- 172.21.15.6:0/233187784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd41a86f0 con 0x7fadd4108d40 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd9169640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.464+0000 7fadd1ffb640 1 -- 172.21.15.6:0/233187784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc017070 con 0x7fadd4108d40 2024-09-21T08:00:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.465+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd41a89e0 con 0x7fadd4108d40 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.465+0000 7fadd1ffb640 1 -- 172.21.15.6:0/233187784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadcc003e00 con 0x7fadd4108d40 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.465+0000 7fadd1ffb640 1 -- 172.21.15.6:0/233187784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc010460 con 0x7fadd4108d40 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.465+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd41a8ea0 con 0x7fadd4108d40 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.467+0000 7fadd1ffb640 1 -- 172.21.15.6:0/233187784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fadcc003970 con 0x7fadd4108d40 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.467+0000 7fade1140740 1 Processor -- start 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.467+0000 7fade1140740 1 -- start start 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc191f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc192440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600dc109c10 con 0x5600dbdcb280 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dc0f9040 con 0x5600dbdebf60 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fade1140740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600dc0fce50 con 0x5600dbdc30a0 2024-09-21T08:00:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53470/0 (socket says 172.21.15.6:53470) 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 -- 172.21.15.6:0/2769812151 learned_addr learned my addr 172.21.15.6:0/2769812151 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd1ffb640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 0x7fadbc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd8968640 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc192440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc191f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd9169640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 0x7fadbc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 -- 172.21.15.6:0/2769812151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 msgr2=0x5600dc192440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc192440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 -- 172.21.15.6:0/2769812151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 msgr2=0x5600dc191f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc191f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd3fff640 1 -- 172.21.15.6:0/2769812151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600dbe57540 con 0x5600dbdcb280 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.468+0000 7fadd1ffb640 1 -- 172.21.15.6:0/233187784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fadcc0e7b20 con 0x7fadd4108d40 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.469+0000 7fadd3fff640 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadd4075a70 tx=0x7fadc8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ed3029f63831f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.469+0000 7fadd9169640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 0x7fadbc0b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0ad3b0 tx=0x7fadcc07a360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.469+0000 7fadbaffd640 1 -- 172.21.15.6:0/2769812151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8035070 con 0x5600dbdcb280 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.469+0000 7fadbaffd640 1 -- 172.21.15.6:0/2769812151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadc8004030 con 0x5600dbdcb280 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.469+0000 7fadbaffd640 1 -- 172.21.15.6:0/2769812151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8003a40 con 0x5600dbdcb280 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- 172.21.15.6:0/2769812151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 msgr2=0x5600dc192980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadd4075a70 tx=0x7fadc8005fd0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- 172.21.15.6:0/2769812151 shutdown_connections 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc192440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc192980 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 --2- 172.21.15.6:0/2769812151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc191f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- 172.21.15.6:0/2769812151 >> 172.21.15.6:0/2769812151 conn(0x5600dbde0350 msgr2=0x5600dc18fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- 172.21.15.6:0/2769812151 shutdown_connections 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- 172.21.15.6:0/2769812151 wait complete. 2024-09-21T08:00:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 -- start start 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.470+0000 7fade1140740 1 Processor -- start 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 0x5600dc19d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdebf60 0x5600dc1a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600dbf5a5f0 con 0x5600dbdcb280 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dc094010 con 0x5600dbdc30a0 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1a0680 con 0x5600dbdebf60 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fade1140740 10 client.0 _ll_register_callbacks cb 0x5600dc0f3340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53478/0 (socket says 172.21.15.6:53478) 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 -- 172.21.15.6:0/949173157 learned_addr learned my addr 172.21.15.6:0/949173157 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd3fff640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdebf60 0x5600dc1a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd3fff640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 0x5600dc19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 -- 172.21.15.6:0/949173157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdebf60 msgr2=0x5600dc1a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdebf60 0x5600dc1a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 -- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 msgr2=0x5600dc19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 0x5600dc19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 -- 172.21.15.6:0/949173157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600dc0c1a00 con 0x5600dbdcb280 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd3fff640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 0x5600dc19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadd8968640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadc4011750 tx=0x7fadc4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9818d746ad59f715 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.471+0000 7fadb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4011e60 con 0x5600dbdcb280 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fadc400fdb0 con 0x5600dbdcb280 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc8004030 con 0x5600dbdcb280 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fadc4024050 con 0x5600dbdcb280 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 10 client.15300 fetch_fsmap learned FSMap version 21 2024-09-21T08:00:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5600dc1ac630 con 0x5600dbdcb280 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadc8004030 con 0x5600dbdcb280 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fadc4018030 con 0x5600dbdcb280 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 10 client.15300 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 20 client.15300 populate_metadata read hostname 'smithi006' 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbdaa8e0 0x5600dc1b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 4 client.15300 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.472+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600dc10bb60 con 0x5600dbdaa8e0 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.473+0000 7fadd3fff640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbdaa8e0 0x5600dc1b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.473+0000 7fadb3fff640 10 client.15300 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.473+0000 7fadd3fff640 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbdaa8e0 0x5600dc1b0160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e04935404cecd server_cookie=53d2f7a82fb7eb24 in_seq=0 out_seq=0 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fadb3fff640 1 -- 172.21.15.6:0/949173157 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600dc10bb60 con 0x5600dbdaa8e0 2024-09-21T08:00:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fadb3fff640 10 client.15300 handle_command_reply: tid=0 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 client.15300 shutdown 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 msgr2=0x5600dc19dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadc4011750 tx=0x7fadc4011c10 comp rx=0 tx=0).stop 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 shutdown_connections 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbdaa8e0 0x5600dc1b0160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdebf60 0x5600dc1a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc19dd70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 --2- 172.21.15.6:0/949173157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdc30a0 0x5600dc19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fadb3fff640 0 client.15300 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 >> 172.21.15.6:0/949173157 conn(0x5600dbde0350 msgr2=0x5600dc195090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 shutdown_connections 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 1 -- 172.21.15.6:0/949173157 wait complete. 2024-09-21T08:00:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.474+0000 7fade1140740 20 client.15300 trim_cache size 0 max 16384 2024-09-21T08:00:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.492+0000 7fade1140740 1 Processor -- start 2024-09-21T08:00:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.492+0000 7fade1140740 1 -- start start 2024-09-21T08:00:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc18aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdcb280 0x5600dc1a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1ae4a0 con 0x5600dbdebf60 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1aeb70 con 0x5600dbdcb280 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fade1140740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1af240 con 0x5600dbdc30a0 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53492/0 (socket says 172.21.15.6:53492) 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 -- 172.21.15.6:0/1039540465 learned_addr learned my addr 172.21.15.6:0/1039540465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc18aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd8968640 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdcb280 0x5600dc1a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 -- 172.21.15.6:0/1039540465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 msgr2=0x5600dc18aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc18aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 -- 172.21.15.6:0/1039540465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdcb280 msgr2=0x5600dc1a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdcb280 0x5600dc1a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.493+0000 7fadd3fff640 1 -- 172.21.15.6:0/1039540465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600dc19e480 con 0x5600dbdebf60 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fadd3fff640 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fadc8032e40 tx=0x7fadc8040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554e04c094fd3f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fadba7fc640 1 -- 172.21.15.6:0/1039540465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8035040 con 0x5600dbdebf60 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fadba7fc640 1 -- 172.21.15.6:0/1039540465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadc8058030 con 0x5600dbdebf60 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fadba7fc640 1 -- 172.21.15.6:0/1039540465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8032710 con 0x5600dbdebf60 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fade1140740 1 -- 172.21.15.6:0/1039540465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 msgr2=0x5600dc1a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.494+0000 7fade1140740 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fadc8032e40 tx=0x7fadc8040040 comp rx=0 tx=0).stop 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 -- 172.21.15.6:0/1039540465 shutdown_connections 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdebf60 0x5600dc1a9eb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdcb280 0x5600dc1a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 --2- 172.21.15.6:0/1039540465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc18aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 -- 172.21.15.6:0/1039540465 >> 172.21.15.6:0/1039540465 conn(0x5600dbde0350 msgr2=0x5600dc198940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 -- 172.21.15.6:0/1039540465 shutdown_connections 2024-09-21T08:00:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 -- 172.21.15.6:0/1039540465 wait complete. 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 -- start start 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.495+0000 7fade1140740 1 Processor -- start 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc1b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc1b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1affe0 con 0x5600dbdcb280 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1af910 con 0x5600dbdebf60 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600dc1b06b0 con 0x5600dbdc30a0 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 10 client.0 _ll_register_callbacks cb 0x7fadc400c670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53500/0 (socket says 172.21.15.6:53500) 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 -- 172.21.15.6:0/886105766 learned_addr learned my addr 172.21.15.6:0/886105766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd3fff640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc1b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd3fff640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc1b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 -- 172.21.15.6:0/886105766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 msgr2=0x5600dc1b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc1b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 -- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 msgr2=0x5600dc1b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc1b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 -- 172.21.15.6:0/886105766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600dc1b3610 con 0x5600dbdcb280 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd3fff640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc1b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadd8968640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fadc4011750 tx=0x7fadc4011270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28102df6dc331925 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc402f030 con 0x5600dbdcb280 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fadc400fdc0 con 0x5600dbdcb280 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.496+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc8058030 con 0x5600dbdcb280 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fadc4039050 con 0x5600dbdcb280 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 10 client.15306 fetch_fsmap learned FSMap version 21 2024-09-21T08:00:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5600dc21bc50 con 0x5600dbdcb280 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadc8058030 con 0x5600dbdcb280 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fadc4018040 con 0x5600dbdcb280 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 10 client.15306 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 20 client.15306 populate_metadata read hostname 'smithi006' 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbd7fc90 0x5600dc21f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 4 client.15306 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.497+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "status"}) -- 0x5600dc107610 con 0x5600dbd7fc90 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fadd3fff640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbd7fc90 0x5600dc21f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fadb3fff640 10 client.15306 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fadd3fff640 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbd7fc90 0x5600dc21f580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d32326b2084458 server_cookie=d616a9a2fb5ede35 in_seq=0 out_seq=0 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fadb3fff640 1 -- 172.21.15.6:0/886105766 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5600dc107610 con 0x5600dbd7fc90 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fadb3fff640 10 client.15306 handle_command_reply: tid=0 2024-09-21T08:00:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fade1140740 1 client.15306 shutdown 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 msgr2=0x5600dc1b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fadc4011750 tx=0x7fadc4011270 comp rx=0 tx=0).stop 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 shutdown_connections 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.498+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dbd7fc90 0x5600dc21f580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600dbdebf60 0x5600dc1b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fadb3fff640 0 client.15306 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600dbdcb280 0x5600dc1b2d20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 --2- 172.21.15.6:0/886105766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600dbdc30a0 0x5600dc1b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 >> 172.21.15.6:0/886105766 conn(0x5600dbde0350 msgr2=0x5600dc198940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 shutdown_connections 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 1 -- 172.21.15.6:0/886105766 wait complete. 2024-09-21T08:00:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7fade1140740 20 client.15306 trim_cache size 0 max 16384 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24713, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 109.151982273, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 21, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 85, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T08:00:35.508 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 120.343993465 2024-09-21T08:00:35.509 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:00:35.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 msgr2=0x7fadbc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 0x7fadbc0b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0ad3b0 tx=0x7fadcc07a360 comp rx=0 tx=0).stop 2024-09-21T08:00:35.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 msgr2=0x7fadd4110950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:35.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc00b260 comp rx=0 tx=0).stop 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 shutdown_connections 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fadbc0b65f0 0x7fadbc0b8b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fadd41083f0 0x7fadd4110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4108d40 0x7fadd4110950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 --2- 172.21.15.6:0/233187784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd4103110 0x7fadd410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.499+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 >> 172.21.15.6:0/233187784 conn(0x7fadd4079e40 msgr2=0x7fadd41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.500+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 shutdown_connections 2024-09-21T08:00:35.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:35.500+0000 7faddabcc640 1 -- 172.21.15.6:0/233187784 wait complete. 2024-09-21T08:00:35.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:35 smithi119 ceph-mon[33564]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:35 smithi145 ceph-mon[34049]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:36.453 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T08:00:36.454 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:36.462 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:00:36.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T08:00:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:37.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:37 smithi006 ceph-mon[30970]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 -- 172.21.15.6:0/365691176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc1094c0 msgr2=0x7fdafc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 --2- 172.21.15.6:0/365691176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc1094c0 0x7fdafc1098d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009900 tx=0x7fdae402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 -- 172.21.15.6:0/365691176 shutdown_connections 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 --2- 172.21.15.6:0/365691176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc109e10 0x7fdafc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 --2- 172.21.15.6:0/365691176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc1094c0 0x7fdafc1098d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 --2- 172.21.15.6:0/365691176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc103b80 0x7fdafc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 -- 172.21.15.6:0/365691176 >> 172.21.15.6:0/365691176 conn(0x7fdafc0ff590 msgr2=0x7fdafc1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 -- 172.21.15.6:0/365691176 shutdown_connections 2024-09-21T08:00:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.375+0000 7fdb0127c640 1 -- 172.21.15.6:0/365691176 wait complete. 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 Processor -- start 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 -- start start 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 0x7fdafc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 0x7fdafc19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc113980 con 0x7fdafc103b80 2024-09-21T08:00:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc113800 con 0x7fdafc109e10 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdb0127c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc113b00 con 0x7fdafc1094c0 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdafaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdafaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52060/0 (socket says 172.21.15.6:52060) 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.376+0000 7fdafaffd640 1 -- 172.21.15.6:0/1298245263 learned_addr learned my addr 172.21.15.6:0/1298245263 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdaf3fff640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 0x7fdafc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafb7fe640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 0x7fdafc19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 -- 172.21.15.6:0/1298245263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 msgr2=0x7fdafc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 0x7fdafc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 -- 172.21.15.6:0/1298245263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 msgr2=0x7fdafc19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 0x7fdafc19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 -- 172.21.15.6:0/1298245263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc1a0340 con 0x7fdafc103b80 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdaf3fff640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 0x7fdafc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafb7fe640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 0x7fdafc19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdafaffd640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e9f0 tx=0x7fdaec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00cd80 con 0x7fdafc103b80 2024-09-21T08:00:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdaec0108c0 con 0x7fdafc103b80 2024-09-21T08:00:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0187c0 con 0x7fdafc103b80 2024-09-21T08:00:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdafc1a0630 con 0x7fdafc103b80 2024-09-21T08:00:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.377+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdafc1a6d90 con 0x7fdafc103b80 2024-09-21T08:00:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.378+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdafc103f90 con 0x7fdafc103b80 2024-09-21T08:00:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.380+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fdaec010430 con 0x7fdafc103b80 2024-09-21T08:00:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.381+0000 7fdaf8ff9640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 0x7fdae80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.381+0000 7fdaf3fff640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 0x7fdae80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.381+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fdaec0e8300 con 0x7fdafc103b80 2024-09-21T08:00:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.381+0000 7fdaf3fff640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 0x7fdae80b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdae40057c0 tx=0x7fdae4009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.384+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdaec0ae530 con 0x7fdafc103b80 2024-09-21T08:00:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.592+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fdafc1083a0 con 0x7fdae80b6670 2024-09-21T08:00:37.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.593+0000 7fdaf8ff9640 1 -- 172.21.15.6:0/1298245263 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fdafc1083a0 con 0x7fdae80b6670 2024-09-21T08:00:37.596 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2024-09-21T08:00:37.596 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2024-09-21T08:00:37.596 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 msgr2=0x7fdae80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 0x7fdae80b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdae40057c0 tx=0x7fdae4009680 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 msgr2=0x7fdafc19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e9f0 tx=0x7fdaec00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 shutdown_connections 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdae80b6670 0x7fdae80b8b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdafc1094c0 0x7fdafc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdafc109e10 0x7fdafc19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 --2- 172.21.15.6:0/1298245263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdafc103b80 0x7fdafc19a3d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 >> 172.21.15.6:0/1298245263 conn(0x7fdafc0ff590 msgr2=0x7fdafc107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.595+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 shutdown_connections 2024-09-21T08:00:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:37.596+0000 7fdb0127c640 1 -- 172.21.15.6:0/1298245263 wait complete. 2024-09-21T08:00:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:37 smithi119 ceph-mon[33564]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:37 smithi145 ceph-mon[34049]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:38.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T08:00:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 -- 172.21.15.6:0/3910932213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0102a60 msgr2=0x7efeb0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3910932213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0102a60 0x7efeb0102e70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 -- 172.21.15.6:0/3910932213 shutdown_connections 2024-09-21T08:00:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3910932213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb0108cf0 0x7efeb010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3910932213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb01083a0 0x7efeb01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3910932213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0102a60 0x7efeb0102e70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 -- 172.21.15.6:0/3910932213 >> 172.21.15.6:0/3910932213 conn(0x7efeb0079730 msgr2=0x7efeb0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 -- 172.21.15.6:0/3910932213 shutdown_connections 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.147+0000 7efeb54a3640 1 -- 172.21.15.6:0/3910932213 wait complete. 2024-09-21T08:00:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.148+0000 7efeb54a3640 1 Processor -- start 2024-09-21T08:00:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.148+0000 7efeb54a3640 1 -- start start 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.148+0000 7efeb54a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb0102a60 0x7efeb019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.148+0000 7efeb54a3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb01083a0 0x7efeb019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeb54a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeb54a3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0112810 con 0x7efeb0108cf0 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeb54a3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0112690 con 0x7efeb0102a60 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeb54a3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0112990 con 0x7efeb01083a0 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52080/0 (socket says 172.21.15.6:52080) 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 -- 172.21.15.6:0/3955571983 learned_addr learned my addr 172.21.15.6:0/3955571983 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efea67fc640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb01083a0 0x7efeb019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaeffd640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb0102a60 0x7efeb019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 -- 172.21.15.6:0/3955571983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb01083a0 msgr2=0x7efeb019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb01083a0 0x7efeb019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 -- 172.21.15.6:0/3955571983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb0102a60 msgr2=0x7efeb019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb0102a60 0x7efeb019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 -- 172.21.15.6:0/3955571983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01a0360 con 0x7efeb0108cf0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeaf7fe640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efea800eaa0 tx=0x7efea800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.149+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800cdb0 con 0x7efeb0108cf0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.150+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb01a0650 con 0x7efeb0108cf0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.150+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efea8005020 con 0x7efeb0108cf0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.150+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea80116d0 con 0x7efeb0108cf0 2024-09-21T08:00:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.150+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a6db0 con 0x7efeb0108cf0 2024-09-21T08:00:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.151+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0102e70 con 0x7efeb0108cf0 2024-09-21T08:00:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.152+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7efea8004a40 con 0x7efeb0108cf0 2024-09-21T08:00:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.153+0000 7efeacff9640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 0x7efe9c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.154+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7efea80e7dd0 con 0x7efeb0108cf0 2024-09-21T08:00:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.154+0000 7efeaeffd640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 0x7efe9c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.154+0000 7efeaeffd640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 0x7efe9c0b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efea00057c0 tx=0x7efea00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.157+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efea8016030 con 0x7efeb0108cf0 2024-09-21T08:00:39.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.355+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efeb0106340 con 0x7efe9c0b65f0 2024-09-21T08:00:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.368+0000 7efeacff9640 1 -- 172.21.15.6:0/3955571983 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7efeb0106340 con 0x7efe9c0b65f0 2024-09-21T08:00:39.370 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.a smithi006 running (2m) 55s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 89c622d586b5 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.b smithi119 running (2m) 57s ago 2m 93.9M - 19.3.0-5120-g18432218 ddce307e1f32 29689e897841 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.c smithi145 running (2m) 57s ago 2m 81.5M - 19.3.0-5120-g18432218 ddce307e1f32 e4851bde3bc2 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.d smithi006 running (2m) 55s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 1f7001471cae 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.e smithi119 running (2m) 57s ago 2m 82.6M - 19.3.0-5120-g18432218 ddce307e1f32 58c95e949ece 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.f smithi145 running (2m) 57s ago 2m 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 4796e15e4590 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.g smithi006 running (2m) 55s ago 2m 81.7M - 19.3.0-5120-g18432218 ddce307e1f32 e8a11bfbe886 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.h smithi119 running (2m) 57s ago 2m 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 88cc9ea232a3 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.i smithi145 running (2m) 57s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 b8211331bace 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.j smithi006 running (2m) 55s ago 2m 81.8M - 19.3.0-5120-g18432218 ddce307e1f32 45b8490faae1 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.k smithi119 running (2m) 57s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 d82824ca1f4f 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mds.l smithi145 running (2m) 57s ago 2m 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 88892584b587 2024-09-21T08:00:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.x smithi006 *:9283,8765 running (10m) 55s ago 10m 584M - 19.3.0-5120-g18432218 ddce307e1f32 9f9ae6555fd3 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.y smithi119 *:8443,8765 running (8m) 57s ago 8m 525M - 19.3.0-5120-g18432218 ddce307e1f32 2ab3b8a08f75 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.z smithi145 *:8443,8765 running (8m) 57s ago 8m 525M - 19.3.0-5120-g18432218 ddce307e1f32 1a5a2f4758a7 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a smithi006 running (10m) 55s ago 10m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 15e6fb8cbba7 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b smithi119 running (8m) 57s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 16d27952c7f0 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c smithi145 running (9m) 57s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 a49f3f96aa2a 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 55s ago 7m 114M 4273M 19.3.0-5120-g18432218 ddce307e1f32 bae51fbccb8d 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi119 running (7m) 57s ago 7m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 da09b9edea66 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi145 running (6m) 57s ago 6m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 27acd0f51464 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi006 running (6m) 55s ago 6m 114M 4273M 19.3.0-5120-g18432218 ddce307e1f32 07a4712b093b 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi119 running (5m) 57s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4bebb988a6b7 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi145 running (5m) 57s ago 5m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b316a4c3e1c3 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 smithi006 running (5m) 55s ago 5m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7f871781f888 2024-09-21T08:00:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 smithi119 running (4m) 57s ago 4m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0a001937241b 2024-09-21T08:00:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 smithi145 running (4m) 57s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 7e4cf15db3fd 2024-09-21T08:00:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 smithi006 running (3m) 55s ago 3m 109M 4273M 19.3.0-5120-g18432218 ddce307e1f32 c14c45fbd867 2024-09-21T08:00:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 smithi119 running (3m) 57s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 229930b8d6ca 2024-09-21T08:00:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 smithi145 running (2m) 57s ago 2m 118M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9a51a40d8c9d 2024-09-21T08:00:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 msgr2=0x7efe9c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 0x7efe9c0b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efea00057c0 tx=0x7efea00058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 msgr2=0x7efeb019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efea800eaa0 tx=0x7efea800ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 shutdown_connections 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efe9c0b65f0 0x7efe9c0b8b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeb01083a0 0x7efeb019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0108cf0 0x7efeb019fc30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 --2- 172.21.15.6:0/3955571983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeb0102a60 0x7efeb019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 >> 172.21.15.6:0/3955571983 conn(0x7efeb0079730 msgr2=0x7efeb0101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 shutdown_connections 2024-09-21T08:00:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:39.370+0000 7efeb54a3640 1 -- 172.21.15.6:0/3955571983 wait complete. 2024-09-21T08:00:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:39 smithi006 ceph-mon[30970]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:39 smithi006 ceph-mon[30970]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:39 smithi119 ceph-mon[33564]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:39 smithi119 ceph-mon[33564]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:39 smithi145 ceph-mon[34049]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:39 smithi145 ceph-mon[34049]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:40.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T08:00:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 -- 172.21.15.6:0/1241574310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c104870 msgr2=0x7f9f2c104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 --2- 172.21.15.6:0/1241574310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c104870 0x7f9f2c104c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009900 tx=0x7f9f1c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 -- 172.21.15.6:0/1241574310 shutdown_connections 2024-09-21T08:00:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 --2- 172.21.15.6:0/1241574310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c1052a0 0x7f9f2c10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 --2- 172.21.15.6:0/1241574310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c10de20 0x7f9f2c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 --2- 172.21.15.6:0/1241574310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c104870 0x7f9f2c104c80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 -- 172.21.15.6:0/1241574310 >> 172.21.15.6:0/1241574310 conn(0x7f9f2c079730 msgr2=0x7f9f2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 -- 172.21.15.6:0/1241574310 shutdown_connections 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.951+0000 7f9f30c75640 1 -- 172.21.15.6:0/1241574310 wait complete. 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 Processor -- start 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 -- start start 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c104870 0x7f9f2c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c1052a0 0x7f9f2c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113940 con 0x7f9f2c10de20 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1137c0 con 0x7f9f2c1052a0 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f30c75640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113ac0 con 0x7f9f2c104870 2024-09-21T08:00:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f2ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52102/0 (socket says 172.21.15.6:52102) 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.952+0000 7f9f2ad9d640 1 -- 172.21.15.6:0/2678747080 learned_addr learned my addr 172.21.15.6:0/2678747080 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2a59c640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c104870 0x7f9f2c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f29d9b640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c1052a0 0x7f9f2c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 -- 172.21.15.6:0/2678747080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c104870 msgr2=0x7f9f2c19a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c104870 0x7f9f2c19a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 -- 172.21.15.6:0/2678747080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c1052a0 msgr2=0x7f9f2c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c1052a0 0x7f9f2c19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 -- 172.21.15.6:0/2678747080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c1a0300 con 0x7f9f2c10de20 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f2ad9d640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400eaa0 tx=0x7f9f2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400cdb0 con 0x7f9f2c10de20 2024-09-21T08:00:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f24005020 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240116d0 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c1a05f0 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.953+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c1a6d50 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.954+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c06c160 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.956+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f9f240051d0 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.957+0000 7f9f1b7fe640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 0x7f9f140b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.957+0000 7f9f2a59c640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 0x7f9f140b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.957+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f9f240e7f60 con 0x7f9f2c10de20 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.958+0000 7f9f2a59c640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 0x7f9f140b8b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0057c0 tx=0x7f9f1c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:40.961+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f24016030 con 0x7f9f2c10de20 2024-09-21T08:00:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.157+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9f2c063800 con 0x7f9f140b6670 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.163+0000 7f9f1b7fe640 1 -- 172.21.15.6:0/2678747080 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9f2c063800 con 0x7f9f140b6670 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stdout:mds.all 12/12 59s ago 2m smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 3/3 59s ago 8m smithi006=x;smithi119=y;smithi145=z;count:3 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stdout:mon 3/3 59s ago 9m smithi006:172.21.15.6=a;smithi119:172.21.15.119=b;smithi145:172.21.15.145=c;count:3 2024-09-21T08:00:41.166 INFO:teuthology.orchestra.run.smithi006.stdout:osd 12 59s ago - 2024-09-21T08:00:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 msgr2=0x7f9f140b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 0x7f9f140b8b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0057c0 tx=0x7f9f1c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 msgr2=0x7f9f2c19fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400eaa0 tx=0x7f9f2400ef60 comp rx=0 tx=0).stop 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 shutdown_connections 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9f140b6670 0x7f9f140b8b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f2c10de20 0x7f9f2c19fbd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f2c1052a0 0x7f9f2c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 --2- 172.21.15.6:0/2678747080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f2c104870 0x7f9f2c19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 >> 172.21.15.6:0/2678747080 conn(0x7f9f2c079730 msgr2=0x7f9f2c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 shutdown_connections 2024-09-21T08:00:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:41.166+0000 7f9f30c75640 1 -- 172.21.15.6:0/2678747080 wait complete. 2024-09-21T08:00:41.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:41 smithi006 ceph-mon[30970]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:41.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:41 smithi006 ceph-mon[30970]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:41 smithi119 ceph-mon[33564]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:41 smithi119 ceph-mon[33564]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:41 smithi145 ceph-mon[34049]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:41 smithi145 ceph-mon[34049]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:41.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T08:00:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:42.603 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:42 smithi006 ceph-mon[30970]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:42.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:42 smithi119 ceph-mon[33564]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:42.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:42 smithi145 ceph-mon[34049]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:42.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 -- 172.21.15.6:0/2312375612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4110200 msgr2=0x7fe4b4112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 --2- 172.21.15.6:0/2312375612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4110200 0x7fe4b4112620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009ca0 tx=0x7fe4ac02a950 comp rx=0 tx=0).stop 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 -- 172.21.15.6:0/2312375612 shutdown_connections 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 --2- 172.21.15.6:0/2312375612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4110200 0x7fe4b4112620 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 --2- 172.21.15.6:0/2312375612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 0x7fe4b410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 --2- 172.21.15.6:0/2312375612 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4102650 0x7fe4b4102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 -- 172.21.15.6:0/2312375612 >> 172.21.15.6:0/2312375612 conn(0x7fe4b4079760 msgr2=0x7fe4b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 -- 172.21.15.6:0/2312375612 shutdown_connections 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.695+0000 7fe4bc091640 1 -- 172.21.15.6:0/2312375612 wait complete. 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 Processor -- start 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 -- start start 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 0x7fe4b419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4110200 0x7fe4b41a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4115b50 con 0x7fe4b4102650 2024-09-21T08:00:42.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b41159d0 con 0x7fe4b4102fa0 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4bc091640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b4115cd0 con 0x7fe4b4110200 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4b9e2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4b9e2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52130/0 (socket says 172.21.15.6:52130) 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.696+0000 7fe4b9e2d640 1 -- 172.21.15.6:0/3833567388 learned_addr learned my addr 172.21.15.6:0/3833567388 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4ba62e640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4110200 0x7fe4b41a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b962c640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 0x7fe4b419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 -- 172.21.15.6:0/3833567388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4110200 msgr2=0x7fe4b41a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4110200 0x7fe4b41a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 -- 172.21.15.6:0/3833567388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 msgr2=0x7fe4b419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 0x7fe4b419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 -- 172.21.15.6:0/3833567388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b41a24b0 con 0x7fe4b4102650 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4b9e2d640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e9f0 tx=0x7fe4b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000cd80 con 0x7fe4b4102650 2024-09-21T08:00:42.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b41a27a0 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4b00054b0 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0010430 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.697+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b41a8f00 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.698+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b406c1f0 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.700+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe4b00046c0 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.701+0000 7fe4aaffd640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 0x7fe4a00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.701+0000 7fe4b962c640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 0x7fe4a00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.701+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe4b00e8040 con 0x7fe4b4102650 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.701+0000 7fe4b962c640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 0x7fe4a00b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4104060 tx=0x7fe4a4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.704+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4b0056710 con 0x7fe4b4102650 2024-09-21T08:00:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.897+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fe4b4109380 con 0x7fe4a00b65f0 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.898+0000 7fe4aaffd640 1 -- 172.21.15.6:0/3833567388 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fe4b4109380 con 0x7fe4a00b65f0 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:smithi119 172.21.15.119 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:smithi145 172.21.15.145 2024-09-21T08:00:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:3 hosts in cluster 2024-09-21T08:00:42.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 msgr2=0x7fe4a00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 0x7fe4a00b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4104060 tx=0x7fe4a4005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 msgr2=0x7fe4b419c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e9f0 tx=0x7fe4b000edf0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 shutdown_connections 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4a00b65f0 0x7fe4a00b8b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe4b4110200 0x7fe4b41a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4b4102fa0 0x7fe4b419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 --2- 172.21.15.6:0/3833567388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b4102650 0x7fe4b419c540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 >> 172.21.15.6:0/3833567388 conn(0x7fe4b4079760 msgr2=0x7fe4b4108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 shutdown_connections 2024-09-21T08:00:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:42.901+0000 7fe4bc091640 1 -- 172.21.15.6:0/3833567388 wait complete. 2024-09-21T08:00:43.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:43 smithi119 ceph-mon[33564]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:43.668 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:43 smithi006 ceph-mon[30970]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:43 smithi145 ceph-mon[34049]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:43.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T08:00:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:44.408 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:44 smithi006 ceph-mon[30970]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:44.408 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:44 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.415+0000 7f13fe449640 1 -- 172.21.15.6:0/3109625336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f8113eb0 msgr2=0x7f13f81142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.415+0000 7f13fe449640 1 --2- 172.21.15.6:0/3109625336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f8113eb0 0x7f13f81142c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009900 tx=0x7f13ec02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 -- 172.21.15.6:0/3109625336 shutdown_connections 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 --2- 172.21.15.6:0/3109625336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8114800 0x7f13f811b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 --2- 172.21.15.6:0/3109625336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f8113eb0 0x7f13f81142c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 --2- 172.21.15.6:0/3109625336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f810e5c0 0x7f13f810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 -- 172.21.15.6:0/3109625336 >> 172.21.15.6:0/3109625336 conn(0x7f13f810a3c0 msgr2=0x7f13f810c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 -- 172.21.15.6:0/3109625336 shutdown_connections 2024-09-21T08:00:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.416+0000 7f13fe449640 1 -- 172.21.15.6:0/3109625336 wait complete. 2024-09-21T08:00:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.417+0000 7f13fe449640 1 Processor -- start 2024-09-21T08:00:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.417+0000 7f13fe449640 1 -- start start 2024-09-21T08:00:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.417+0000 7f13fe449640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f810e5c0 0x7f13f81a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fe449640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fe449640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 0x7f13f81aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fe449640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13f811e320 con 0x7f13f810e5c0 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fe449640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f13f811e1a0 con 0x7f13f8114800 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fe449640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f13f811e4a0 con 0x7f13f8113eb0 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f810e5c0 0x7f13f81a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13f77fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13f77fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43806/0 (socket says 172.21.15.6:43806) 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13f77fe640 1 -- 172.21.15.6:0/3489405815 learned_addr learned my addr 172.21.15.6:0/3489405815 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 0x7f13f81aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 -- 172.21.15.6:0/3489405815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 msgr2=0x7f13f81a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 -- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f810e5c0 msgr2=0x7f13f81a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f810e5c0 0x7f13f81a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13fc9e6640 1 -- 172.21.15.6:0/3489405815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f81aad60 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.418+0000 7f13f77fe640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13fc9e6640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 0x7f13f81aa630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009fd0 tx=0x7f13f000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f000ce20 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f81ab050 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13f0005020 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0010690 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.419+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f81b17b0 con 0x7f13f8114800 2024-09-21T08:00:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.421+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f810f7f0 con 0x7f13f8114800 2024-09-21T08:00:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.422+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f13f0004a40 con 0x7f13f8114800 2024-09-21T08:00:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.423+0000 7f13f57fa640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 0x7f13e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:44.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.423+0000 7f13f7fff640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 0x7f13e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:44.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.423+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f13f00e8090 con 0x7f13f8114800 2024-09-21T08:00:44.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.424+0000 7f13f7fff640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 0x7f13e00b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13e80095f0 tx=0x7f13e8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.430+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13f00ae2c0 con 0x7f13f8114800 2024-09-21T08:00:44.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.650+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f13f8116610 con 0x7f13e00b65f0 2024-09-21T08:00:44.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.652+0000 7f13f57fa640 1 -- 172.21.15.6:0/3489405815 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f13f8116610 con 0x7f13e00b65f0 2024-09-21T08:00:44.654 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T08:00:44.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330000H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T08:00:44.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T08:00:44.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi145 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N9400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T08:00:44.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 msgr2=0x7f13e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 0x7f13e00b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13e80095f0 tx=0x7f13e8005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 msgr2=0x7f13f81aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 0x7f13f81aa630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009fd0 tx=0x7f13f000ef10 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 shutdown_connections 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13e00b65f0 0x7f13e00b8b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13f8113eb0 0x7f13f81a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13f8114800 0x7f13f81aa630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.655+0000 7f13fe449640 1 --2- 172.21.15.6:0/3489405815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13f810e5c0 0x7f13f81a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.656+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 >> 172.21.15.6:0/3489405815 conn(0x7f13f810a3c0 msgr2=0x7f13f8113580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.656+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 shutdown_connections 2024-09-21T08:00:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:44.656+0000 7f13fe449640 1 -- 172.21.15.6:0/3489405815 wait complete. 2024-09-21T08:00:44.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:44 smithi119 ceph-mon[33564]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:44.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:44 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:44 smithi145 ceph-mon[34049]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:44 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:45.549 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:45 smithi006 ceph-mon[30970]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:45.653 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:45 smithi145 ceph-mon[34049]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:45.660 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:45 smithi119 ceph-mon[33564]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:46.045 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T08:00:46.057 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:00:46.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T08:00:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:46.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:46 smithi119 ceph-mon[33564]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:46.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.559 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:46 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.632 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:46 smithi006 ceph-mon[30970]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:46.632 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.633 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.633 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.633 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:46 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:46 smithi145 ceph-mon[34049]: from='client.25088 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:00:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:46 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3707579024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d24105290 msgr2=0x7f2d2410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3707579024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d24105290 0x7f2d2410d8d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009860 tx=0x7f2d0c02a340 comp rx=0 tx=0).stop 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3707579024 shutdown_connections 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3707579024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d24105290 0x7f2d2410d8d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3707579024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d2410de10 0x7f2d24110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3707579024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24104860 0x7f2d24104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3707579024 >> 172.21.15.6:0/3707579024 conn(0x7f2d24079740 msgr2=0x7f2d24079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3707579024 shutdown_connections 2024-09-21T08:00:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.857+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3707579024 wait complete. 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.858+0000 7f2d2a8c0640 1 Processor -- start 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.858+0000 7f2d2a8c0640 1 -- start start 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 0x7f2d2419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2410de10 0x7f2d2419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24113940 con 0x7f2d24105290 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d241137c0 con 0x7f2d24104860 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d2a8c0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24113ac0 con 0x7f2d2410de10 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59674/0 (socket says 172.21.15.6:59674) 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 -- 172.21.15.6:0/3182261941 learned_addr learned my addr 172.21.15.6:0/3182261941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d23fff640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 0x7f2d2419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d28e5d640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2410de10 0x7f2d2419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 -- 172.21.15.6:0/3182261941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2410de10 msgr2=0x7f2d2419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2410de10 0x7f2d2419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 -- 172.21.15.6:0/3182261941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 msgr2=0x7f2d2419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 0x7f2d2419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 -- 172.21.15.6:0/3182261941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d241a0340 con 0x7f2d24105290 2024-09-21T08:00:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d23fff640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 0x7f2d2419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.859+0000 7f2d237fe640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005940 tx=0x7f2d0c02ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.860+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c040020 con 0x7f2d24105290 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.860+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d241a05d0 con 0x7f2d24105290 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.860+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d0c0044d0 con 0x7f2d24105290 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.860+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c037040 con 0x7f2d24105290 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.860+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d241a6d90 con 0x7f2d24105290 2024-09-21T08:00:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.861+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2406c1e0 con 0x7f2d24105290 2024-09-21T08:00:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.863+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f2d0c043020 con 0x7f2d24105290 2024-09-21T08:00:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.863+0000 7f2d217fa640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 0x7f2d100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.863+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f2d0c107c60 con 0x7f2d24105290 2024-09-21T08:00:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.864+0000 7f2d23fff640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 0x7f2d100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.864+0000 7f2d23fff640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 0x7f2d100b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d140096c0 tx=0x7f2d14009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:46.867+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d0c04a020 con 0x7f2d24105290 2024-09-21T08:00:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.096+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2d24108ff0 con 0x7f2d24105290 2024-09-21T08:00:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.097+0000 7f2d217fa640 1 -- 172.21.15.6:0/3182261941 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3040 (secure 0 0 0) 0x7f2d0c0cdef0 con 0x7f2d24105290 2024-09-21T08:00:47.099 INFO:teuthology.orchestra.run.smithi006.stdout:e21 2024-09-21T08:00:47.099 INFO:teuthology.orchestra.run.smithi006.stdout:btime 2024-09-21T07:59:28:670569+0000 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 21 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-21T07:58:46.069948+0000 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-09-21T07:59:28.356248+0000 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-09-21T08:00:47.100 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 300 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 1 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:in 0 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=24713} 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-09-21T08:00:47.101 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3,4] 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:qdb_cluster leader: 24713 members: 24713 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b{0:24713} state up:active seq 4 addr [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.i{0:24694} state up:standby-replay seq 1 addr [v2:172.21.15.145:6838/3378332428,v1:172.21.15.145:6839/3378332428] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.j{-1:14772} state up:standby seq 1 addr [v2:172.21.15.6:6834/161038542,v1:172.21.15.6:6835/161038542] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d{-1:14784} state up:standby seq 1 addr [v2:172.21.15.6:6836/3652258575,v1:172.21.15.6:6837/3652258575] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.g{-1:14835} state up:standby seq 1 addr [v2:172.21.15.6:6838/387284597,v1:172.21.15.6:6839/387284597] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a{-1:14847} state up:standby seq 1 addr [v2:172.21.15.6:6840/1772436480,v1:172.21.15.6:6841/1772436480] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.l{-1:24619} state up:standby seq 1 addr [v2:172.21.15.145:6832/4259948654,v1:172.21.15.145:6833/4259948654] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.k{-1:24620} state up:standby seq 1 addr [v2:172.21.15.119:6832/592378988,v1:172.21.15.119:6833/592378988] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e{-1:24650} state up:standby seq 1 addr [v2:172.21.15.119:6834/467473041,v1:172.21.15.119:6835/467473041] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f{-1:24664} state up:standby seq 1 addr [v2:172.21.15.145:6834/1223773032,v1:172.21.15.145:6835/1223773032] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c{-1:24670} state up:standby seq 1 addr [v2:172.21.15.145:6836/2301419443,v1:172.21.15.145:6837/2301419443] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.h{-1:24674} state up:standby seq 1 addr [v2:172.21.15.119:6836/649850898,v1:172.21.15.119:6837/649850898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 msgr2=0x7f2d100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 0x7f2d100b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d140096c0 tx=0x7f2d14009260 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 msgr2=0x7f2d2419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005940 tx=0x7f2d0c02ae40 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 shutdown_connections 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d100b65f0 0x7f2d100b8b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d2410de10 0x7f2d2419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d24105290 0x7f2d2419a970 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 --2- 172.21.15.6:0/3182261941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d24104860 0x7f2d2419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 >> 172.21.15.6:0/3182261941 conn(0x7f2d24079740 msgr2=0x7f2d24100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 shutdown_connections 2024-09-21T08:00:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:47.099+0000 7f2d2a8c0640 1 -- 172.21.15.6:0/3182261941 wait complete. 2024-09-21T08:00:47.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:47.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:47.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:47.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3182261941' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T08:00:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3182261941' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:00:47.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3182261941' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T08:00:47.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T08:00:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.472+0000 7fec7beff640 1 -- 172.21.15.6:0/384035190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74103b60 msgr2=0x7fec74103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.472+0000 7fec7beff640 1 --2- 172.21.15.6:0/384035190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74103b60 0x7fec74103f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fec70009900 tx=0x7fec7002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 -- 172.21.15.6:0/384035190 shutdown_connections 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 --2- 172.21.15.6:0/384035190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec741094a0 0x7fec741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 --2- 172.21.15.6:0/384035190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec74110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 --2- 172.21.15.6:0/384035190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec74103b60 0x7fec74103f70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 -- 172.21.15.6:0/384035190 >> 172.21.15.6:0/384035190 conn(0x7fec7407b850 msgr2=0x7fec7407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 -- 172.21.15.6:0/384035190 shutdown_connections 2024-09-21T08:00:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 -- 172.21.15.6:0/384035190 wait complete. 2024-09-21T08:00:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.473+0000 7fec7beff640 1 Processor -- start 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 -- start start 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec74103b60 0x7fec7419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec7419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec74113960 con 0x7fec741094a0 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec741137e0 con 0x7fec74109df0 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7beff640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fec74113ae0 con 0x7fec74103b60 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7949a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7949a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59692/0 (socket says 172.21.15.6:59692) 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7949a640 1 -- 172.21.15.6:0/2252182261 learned_addr learned my addr 172.21.15.6:0/2252182261 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec79c9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec74103b60 0x7fec7419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.474+0000 7fec7a49c640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec7419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 -- 172.21.15.6:0/2252182261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec74103b60 msgr2=0x7fec7419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec74103b60 0x7fec7419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 -- 172.21.15.6:0/2252182261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 msgr2=0x7fec7419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec7419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 -- 172.21.15.6:0/2252182261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec741a03a0 con 0x7fec741094a0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7a49c640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec7419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7949a640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c970 tx=0x7fec6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64007bb0 con 0x7fec741094a0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec64007d50 con 0x7fec741094a0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64004da0 con 0x7fec741094a0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec741a0690 con 0x7fec741094a0 2024-09-21T08:00:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.475+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec740755f0 con 0x7fec741094a0 2024-09-21T08:00:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.476+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec74103f70 con 0x7fec741094a0 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.478+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fec64004f60 con 0x7fec741094a0 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.478+0000 7fec6affd640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 0x7fec600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.479+0000 7fec79c9b640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 0x7fec600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.479+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fec640e7a90 con 0x7fec741094a0 2024-09-21T08:00:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.479+0000 7fec79c9b640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 0x7fec600b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fec700057c0 tx=0x7fec700058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.482+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec64014030 con 0x7fec741094a0 2024-09-21T08:00:48.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.674+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fec7419b560 con 0x7fec741094a0 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.676+0000 7fec6affd640 1 -- 172.21.15.6:0/2252182261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+6065 (secure 0 0 0) 0x7fec7419b560 con 0x7fec741094a0 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 85 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:fsid f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-21T07:50:07.867657+0000 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-09-21T08:00:03.985299+0000 2024-09-21T08:00:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 27 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client luminous 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release squid 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 12 2024-09-21T08:00:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 9 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6802/3344893896,v1:172.21.15.6:6803/3344893896] [v2:172.21.15.6:6804/3344893896,v1:172.21.15.6:6805/3344893896] exists,up ba946387-792a-4df2-a544-d128afc01190 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 14 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/1612348700,v1:172.21.15.119:6801/1612348700] [v2:172.21.15.119:6802/1612348700,v1:172.21.15.119:6803/1612348700] exists,up 93cedb16-3deb-4ddc-b6fa-38e5abf65026 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6800/1447926373,v1:172.21.15.145:6801/1447926373] [v2:172.21.15.145:6802/1447926373,v1:172.21.15.145:6803/1447926373] exists,up f67832f5-9808-4579-b997-627e0a1363dc 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 25 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6810/2874010915,v1:172.21.15.6:6811/2874010915] [v2:172.21.15.6:6812/2874010915,v1:172.21.15.6:6813/2874010915] exists,up 1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/3176052266,v1:172.21.15.119:6809/3176052266] [v2:172.21.15.119:6810/3176052266,v1:172.21.15.119:6811/3176052266] exists,up a92a8a1e-7783-42c7-8724-62e824581e6d 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 36 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6808/4185277964,v1:172.21.15.145:6809/4185277964] [v2:172.21.15.145:6810/4185277964,v1:172.21.15.145:6811/4185277964] exists,up 80b6eb01-3f7b-472a-aee0-0c1f8ff4e278 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 42 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6818/3354206555,v1:172.21.15.6:6819/3354206555] [v2:172.21.15.6:6820/3354206555,v1:172.21.15.6:6821/3354206555] exists,up 24def8b3-915b-4aae-8d84-76eead4d123e 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 47 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/1355332181,v1:172.21.15.119:6817/1355332181] [v2:172.21.15.119:6818/1355332181,v1:172.21.15.119:6819/1355332181] exists,up 348c45b0-811d-4c56-a331-7033863e36d4 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 up in weight 1 up_from 52 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6816/3838836474,v1:172.21.15.145:6817/3838836474] [v2:172.21.15.145:6818/3838836474,v1:172.21.15.145:6819/3838836474] exists,up e25c1373-dd60-4948-a8d9-c5c43d9aebf8 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 up in weight 1 up_from 58 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6826/514953614,v1:172.21.15.6:6827/514953614] [v2:172.21.15.6:6828/514953614,v1:172.21.15.6:6829/514953614] exists,up 565edfc0-01d7-484b-abb2-923dcd7337d9 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/597400106,v1:172.21.15.119:6825/597400106] [v2:172.21.15.119:6826/597400106,v1:172.21.15.119:6827/597400106] exists,up 16df7040-3040-4d5c-8bfd-8f00307555eb 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 up in weight 1 up_from 69 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6824/2180299713,v1:172.21.15.145:6825/2180299713] [v2:172.21.15.145:6826/2180299713,v1:172.21.15.145:6827/2180299713] exists,up 818aec19-fff3-4e7a-959c-785c93f0462d 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.f [8,11] 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.10 [2,1] 2024-09-21T08:00:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1b [2,4] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1f [7,11] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.6 [3,6] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.25 [5,9] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.27 [4,8] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.31 [4,7] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.34 [4,9] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.5 [5,8] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.6 [9,11] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.10 [9,8] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.12 [9,10] 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2176108638 expires 2024-09-22T07:50:30.675598+0000 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/3452647007 expires 2024-09-22T07:50:30.675598+0000 2024-09-21T08:00:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/3452647007 expires 2024-09-22T07:50:30.675598+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/548693640 expires 2024-09-22T07:52:01.430168+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/2249378231 expires 2024-09-22T07:52:01.430168+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1495310432 expires 2024-09-22T07:50:30.675598+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3861437943 expires 2024-09-22T07:50:30.675598+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1282952085 expires 2024-09-22T07:50:57.944225+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/558991039 expires 2024-09-22T07:50:57.944225+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/1452797413 expires 2024-09-22T07:50:57.944225+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/2249378231 expires 2024-09-22T07:52:01.430168+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/1452797413 expires 2024-09-22T07:50:57.944225+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3295809902 expires 2024-09-22T07:50:57.944225+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/4039375936 expires 2024-09-22T07:52:01.430168+0000 2024-09-21T08:00:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1669454132 expires 2024-09-22T07:52:01.430168+0000 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 msgr2=0x7fec600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 0x7fec600b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fec700057c0 tx=0x7fec700058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 msgr2=0x7fec7419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c970 tx=0x7fec6400ce30 comp rx=0 tx=0).stop 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 shutdown_connections 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fec600b65f0 0x7fec600b8b00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74109df0 0x7fec7419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec741094a0 0x7fec7419a9d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 --2- 172.21.15.6:0/2252182261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec74103b60 0x7fec7419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 >> 172.21.15.6:0/2252182261 conn(0x7fec7407b850 msgr2=0x7fec74107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 shutdown_connections 2024-09-21T08:00:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:48.679+0000 7fec7beff640 1 -- 172.21.15.6:0/2252182261 wait complete. 2024-09-21T08:00:49.387 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T08:00:49.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:49.429 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:49 smithi006 ceph-mon[30970]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:49.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:49 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2252182261' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T08:00:49.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:49 smithi119 ceph-mon[33564]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:49.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:49 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2252182261' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T08:00:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:49 smithi145 ceph-mon[34049]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:49 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2252182261' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 -- 172.21.15.6:0/2669735171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc1094a0 msgr2=0x7fb5fc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 --2- 172.21.15.6:0/2669735171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc1098b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009900 tx=0x7fb5f002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 -- 172.21.15.6:0/2669735171 shutdown_connections 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 --2- 172.21.15.6:0/2669735171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc109df0 0x7fb5fc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 --2- 172.21.15.6:0/2669735171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc1098b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 --2- 172.21.15.6:0/2669735171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc103b60 0x7fb5fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 -- 172.21.15.6:0/2669735171 >> 172.21.15.6:0/2669735171 conn(0x7fb5fc07b850 msgr2=0x7fb5fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 -- 172.21.15.6:0/2669735171 shutdown_connections 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.215+0000 7fb601828640 1 -- 172.21.15.6:0/2669735171 wait complete. 2024-09-21T08:00:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 Processor -- start 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 -- start start 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc109df0 0x7fb5fc19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc113960 con 0x7fb5fc103b60 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc1137e0 con 0x7fb5fc1094a0 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb601828640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc113ae0 con 0x7fb5fc109df0 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.216+0000 7fb5faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59714/0 (socket says 172.21.15.6:59714) 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 -- 172.21.15.6:0/1176083352 learned_addr learned my addr 172.21.15.6:0/1176083352 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5fb7fe640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc109df0 0x7fb5fc19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5fa7fc640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 -- 172.21.15.6:0/1176083352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc109df0 msgr2=0x7fb5fc19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc109df0 0x7fb5fc19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 -- 172.21.15.6:0/1176083352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc1094a0 msgr2=0x7fb5fc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 -- 172.21.15.6:0/1176083352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc1a0340 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb5faffd640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9f0 tx=0x7fb5ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00cd80 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5ec0108c0 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc1a0630 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.217+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0187c0 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.218+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc1a6d90 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.219+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc104de0 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.221+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb5ec010430 con 0x7fb5fc103b60 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.222+0000 7fb600826640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 0x7fb5e40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.222+0000 7fb5fa7fc640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 0x7fb5e40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.222+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb5ec0e8240 con 0x7fb5fc103b60 2024-09-21T08:00:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.222+0000 7fb5fa7fc640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 0x7fb5e40b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005940 tx=0x7fb5f00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.225+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5ec0b2850 con 0x7fb5fc103b60 2024-09-21T08:00:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.454+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5fc10bc40 con 0x7fb5fc103b60 2024-09-21T08:00:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.455+0000 7fb600826640 1 -- 172.21.15.6:0/1176083352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fb5ec0b7790 con 0x7fb5fc103b60 2024-09-21T08:00:50.457 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:50.458 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:00:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 msgr2=0x7fb5e40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 0x7fb5e40b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0005940 tx=0x7fb5f00058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 msgr2=0x7fb5fc19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9f0 tx=0x7fb5ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 shutdown_connections 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb5e40b65f0 0x7fb5e40b8b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb5fc109df0 0x7fb5fc19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5fc1094a0 0x7fb5fc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 --2- 172.21.15.6:0/1176083352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc103b60 0x7fb5fc19a3d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.457+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 >> 172.21.15.6:0/1176083352 conn(0x7fb5fc07b850 msgr2=0x7fb5fc1075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.458+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 shutdown_connections 2024-09-21T08:00:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:50.458+0000 7fb601828640 1 -- 172.21.15.6:0/1176083352 wait complete. 2024-09-21T08:00:51.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:51 smithi006 ceph-mon[30970]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:51 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1176083352' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:51 smithi119 ceph-mon[33564]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:51 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1176083352' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:51 smithi145 ceph-mon[34049]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:51 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1176083352' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:51.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 -- 172.21.15.6:0/4029821907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78108d10 msgr2=0x7f3d7810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 --2- 172.21.15.6:0/4029821907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78108d10 0x7f3d7810f540 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009ca0 tx=0x7f3d7002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 -- 172.21.15.6:0/4029821907 shutdown_connections 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 --2- 172.21.15.6:0/4029821907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78108d10 0x7f3d7810f540 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 --2- 172.21.15.6:0/4029821907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d781083c0 0x7f3d781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 --2- 172.21.15.6:0/4029821907 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d78102a80 0x7f3d78102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 -- 172.21.15.6:0/4029821907 >> 172.21.15.6:0/4029821907 conn(0x7f3d78079740 msgr2=0x7f3d78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 -- 172.21.15.6:0/4029821907 shutdown_connections 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.940+0000 7f3d7d967640 1 -- 172.21.15.6:0/4029821907 wait complete. 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 Processor -- start 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 -- start start 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d781083c0 0x7f3d7819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:51.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d78108d10 0x7f3d7819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112880 con 0x7f3d78102a80 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112700 con 0x7f3d78108d10 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d7d967640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112a00 con 0x7f3d781083c0 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59728/0 (socket says 172.21.15.6:59728) 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.941+0000 7f3d76ffd640 1 -- 172.21.15.6:0/773253808 learned_addr learned my addr 172.21.15.6:0/773253808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d767fc640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d781083c0 0x7f3d7819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d777fe640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d78108d10 0x7f3d7819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 -- 172.21.15.6:0/773253808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d781083c0 msgr2=0x7f3d7819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d781083c0 0x7f3d7819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 -- 172.21.15.6:0/773253808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d78108d10 msgr2=0x7f3d7819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d78108d10 0x7f3d7819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 -- 172.21.15.6:0/773253808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a63d0 con 0x7f3d78102a80 2024-09-21T08:00:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d76ffd640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800d770 tx=0x7f3d6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68017070 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d680054b0 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a66c0 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68004c60 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.942+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a6c00 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.943+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78103d00 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.945+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3d68004e00 con 0x7f3d78102a80 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.945+0000 7f3d7c965640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 0x7f3d600b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.946+0000 7f3d767fc640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 0x7f3d600b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:51.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.946+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3d680e7870 con 0x7f3d78102a80 2024-09-21T08:00:51.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.946+0000 7f3d767fc640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 0x7f3d600b8b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c005fd0 tx=0x7f3d6c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:51.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:51.949+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d680adb80 con 0x7f3d78102a80 2024-09-21T08:00:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.177+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d78102e90 con 0x7f3d78102a80 2024-09-21T08:00:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.178+0000 7f3d7c965640 1 -- 172.21.15.6:0/773253808 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f3d680b1f60 con 0x7f3d78102a80 2024-09-21T08:00:52.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:52.181 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:00:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:00:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 msgr2=0x7f3d600b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 0x7f3d600b8b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c005fd0 tx=0x7f3d6c005850 comp rx=0 tx=0).stop 2024-09-21T08:00:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 msgr2=0x7f3d7819b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800d770 tx=0x7f3d6800dc30 comp rx=0 tx=0).stop 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 shutdown_connections 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3d600b6670 0x7f3d600b8b80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d781083c0 0x7f3d7819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d78108d10 0x7f3d7819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 --2- 172.21.15.6:0/773253808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d78102a80 0x7f3d7819b110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 >> 172.21.15.6:0/773253808 conn(0x7f3d78079740 msgr2=0x7f3d781043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 shutdown_connections 2024-09-21T08:00:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:52.181+0000 7f3d7d967640 1 -- 172.21.15.6:0/773253808 wait complete. 2024-09-21T08:00:52.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:52 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/773253808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:52.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:52 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/773253808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:52 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/773253808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:52.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:00:53.061 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:53 smithi006 ceph-mon[30970]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 -- 172.21.15.6:0/3233079925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 msgr2=0x7f6760103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 --2- 172.21.15.6:0/3233079925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f6760103f70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f675c009900 tx=0x7f675c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 -- 172.21.15.6:0/3233079925 shutdown_connections 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 --2- 172.21.15.6:0/3233079925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 0x7f67601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 --2- 172.21.15.6:0/3233079925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 0x7f6760110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 --2- 172.21.15.6:0/3233079925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f6760103f70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 -- 172.21.15.6:0/3233079925 >> 172.21.15.6:0/3233079925 conn(0x7f676007b850 msgr2=0x7f676007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 -- 172.21.15.6:0/3233079925 shutdown_connections 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.549+0000 7f676769e640 1 -- 172.21.15.6:0/3233079925 wait complete. 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 Processor -- start 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 -- start start 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 0x7f676019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 0x7f676019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6760113960 con 0x7f6760103b60 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67601137e0 con 0x7f6760109df0 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.550+0000 7f676769e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6760113ae0 con 0x7f67601094a0 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59744/0 (socket says 172.21.15.6:59744) 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 -- 172.21.15.6:0/1934256181 learned_addr learned my addr 172.21.15.6:0/1934256181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f6765c3b640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 0x7f676019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f6764c39640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 0x7f676019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 -- 172.21.15.6:0/1934256181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 msgr2=0x7f676019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 0x7f676019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 -- 172.21.15.6:0/1934256181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 msgr2=0x7f676019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 0x7f676019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 -- 172.21.15.6:0/1934256181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67601a0320 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676543a640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f675c009230 tx=0x7f675c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c03f030 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67601a05b0 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f675c003a80 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c035070 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.551+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67601a6d70 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.553+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6760103f70 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.555+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f675c042030 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.556+0000 7f67567fc640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 0x7f674c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.556+0000 7f6764c39640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 0x7f674c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.556+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f675c108480 con 0x7f6760103b60 2024-09-21T08:00:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.557+0000 7f6764c39640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 0x7f674c0b8b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6760106530 tx=0x7f675000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:53.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.560+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f675c0d2a90 con 0x7f6760103b60 2024-09-21T08:00:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:53 smithi119 ceph-mon[33564]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:53 smithi145 ceph-mon[34049]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.750+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f676019b4e0 con 0x7f6760103b60 2024-09-21T08:00:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.752+0000 7f67567fc640 1 -- 172.21.15.6:0/1934256181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25204 (secure 0 0 0) 0x7f675c0d79d0 con 0x7f6760103b60 2024-09-21T08:00:53.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:53.755 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:00:03.985299+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 msgr2=0x7f674c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 0x7f674c0b8b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6760106530 tx=0x7f675000b390 comp rx=0 tx=0).stop 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 msgr2=0x7f676019a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f675c009230 tx=0x7f675c004270 comp rx=0 tx=0).stop 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 shutdown_connections 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f674c0b65f0 0x7f674c0b8b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67601094a0 0x7f676019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760109df0 0x7f676019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 --2- 172.21.15.6:0/1934256181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6760103b60 0x7f676019a3b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.754+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 >> 172.21.15.6:0/1934256181 conn(0x7f676007b850 msgr2=0x7f67601075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.755+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 shutdown_connections 2024-09-21T08:00:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:53.755+0000 7f676769e640 1 -- 172.21.15.6:0/1934256181 wait complete. 2024-09-21T08:00:54.416 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1934256181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:54.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:58:46.069948+0000', 'modified': '2024-09-21T07:59:28.356248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24713}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24694': {'gid': 24694, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6839/3378332428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3378332428}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3378332428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24713': {'gid': 24713, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/1644051507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1644051507}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1644051507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24713, 'qdb_cluster': [24713]} 2024-09-21T08:00:54.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T08:00:54.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.b status 2024-09-21T08:00:54.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1934256181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:54.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1934256181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 -- 172.21.15.6:0/2517684274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc108d20 msgr2=0x7fc1fc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 --2- 172.21.15.6:0/2517684274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc108d20 0x7fc1fc10f550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009ca0 tx=0x7fc1f402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 -- 172.21.15.6:0/2517684274 shutdown_connections 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 --2- 172.21.15.6:0/2517684274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc108d20 0x7fc1fc10f550 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 --2- 172.21.15.6:0/2517684274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 --2- 172.21.15.6:0/2517684274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 0x7fc1fc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 -- 172.21.15.6:0/2517684274 >> 172.21.15.6:0/2517684274 conn(0x7fc1fc079760 msgr2=0x7fc1fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 -- 172.21.15.6:0/2517684274 shutdown_connections 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.195+0000 7fc203c12640 1 -- 172.21.15.6:0/2517684274 wait complete. 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 Processor -- start 2024-09-21T08:00:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 -- start start 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 0x7fc1fc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 0x7fc1fc19ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc112890 con 0x7fc1fc1083d0 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc112710 con 0x7fc1fc108d20 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc203c12640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc112a10 con 0x7fc1fc102ae0 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59768/0 (socket says 172.21.15.6:59768) 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 -- 172.21.15.6:0/3714029538 learned_addr learned my addr 172.21.15.6:0/3714029538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2019ae640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 0x7fc1fc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2021af640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 0x7fc1fc19ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 -- 172.21.15.6:0/3714029538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 msgr2=0x7fc1fc199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 0x7fc1fc199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 -- 172.21.15.6:0/3714029538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 msgr2=0x7fc1fc19ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 0x7fc1fc19ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2011ad640 1 -- 172.21.15.6:0/3714029538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc19f1b0 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.196+0000 7fc2021af640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 0x7fc1fc19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc2011ad640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9c0 tx=0x7fc1ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc1f2ffd640 1 -- 172.21.15.6:0/3714029538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00cd80 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1fc19f4a0 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc1f2ffd640 1 -- 172.21.15.6:0/3714029538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1ec0054b0 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc1f2ffd640 1 -- 172.21.15.6:0/3714029538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec010430 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.197+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1fc1a5c00 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.200+0000 7fc1f2ffd640 1 -- 172.21.15.6:0/3714029538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fc1ec004f20 con 0x7fc1fc1083d0 2024-09-21T08:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.200+0000 7fc20a186740 1 Processor -- start 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.200+0000 7fc20a186740 1 -- start start 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a92198440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 0x556a92198980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556a9210fc10 con 0x556a91df1f60 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556a920ff040 con 0x556a91dd1280 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc20a186740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556a92102e50 con 0x556a91dc90a0 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc1f2ffd640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 0x7fc1e80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59776/0 (socket says 172.21.15.6:59776) 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 -- 172.21.15.6:0/2274600014 learned_addr learned my addr 172.21.15.6:0/2274600014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2011ad640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 0x556a92198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2019ae640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a92198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 0x7fc1e80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc1f2ffd640 1 -- 172.21.15.6:0/3714029538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1ec0e7f70 con 0x7fc1fc1083d0 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 -- 172.21.15.6:0/2274600014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 msgr2=0x556a92198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a92198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 -- 172.21.15.6:0/2274600014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 msgr2=0x556a92198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 0x556a92198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2021af640 1 -- 172.21.15.6:0/2274600014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a91e5d540 con 0x556a91df1f60 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.201+0000 7fc2011ad640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 0x556a92198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.202+0000 7fc2021af640 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4035000 tx=0x7fc1f40318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba08e1da523d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.202+0000 7fc1e7fff640 1 -- 172.21.15.6:0/2274600014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4031cd0 con 0x556a91df1f60 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.202+0000 7fc1e7fff640 1 -- 172.21.15.6:0/2274600014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1f404e070 con 0x556a91df1f60 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.202+0000 7fc1e7fff640 1 -- 172.21.15.6:0/2274600014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40307c0 con 0x556a91df1f60 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.202+0000 7fc2021af640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 0x7fc1e80b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1f404d000 tx=0x7fc1f404b000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- 172.21.15.6:0/2274600014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 msgr2=0x556a92197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4035000 tx=0x7fc1f40318e0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- 172.21.15.6:0/2274600014 shutdown_connections 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a92198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dd1280 0x556a92198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 --2- 172.21.15.6:0/2274600014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a92197f00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- 172.21.15.6:0/2274600014 >> 172.21.15.6:0/2274600014 conn(0x556a91de6350 msgr2=0x556a92195df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- 172.21.15.6:0/2274600014 shutdown_connections 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- 172.21.15.6:0/2274600014 wait complete. 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 -- start start 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.203+0000 7fc20a186740 1 Processor -- start 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a921a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91df1f60 0x556a921afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556a91f605f0 con 0x556a91dd1280 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556a9209a010 con 0x556a91dc90a0 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556a921a66e0 con 0x556a91df1f60 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc20a186740 10 client.0 _ll_register_callbacks cb 0x556a920f9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59782/0 (socket says 172.21.15.6:59782) 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 -- 172.21.15.6:0/4100974709 learned_addr learned my addr 172.21.15.6:0/4100974709 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2021af640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91df1f60 0x556a921afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2019ae640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a921a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 -- 172.21.15.6:0/4100974709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91df1f60 msgr2=0x556a921afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91df1f60 0x556a921afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 -- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 msgr2=0x556a921a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a921a39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2011ad640 1 -- 172.21.15.6:0/4100974709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a920c7a00 con 0x556a91dd1280 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.204+0000 7fc2019ae640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a921a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ada90 tx=0x7fc1ec076620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0975c2b001f694 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0a9270 con 0x556a91dd1280 2024-09-21T08:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1ec0b7090 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f404e070 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1ec0ad610 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 10 client.15378 fetch_fsmap learned FSMap version 21 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556a921b2640 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1f404e070 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1ec0cfb10 con 0x556a91dd1280 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 10 client.15378 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 20 client.15378 populate_metadata read hostname 'smithi006' 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91db08e0 0x556a921b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 4 client.15378 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.205+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a92111b60 con 0x556a91db08e0 2024-09-21T08:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.206+0000 7fc2019ae640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91db08e0 0x556a921b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.206+0000 7fc1e57fa640 10 client.15378 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.206+0000 7fc2019ae640 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91db08e0 0x556a921b6050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af3df56b5c98874 server_cookie=9c0ee4223b0e0518 in_seq=0 out_seq=0 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc1e57fa640 1 -- 172.21.15.6:0/4100974709 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a92111b60 con 0x556a91db08e0 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc1e57fa640 10 client.15378 handle_command_reply: tid=0 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 client.15378 shutdown 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 msgr2=0x556a921a3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ada90 tx=0x7fc1ec076620 comp rx=0 tx=0).stop 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 shutdown_connections 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91db08e0 0x556a921b6050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91df1f60 0x556a921afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921a3f20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc1e57fa640 0 client.15378 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 --2- 172.21.15.6:0/4100974709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a921a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 >> 172.21.15.6:0/4100974709 conn(0x556a91de6350 msgr2=0x556a9219b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.207+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 shutdown_connections 2024-09-21T08:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.208+0000 7fc20a186740 1 -- 172.21.15.6:0/4100974709 wait complete. 2024-09-21T08:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.208+0000 7fc20a186740 20 client.15378 trim_cache size 0 max 16384 2024-09-21T08:00:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 Processor -- start 2024-09-21T08:00:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 -- start start 2024-09-21T08:00:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a921be920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91df1f60 0x556a921afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556a921b4390 con 0x556a91dd1280 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556a921b4a60 con 0x556a91df1f60 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc20a186740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556a921b5130 con 0x556a91dc90a0 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59798/0 (socket says 172.21.15.6:59798) 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 -- 172.21.15.6:0/4238161625 learned_addr learned my addr 172.21.15.6:0/4238161625 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2019ae640 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a921be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2021af640 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91df1f60 0x556a921afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 -- 172.21.15.6:0/4238161625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 msgr2=0x556a921be920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a921be920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 -- 172.21.15.6:0/4238161625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91df1f60 msgr2=0x556a921afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91df1f60 0x556a921afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.226+0000 7fc2011ad640 1 -- 172.21.15.6:0/4238161625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a921a4aa0 con 0x556a91dd1280 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.227+0000 7fc2011ad640 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0058c0 tx=0x7fc1ec0ad350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb20eeca71db4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.227+0000 7fc1e77fe640 1 -- 172.21.15.6:0/4238161625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0a9270 con 0x556a91dd1280 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.227+0000 7fc1e77fe640 1 -- 172.21.15.6:0/4238161625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1ec07ae50 con 0x556a91dd1280 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.227+0000 7fc1e77fe640 1 -- 172.21.15.6:0/4238161625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0b25e0 con 0x556a91dd1280 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- 172.21.15.6:0/4238161625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 msgr2=0x556a921af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0058c0 tx=0x7fc1ec0ad350 comp rx=0 tx=0).stop 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- 172.21.15.6:0/4238161625 shutdown_connections 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91df1f60 0x556a921afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91dd1280 0x556a921af970 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 --2- 172.21.15.6:0/4238161625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dc90a0 0x556a921be920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- 172.21.15.6:0/4238161625 >> 172.21.15.6:0/4238161625 conn(0x556a91de6350 msgr2=0x556a92190ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- 172.21.15.6:0/4238161625 shutdown_connections 2024-09-21T08:00:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- 172.21.15.6:0/4238161625 wait complete. 2024-09-21T08:00:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 -- start start 2024-09-21T08:00:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.228+0000 7fc20a186740 1 Processor -- start 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 0x556a9219ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556a921b5ed0 con 0x556a91df1f60 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556a921b5800 con 0x556a91dc90a0 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556a921b65a0 con 0x556a91dd1280 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc20a186740 10 client.0 _ll_register_callbacks cb 0x7fc1ec004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2021af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2021af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59802/0 (socket says 172.21.15.6:59802) 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:49264/0 (socket says 172.21.15.6:49264) 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2021af640 1 -- 172.21.15.6:0/322829723 learned_addr learned my addr 172.21.15.6:0/322829723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2011ad640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 0x556a9219ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 -- 172.21.15.6:0/322829723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 msgr2=0x556a9219ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 0x556a9219ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 -- 172.21.15.6:0/322829723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 msgr2=0x556a921a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2019ae640 1 -- 172.21.15.6:0/322829723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a921a0c10 con 0x556a91dc90a0 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2011ad640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 0x556a9219ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.229+0000 7fc2021af640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc2019ae640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556a921b6720 tx=0x7fc1f8012c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f6d7cb55cb4fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc1e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:00:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8010ad0 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1f8010c70 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1ec07ae50 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1f8030050 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc20a186740 10 client.25136 fetch_fsmap learned FSMap version 21 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556a92225a40 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.230+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1ec07ae50 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1f80047a0 con 0x556a91dc90a0 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 10 client.25136 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 10 client.25136 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 20 client.25136 populate_metadata read hostname 'smithi006' 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91d85c90 0x556a922292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 4 client.25136 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "status"}) -- 0x556a9210d610 con 0x556a91d85c90 2024-09-21T08:00:55.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc2011ad640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91d85c90 0x556a922292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc1e57fa640 10 client.25136 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.231+0000 7fc2011ad640 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91d85c90 0x556a922292d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dceab0b27445de31 server_cookie=91dd2f1bd90d5342 in_seq=0 out_seq=0 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc1e57fa640 1 -- 172.21.15.6:0/322829723 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556a9210d610 con 0x556a91d85c90 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc1e57fa640 10 client.25136 handle_command_reply: tid=0 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 client.25136 shutdown 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 msgr2=0x556a9219f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556a921b6720 tx=0x7fc1f8012c40 comp rx=0 tx=0).stop 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 shutdown_connections 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556a91d85c90 0x556a922292d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556a91dd1280 0x556a9219ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556a91df1f60 0x556a921a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc1e57fa640 0 client.25136 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 --2- 172.21.15.6:0/322829723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556a91dc90a0 0x556a9219f9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 >> 172.21.15.6:0/322829723 conn(0x556a91de6350 msgr2=0x556a9219e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 shutdown_connections 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 1 -- 172.21.15.6:0/322829723 wait complete. 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.232+0000 7fc20a186740 20 client.25136 trim_cache size 0 max 16384 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24713, 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-21T08:00:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 128.88525126499999, 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 21, 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 85, 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 140.07726228300001 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:00:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 msgr2=0x7fc1e80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 0x7fc1e80b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1f404d000 tx=0x7fc1f404b000 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 msgr2=0x7fc1fc1997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9c0 tx=0x7fc1ec00ee80 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 shutdown_connections 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1e80b65f0 0x7fc1e80b8b00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1fc108d20 0x7fc1fc19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1fc1083d0 0x7fc1fc1997e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 --2- 172.21.15.6:0/3714029538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1fc102ae0 0x7fc1fc199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 >> 172.21.15.6:0/3714029538 conn(0x7fc1fc079760 msgr2=0x7fc1fc104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 shutdown_connections 2024-09-21T08:00:55.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:55.233+0000 7fc203c12640 1 -- 172.21.15.6:0/3714029538 wait complete. 2024-09-21T08:00:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:55 smithi006 ceph-mon[30970]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:55.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:55 smithi119 ceph-mon[33564]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:55 smithi145 ceph-mon[34049]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:00:55.940 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T08:00:55.951 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T08:00:55.951 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T08:00:55.951 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-21T08:00:55.951 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T08:00:55.951 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-21T08:00:55.951 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-21T08:00:55.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:55.951 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-21T08:00:55.969 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T08:00:55.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:55.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T08:00:56.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:56.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-21T08:00:56.146 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T08:00:56.146 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T08:00:56.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T08:00:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:00:56.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:56 smithi006 ceph-mon[30970]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:56 smithi119 ceph-mon[33564]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:56.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:56 smithi145 ceph-mon[34049]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 -- 172.21.15.6:0/3496721939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa890103b60 msgr2=0x7fa890103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 --2- 172.21.15.6:0/3496721939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa890103b60 0x7fa890103f70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009900 tx=0x7fa88c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 -- 172.21.15.6:0/3496721939 shutdown_connections 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 --2- 172.21.15.6:0/3496721939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890109df0 0x7fa890110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 --2- 172.21.15.6:0/3496721939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8901094a0 0x7fa8901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 --2- 172.21.15.6:0/3496721939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa890103b60 0x7fa890103f70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.864+0000 7fa897b0e640 1 -- 172.21.15.6:0/3496721939 >> 172.21.15.6:0/3496721939 conn(0x7fa89007b850 msgr2=0x7fa89007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.865+0000 7fa897b0e640 1 -- 172.21.15.6:0/3496721939 shutdown_connections 2024-09-21T08:00:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.865+0000 7fa897b0e640 1 -- 172.21.15.6:0/3496721939 wait complete. 2024-09-21T08:00:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.865+0000 7fa897b0e640 1 Processor -- start 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 -- start start 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890103b60 0x7fa89019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890109df0 0x7fa89019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa890113960 con 0x7fa8901094a0 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8901137e0 con 0x7fa890109df0 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa897b0e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa890113ae0 con 0x7fa890103b60 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa8950a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa8958aa640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890103b60 0x7fa89019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa8950a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40006/0 (socket says 172.21.15.6:40006) 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa8950a9640 1 -- 172.21.15.6:0/595438076 learned_addr learned my addr 172.21.15.6:0/595438076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.866+0000 7fa8960ab640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890109df0 0x7fa89019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 -- 172.21.15.6:0/595438076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890103b60 msgr2=0x7fa89019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890103b60 0x7fa89019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 -- 172.21.15.6:0/595438076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890109df0 msgr2=0x7fa89019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890109df0 0x7fa89019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 -- 172.21.15.6:0/595438076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8901a0320 con 0x7fa8901094a0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa8950a9640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d740 tx=0x7fa88000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880017070 con 0x7fa8901094a0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa88000de50 con 0x7fa8901094a0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8901a0610 con 0x7fa8901094a0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88000f620 con 0x7fa8901094a0 2024-09-21T08:00:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.867+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8901a6d70 con 0x7fa8901094a0 2024-09-21T08:00:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.868+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa890103f70 con 0x7fa8901094a0 2024-09-21T08:00:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.871+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa88001a070 con 0x7fa8901094a0 2024-09-21T08:00:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.871+0000 7fa886ffd640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 0x7fa87c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.872+0000 7fa8958aa640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 0x7fa87c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.872+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa8800e7260 con 0x7fa8901094a0 2024-09-21T08:00:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.872+0000 7fa8958aa640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 0x7fa87c0b8b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0057c0 tx=0x7fa88c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:56.875+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8800b1950 con 0x7fa8901094a0 2024-09-21T08:00:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.105+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa89019b4e0 con 0x7fa8901094a0 2024-09-21T08:00:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.105+0000 7fa886ffd640 1 -- 172.21.15.6:0/595438076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7fa89019b4e0 con 0x7fa8901094a0 2024-09-21T08:00:57.108 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.107+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 msgr2=0x7fa87c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.107+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 0x7fa87c0b8b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0057c0 tx=0x7fa88c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.107+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 msgr2=0x7fa89019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.107+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d740 tx=0x7fa88000dc00 comp rx=0 tx=0).stop 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 shutdown_connections 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa87c0b6670 0x7fa87c0b8b80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890109df0 0x7fa89019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8901094a0 0x7fa89019a950 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 --2- 172.21.15.6:0/595438076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa890103b60 0x7fa89019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 >> 172.21.15.6:0/595438076 conn(0x7fa89007b850 msgr2=0x7fa8901075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 shutdown_connections 2024-09-21T08:00:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57.108+0000 7fa897b0e640 1 -- 172.21.15.6:0/595438076 wait complete. 2024-09-21T08:00:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:57 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/595438076' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T08:00:57.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:57 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/595438076' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T08:00:57.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:57 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/595438076' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T08:00:57.827 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T08:00:57.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T08:00:57.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-21T08:00:57.827 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T08:00:57.828 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-21T08:00:57.828 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T08:00:57.828 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T08:00:57.828 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T08:00:57.828 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-21T08:00:57.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:57.828 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-21T08:00:57.846 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T08:00:57.846 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:57.847 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42095sec preferred_lft 42095sec 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-21T08:00:57.848 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-21T08:00:57.848 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T08:00:57.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:57.848 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T08:00:57.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-09-21T08:00:57.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-09-21T08:00:57.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-09-21T08:00:57.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T08:00:57.849 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T08:00:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:57.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:57.996 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T08:00:58.022 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-21T08:00:58.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:58.024 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-21T08:00:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-21T08:00:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T08:00:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T08:00:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T08:00:58.082 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T08:00:58.082 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T08:00:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:58.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:58.211 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-21T08:00:58.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:58.227 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-21T08:00:58.283 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:58.283 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T08:00:58.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-21T08:00:58.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-21T08:00:58.284 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T08:00:58.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:58.406 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-21T08:00:58.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-21T08:00:58.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-21T08:00:58.407 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T08:00:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:58.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:00:58 smithi006 ceph-mon[30970]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:58.524 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T08:00:58.524 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-21T08:00:58.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-21T08:00:58.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T08:00:58.524 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-21T08:00:58.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T08:00:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:58.603 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-21T08:00:58.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:58.603 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /tmp/cephfs 2024-09-21T08:00:58.632 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-21T08:00:58.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T08:00:58.633 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /tmp/cephfs 2024-09-21T08:00:58.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:00:58 smithi119 ceph-mon[33564]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:58.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-21T08:00:58.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:00:58 smithi145 ceph-mon[34049]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:00:58.756 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-21T08:00:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-21T08:00:58.814 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/a20f934e0dbd8fc6f0d2c73ed9d9373ca1730a82b09de146e35c9a22234bcb32/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00d8313383251f90a9c9a02e29741cb4b7f3a85ecbcce39d9947dc83ad8bff15/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/f061c8f7ea0f26d2819a7a949e8be5ecf800619e3d4b440056bd413e67a2aa2b/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/e45ff3be6e06861133c983d1828a8b3aec8808deb936db22cdd9fe0255bd8de5/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/05326b152013b3a6fae6e0549d70b60c2be598596ee8f38fcf28e637346b7b1c/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ea3efb7402493d1001343d8eccb202a075b76eb9f07d4a44bb418acc31598cc9/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/7a3ec3c34cb66b91a94c1553d3c5ccd6ca10ae48ab20fa62652ce9aec8828acc/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/3995b3f08c5f3a842f18656ff777df5295e89808913f6781c960a0555933272b/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/d56aa35cc29b7c2705436bc695ed4b0cd848fa798ed1e2752308a788266f78e9/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/97610741785e7be078ec91ce87819054fe9871596699122451403f170deb22cf/merged 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-21T08:00:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T08:00:58.816 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T08:00:58.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:58.816 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-21T08:00:58.869 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T08:00:58.869 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/938de8c1-dac3-4f59-a07f-a5df9e5aee00 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-09-21T08:00:58.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-21T08:00:58.937 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-21T08:00:58.995 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T08:00:58.996 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/a20f934e0dbd8fc6f0d2c73ed9d9373ca1730a82b09de146e35c9a22234bcb32/merged 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/00d8313383251f90a9c9a02e29741cb4b7f3a85ecbcce39d9947dc83ad8bff15/merged 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/f061c8f7ea0f26d2819a7a949e8be5ecf800619e3d4b440056bd413e67a2aa2b/merged 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/e45ff3be6e06861133c983d1828a8b3aec8808deb936db22cdd9fe0255bd8de5/merged 2024-09-21T08:00:58.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/05326b152013b3a6fae6e0549d70b60c2be598596ee8f38fcf28e637346b7b1c/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/ea3efb7402493d1001343d8eccb202a075b76eb9f07d4a44bb418acc31598cc9/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/7a3ec3c34cb66b91a94c1553d3c5ccd6ca10ae48ab20fa62652ce9aec8828acc/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/3995b3f08c5f3a842f18656ff777df5295e89808913f6781c960a0555933272b/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/d56aa35cc29b7c2705436bc695ed4b0cd848fa798ed1e2752308a788266f78e9/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/97610741785e7be078ec91ce87819054fe9871596699122451403f170deb22cf/merged 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T08:00:58.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:58.999 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-21T08:00:59.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-09-21T08:00:59.006+0000 7f152c711480 -1 init, newargv = 0x7f1520004b60 newargc=17 2024-09-21T08:00:59.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85572]: starting ceph client 2024-09-21T08:00:59.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85572]: starting fuse 2024-09-21T08:00:59.024 INFO:teuthology.orchestra.run.smithi006.stdout:120 2024-09-21T08:00:59.024 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/tmp/cephfs" 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-21T08:00:59.025 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-09-21T08:00:59.026 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-21T08:00:59.145 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.85572.asok 2024-09-21T08:00:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T08:00:59.156 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85572.asok 2024-09-21T08:00:59.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:59.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85572.asok status 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-09-21T08:00:59.302 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/tmp/cephfs", 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "85572", 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/volumes/qa/sv_0/938de8c1-dac3-4f59-a07f-a5df9e5aee00" 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 15396, 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 15396 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-21T08:00:59.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1187420475 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1187420475 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.15396 192.168.0.1:0/1187420475", 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1187420475", 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 5, 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 21, 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 85, 2024-09-21T08:00:59.304 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-21T08:00:59.305 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-21T08:00:59.305 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-21T08:00:59.305 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:00:59.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:59.311 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-21T08:00:59.311 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /tmp/cephfs 2024-09-21T08:00:59.327 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-21T08:00:59.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-09-21T08:00:59.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:59.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /tmp/cephfs 2024-09-21T08:00:59.395 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T08:00:59.406 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T08:00:59.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:00:59.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 -- 172.21.15.6:0/963843079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc108c30 msgr2=0x7f4dcc10f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 --2- 172.21.15.6:0/963843079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc108c30 0x7f4dcc10f460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009ca0 tx=0x7f4dc402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 -- 172.21.15.6:0/963843079 shutdown_connections 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 --2- 172.21.15.6:0/963843079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 --2- 172.21.15.6:0/963843079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc108c30 0x7f4dcc10f460 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 --2- 172.21.15.6:0/963843079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc1029b0 0x7f4dcc102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 -- 172.21.15.6:0/963843079 >> 172.21.15.6:0/963843079 conn(0x7f4dcc0fe3b0 msgr2=0x7f4dcc100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 -- 172.21.15.6:0/963843079 shutdown_connections 2024-09-21T08:00:59.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 -- 172.21.15.6:0/963843079 wait complete. 2024-09-21T08:00:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.554+0000 7f4dd30de640 1 Processor -- start 2024-09-21T08:00:59.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 -- start start 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1029b0 0x7f4dcc19b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc108c30 0x7f4dcc19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1127f0 con 0x7f4dcc1082e0 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc112670 con 0x7f4dcc108c30 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd30de640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc112970 con 0x7f4dcc1029b0 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40016/0 (socket says 172.21.15.6:40016) 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 -- 172.21.15.6:0/1593512798 learned_addr learned my addr 172.21.15.6:0/1593512798 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd167b640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc108c30 0x7f4dcc19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dd0e7a640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1029b0 0x7f4dcc19b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 -- 172.21.15.6:0/1593512798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1029b0 msgr2=0x7f4dcc19b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1029b0 0x7f4dcc19b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 -- 172.21.15.6:0/1593512798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc108c30 msgr2=0x7f4dcc19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc108c30 0x7f4dcc19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 -- 172.21.15.6:0/1593512798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc1a6390 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.555+0000 7f4dcbfff640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9c0 tx=0x7f4dc000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.556+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000ccc0 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.556+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc00054b0 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.556+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc1a6680 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.556+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0010430 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.556+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc1a6b80 con 0x7f4dcc1082e0 2024-09-21T08:00:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.557+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dcc102dc0 con 0x7f4dcc1082e0 2024-09-21T08:00:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.558+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f4dc0004f20 con 0x7f4dcc1082e0 2024-09-21T08:00:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.560+0000 7f4dc9ffb640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 0x7f4db40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.560+0000 7f4dd0e7a640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 0x7f4db40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.560+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4dc00e7e20 con 0x7f4dcc1082e0 2024-09-21T08:00:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.560+0000 7f4dd0e7a640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 0x7f4db40b8b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc005fd0 tx=0x7f4dbc005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.564+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4dc00ae050 con 0x7f4dcc1082e0 2024-09-21T08:00:59.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.754+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dcc02e640 con 0x7f4dcc1082e0 2024-09-21T08:00:59.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.755+0000 7f4dc9ffb640 1 -- 172.21.15.6:0/1593512798 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25204 (secure 0 0 0) 0x7f4dc00b2430 con 0x7f4dcc1082e0 2024-09-21T08:00:59.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:00:59.758 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:00:03.985299+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:00:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 msgr2=0x7f4db40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 0x7f4db40b8b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc005fd0 tx=0x7f4dbc005850 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 msgr2=0x7f4dcc19b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9c0 tx=0x7f4dc000ee80 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 shutdown_connections 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4db40b65f0 0x7f4db40b8b00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dcc108c30 0x7f4dcc19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dcc1082e0 0x7f4dcc19b640 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 --2- 172.21.15.6:0/1593512798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4dcc1029b0 0x7f4dcc19b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 >> 172.21.15.6:0/1593512798 conn(0x7f4dcc0fe3b0 msgr2=0x7f4dcc1078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 shutdown_connections 2024-09-21T08:00:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.758+0000 7f4dd30de640 1 -- 172.21.15.6:0/1593512798 wait complete. 2024-09-21T08:00:59.772 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:54:01.897308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:58:41.348167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:58:43.952628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:58:50.378691+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T08:00:59.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T08:00:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 -- 172.21.15.6:0/461759088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 msgr2=0x7efd54102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 --2- 172.21.15.6:0/461759088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd54102dc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efd50009900 tx=0x7efd5002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 -- 172.21.15.6:0/461759088 shutdown_connections 2024-09-21T08:00:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 --2- 172.21.15.6:0/461759088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 0x7efd5410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 --2- 172.21.15.6:0/461759088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 0x7efd541086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 --2- 172.21.15.6:0/461759088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd54102dc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 -- 172.21.15.6:0/461759088 >> 172.21.15.6:0/461759088 conn(0x7efd540fe3f0 msgr2=0x7efd54100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 -- 172.21.15.6:0/461759088 shutdown_connections 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.886+0000 7efd5b28c640 1 -- 172.21.15.6:0/461759088 wait complete. 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 Processor -- start 2024-09-21T08:00:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 -- start start 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 0x7efd5419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 0x7efd5419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd541127a0 con 0x7efd541029b0 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd54112620 con 0x7efd541082e0 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd5b28c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd54112920 con 0x7efd54108c30 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd59028640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd59028640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40030/0 (socket says 172.21.15.6:40030) 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.887+0000 7efd59028640 1 -- 172.21.15.6:0/1378374219 learned_addr learned my addr 172.21.15.6:0/1378374219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd58827640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 0x7efd5419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59829640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 0x7efd5419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 -- 172.21.15.6:0/1378374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 msgr2=0x7efd5419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 0x7efd5419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 -- 172.21.15.6:0/1378374219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 msgr2=0x7efd5419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 0x7efd5419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 -- 172.21.15.6:0/1378374219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd541a0280 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd59028640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efd50009230 tx=0x7efd50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5003f030 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd50003a80 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd541a0510 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50035070 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.888+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd541a6d00 con 0x7efd541029b0 2024-09-21T08:00:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.889+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd54103c20 con 0x7efd541029b0 2024-09-21T08:00:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.891+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7efd50042030 con 0x7efd541029b0 2024-09-21T08:00:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.892+0000 7efd4a7fc640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 0x7efd400b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.892+0000 7efd58827640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 0x7efd400b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.892+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7efd50108680 con 0x7efd541029b0 2024-09-21T08:00:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.892+0000 7efd58827640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 0x7efd400b8b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd44005fd0 tx=0x7efd44005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:00:59.895+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd500ce8b0 con 0x7efd541029b0 2024-09-21T08:01:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.083+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efd541a6ed0 con 0x7efd541029b0 2024-09-21T08:01:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.084+0000 7efd4a7fc640 1 -- 172.21.15.6:0/1378374219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7efd500d2c90 con 0x7efd541029b0 2024-09-21T08:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-21T08:01:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 msgr2=0x7efd400b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 0x7efd400b8b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd44005fd0 tx=0x7efd44005850 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 msgr2=0x7efd5419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efd50009230 tx=0x7efd50004270 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 shutdown_connections 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd400b65f0 0x7efd400b8b00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd54108c30 0x7efd5419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd541082e0 0x7efd5419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 --2- 172.21.15.6:0/1378374219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd541029b0 0x7efd5419a350 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 >> 172.21.15.6:0/1378374219 conn(0x7efd540fe3f0 msgr2=0x7efd5406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 shutdown_connections 2024-09-21T08:01:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.086+0000 7efd5b28c640 1 -- 172.21.15.6:0/1378374219 wait complete. 2024-09-21T08:01:00.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T08:01:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 -- 172.21.15.6:0/14692052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 msgr2=0x7fa6a810f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/14692052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a810f440 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009ca0 tx=0x7fa6a002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 -- 172.21.15.6:0/14692052 shutdown_connections 2024-09-21T08:01:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/14692052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a810f440 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/14692052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 0x7fa6a81086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/14692052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 0x7fa6a8102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 -- 172.21.15.6:0/14692052 >> 172.21.15.6:0/14692052 conn(0x7fa6a80fe3b0 msgr2=0x7fa6a8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 -- 172.21.15.6:0/14692052 shutdown_connections 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.214+0000 7fa6ac98b640 1 -- 172.21.15.6:0/14692052 wait complete. 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 Processor -- start 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 -- start start 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 0x7fa6a819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 0x7fa6a819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a81127d0 con 0x7fa6a8108c10 2024-09-21T08:01:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112650 con 0x7fa6a81082c0 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6ac98b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112950 con 0x7fa6a8102990 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40054/0 (socket says 172.21.15.6:40054) 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.215+0000 7fa6a6d9d640 1 -- 172.21.15.6:0/1948067410 learned_addr learned my addr 172.21.15.6:0/1948067410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a5d9b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 0x7fa6a819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a659c640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 0x7fa6a819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 -- 172.21.15.6:0/1948067410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 msgr2=0x7fa6a819b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 0x7fa6a819b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 -- 172.21.15.6:0/1948067410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 msgr2=0x7fa6a819b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 0x7fa6a819b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 -- 172.21.15.6:0/1948067410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a81a63d0 con 0x7fa6a8108c10 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6a6d9d640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0005e30 tx=0x7fa6a00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0032d10 con 0x7fa6a8108c10 2024-09-21T08:01:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a81a6660 con 0x7fa6a8108c10 2024-09-21T08:01:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6a0032eb0 con 0x7fa6a8108c10 2024-09-21T08:01:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0030b20 con 0x7fa6a8108c10 2024-09-21T08:01:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.216+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a81a6bb0 con 0x7fa6a8108c10 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.217+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a8102da0 con 0x7fa6a8108c10 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.219+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa6a0030cc0 con 0x7fa6a8108c10 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.220+0000 7fa6977fe640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 0x7fa6900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.220+0000 7fa6a659c640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 0x7fa6900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.220+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa6a0108c80 con 0x7fa6a8108c10 2024-09-21T08:01:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.221+0000 7fa6a659c640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 0x7fa6900b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806b280 tx=0x7fa698005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.223+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6a00cef10 con 0x7fa6a8108c10 2024-09-21T08:01:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.414+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa6a802e640 con 0x7fa6a8108c10 2024-09-21T08:01:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.415+0000 7fa6977fe640 1 -- 172.21.15.6:0/1948067410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7fa6a00d32f0 con 0x7fa6a8108c10 2024-09-21T08:01:00.418 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 msgr2=0x7fa6900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 0x7fa6900b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806b280 tx=0x7fa698005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 msgr2=0x7fa6a819bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0005e30 tx=0x7fa6a00093d0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 shutdown_connections 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa6900b65f0 0x7fa6900b8b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a8108c10 0x7fa6a819bbc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a81082c0 0x7fa6a819b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 --2- 172.21.15.6:0/1948067410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6a8102990 0x7fa6a819b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 >> 172.21.15.6:0/1948067410 conn(0x7fa6a80fe3b0 msgr2=0x7fa6a81007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.417+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 shutdown_connections 2024-09-21T08:01:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.418+0000 7fa6ac98b640 1 -- 172.21.15.6:0/1948067410 wait complete. 2024-09-21T08:01:00.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T08:01:00.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 -- 172.21.15.6:0/1112955265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f1010dd60 msgr2=0x7f1f10110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/1112955265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f1010dd60 0x7f1f10110240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009ca0 tx=0x7f1f0802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 -- 172.21.15.6:0/1112955265 shutdown_connections 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/1112955265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10105290 0x7f1f1010d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/1112955265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f1010dd60 0x7f1f10110240 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/1112955265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f10104940 0x7f1f10104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 -- 172.21.15.6:0/1112955265 >> 172.21.15.6:0/1112955265 conn(0x7f1f100fe3b0 msgr2=0x7f1f10100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 -- 172.21.15.6:0/1112955265 shutdown_connections 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.546+0000 7f1f16fa8640 1 -- 172.21.15.6:0/1112955265 wait complete. 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 Processor -- start 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 -- start start 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10104940 0x7f1f1019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 0x7f1f1019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101138b0 con 0x7f1f10105290 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10113730 con 0x7f1f1010dd60 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f16fa8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10113a30 con 0x7f1f10104940 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40078/0 (socket says 172.21.15.6:40078) 2024-09-21T08:01:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f0ffff640 1 -- 172.21.15.6:0/2287825270 learned_addr learned my addr 172.21.15.6:0/2287825270 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:00.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f15545640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 0x7f1f1019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f14d44640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10104940 0x7f1f1019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f0ffff640 1 -- 172.21.15.6:0/2287825270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10104940 msgr2=0x7f1f1019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.547+0000 7f1f0ffff640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10104940 0x7f1f1019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0ffff640 1 -- 172.21.15.6:0/2287825270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 msgr2=0x7f1f1019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0ffff640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 0x7f1f1019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0ffff640 1 -- 172.21.15.6:0/2287825270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f101a0260 con 0x7f1f10105290 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f15545640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 0x7f1f1019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0ffff640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e9f0 tx=0x7f1efc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00ccc0 con 0x7f1f10105290 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1efc0108c0 con 0x7f1f10105290 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f101a0550 con 0x7f1f10105290 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc018750 con 0x7f1f10105290 2024-09-21T08:01:00.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.548+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f101a6ce0 con 0x7f1f10105290 2024-09-21T08:01:00.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.549+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f10104d50 con 0x7f1f10105290 2024-09-21T08:01:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.551+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f1efc010430 con 0x7f1f10105290 2024-09-21T08:01:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.552+0000 7f1f0dffb640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 0x7f1f000b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.552+0000 7f1f14d44640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 0x7f1f000b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.552+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f1efc0e81c0 con 0x7f1f10105290 2024-09-21T08:01:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.552+0000 7f1f14d44640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 0x7f1f000b8b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009b60 tx=0x7f1f04005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.555+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1efc0ae450 con 0x7f1f10105290 2024-09-21T08:01:00.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:00 smithi006 ceph-mon[30970]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:01:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:00 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1593512798' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:00 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1378374219' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:01:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:00 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1948067410' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:01:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.746+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f101a7030 con 0x7f1f10105290 2024-09-21T08:01:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.747+0000 7f1f0dffb640 1 -- 172.21.15.6:0/2287825270 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f1efc0b2830 con 0x7f1f10105290 2024-09-21T08:01:00.749 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-09-21T08:01:00.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 msgr2=0x7f1f000b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 0x7f1f000b8b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009b60 tx=0x7f1f04005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 msgr2=0x7f1f1019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e9f0 tx=0x7f1efc00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 shutdown_connections 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1f000b6670 0x7f1f000b8b80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1010dd60 0x7f1f1019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f10105290 0x7f1f1019a8d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 --2- 172.21.15.6:0/2287825270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f10104940 0x7f1f1019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 >> 172.21.15.6:0/2287825270 conn(0x7f1f100fe3b0 msgr2=0x7f1f10107840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 shutdown_connections 2024-09-21T08:01:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.749+0000 7f1f16fa8640 1 -- 172.21.15.6:0/2287825270 wait complete. 2024-09-21T08:01:00.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 -- 172.21.15.6:0/2391807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 msgr2=0x7fea44104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 --2- 172.21.15.6:0/2391807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea44104cf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fea40009900 tx=0x7fea4002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 -- 172.21.15.6:0/2391807825 shutdown_connections 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 --2- 172.21.15.6:0/2391807825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea44110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 --2- 172.21.15.6:0/2391807825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 --2- 172.21.15.6:0/2391807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea44104cf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 -- 172.21.15.6:0/2391807825 >> 172.21.15.6:0/2391807825 conn(0x7fea440fe3b0 msgr2=0x7fea44100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 -- 172.21.15.6:0/2391807825 shutdown_connections 2024-09-21T08:01:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.877+0000 7fea4b920640 1 -- 172.21.15.6:0/2391807825 wait complete. 2024-09-21T08:01:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 Processor -- start 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 -- start start 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea4419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea44113850 con 0x7fea441048e0 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fea441136d0 con 0x7fea44105230 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea4b920640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fea441139d0 con 0x7fea4410dd40 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea496bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea496bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40100/0 (socket says 172.21.15.6:40100) 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.878+0000 7fea496bc640 1 -- 172.21.15.6:0/1988716117 learned_addr learned my addr 172.21.15.6:0/1988716117 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea48ebb640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea49ebd640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea4419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 -- 172.21.15.6:0/1988716117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 msgr2=0x7fea4419fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea4419fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 -- 172.21.15.6:0/1988716117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 msgr2=0x7fea4419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 -- 172.21.15.6:0/1988716117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea441a0220 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea49ebd640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea4419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea48ebb640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea496bc640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fea40009230 tx=0x7fea40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4003f030 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea40003a80 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea441a04b0 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40035070 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.879+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441a6ca0 con 0x7fea441048e0 2024-09-21T08:01:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.880+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea44104cf0 con 0x7fea441048e0 2024-09-21T08:01:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.882+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fea40042030 con 0x7fea441048e0 2024-09-21T08:01:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.883+0000 7fea3a7fc640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 0x7fea300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.883+0000 7fea48ebb640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 0x7fea300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.883+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fea401085d0 con 0x7fea441048e0 2024-09-21T08:01:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.884+0000 7fea48ebb640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 0x7fea300b8b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea4410fcf0 tx=0x7fea34005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:00.886+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea400ce860 con 0x7fea441048e0 2024-09-21T08:01:00.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:00 smithi119 ceph-mon[33564]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:01:00.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:00 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1593512798' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:00.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:00 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1378374219' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:01:00.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:00 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1948067410' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:00 smithi145 ceph-mon[34049]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:00 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1593512798' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:00 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1378374219' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:00 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1948067410' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.074+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fea44108e90 con 0x7fea441048e0 2024-09-21T08:01:01.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.074+0000 7fea3a7fc640 1 -- 172.21.15.6:0/1988716117 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v85) ==== 103+0+11 (secure 0 0 0) 0x7fea400d2c40 con 0x7fea441048e0 2024-09-21T08:01:01.076 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 msgr2=0x7fea300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 0x7fea300b8b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea4410fcf0 tx=0x7fea34005e50 comp rx=0 tx=0).stop 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 msgr2=0x7fea4419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fea40009230 tx=0x7fea40004270 comp rx=0 tx=0).stop 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 shutdown_connections 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fea300b65f0 0x7fea300b8b00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea4410dd40 0x7fea4419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea44105230 0x7fea4419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 --2- 172.21.15.6:0/1988716117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441048e0 0x7fea4419a2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 >> 172.21.15.6:0/1988716117 conn(0x7fea440fe3b0 msgr2=0x7fea440feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 shutdown_connections 2024-09-21T08:01:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.076+0000 7fea4b920640 1 -- 172.21.15.6:0/1988716117 wait complete. 2024-09-21T08:01:01.090 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T08:01:01.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:01.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:01 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2287825270' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:01 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1988716117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 -- 172.21.15.6:0/3885484862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7410de50 msgr2=0x7f0e74110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3885484862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7410de50 0x7f0e74110340 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009ca0 tx=0x7f0e6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 -- 172.21.15.6:0/3885484862 shutdown_connections 2024-09-21T08:01:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3885484862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7410de50 0x7f0e74110340 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3885484862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e74105340 0x7f0e7410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3885484862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e741049f0 0x7f0e74104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 -- 172.21.15.6:0/3885484862 >> 172.21.15.6:0/3885484862 conn(0x7f0e740797e0 msgr2=0x7f0e74079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 -- 172.21.15.6:0/3885484862 shutdown_connections 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.878+0000 7f0e79d25640 1 -- 172.21.15.6:0/3885484862 wait complete. 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 Processor -- start 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 -- start start 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e74105340 0x7f0e7419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e7410de50 0x7f0e7419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e741139d0 con 0x7f0e741049f0 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e74113850 con 0x7f0e7410de50 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e79d25640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0e74113b50 con 0x7f0e74105340 2024-09-21T08:01:01.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.879+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40110/0 (socket says 172.21.15.6:40110) 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 -- 172.21.15.6:0/3301988437 learned_addr learned my addr 172.21.15.6:0/3301988437 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e72ffd640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e74105340 0x7f0e7419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e73fff640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e7410de50 0x7f0e7419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 -- 172.21.15.6:0/3301988437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e74105340 msgr2=0x7f0e7419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e74105340 0x7f0e7419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 -- 172.21.15.6:0/3301988437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e7410de50 msgr2=0x7f0e7419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e7410de50 0x7f0e7419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 -- 172.21.15.6:0/3301988437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e741a0330 con 0x7f0e741049f0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e737fe640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c970 tx=0x7f0e6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004220 con 0x7f0e741049f0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e64007e40 con 0x7f0e741049f0 2024-09-21T08:01:01.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741a0620 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640047c0 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.880+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e741a6d80 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.881+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e74104e00 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.883+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f0e640079b0 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.884+0000 7f0e70ff9640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 0x7f0e5c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.884+0000 7f0e72ffd640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 0x7f0e5c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.884+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0e640e7bd0 con 0x7f0e741049f0 2024-09-21T08:01:01.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.885+0000 7f0e72ffd640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 0x7f0e5c0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e7410f920 tx=0x7f0e6800a4c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:01.891 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:01 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2287825270' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.891 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:01 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1988716117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:01.891+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e64014030 con 0x7f0e741049f0 2024-09-21T08:01:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:01 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2287825270' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:01:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:01 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1988716117' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:01:02.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.144+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e7419b4f0 con 0x7f0e741049f0 2024-09-21T08:01:02.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.144+0000 7f0e70ff9640 1 -- 172.21.15.6:0/3301988437 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f0e640ade60 con 0x7f0e741049f0 2024-09-21T08:01:02.147 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:02.147 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:02.147 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 msgr2=0x7f0e5c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 0x7f0e5c0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e7410f920 tx=0x7f0e6800a4c0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 msgr2=0x7f0e7419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c970 tx=0x7f0e6400ce30 comp rx=0 tx=0).stop 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 shutdown_connections 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e5c0b65f0 0x7f0e5c0b8b00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e74105340 0x7f0e7419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e7410de50 0x7f0e7419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 --2- 172.21.15.6:0/3301988437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e741049f0 0x7f0e7419a3c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 >> 172.21.15.6:0/3301988437 conn(0x7f0e740797e0 msgr2=0x7f0e74107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 shutdown_connections 2024-09-21T08:01:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.147+0000 7f0e79d25640 1 -- 172.21.15.6:0/3301988437 wait complete. 2024-09-21T08:01:02.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:02 smithi006 ceph-mon[30970]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:01:02.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3301988437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:02.792 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T08:01:02.792 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T08:01:02.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:01:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:02 smithi119 ceph-mon[33564]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:01:02.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3301988437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- 172.21.15.6:0/3934615840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 msgr2=0x7fe28c10d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3934615840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c10d790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe280009900 tx=0x7fe28002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- 172.21.15.6:0/3934615840 shutdown_connections 2024-09-21T08:01:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3934615840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c10dd60 0x7fe28c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3934615840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c10d790 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3934615840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c104900 0x7fe28c104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- 172.21.15.6:0/3934615840 >> 172.21.15.6:0/3934615840 conn(0x7fe28c0fe3b0 msgr2=0x7fe28c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- 172.21.15.6:0/3934615840 shutdown_connections 2024-09-21T08:01:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- 172.21.15.6:0/3934615840 wait complete. 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 Processor -- start 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.912+0000 7fe2928a9640 1 -- start start 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c104900 0x7fe28c19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 0x7fe28c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c113870 con 0x7fe28c105250 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1136f0 con 0x7fe28c10dd60 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe2928a9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1139f0 con 0x7fe28c104900 2024-09-21T08:01:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40132/0 (socket says 172.21.15.6:40132) 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 -- 172.21.15.6:0/3070080074 learned_addr learned my addr 172.21.15.6:0/3070080074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28bfff640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c104900 0x7fe28c19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe290e46640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 0x7fe28c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 -- 172.21.15.6:0/3070080074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c104900 msgr2=0x7fe28c19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c104900 0x7fe28c19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 -- 172.21.15.6:0/3070080074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 msgr2=0x7fe28c19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 0x7fe28c19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe28b7fe640 1 -- 172.21.15.6:0/3070080074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1a0280 con 0x7fe28c105250 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.913+0000 7fe290e46640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 0x7fe28c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe28b7fe640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe280005940 tx=0x7fe2800040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28003f030 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe280003a80 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c1a0510 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280035070 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.914+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c1a6d00 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.915+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c06c010 con 0x7fe28c105250 2024-09-21T08:01:02.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.917+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe280042030 con 0x7fe28c105250 2024-09-21T08:01:02.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.918+0000 7fe2897fa640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 0x7fe2740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.918+0000 7fe28bfff640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 0x7fe2740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.918+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe2801082e0 con 0x7fe28c105250 2024-09-21T08:01:02.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.918+0000 7fe28bfff640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 0x7fe2740b8b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bbe0 tx=0x7fe27c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:02.921+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2800ce570 con 0x7fe28c105250 2024-09-21T08:01:02.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:02 smithi145 ceph-mon[34049]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:01:02.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3301988437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:03.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.126+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe28c063800 con 0x7fe2740b65f0 2024-09-21T08:01:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.132+0000 7fe2897fa640 1 -- 172.21.15.6:0/3070080074 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340497 (secure 0 0 0) 0x7fe28c063800 con 0x7fe2740b65f0 2024-09-21T08:01:03.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 msgr2=0x7fe2740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 0x7fe2740b8b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bbe0 tx=0x7fe27c00b390 comp rx=0 tx=0).stop 2024-09-21T08:01:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 msgr2=0x7fe28c19a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe280005940 tx=0x7fe2800040e0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 shutdown_connections 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe2740b65f0 0x7fe2740b8b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe28c10dd60 0x7fe28c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c105250 0x7fe28c19a8f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 --2- 172.21.15.6:0/3070080074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe28c104900 0x7fe28c19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 >> 172.21.15.6:0/3070080074 conn(0x7fe28c0fe3b0 msgr2=0x7fe28c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 shutdown_connections 2024-09-21T08:01:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.136+0000 7fe2928a9640 1 -- 172.21.15.6:0/3070080074 wait complete. 2024-09-21T08:01:03.149 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-21T08:01:01.562376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":279,"num_read_kb":239,"num_write":213,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352372,"kb_used_data":11364,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589452,"statfs":{"total":1151940427776,"available":1151579598848,"internally_reserved":0,"allocated":11636736,"data_stored":7966573,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003491"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174094+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174094+0000","last_peered":"2024-09-21T08:00:04.174094+0000","last_clean":"2024-09-21T08:00:04.174094+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174094+0000","last_undegraded":"2024-09-21T08:00:04.174094+0000","last_fullsized":"2024-09-21T08:00:04.174094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336185+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:00:04.336185+0000","last_peered":"2024-09-21T08:00:04.336185+0000","last_clean":"2024-09-21T08:00:04.336185+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:00:04.336185+0000","last_undegraded":"2024-09-21T08:00:04.336185+0000","last_fullsized":"2024-09-21T08:00:04.336185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997572+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:00:03.997572+0000","last_peered":"2024-09-21T08:00:03.997572+0000","last_clean":"2024-09-21T08:00:03.997572+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:00:03.997572+0000","last_undegraded":"2024-09-21T08:00:03.997572+0000","last_fullsized":"2024-09-21T08:00:03.997572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216625+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:00:04.216625+0000","last_peered":"2024-09-21T08:00:04.216625+0000","last_clean":"2024-09-21T08:00:04.216625+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:00:04.216625+0000","last_undegraded":"2024-09-21T08:00:04.216625+0000","last_fullsized":"2024-09-21T08:00:04.216625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073035+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:00:04.073035+0000","last_peered":"2024-09-21T08:00:04.073035+0000","last_clean":"2024-09-21T08:00:04.073035+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:00:04.073035+0000","last_undegraded":"2024-09-21T08:00:04.073035+0000","last_fullsized":"2024-09-21T08:00:04.073035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994076+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:00:03.994076+0000","last_peered":"2024-09-21T08:00:03.994076+0000","last_clean":"2024-09-21T08:00:03.994076+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:00:03.994076+0000","last_undegraded":"2024-09-21T08:00:03.994076+0000","last_fullsized":"2024-09-21T08:00:03.994076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217221+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217221+0000","last_peered":"2024-09-21T08:00:04.217221+0000","last_clean":"2024-09-21T08:00:04.217221+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217221+0000","last_undegraded":"2024-09-21T08:00:04.217221+0000","last_fullsized":"2024-09-21T08:00:04.217221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335579+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:00:04.335579+0000","last_peered":"2024-09-21T08:00:04.335579+0000","last_clean":"2024-09-21T08:00:04.335579+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:00:04.335579+0000","last_undegraded":"2024-09-21T08:00:04.335579+0000","last_fullsized":"2024-09-21T08:00:04.335579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217462+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217462+0000","last_peered":"2024-09-21T08:00:04.217462+0000","last_clean":"2024-09-21T08:00:04.217462+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217462+0000","last_undegraded":"2024-09-21T08:00:04.217462+0000","last_fullsized":"2024-09-21T08:00:04.217462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998018+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:00:03.998018+0000","last_peered":"2024-09-21T08:00:03.998018+0000","last_clean":"2024-09-21T08:00:03.998018+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:00:03.998018+0000","last_undegraded":"2024-09-21T08:00:03.998018+0000","last_fullsized":"2024-09-21T08:00:03.998018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173844+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173844+0000","last_peered":"2024-09-21T08:00:04.173844+0000","last_clean":"2024-09-21T08:00:04.173844+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173844+0000","last_undegraded":"2024-09-21T08:00:04.173844+0000","last_fullsized":"2024-09-21T08:00:04.173844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084739+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:00:04.084739+0000","last_peered":"2024-09-21T08:00:04.084739+0000","last_clean":"2024-09-21T08:00:04.084739+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:00:04.084739+0000","last_undegraded":"2024-09-21T08:00:04.084739+0000","last_fullsized":"2024-09-21T08:00:04.084739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217949+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.217949+0000","last_peered":"2024-09-21T08:00:04.217949+0000","last_clean":"2024-09-21T08:00:04.217949+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.217949+0000","last_undegraded":"2024-09-21T08:00:04.217949+0000","last_fullsized":"2024-09-21T08:00:04.217949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220076+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:00:04.220076+0000","last_peered":"2024-09-21T08:00:04.220076+0000","last_clean":"2024-09-21T08:00:04.220076+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:00:04.220076+0000","last_undegraded":"2024-09-21T08:00:04.220076+0000","last_fullsized":"2024-09-21T08:00:04.220076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336168+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:00:04.336168+0000","last_peered":"2024-09-21T08:00:04.336168+0000","last_clean":"2024-09-21T08:00:04.336168+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:00:04.336168+0000","last_undegraded":"2024-09-21T08:00:04.336168+0000","last_fullsized":"2024-09-21T08:00:04.336168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173926+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:04.173926+0000","last_peered":"2024-09-21T08:00:04.173926+0000","last_clean":"2024-09-21T08:00:04.173926+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:04.173926+0000","last_undegraded":"2024-09-21T08:00:04.173926+0000","last_fullsized":"2024-09-21T08:00:04.173926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993942+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:00:03.993942+0000","last_peered":"2024-09-21T08:00:03.993942+0000","last_clean":"2024-09-21T08:00:03.993942+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:00:03.993942+0000","last_undegraded":"2024-09-21T08:00:03.993942+0000","last_fullsized":"2024-09-21T08:00:03.993942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217585+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:00:04.217585+0000","last_peered":"2024-09-21T08:00:04.217585+0000","last_clean":"2024-09-21T08:00:04.217585+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:00:04.217585+0000","last_undegraded":"2024-09-21T08:00:04.217585+0000","last_fullsized":"2024-09-21T08:00:04.217585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217390+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:00:04.217390+0000","last_peered":"2024-09-21T08:00:04.217390+0000","last_clean":"2024-09-21T08:00:04.217390+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:00:04.217390+0000","last_undegraded":"2024-09-21T08:00:04.217390+0000","last_fullsized":"2024-09-21T08:00:04.217390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072560+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:00:04.072560+0000","last_peered":"2024-09-21T08:00:04.072560+0000","last_clean":"2024-09-21T08:00:04.072560+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:00:04.072560+0000","last_undegraded":"2024-09-21T08:00:04.072560+0000","last_fullsized":"2024-09-21T08:00:04.072560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994017+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994017+0000","last_peered":"2024-09-21T08:00:03.994017+0000","last_clean":"2024-09-21T08:00:03.994017+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994017+0000","last_undegraded":"2024-09-21T08:00:03.994017+0000","last_fullsized":"2024-09-21T08:00:03.994017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993283+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:00:03.993283+0000","last_peered":"2024-09-21T08:00:03.993283+0000","last_clean":"2024-09-21T08:00:03.993283+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:00:03.993283+0000","last_undegraded":"2024-09-21T08:00:03.993283+0000","last_fullsized":"2024-09-21T08:00:03.993283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072929+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.072929+0000","last_peered":"2024-09-21T08:00:04.072929+0000","last_clean":"2024-09-21T08:00:04.072929+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.072929+0000","last_undegraded":"2024-09-21T08:00:04.072929+0000","last_fullsized":"2024-09-21T08:00:04.072929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335921+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:00:04.335921+0000","last_peered":"2024-09-21T08:00:04.335921+0000","last_clean":"2024-09-21T08:00:04.335921+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:00:04.335921+0000","last_undegraded":"2024-09-21T08:00:04.335921+0000","last_fullsized":"2024-09-21T08:00:04.335921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994628+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:00:03.994628+0000","last_peered":"2024-09-21T08:00:03.994628+0000","last_clean":"2024-09-21T08:00:03.994628+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:00:03.994628+0000","last_undegraded":"2024-09-21T08:00:03.994628+0000","last_fullsized":"2024-09-21T08:00:03.994628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216204+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216204+0000","last_peered":"2024-09-21T08:00:04.216204+0000","last_clean":"2024-09-21T08:00:04.216204+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216204+0000","last_undegraded":"2024-09-21T08:00:04.216204+0000","last_fullsized":"2024-09-21T08:00:04.216204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994346+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:00:03.994346+0000","last_peered":"2024-09-21T08:00:03.994346+0000","last_clean":"2024-09-21T08:00:03.994346+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:00:03.994346+0000","last_undegraded":"2024-09-21T08:00:03.994346+0000","last_fullsized":"2024-09-21T08:00:03.994346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073341+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:00:04.073341+0000","last_peered":"2024-09-21T08:00:04.073341+0000","last_clean":"2024-09-21T08:00:04.073341+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:00:04.073341+0000","last_undegraded":"2024-09-21T08:00:04.073341+0000","last_fullsized":"2024-09-21T08:00:04.073341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994447+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:00:03.994447+0000","last_peered":"2024-09-21T08:00:03.994447+0000","last_clean":"2024-09-21T08:00:03.994447+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:00:03.994447+0000","last_undegraded":"2024-09-21T08:00:03.994447+0000","last_fullsized":"2024-09-21T08:00:03.994447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072262+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072262+0000","last_peered":"2024-09-21T08:00:04.072262+0000","last_clean":"2024-09-21T08:00:04.072262+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072262+0000","last_undegraded":"2024-09-21T08:00:04.072262+0000","last_fullsized":"2024-09-21T08:00:04.072262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220043+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:00:04.220043+0000","last_peered":"2024-09-21T08:00:04.220043+0000","last_clean":"2024-09-21T08:00:04.220043+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:00:04.220043+0000","last_undegraded":"2024-09-21T08:00:04.220043+0000","last_fullsized":"2024-09-21T08:00:04.220043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072350+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072350+0000","last_peered":"2024-09-21T08:00:04.072350+0000","last_clean":"2024-09-21T08:00:04.072350+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072350+0000","last_undegraded":"2024-09-21T08:00:04.072350+0000","last_fullsized":"2024-09-21T08:00:04.072350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072584+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:00:04.072584+0000","last_peered":"2024-09-21T08:00:04.072584+0000","last_clean":"2024-09-21T08:00:04.072584+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:00:04.072584+0000","last_undegraded":"2024-09-21T08:00:04.072584+0000","last_fullsized":"2024-09-21T08:00:04.072584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084599+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084599+0000","last_peered":"2024-09-21T08:00:04.084599+0000","last_clean":"2024-09-21T08:00:04.084599+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084599+0000","last_undegraded":"2024-09-21T08:00:04.084599+0000","last_fullsized":"2024-09-21T08:00:04.084599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993780+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:00:03.993780+0000","last_peered":"2024-09-21T08:00:03.993780+0000","last_clean":"2024-09-21T08:00:03.993780+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:00:03.993780+0000","last_undegraded":"2024-09-21T08:00:03.993780+0000","last_fullsized":"2024-09-21T08:00:03.993780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217468+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217468+0000","last_peered":"2024-09-21T08:00:04.217468+0000","last_clean":"2024-09-21T08:00:04.217468+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217468+0000","last_undegraded":"2024-09-21T08:00:04.217468+0000","last_fullsized":"2024-09-21T08:00:04.217468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994176+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:00:03.994176+0000","last_peered":"2024-09-21T08:00:03.994176+0000","last_clean":"2024-09-21T08:00:03.994176+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:00:03.994176+0000","last_undegraded":"2024-09-21T08:00:03.994176+0000","last_fullsized":"2024-09-21T08:00:03.994176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072796+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072796+0000","last_peered":"2024-09-21T08:00:04.072796+0000","last_clean":"2024-09-21T08:00:04.072796+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072796+0000","last_undegraded":"2024-09-21T08:00:04.072796+0000","last_fullsized":"2024-09-21T08:00:04.072796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993591+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:00:03.993591+0000","last_peered":"2024-09-21T08:00:03.993591+0000","last_clean":"2024-09-21T08:00:03.993591+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:00:03.993591+0000","last_undegraded":"2024-09-21T08:00:03.993591+0000","last_fullsized":"2024-09-21T08:00:03.993591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994222+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994222+0000","last_peered":"2024-09-21T08:00:03.994222+0000","last_clean":"2024-09-21T08:00:03.994222+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994222+0000","last_undegraded":"2024-09-21T08:00:03.994222+0000","last_fullsized":"2024-09-21T08:00:03.994222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085070+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:00:04.085070+0000","last_peered":"2024-09-21T08:00:04.085070+0000","last_clean":"2024-09-21T08:00:04.085070+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:00:04.085070+0000","last_undegraded":"2024-09-21T08:00:04.085070+0000","last_fullsized":"2024-09-21T08:00:04.085070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:57.833873+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:00:57.833873+0000","last_peered":"2024-09-21T08:00:57.833873+0000","last_clean":"2024-09-21T08:00:57.833873+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:00:57.833873+0000","last_undegraded":"2024-09-21T08:00:57.833873+0000","last_fullsized":"2024-09-21T08:00:57.833873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":164,"num_write":32,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216770+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:00:04.216770+0000","last_peered":"2024-09-21T08:00:04.216770+0000","last_clean":"2024-09-21T08:00:04.216770+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:00:04.216770+0000","last_undegraded":"2024-09-21T08:00:04.216770+0000","last_fullsized":"2024-09-21T08:00:04.216770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073275+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073275+0000","last_peered":"2024-09-21T08:00:04.073275+0000","last_clean":"2024-09-21T08:00:04.073275+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073275+0000","last_undegraded":"2024-09-21T08:00:04.073275+0000","last_fullsized":"2024-09-21T08:00:04.073275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997633+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:00:03.997633+0000","last_peered":"2024-09-21T08:00:03.997633+0000","last_clean":"2024-09-21T08:00:03.997633+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:00:03.997633+0000","last_undegraded":"2024-09-21T08:00:03.997633+0000","last_fullsized":"2024-09-21T08:00:03.997633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217384+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:00:04.217384+0000","last_peered":"2024-09-21T08:00:04.217384+0000","last_clean":"2024-09-21T08:00:04.217384+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:00:04.217384+0000","last_undegraded":"2024-09-21T08:00:04.217384+0000","last_fullsized":"2024-09-21T08:00:04.217384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217377+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217377+0000","last_peered":"2024-09-21T08:00:04.217377+0000","last_clean":"2024-09-21T08:00:04.217377+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217377+0000","last_undegraded":"2024-09-21T08:00:04.217377+0000","last_fullsized":"2024-09-21T08:00:04.217377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173242+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:00:04.173242+0000","last_peered":"2024-09-21T08:00:04.173242+0000","last_clean":"2024-09-21T08:00:04.173242+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:00:04.173242+0000","last_undegraded":"2024-09-21T08:00:04.173242+0000","last_fullsized":"2024-09-21T08:00:04.173242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072745+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072745+0000","last_peered":"2024-09-21T08:00:04.072745+0000","last_clean":"2024-09-21T08:00:04.072745+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072745+0000","last_undegraded":"2024-09-21T08:00:04.072745+0000","last_fullsized":"2024-09-21T08:00:04.072745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335429+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:00:04.335429+0000","last_peered":"2024-09-21T08:00:04.335429+0000","last_clean":"2024-09-21T08:00:04.335429+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:00:04.335429+0000","last_undegraded":"2024-09-21T08:00:04.335429+0000","last_fullsized":"2024-09-21T08:00:04.335429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993345+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993345+0000","last_peered":"2024-09-21T08:00:03.993345+0000","last_clean":"2024-09-21T08:00:03.993345+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993345+0000","last_undegraded":"2024-09-21T08:00:03.993345+0000","last_fullsized":"2024-09-21T08:00:03.993345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072755+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:00:04.072755+0000","last_peered":"2024-09-21T08:00:04.072755+0000","last_clean":"2024-09-21T08:00:04.072755+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:00:04.072755+0000","last_undegraded":"2024-09-21T08:00:04.072755+0000","last_fullsized":"2024-09-21T08:00:04.072755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084623+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:00:04.084623+0000","last_peered":"2024-09-21T08:00:04.084623+0000","last_clean":"2024-09-21T08:00:04.084623+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:00:04.084623+0000","last_undegraded":"2024-09-21T08:00:04.084623+0000","last_fullsized":"2024-09-21T08:00:04.084623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997955+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:00:03.997955+0000","last_peered":"2024-09-21T08:00:03.997955+0000","last_clean":"2024-09-21T08:00:03.997955+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:00:03.997955+0000","last_undegraded":"2024-09-21T08:00:03.997955+0000","last_fullsized":"2024-09-21T08:00:03.997955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994731+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:00:03.994731+0000","last_peered":"2024-09-21T08:00:03.994731+0000","last_clean":"2024-09-21T08:00:03.994731+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:00:03.994731+0000","last_undegraded":"2024-09-21T08:00:03.994731+0000","last_fullsized":"2024-09-21T08:00:03.994731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994068+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:00:03.994068+0000","last_peered":"2024-09-21T08:00:03.994068+0000","last_clean":"2024-09-21T08:00:03.994068+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:00:03.994068+0000","last_undegraded":"2024-09-21T08:00:03.994068+0000","last_fullsized":"2024-09-21T08:00:03.994068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996376+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:00:03.996376+0000","last_peered":"2024-09-21T08:00:03.996376+0000","last_clean":"2024-09-21T08:00:03.996376+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:00:03.996376+0000","last_undegraded":"2024-09-21T08:00:03.996376+0000","last_fullsized":"2024-09-21T08:00:03.996376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993932+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:00:03.993932+0000","last_peered":"2024-09-21T08:00:03.993932+0000","last_clean":"2024-09-21T08:00:03.993932+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:00:03.993932+0000","last_undegraded":"2024-09-21T08:00:03.993932+0000","last_fullsized":"2024-09-21T08:00:03.993932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.175055+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:00:04.175055+0000","last_peered":"2024-09-21T08:00:04.175055+0000","last_clean":"2024-09-21T08:00:04.175055+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:00:04.175055+0000","last_undegraded":"2024-09-21T08:00:04.175055+0000","last_fullsized":"2024-09-21T08:00:04.175055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994402+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:00:03.994402+0000","last_peered":"2024-09-21T08:00:03.994402+0000","last_clean":"2024-09-21T08:00:03.994402+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:00:03.994402+0000","last_undegraded":"2024-09-21T08:00:03.994402+0000","last_fullsized":"2024-09-21T08:00:03.994402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336120+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:00:04.336120+0000","last_peered":"2024-09-21T08:00:04.336120+0000","last_clean":"2024-09-21T08:00:04.336120+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:00:04.336120+0000","last_undegraded":"2024-09-21T08:00:04.336120+0000","last_fullsized":"2024-09-21T08:00:04.336120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072544+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:00:04.072544+0000","last_peered":"2024-09-21T08:00:04.072544+0000","last_clean":"2024-09-21T08:00:04.072544+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:00:04.072544+0000","last_undegraded":"2024-09-21T08:00:04.072544+0000","last_fullsized":"2024-09-21T08:00:04.072544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335638+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:00:04.335638+0000","last_peered":"2024-09-21T08:00:04.335638+0000","last_clean":"2024-09-21T08:00:04.335638+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:00:04.335638+0000","last_undegraded":"2024-09-21T08:00:04.335638+0000","last_fullsized":"2024-09-21T08:00:04.335638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216644+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:00:04.216644+0000","last_peered":"2024-09-21T08:00:04.216644+0000","last_clean":"2024-09-21T08:00:04.216644+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:00:04.216644+0000","last_undegraded":"2024-09-21T08:00:04.216644+0000","last_fullsized":"2024-09-21T08:00:04.216644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993593+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:00:03.993593+0000","last_peered":"2024-09-21T08:00:03.993593+0000","last_clean":"2024-09-21T08:00:03.993593+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:00:03.993593+0000","last_undegraded":"2024-09-21T08:00:03.993593+0000","last_fullsized":"2024-09-21T08:00:03.993593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998191+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:00:03.998191+0000","last_peered":"2024-09-21T08:00:03.998191+0000","last_clean":"2024-09-21T08:00:03.998191+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:00:03.998191+0000","last_undegraded":"2024-09-21T08:00:03.998191+0000","last_fullsized":"2024-09-21T08:00:03.998191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994637+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:00:03.994637+0000","last_peered":"2024-09-21T08:00:03.994637+0000","last_clean":"2024-09-21T08:00:03.994637+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:00:03.994637+0000","last_undegraded":"2024-09-21T08:00:03.994637+0000","last_fullsized":"2024-09-21T08:00:03.994637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173852+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:00:04.173852+0000","last_peered":"2024-09-21T08:00:04.173852+0000","last_clean":"2024-09-21T08:00:04.173852+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:00:04.173852+0000","last_undegraded":"2024-09-21T08:00:04.173852+0000","last_fullsized":"2024-09-21T08:00:04.173852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998621+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:00:03.998621+0000","last_peered":"2024-09-21T08:00:03.998621+0000","last_clean":"2024-09-21T08:00:03.998621+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:00:03.998621+0000","last_undegraded":"2024-09-21T08:00:03.998621+0000","last_fullsized":"2024-09-21T08:00:03.998621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216277+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:00:04.216277+0000","last_peered":"2024-09-21T08:00:04.216277+0000","last_clean":"2024-09-21T08:00:04.216277+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:00:04.216277+0000","last_undegraded":"2024-09-21T08:00:04.216277+0000","last_fullsized":"2024-09-21T08:00:04.216277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998478+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:00:03.998478+0000","last_peered":"2024-09-21T08:00:03.998478+0000","last_clean":"2024-09-21T08:00:03.998478+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:00:03.998478+0000","last_undegraded":"2024-09-21T08:00:03.998478+0000","last_fullsized":"2024-09-21T08:00:03.998478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996090+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:00:03.996090+0000","last_peered":"2024-09-21T08:00:03.996090+0000","last_clean":"2024-09-21T08:00:03.996090+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:00:03.996090+0000","last_undegraded":"2024-09-21T08:00:03.996090+0000","last_fullsized":"2024-09-21T08:00:03.996090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993526+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:00:03.993526+0000","last_peered":"2024-09-21T08:00:03.993526+0000","last_clean":"2024-09-21T08:00:03.993526+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:00:03.993526+0000","last_undegraded":"2024-09-21T08:00:03.993526+0000","last_fullsized":"2024-09-21T08:00:03.993526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173531+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:00:04.173531+0000","last_peered":"2024-09-21T08:00:04.173531+0000","last_clean":"2024-09-21T08:00:04.173531+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:00:04.173531+0000","last_undegraded":"2024-09-21T08:00:04.173531+0000","last_fullsized":"2024-09-21T08:00:04.173531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994496+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:00:03.994496+0000","last_peered":"2024-09-21T08:00:03.994496+0000","last_clean":"2024-09-21T08:00:03.994496+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:00:03.994496+0000","last_undegraded":"2024-09-21T08:00:03.994496+0000","last_fullsized":"2024-09-21T08:00:03.994496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216906+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:00:04.216906+0000","last_peered":"2024-09-21T08:00:04.216906+0000","last_clean":"2024-09-21T08:00:04.216906+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:00:04.216906+0000","last_undegraded":"2024-09-21T08:00:04.216906+0000","last_fullsized":"2024-09-21T08:00:04.216906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216766+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:00:04.216766+0000","last_peered":"2024-09-21T08:00:04.216766+0000","last_clean":"2024-09-21T08:00:04.216766+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:00:04.216766+0000","last_undegraded":"2024-09-21T08:00:04.216766+0000","last_fullsized":"2024-09-21T08:00:04.216766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993837+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:00:03.993837+0000","last_peered":"2024-09-21T08:00:03.993837+0000","last_clean":"2024-09-21T08:00:03.993837+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:00:03.993837+0000","last_undegraded":"2024-09-21T08:00:03.993837+0000","last_fullsized":"2024-09-21T08:00:03.993837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217005+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:00:04.217005+0000","last_peered":"2024-09-21T08:00:04.217005+0000","last_clean":"2024-09-21T08:00:04.217005+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:00:04.217005+0000","last_undegraded":"2024-09-21T08:00:04.217005+0000","last_fullsized":"2024-09-21T08:00:04.217005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084504+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:00:04.084504+0000","last_peered":"2024-09-21T08:00:04.084504+0000","last_clean":"2024-09-21T08:00:04.084504+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:00:04.084504+0000","last_undegraded":"2024-09-21T08:00:04.084504+0000","last_fullsized":"2024-09-21T08:00:04.084504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217637+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:00:04.217637+0000","last_peered":"2024-09-21T08:00:04.217637+0000","last_clean":"2024-09-21T08:00:04.217637+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:00:04.217637+0000","last_undegraded":"2024-09-21T08:00:04.217637+0000","last_fullsized":"2024-09-21T08:00:04.217637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998667+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:00:03.998667+0000","last_peered":"2024-09-21T08:00:03.998667+0000","last_clean":"2024-09-21T08:00:03.998667+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:00:03.998667+0000","last_undegraded":"2024-09-21T08:00:03.998667+0000","last_fullsized":"2024-09-21T08:00:03.998667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997007+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:00:03.997007+0000","last_peered":"2024-09-21T08:00:03.997007+0000","last_clean":"2024-09-21T08:00:03.997007+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:00:03.997007+0000","last_undegraded":"2024-09-21T08:00:03.997007+0000","last_fullsized":"2024-09-21T08:00:03.997007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998603+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:00:03.998603+0000","last_peered":"2024-09-21T08:00:03.998603+0000","last_clean":"2024-09-21T08:00:03.998603+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:00:03.998603+0000","last_undegraded":"2024-09-21T08:00:03.998603+0000","last_fullsized":"2024-09-21T08:00:03.998603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":88,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":215021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939693,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":1155469,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299448,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462972,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626498,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":1086190,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":569767,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542236,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":564907,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:03.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:01:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.302+0000 7fd94cac5640 1 -- 172.21.15.6:0/837483538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948101d50 msgr2=0x7fd948102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 --2- 172.21.15.6:0/837483538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948101d50 0x7fd948102160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd930009900 tx=0x7fd93002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 -- 172.21.15.6:0/837483538 shutdown_connections 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 --2- 172.21.15.6:0/837483538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481026a0 0x7fd9481104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 --2- 172.21.15.6:0/837483538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948101d50 0x7fd948102160 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 --2- 172.21.15.6:0/837483538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd948108670 0x7fd948108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 -- 172.21.15.6:0/837483538 >> 172.21.15.6:0/837483538 conn(0x7fd948079d00 msgr2=0x7fd94807a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 -- 172.21.15.6:0/837483538 shutdown_connections 2024-09-21T08:01:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 -- 172.21.15.6:0/837483538 wait complete. 2024-09-21T08:01:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.303+0000 7fd94cac5640 1 Processor -- start 2024-09-21T08:01:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 -- start start 2024-09-21T08:01:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd948101d50 0x7fd94819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9481026a0 0x7fd94819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481138c0 con 0x7fd948108670 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd948113740 con 0x7fd948101d50 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94cac5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd948113a40 con 0x7fd9481026a0 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40152/0 (socket says 172.21.15.6:40152) 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 -- 172.21.15.6:0/4262866381 learned_addr learned my addr 172.21.15.6:0/4262866381 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd94659c640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd948101d50 0x7fd94819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd945d9b640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9481026a0 0x7fd94819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 -- 172.21.15.6:0/4262866381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9481026a0 msgr2=0x7fd94819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9481026a0 0x7fd94819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 -- 172.21.15.6:0/4262866381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd948101d50 msgr2=0x7fd94819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd948101d50 0x7fd94819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 -- 172.21.15.6:0/4262866381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9481a02d0 con 0x7fd948108670 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.304+0000 7fd946d9d640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd94000dac0 tx=0x7fd94000df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.305+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940017070 con 0x7fd948108670 2024-09-21T08:01:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.305+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd94000be30 con 0x7fd948108670 2024-09-21T08:01:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.305+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9481a05c0 con 0x7fd948108670 2024-09-21T08:01:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.305+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940010460 con 0x7fd948108670 2024-09-21T08:01:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.305+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9481a6d50 con 0x7fd948108670 2024-09-21T08:01:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.306+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd948102160 con 0x7fd948108670 2024-09-21T08:01:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.308+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fd940004a40 con 0x7fd948108670 2024-09-21T08:01:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.309+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 0x7fd9340b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.309+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fd9400e76c0 con 0x7fd948108670 2024-09-21T08:01:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.309+0000 7fd94659c640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 0x7fd9340b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.310+0000 7fd94659c640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 0x7fd9340b8b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd938005fd0 tx=0x7fd93800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.312+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9400ad970 con 0x7fd948108670 2024-09-21T08:01:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.497+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd948063800 con 0x7fd9340b6670 2024-09-21T08:01:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.503+0000 7fd93f7fe640 1 -- 172.21.15.6:0/4262866381 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340497 (secure 0 0 0) 0x7fd948063800 con 0x7fd9340b6670 2024-09-21T08:01:03.508 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 msgr2=0x7fd9340b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 0x7fd9340b8b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd938005fd0 tx=0x7fd93800b390 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 msgr2=0x7fd94819fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd94000dac0 tx=0x7fd94000df80 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 shutdown_connections 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9340b6670 0x7fd9340b8b80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9481026a0 0x7fd94819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd948108670 0x7fd94819fbd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 --2- 172.21.15.6:0/4262866381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd948101d50 0x7fd94819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 >> 172.21.15.6:0/4262866381 conn(0x7fd948079d00 msgr2=0x7fd9481052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 shutdown_connections 2024-09-21T08:01:03.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.507+0000 7fd94cac5640 1 -- 172.21.15.6:0/4262866381 wait complete. 2024-09-21T08:01:03.520 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-21T08:01:01.562376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":279,"num_read_kb":239,"num_write":213,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352372,"kb_used_data":11364,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589452,"statfs":{"total":1151940427776,"available":1151579598848,"internally_reserved":0,"allocated":11636736,"data_stored":7966573,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003491"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174094+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174094+0000","last_peered":"2024-09-21T08:00:04.174094+0000","last_clean":"2024-09-21T08:00:04.174094+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174094+0000","last_undegraded":"2024-09-21T08:00:04.174094+0000","last_fullsized":"2024-09-21T08:00:04.174094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336185+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:00:04.336185+0000","last_peered":"2024-09-21T08:00:04.336185+0000","last_clean":"2024-09-21T08:00:04.336185+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:00:04.336185+0000","last_undegraded":"2024-09-21T08:00:04.336185+0000","last_fullsized":"2024-09-21T08:00:04.336185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997572+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:00:03.997572+0000","last_peered":"2024-09-21T08:00:03.997572+0000","last_clean":"2024-09-21T08:00:03.997572+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:00:03.997572+0000","last_undegraded":"2024-09-21T08:00:03.997572+0000","last_fullsized":"2024-09-21T08:00:03.997572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216625+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:00:04.216625+0000","last_peered":"2024-09-21T08:00:04.216625+0000","last_clean":"2024-09-21T08:00:04.216625+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:00:04.216625+0000","last_undegraded":"2024-09-21T08:00:04.216625+0000","last_fullsized":"2024-09-21T08:00:04.216625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073035+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:00:04.073035+0000","last_peered":"2024-09-21T08:00:04.073035+0000","last_clean":"2024-09-21T08:00:04.073035+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:00:04.073035+0000","last_undegraded":"2024-09-21T08:00:04.073035+0000","last_fullsized":"2024-09-21T08:00:04.073035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994076+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:00:03.994076+0000","last_peered":"2024-09-21T08:00:03.994076+0000","last_clean":"2024-09-21T08:00:03.994076+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:00:03.994076+0000","last_undegraded":"2024-09-21T08:00:03.994076+0000","last_fullsized":"2024-09-21T08:00:03.994076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217221+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217221+0000","last_peered":"2024-09-21T08:00:04.217221+0000","last_clean":"2024-09-21T08:00:04.217221+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217221+0000","last_undegraded":"2024-09-21T08:00:04.217221+0000","last_fullsized":"2024-09-21T08:00:04.217221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335579+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:00:04.335579+0000","last_peered":"2024-09-21T08:00:04.335579+0000","last_clean":"2024-09-21T08:00:04.335579+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:00:04.335579+0000","last_undegraded":"2024-09-21T08:00:04.335579+0000","last_fullsized":"2024-09-21T08:00:04.335579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217462+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217462+0000","last_peered":"2024-09-21T08:00:04.217462+0000","last_clean":"2024-09-21T08:00:04.217462+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217462+0000","last_undegraded":"2024-09-21T08:00:04.217462+0000","last_fullsized":"2024-09-21T08:00:04.217462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998018+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:00:03.998018+0000","last_peered":"2024-09-21T08:00:03.998018+0000","last_clean":"2024-09-21T08:00:03.998018+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:00:03.998018+0000","last_undegraded":"2024-09-21T08:00:03.998018+0000","last_fullsized":"2024-09-21T08:00:03.998018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173844+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173844+0000","last_peered":"2024-09-21T08:00:04.173844+0000","last_clean":"2024-09-21T08:00:04.173844+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173844+0000","last_undegraded":"2024-09-21T08:00:04.173844+0000","last_fullsized":"2024-09-21T08:00:04.173844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084739+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:00:04.084739+0000","last_peered":"2024-09-21T08:00:04.084739+0000","last_clean":"2024-09-21T08:00:04.084739+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:00:04.084739+0000","last_undegraded":"2024-09-21T08:00:04.084739+0000","last_fullsized":"2024-09-21T08:00:04.084739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217949+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.217949+0000","last_peered":"2024-09-21T08:00:04.217949+0000","last_clean":"2024-09-21T08:00:04.217949+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.217949+0000","last_undegraded":"2024-09-21T08:00:04.217949+0000","last_fullsized":"2024-09-21T08:00:04.217949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220076+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:00:04.220076+0000","last_peered":"2024-09-21T08:00:04.220076+0000","last_clean":"2024-09-21T08:00:04.220076+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:00:04.220076+0000","last_undegraded":"2024-09-21T08:00:04.220076+0000","last_fullsized":"2024-09-21T08:00:04.220076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336168+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:00:04.336168+0000","last_peered":"2024-09-21T08:00:04.336168+0000","last_clean":"2024-09-21T08:00:04.336168+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:00:04.336168+0000","last_undegraded":"2024-09-21T08:00:04.336168+0000","last_fullsized":"2024-09-21T08:00:04.336168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173926+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:04.173926+0000","last_peered":"2024-09-21T08:00:04.173926+0000","last_clean":"2024-09-21T08:00:04.173926+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:04.173926+0000","last_undegraded":"2024-09-21T08:00:04.173926+0000","last_fullsized":"2024-09-21T08:00:04.173926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993942+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:00:03.993942+0000","last_peered":"2024-09-21T08:00:03.993942+0000","last_clean":"2024-09-21T08:00:03.993942+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:00:03.993942+0000","last_undegraded":"2024-09-21T08:00:03.993942+0000","last_fullsized":"2024-09-21T08:00:03.993942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217585+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:00:04.217585+0000","last_peered":"2024-09-21T08:00:04.217585+0000","last_clean":"2024-09-21T08:00:04.217585+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:00:04.217585+0000","last_undegraded":"2024-09-21T08:00:04.217585+0000","last_fullsized":"2024-09-21T08:00:04.217585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217390+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:00:04.217390+0000","last_peered":"2024-09-21T08:00:04.217390+0000","last_clean":"2024-09-21T08:00:04.217390+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:00:04.217390+0000","last_undegraded":"2024-09-21T08:00:04.217390+0000","last_fullsized":"2024-09-21T08:00:04.217390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072560+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:00:04.072560+0000","last_peered":"2024-09-21T08:00:04.072560+0000","last_clean":"2024-09-21T08:00:04.072560+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:00:04.072560+0000","last_undegraded":"2024-09-21T08:00:04.072560+0000","last_fullsized":"2024-09-21T08:00:04.072560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994017+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994017+0000","last_peered":"2024-09-21T08:00:03.994017+0000","last_clean":"2024-09-21T08:00:03.994017+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994017+0000","last_undegraded":"2024-09-21T08:00:03.994017+0000","last_fullsized":"2024-09-21T08:00:03.994017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993283+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:00:03.993283+0000","last_peered":"2024-09-21T08:00:03.993283+0000","last_clean":"2024-09-21T08:00:03.993283+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:00:03.993283+0000","last_undegraded":"2024-09-21T08:00:03.993283+0000","last_fullsized":"2024-09-21T08:00:03.993283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072929+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.072929+0000","last_peered":"2024-09-21T08:00:04.072929+0000","last_clean":"2024-09-21T08:00:04.072929+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.072929+0000","last_undegraded":"2024-09-21T08:00:04.072929+0000","last_fullsized":"2024-09-21T08:00:04.072929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335921+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:00:04.335921+0000","last_peered":"2024-09-21T08:00:04.335921+0000","last_clean":"2024-09-21T08:00:04.335921+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:00:04.335921+0000","last_undegraded":"2024-09-21T08:00:04.335921+0000","last_fullsized":"2024-09-21T08:00:04.335921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994628+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:00:03.994628+0000","last_peered":"2024-09-21T08:00:03.994628+0000","last_clean":"2024-09-21T08:00:03.994628+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:00:03.994628+0000","last_undegraded":"2024-09-21T08:00:03.994628+0000","last_fullsized":"2024-09-21T08:00:03.994628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216204+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216204+0000","last_peered":"2024-09-21T08:00:04.216204+0000","last_clean":"2024-09-21T08:00:04.216204+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216204+0000","last_undegraded":"2024-09-21T08:00:04.216204+0000","last_fullsized":"2024-09-21T08:00:04.216204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994346+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:00:03.994346+0000","last_peered":"2024-09-21T08:00:03.994346+0000","last_clean":"2024-09-21T08:00:03.994346+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:00:03.994346+0000","last_undegraded":"2024-09-21T08:00:03.994346+0000","last_fullsized":"2024-09-21T08:00:03.994346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073341+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:00:04.073341+0000","last_peered":"2024-09-21T08:00:04.073341+0000","last_clean":"2024-09-21T08:00:04.073341+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:00:04.073341+0000","last_undegraded":"2024-09-21T08:00:04.073341+0000","last_fullsized":"2024-09-21T08:00:04.073341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994447+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:00:03.994447+0000","last_peered":"2024-09-21T08:00:03.994447+0000","last_clean":"2024-09-21T08:00:03.994447+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:00:03.994447+0000","last_undegraded":"2024-09-21T08:00:03.994447+0000","last_fullsized":"2024-09-21T08:00:03.994447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072262+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072262+0000","last_peered":"2024-09-21T08:00:04.072262+0000","last_clean":"2024-09-21T08:00:04.072262+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072262+0000","last_undegraded":"2024-09-21T08:00:04.072262+0000","last_fullsized":"2024-09-21T08:00:04.072262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220043+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:00:04.220043+0000","last_peered":"2024-09-21T08:00:04.220043+0000","last_clean":"2024-09-21T08:00:04.220043+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:00:04.220043+0000","last_undegraded":"2024-09-21T08:00:04.220043+0000","last_fullsized":"2024-09-21T08:00:04.220043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072350+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072350+0000","last_peered":"2024-09-21T08:00:04.072350+0000","last_clean":"2024-09-21T08:00:04.072350+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072350+0000","last_undegraded":"2024-09-21T08:00:04.072350+0000","last_fullsized":"2024-09-21T08:00:04.072350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072584+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:00:04.072584+0000","last_peered":"2024-09-21T08:00:04.072584+0000","last_clean":"2024-09-21T08:00:04.072584+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:00:04.072584+0000","last_undegraded":"2024-09-21T08:00:04.072584+0000","last_fullsized":"2024-09-21T08:00:04.072584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084599+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084599+0000","last_peered":"2024-09-21T08:00:04.084599+0000","last_clean":"2024-09-21T08:00:04.084599+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084599+0000","last_undegraded":"2024-09-21T08:00:04.084599+0000","last_fullsized":"2024-09-21T08:00:04.084599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993780+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:00:03.993780+0000","last_peered":"2024-09-21T08:00:03.993780+0000","last_clean":"2024-09-21T08:00:03.993780+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:00:03.993780+0000","last_undegraded":"2024-09-21T08:00:03.993780+0000","last_fullsized":"2024-09-21T08:00:03.993780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217468+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217468+0000","last_peered":"2024-09-21T08:00:04.217468+0000","last_clean":"2024-09-21T08:00:04.217468+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217468+0000","last_undegraded":"2024-09-21T08:00:04.217468+0000","last_fullsized":"2024-09-21T08:00:04.217468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994176+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:00:03.994176+0000","last_peered":"2024-09-21T08:00:03.994176+0000","last_clean":"2024-09-21T08:00:03.994176+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:00:03.994176+0000","last_undegraded":"2024-09-21T08:00:03.994176+0000","last_fullsized":"2024-09-21T08:00:03.994176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072796+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072796+0000","last_peered":"2024-09-21T08:00:04.072796+0000","last_clean":"2024-09-21T08:00:04.072796+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072796+0000","last_undegraded":"2024-09-21T08:00:04.072796+0000","last_fullsized":"2024-09-21T08:00:04.072796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993591+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:00:03.993591+0000","last_peered":"2024-09-21T08:00:03.993591+0000","last_clean":"2024-09-21T08:00:03.993591+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:00:03.993591+0000","last_undegraded":"2024-09-21T08:00:03.993591+0000","last_fullsized":"2024-09-21T08:00:03.993591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994222+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994222+0000","last_peered":"2024-09-21T08:00:03.994222+0000","last_clean":"2024-09-21T08:00:03.994222+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994222+0000","last_undegraded":"2024-09-21T08:00:03.994222+0000","last_fullsized":"2024-09-21T08:00:03.994222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085070+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:00:04.085070+0000","last_peered":"2024-09-21T08:00:04.085070+0000","last_clean":"2024-09-21T08:00:04.085070+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:00:04.085070+0000","last_undegraded":"2024-09-21T08:00:04.085070+0000","last_fullsized":"2024-09-21T08:00:04.085070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:57.833873+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:00:57.833873+0000","last_peered":"2024-09-21T08:00:57.833873+0000","last_clean":"2024-09-21T08:00:57.833873+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:00:57.833873+0000","last_undegraded":"2024-09-21T08:00:57.833873+0000","last_fullsized":"2024-09-21T08:00:57.833873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":164,"num_write":32,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216770+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:00:04.216770+0000","last_peered":"2024-09-21T08:00:04.216770+0000","last_clean":"2024-09-21T08:00:04.216770+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:00:04.216770+0000","last_undegraded":"2024-09-21T08:00:04.216770+0000","last_fullsized":"2024-09-21T08:00:04.216770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073275+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073275+0000","last_peered":"2024-09-21T08:00:04.073275+0000","last_clean":"2024-09-21T08:00:04.073275+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073275+0000","last_undegraded":"2024-09-21T08:00:04.073275+0000","last_fullsized":"2024-09-21T08:00:04.073275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997633+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:00:03.997633+0000","last_peered":"2024-09-21T08:00:03.997633+0000","last_clean":"2024-09-21T08:00:03.997633+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:00:03.997633+0000","last_undegraded":"2024-09-21T08:00:03.997633+0000","last_fullsized":"2024-09-21T08:00:03.997633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217384+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:00:04.217384+0000","last_peered":"2024-09-21T08:00:04.217384+0000","last_clean":"2024-09-21T08:00:04.217384+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:00:04.217384+0000","last_undegraded":"2024-09-21T08:00:04.217384+0000","last_fullsized":"2024-09-21T08:00:04.217384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217377+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217377+0000","last_peered":"2024-09-21T08:00:04.217377+0000","last_clean":"2024-09-21T08:00:04.217377+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217377+0000","last_undegraded":"2024-09-21T08:00:04.217377+0000","last_fullsized":"2024-09-21T08:00:04.217377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173242+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:00:04.173242+0000","last_peered":"2024-09-21T08:00:04.173242+0000","last_clean":"2024-09-21T08:00:04.173242+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:00:04.173242+0000","last_undegraded":"2024-09-21T08:00:04.173242+0000","last_fullsized":"2024-09-21T08:00:04.173242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072745+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072745+0000","last_peered":"2024-09-21T08:00:04.072745+0000","last_clean":"2024-09-21T08:00:04.072745+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072745+0000","last_undegraded":"2024-09-21T08:00:04.072745+0000","last_fullsized":"2024-09-21T08:00:04.072745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335429+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:00:04.335429+0000","last_peered":"2024-09-21T08:00:04.335429+0000","last_clean":"2024-09-21T08:00:04.335429+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:00:04.335429+0000","last_undegraded":"2024-09-21T08:00:04.335429+0000","last_fullsized":"2024-09-21T08:00:04.335429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993345+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993345+0000","last_peered":"2024-09-21T08:00:03.993345+0000","last_clean":"2024-09-21T08:00:03.993345+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993345+0000","last_undegraded":"2024-09-21T08:00:03.993345+0000","last_fullsized":"2024-09-21T08:00:03.993345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072755+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:00:04.072755+0000","last_peered":"2024-09-21T08:00:04.072755+0000","last_clean":"2024-09-21T08:00:04.072755+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:00:04.072755+0000","last_undegraded":"2024-09-21T08:00:04.072755+0000","last_fullsized":"2024-09-21T08:00:04.072755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084623+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:00:04.084623+0000","last_peered":"2024-09-21T08:00:04.084623+0000","last_clean":"2024-09-21T08:00:04.084623+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:00:04.084623+0000","last_undegraded":"2024-09-21T08:00:04.084623+0000","last_fullsized":"2024-09-21T08:00:04.084623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997955+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:00:03.997955+0000","last_peered":"2024-09-21T08:00:03.997955+0000","last_clean":"2024-09-21T08:00:03.997955+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:00:03.997955+0000","last_undegraded":"2024-09-21T08:00:03.997955+0000","last_fullsized":"2024-09-21T08:00:03.997955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994731+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:00:03.994731+0000","last_peered":"2024-09-21T08:00:03.994731+0000","last_clean":"2024-09-21T08:00:03.994731+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:00:03.994731+0000","last_undegraded":"2024-09-21T08:00:03.994731+0000","last_fullsized":"2024-09-21T08:00:03.994731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994068+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:00:03.994068+0000","last_peered":"2024-09-21T08:00:03.994068+0000","last_clean":"2024-09-21T08:00:03.994068+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:00:03.994068+0000","last_undegraded":"2024-09-21T08:00:03.994068+0000","last_fullsized":"2024-09-21T08:00:03.994068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996376+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:00:03.996376+0000","last_peered":"2024-09-21T08:00:03.996376+0000","last_clean":"2024-09-21T08:00:03.996376+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:00:03.996376+0000","last_undegraded":"2024-09-21T08:00:03.996376+0000","last_fullsized":"2024-09-21T08:00:03.996376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993932+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:00:03.993932+0000","last_peered":"2024-09-21T08:00:03.993932+0000","last_clean":"2024-09-21T08:00:03.993932+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:00:03.993932+0000","last_undegraded":"2024-09-21T08:00:03.993932+0000","last_fullsized":"2024-09-21T08:00:03.993932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.175055+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:00:04.175055+0000","last_peered":"2024-09-21T08:00:04.175055+0000","last_clean":"2024-09-21T08:00:04.175055+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:00:04.175055+0000","last_undegraded":"2024-09-21T08:00:04.175055+0000","last_fullsized":"2024-09-21T08:00:04.175055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994402+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:00:03.994402+0000","last_peered":"2024-09-21T08:00:03.994402+0000","last_clean":"2024-09-21T08:00:03.994402+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:00:03.994402+0000","last_undegraded":"2024-09-21T08:00:03.994402+0000","last_fullsized":"2024-09-21T08:00:03.994402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336120+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:00:04.336120+0000","last_peered":"2024-09-21T08:00:04.336120+0000","last_clean":"2024-09-21T08:00:04.336120+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:00:04.336120+0000","last_undegraded":"2024-09-21T08:00:04.336120+0000","last_fullsized":"2024-09-21T08:00:04.336120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072544+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:00:04.072544+0000","last_peered":"2024-09-21T08:00:04.072544+0000","last_clean":"2024-09-21T08:00:04.072544+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:00:04.072544+0000","last_undegraded":"2024-09-21T08:00:04.072544+0000","last_fullsized":"2024-09-21T08:00:04.072544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335638+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:00:04.335638+0000","last_peered":"2024-09-21T08:00:04.335638+0000","last_clean":"2024-09-21T08:00:04.335638+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:00:04.335638+0000","last_undegraded":"2024-09-21T08:00:04.335638+0000","last_fullsized":"2024-09-21T08:00:04.335638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216644+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:00:04.216644+0000","last_peered":"2024-09-21T08:00:04.216644+0000","last_clean":"2024-09-21T08:00:04.216644+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:00:04.216644+0000","last_undegraded":"2024-09-21T08:00:04.216644+0000","last_fullsized":"2024-09-21T08:00:04.216644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993593+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:00:03.993593+0000","last_peered":"2024-09-21T08:00:03.993593+0000","last_clean":"2024-09-21T08:00:03.993593+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:00:03.993593+0000","last_undegraded":"2024-09-21T08:00:03.993593+0000","last_fullsized":"2024-09-21T08:00:03.993593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998191+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:00:03.998191+0000","last_peered":"2024-09-21T08:00:03.998191+0000","last_clean":"2024-09-21T08:00:03.998191+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:00:03.998191+0000","last_undegraded":"2024-09-21T08:00:03.998191+0000","last_fullsized":"2024-09-21T08:00:03.998191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994637+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:00:03.994637+0000","last_peered":"2024-09-21T08:00:03.994637+0000","last_clean":"2024-09-21T08:00:03.994637+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:00:03.994637+0000","last_undegraded":"2024-09-21T08:00:03.994637+0000","last_fullsized":"2024-09-21T08:00:03.994637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173852+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:00:04.173852+0000","last_peered":"2024-09-21T08:00:04.173852+0000","last_clean":"2024-09-21T08:00:04.173852+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:00:04.173852+0000","last_undegraded":"2024-09-21T08:00:04.173852+0000","last_fullsized":"2024-09-21T08:00:04.173852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998621+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:00:03.998621+0000","last_peered":"2024-09-21T08:00:03.998621+0000","last_clean":"2024-09-21T08:00:03.998621+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:00:03.998621+0000","last_undegraded":"2024-09-21T08:00:03.998621+0000","last_fullsized":"2024-09-21T08:00:03.998621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216277+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:00:04.216277+0000","last_peered":"2024-09-21T08:00:04.216277+0000","last_clean":"2024-09-21T08:00:04.216277+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:00:04.216277+0000","last_undegraded":"2024-09-21T08:00:04.216277+0000","last_fullsized":"2024-09-21T08:00:04.216277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998478+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:00:03.998478+0000","last_peered":"2024-09-21T08:00:03.998478+0000","last_clean":"2024-09-21T08:00:03.998478+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:00:03.998478+0000","last_undegraded":"2024-09-21T08:00:03.998478+0000","last_fullsized":"2024-09-21T08:00:03.998478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996090+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:00:03.996090+0000","last_peered":"2024-09-21T08:00:03.996090+0000","last_clean":"2024-09-21T08:00:03.996090+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:00:03.996090+0000","last_undegraded":"2024-09-21T08:00:03.996090+0000","last_fullsized":"2024-09-21T08:00:03.996090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993526+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:00:03.993526+0000","last_peered":"2024-09-21T08:00:03.993526+0000","last_clean":"2024-09-21T08:00:03.993526+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:00:03.993526+0000","last_undegraded":"2024-09-21T08:00:03.993526+0000","last_fullsized":"2024-09-21T08:00:03.993526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173531+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:00:04.173531+0000","last_peered":"2024-09-21T08:00:04.173531+0000","last_clean":"2024-09-21T08:00:04.173531+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:00:04.173531+0000","last_undegraded":"2024-09-21T08:00:04.173531+0000","last_fullsized":"2024-09-21T08:00:04.173531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994496+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:00:03.994496+0000","last_peered":"2024-09-21T08:00:03.994496+0000","last_clean":"2024-09-21T08:00:03.994496+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:00:03.994496+0000","last_undegraded":"2024-09-21T08:00:03.994496+0000","last_fullsized":"2024-09-21T08:00:03.994496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216906+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:00:04.216906+0000","last_peered":"2024-09-21T08:00:04.216906+0000","last_clean":"2024-09-21T08:00:04.216906+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:00:04.216906+0000","last_undegraded":"2024-09-21T08:00:04.216906+0000","last_fullsized":"2024-09-21T08:00:04.216906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216766+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:00:04.216766+0000","last_peered":"2024-09-21T08:00:04.216766+0000","last_clean":"2024-09-21T08:00:04.216766+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:00:04.216766+0000","last_undegraded":"2024-09-21T08:00:04.216766+0000","last_fullsized":"2024-09-21T08:00:04.216766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993837+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:00:03.993837+0000","last_peered":"2024-09-21T08:00:03.993837+0000","last_clean":"2024-09-21T08:00:03.993837+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:00:03.993837+0000","last_undegraded":"2024-09-21T08:00:03.993837+0000","last_fullsized":"2024-09-21T08:00:03.993837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217005+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:00:04.217005+0000","last_peered":"2024-09-21T08:00:04.217005+0000","last_clean":"2024-09-21T08:00:04.217005+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:00:04.217005+0000","last_undegraded":"2024-09-21T08:00:04.217005+0000","last_fullsized":"2024-09-21T08:00:04.217005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084504+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:00:04.084504+0000","last_peered":"2024-09-21T08:00:04.084504+0000","last_clean":"2024-09-21T08:00:04.084504+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:00:04.084504+0000","last_undegraded":"2024-09-21T08:00:04.084504+0000","last_fullsized":"2024-09-21T08:00:04.084504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217637+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:00:04.217637+0000","last_peered":"2024-09-21T08:00:04.217637+0000","last_clean":"2024-09-21T08:00:04.217637+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:00:04.217637+0000","last_undegraded":"2024-09-21T08:00:04.217637+0000","last_fullsized":"2024-09-21T08:00:04.217637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998667+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:00:03.998667+0000","last_peered":"2024-09-21T08:00:03.998667+0000","last_clean":"2024-09-21T08:00:03.998667+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:00:03.998667+0000","last_undegraded":"2024-09-21T08:00:03.998667+0000","last_fullsized":"2024-09-21T08:00:03.998667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997007+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:00:03.997007+0000","last_peered":"2024-09-21T08:00:03.997007+0000","last_clean":"2024-09-21T08:00:03.997007+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:00:03.997007+0000","last_undegraded":"2024-09-21T08:00:03.997007+0000","last_fullsized":"2024-09-21T08:00:03.997007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998603+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:00:03.998603+0000","last_peered":"2024-09-21T08:00:03.998603+0000","last_clean":"2024-09-21T08:00:03.998603+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:00:03.998603+0000","last_undegraded":"2024-09-21T08:00:03.998603+0000","last_fullsized":"2024-09-21T08:00:03.998603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":88,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":215021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939693,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":1155469,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299448,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462972,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626498,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":1086190,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":569767,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542236,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":564907,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:03.525 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T08:01:03.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 -- 172.21.15.6:0/4262212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a4108c00 msgr2=0x7f81a410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 --2- 172.21.15.6:0/4262212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a4108c00 0x7f81a410f430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f819c009ca0 tx=0x7f819c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 -- 172.21.15.6:0/4262212584 shutdown_connections 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 --2- 172.21.15.6:0/4262212584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a41082b0 0x7f81a41086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 --2- 172.21.15.6:0/4262212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a4108c00 0x7f81a410f430 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 --2- 172.21.15.6:0/4262212584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 0x7f81a4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 -- 172.21.15.6:0/4262212584 >> 172.21.15.6:0/4262212584 conn(0x7f81a40fe380 msgr2=0x7f81a41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 -- 172.21.15.6:0/4262212584 shutdown_connections 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.677+0000 7f81a9300640 1 -- 172.21.15.6:0/4262212584 wait complete. 2024-09-21T08:01:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 Processor -- start 2024-09-21T08:01:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 -- start start 2024-09-21T08:01:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 0x7f81a4198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a4108c00 0x7f81a4199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81a41127c0 con 0x7f81a41082b0 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4112640 con 0x7f81a4102980 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a9300640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4112940 con 0x7f81a4108c00 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40162/0 (socket says 172.21.15.6:40162) 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a27fc640 1 -- 172.21.15.6:0/1663492024 learned_addr learned my addr 172.21.15.6:0/1663492024 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a37fe640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a4108c00 0x7f81a4199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.678+0000 7f81a2ffd640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 0x7f81a4198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 -- 172.21.15.6:0/1663492024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a4108c00 msgr2=0x7f81a4199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a4108c00 0x7f81a4199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 -- 172.21.15.6:0/1663492024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 msgr2=0x7f81a4198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 0x7f81a4198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 -- 172.21.15.6:0/1663492024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a41a85b0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a27fc640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f819800d750 tx=0x7f819800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198017070 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a41a88a0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81980054b0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198004bc0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.679+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a41a8da0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.680+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a4103bf0 con 0x7f81a41082b0 2024-09-21T08:01:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.682+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f8198009bd0 con 0x7f81a41082b0 2024-09-21T08:01:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.683+0000 7f818bfff640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 0x7f818c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:03.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.683+0000 7f81a2ffd640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 0x7f818c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:03.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.683+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f81980e7650 con 0x7f81a41082b0 2024-09-21T08:01:03.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.684+0000 7f81a2ffd640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 0x7f818c0b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81a406bdc0 tx=0x7f8194005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:03.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.686+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81980ada40 con 0x7f81a41082b0 2024-09-21T08:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.872+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81a4063800 con 0x7f818c0b6560 2024-09-21T08:01:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.878+0000 7f818bfff640 1 -- 172.21.15.6:0/1663492024 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340578 (secure 0 0 0) 0x7f81a4063800 con 0x7f818c0b6560 2024-09-21T08:01:03.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:03.888 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 msgr2=0x7f818c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 0x7f818c0b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81a406bdc0 tx=0x7f8194005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 msgr2=0x7f81a4199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f819800d750 tx=0x7f819800dc10 comp rx=0 tx=0).stop 2024-09-21T08:01:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 shutdown_connections 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f818c0b6560 0x7f818c0b8a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f81a4108c00 0x7f81a4199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a41082b0 0x7f81a4199440 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 --2- 172.21.15.6:0/1663492024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a4102980 0x7f81a4198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 >> 172.21.15.6:0/1663492024 conn(0x7f81a40fe380 msgr2=0x7f81a41078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 shutdown_connections 2024-09-21T08:01:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:03.882+0000 7f81a9300640 1 -- 172.21.15.6:0/1663492024 wait complete. 2024-09-21T08:01:03.894 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:03 smithi006 ceph-mon[30970]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:03.895 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-21T08:01:03.562940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665742,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":292,"num_read_kb":251,"num_write":218,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352340,"kb_used_data":11372,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589484,"statfs":{"total":1151940427776,"available":1151579631616,"internally_reserved":0,"allocated":11644928,"data_stored":7976474,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5075,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":22,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003542"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174094+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174094+0000","last_peered":"2024-09-21T08:00:04.174094+0000","last_clean":"2024-09-21T08:00:04.174094+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174094+0000","last_undegraded":"2024-09-21T08:00:04.174094+0000","last_fullsized":"2024-09-21T08:00:04.174094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336185+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:00:04.336185+0000","last_peered":"2024-09-21T08:00:04.336185+0000","last_clean":"2024-09-21T08:00:04.336185+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:00:04.336185+0000","last_undegraded":"2024-09-21T08:00:04.336185+0000","last_fullsized":"2024-09-21T08:00:04.336185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997572+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:00:03.997572+0000","last_peered":"2024-09-21T08:00:03.997572+0000","last_clean":"2024-09-21T08:00:03.997572+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:00:03.997572+0000","last_undegraded":"2024-09-21T08:00:03.997572+0000","last_fullsized":"2024-09-21T08:00:03.997572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216625+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:00:04.216625+0000","last_peered":"2024-09-21T08:00:04.216625+0000","last_clean":"2024-09-21T08:00:04.216625+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:00:04.216625+0000","last_undegraded":"2024-09-21T08:00:04.216625+0000","last_fullsized":"2024-09-21T08:00:04.216625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944309+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:01:01.944309+0000","last_peered":"2024-09-21T08:01:01.944309+0000","last_clean":"2024-09-21T08:01:01.944309+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:01:01.944309+0000","last_undegraded":"2024-09-21T08:01:01.944309+0000","last_fullsized":"2024-09-21T08:01:01.944309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994076+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:00:03.994076+0000","last_peered":"2024-09-21T08:00:03.994076+0000","last_clean":"2024-09-21T08:00:03.994076+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:00:03.994076+0000","last_undegraded":"2024-09-21T08:00:03.994076+0000","last_fullsized":"2024-09-21T08:00:03.994076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217221+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217221+0000","last_peered":"2024-09-21T08:00:04.217221+0000","last_clean":"2024-09-21T08:00:04.217221+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217221+0000","last_undegraded":"2024-09-21T08:00:04.217221+0000","last_fullsized":"2024-09-21T08:00:04.217221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335579+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:00:04.335579+0000","last_peered":"2024-09-21T08:00:04.335579+0000","last_clean":"2024-09-21T08:00:04.335579+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:00:04.335579+0000","last_undegraded":"2024-09-21T08:00:04.335579+0000","last_fullsized":"2024-09-21T08:00:04.335579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217462+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217462+0000","last_peered":"2024-09-21T08:00:04.217462+0000","last_clean":"2024-09-21T08:00:04.217462+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217462+0000","last_undegraded":"2024-09-21T08:00:04.217462+0000","last_fullsized":"2024-09-21T08:00:04.217462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998018+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:00:03.998018+0000","last_peered":"2024-09-21T08:00:03.998018+0000","last_clean":"2024-09-21T08:00:03.998018+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:00:03.998018+0000","last_undegraded":"2024-09-21T08:00:03.998018+0000","last_fullsized":"2024-09-21T08:00:03.998018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173844+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173844+0000","last_peered":"2024-09-21T08:00:04.173844+0000","last_clean":"2024-09-21T08:00:04.173844+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173844+0000","last_undegraded":"2024-09-21T08:00:04.173844+0000","last_fullsized":"2024-09-21T08:00:04.173844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084739+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:00:04.084739+0000","last_peered":"2024-09-21T08:00:04.084739+0000","last_clean":"2024-09-21T08:00:04.084739+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:00:04.084739+0000","last_undegraded":"2024-09-21T08:00:04.084739+0000","last_fullsized":"2024-09-21T08:00:04.084739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217949+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.217949+0000","last_peered":"2024-09-21T08:00:04.217949+0000","last_clean":"2024-09-21T08:00:04.217949+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.217949+0000","last_undegraded":"2024-09-21T08:00:04.217949+0000","last_fullsized":"2024-09-21T08:00:04.217949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220076+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:00:04.220076+0000","last_peered":"2024-09-21T08:00:04.220076+0000","last_clean":"2024-09-21T08:00:04.220076+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:00:04.220076+0000","last_undegraded":"2024-09-21T08:00:04.220076+0000","last_fullsized":"2024-09-21T08:00:04.220076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336168+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:00:04.336168+0000","last_peered":"2024-09-21T08:00:04.336168+0000","last_clean":"2024-09-21T08:00:04.336168+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:00:04.336168+0000","last_undegraded":"2024-09-21T08:00:04.336168+0000","last_fullsized":"2024-09-21T08:00:04.336168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173926+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:04.173926+0000","last_peered":"2024-09-21T08:00:04.173926+0000","last_clean":"2024-09-21T08:00:04.173926+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:04.173926+0000","last_undegraded":"2024-09-21T08:00:04.173926+0000","last_fullsized":"2024-09-21T08:00:04.173926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993942+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:00:03.993942+0000","last_peered":"2024-09-21T08:00:03.993942+0000","last_clean":"2024-09-21T08:00:03.993942+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:00:03.993942+0000","last_undegraded":"2024-09-21T08:00:03.993942+0000","last_fullsized":"2024-09-21T08:00:03.993942+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936395+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:01:01.936395+0000","last_peered":"2024-09-21T08:01:01.936395+0000","last_clean":"2024-09-21T08:01:01.936395+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:01:01.936395+0000","last_undegraded":"2024-09-21T08:01:01.936395+0000","last_fullsized":"2024-09-21T08:01:01.936395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930026+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:01:01.930026+0000","last_peered":"2024-09-21T08:01:01.930026+0000","last_clean":"2024-09-21T08:01:01.930026+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:01:01.930026+0000","last_undegraded":"2024-09-21T08:01:01.930026+0000","last_fullsized":"2024-09-21T08:01:01.930026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930274+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:01:01.930274+0000","last_peered":"2024-09-21T08:01:01.930274+0000","last_clean":"2024-09-21T08:01:01.930274+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:01:01.930274+0000","last_undegraded":"2024-09-21T08:01:01.930274+0000","last_fullsized":"2024-09-21T08:01:01.930274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994017+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994017+0000","last_peered":"2024-09-21T08:00:03.994017+0000","last_clean":"2024-09-21T08:00:03.994017+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994017+0000","last_undegraded":"2024-09-21T08:00:03.994017+0000","last_fullsized":"2024-09-21T08:00:03.994017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993283+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:00:03.993283+0000","last_peered":"2024-09-21T08:00:03.993283+0000","last_clean":"2024-09-21T08:00:03.993283+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:00:03.993283+0000","last_undegraded":"2024-09-21T08:00:03.993283+0000","last_fullsized":"2024-09-21T08:00:03.993283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073047+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.073047+0000","last_peered":"2024-09-21T08:00:04.073047+0000","last_clean":"2024-09-21T08:00:04.073047+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.073047+0000","last_undegraded":"2024-09-21T08:00:04.073047+0000","last_fullsized":"2024-09-21T08:00:04.073047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335921+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:00:04.335921+0000","last_peered":"2024-09-21T08:00:04.335921+0000","last_clean":"2024-09-21T08:00:04.335921+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:00:04.335921+0000","last_undegraded":"2024-09-21T08:00:04.335921+0000","last_fullsized":"2024-09-21T08:00:04.335921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994628+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:00:03.994628+0000","last_peered":"2024-09-21T08:00:03.994628+0000","last_clean":"2024-09-21T08:00:03.994628+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:00:03.994628+0000","last_undegraded":"2024-09-21T08:00:03.994628+0000","last_fullsized":"2024-09-21T08:00:03.994628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216269+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216269+0000","last_peered":"2024-09-21T08:00:04.216269+0000","last_clean":"2024-09-21T08:00:04.216269+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216269+0000","last_undegraded":"2024-09-21T08:00:04.216269+0000","last_fullsized":"2024-09-21T08:00:04.216269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994346+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:00:03.994346+0000","last_peered":"2024-09-21T08:00:03.994346+0000","last_clean":"2024-09-21T08:00:03.994346+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:00:03.994346+0000","last_undegraded":"2024-09-21T08:00:03.994346+0000","last_fullsized":"2024-09-21T08:00:03.994346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073341+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:00:04.073341+0000","last_peered":"2024-09-21T08:00:04.073341+0000","last_clean":"2024-09-21T08:00:04.073341+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:00:04.073341+0000","last_undegraded":"2024-09-21T08:00:04.073341+0000","last_fullsized":"2024-09-21T08:00:04.073341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994447+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:00:03.994447+0000","last_peered":"2024-09-21T08:00:03.994447+0000","last_clean":"2024-09-21T08:00:03.994447+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:00:03.994447+0000","last_undegraded":"2024-09-21T08:00:03.994447+0000","last_fullsized":"2024-09-21T08:00:03.994447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072310+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072310+0000","last_peered":"2024-09-21T08:00:04.072310+0000","last_clean":"2024-09-21T08:00:04.072310+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072310+0000","last_undegraded":"2024-09-21T08:00:04.072310+0000","last_fullsized":"2024-09-21T08:00:04.072310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.220043+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:00:04.220043+0000","last_peered":"2024-09-21T08:00:04.220043+0000","last_clean":"2024-09-21T08:00:04.220043+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:00:04.220043+0000","last_undegraded":"2024-09-21T08:00:04.220043+0000","last_fullsized":"2024-09-21T08:00:04.220043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072425+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072425+0000","last_peered":"2024-09-21T08:00:04.072425+0000","last_clean":"2024-09-21T08:00:04.072425+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072425+0000","last_undegraded":"2024-09-21T08:00:04.072425+0000","last_fullsized":"2024-09-21T08:00:04.072425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937873+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:01:01.937873+0000","last_peered":"2024-09-21T08:01:01.937873+0000","last_clean":"2024-09-21T08:01:01.937873+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:01:01.937873+0000","last_undegraded":"2024-09-21T08:01:01.937873+0000","last_fullsized":"2024-09-21T08:01:01.937873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084599+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084599+0000","last_peered":"2024-09-21T08:00:04.084599+0000","last_clean":"2024-09-21T08:00:04.084599+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084599+0000","last_undegraded":"2024-09-21T08:00:04.084599+0000","last_fullsized":"2024-09-21T08:00:04.084599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993780+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:00:03.993780+0000","last_peered":"2024-09-21T08:00:03.993780+0000","last_clean":"2024-09-21T08:00:03.993780+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:00:03.993780+0000","last_undegraded":"2024-09-21T08:00:03.993780+0000","last_fullsized":"2024-09-21T08:00:03.993780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217516+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217516+0000","last_peered":"2024-09-21T08:00:04.217516+0000","last_clean":"2024-09-21T08:00:04.217516+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217516+0000","last_undegraded":"2024-09-21T08:00:04.217516+0000","last_fullsized":"2024-09-21T08:00:04.217516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994176+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:00:03.994176+0000","last_peered":"2024-09-21T08:00:03.994176+0000","last_clean":"2024-09-21T08:00:03.994176+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:00:03.994176+0000","last_undegraded":"2024-09-21T08:00:03.994176+0000","last_fullsized":"2024-09-21T08:00:03.994176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072872+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072872+0000","last_peered":"2024-09-21T08:00:04.072872+0000","last_clean":"2024-09-21T08:00:04.072872+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072872+0000","last_undegraded":"2024-09-21T08:00:04.072872+0000","last_fullsized":"2024-09-21T08:00:04.072872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993591+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:00:03.993591+0000","last_peered":"2024-09-21T08:00:03.993591+0000","last_clean":"2024-09-21T08:00:03.993591+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:00:03.993591+0000","last_undegraded":"2024-09-21T08:00:03.993591+0000","last_fullsized":"2024-09-21T08:00:03.993591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994222+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994222+0000","last_peered":"2024-09-21T08:00:03.994222+0000","last_clean":"2024-09-21T08:00:03.994222+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994222+0000","last_undegraded":"2024-09-21T08:00:03.994222+0000","last_fullsized":"2024-09-21T08:00:03.994222+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085070+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:00:04.085070+0000","last_peered":"2024-09-21T08:00:04.085070+0000","last_clean":"2024-09-21T08:00:04.085070+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:00:04.085070+0000","last_undegraded":"2024-09-21T08:00:04.085070+0000","last_fullsized":"2024-09-21T08:00:04.085070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":282,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:02.846150+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:01:02.846150+0000","last_peered":"2024-09-21T08:01:02.846150+0000","last_clean":"2024-09-21T08:01:02.846150+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:01:02.846150+0000","last_undegraded":"2024-09-21T08:01:02.846150+0000","last_fullsized":"2024-09-21T08:01:02.846150+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74342,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":205,"num_read_kb":176,"num_write":37,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216770+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:00:04.216770+0000","last_peered":"2024-09-21T08:00:04.216770+0000","last_clean":"2024-09-21T08:00:04.216770+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:00:04.216770+0000","last_undegraded":"2024-09-21T08:00:04.216770+0000","last_fullsized":"2024-09-21T08:00:04.216770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073275+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073275+0000","last_peered":"2024-09-21T08:00:04.073275+0000","last_clean":"2024-09-21T08:00:04.073275+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073275+0000","last_undegraded":"2024-09-21T08:00:04.073275+0000","last_fullsized":"2024-09-21T08:00:04.073275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997633+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:00:03.997633+0000","last_peered":"2024-09-21T08:00:03.997633+0000","last_clean":"2024-09-21T08:00:03.997633+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:00:03.997633+0000","last_undegraded":"2024-09-21T08:00:03.997633+0000","last_fullsized":"2024-09-21T08:00:03.997633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217384+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:00:04.217384+0000","last_peered":"2024-09-21T08:00:04.217384+0000","last_clean":"2024-09-21T08:00:04.217384+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:00:04.217384+0000","last_undegraded":"2024-09-21T08:00:04.217384+0000","last_fullsized":"2024-09-21T08:00:04.217384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217377+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217377+0000","last_peered":"2024-09-21T08:00:04.217377+0000","last_clean":"2024-09-21T08:00:04.217377+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217377+0000","last_undegraded":"2024-09-21T08:00:04.217377+0000","last_fullsized":"2024-09-21T08:00:04.217377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938616+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:01:01.938616+0000","last_peered":"2024-09-21T08:01:01.938616+0000","last_clean":"2024-09-21T08:01:01.938616+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:01:01.938616+0000","last_undegraded":"2024-09-21T08:01:01.938616+0000","last_fullsized":"2024-09-21T08:01:01.938616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072745+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072745+0000","last_peered":"2024-09-21T08:00:04.072745+0000","last_clean":"2024-09-21T08:00:04.072745+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072745+0000","last_undegraded":"2024-09-21T08:00:04.072745+0000","last_fullsized":"2024-09-21T08:00:04.072745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335429+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:00:04.335429+0000","last_peered":"2024-09-21T08:00:04.335429+0000","last_clean":"2024-09-21T08:00:04.335429+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:00:04.335429+0000","last_undegraded":"2024-09-21T08:00:04.335429+0000","last_fullsized":"2024-09-21T08:00:04.335429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993345+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993345+0000","last_peered":"2024-09-21T08:00:03.993345+0000","last_clean":"2024-09-21T08:00:03.993345+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993345+0000","last_undegraded":"2024-09-21T08:00:03.993345+0000","last_fullsized":"2024-09-21T08:00:03.993345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935389+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:01:01.935389+0000","last_peered":"2024-09-21T08:01:01.935389+0000","last_clean":"2024-09-21T08:01:01.935389+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:01:01.935389+0000","last_undegraded":"2024-09-21T08:01:01.935389+0000","last_fullsized":"2024-09-21T08:01:01.935389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084623+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:00:04.084623+0000","last_peered":"2024-09-21T08:00:04.084623+0000","last_clean":"2024-09-21T08:00:04.084623+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:00:04.084623+0000","last_undegraded":"2024-09-21T08:00:04.084623+0000","last_fullsized":"2024-09-21T08:00:04.084623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997955+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:00:03.997955+0000","last_peered":"2024-09-21T08:00:03.997955+0000","last_clean":"2024-09-21T08:00:03.997955+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:00:03.997955+0000","last_undegraded":"2024-09-21T08:00:03.997955+0000","last_fullsized":"2024-09-21T08:00:03.997955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994731+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:00:03.994731+0000","last_peered":"2024-09-21T08:00:03.994731+0000","last_clean":"2024-09-21T08:00:03.994731+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:00:03.994731+0000","last_undegraded":"2024-09-21T08:00:03.994731+0000","last_fullsized":"2024-09-21T08:00:03.994731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994068+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:00:03.994068+0000","last_peered":"2024-09-21T08:00:03.994068+0000","last_clean":"2024-09-21T08:00:03.994068+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:00:03.994068+0000","last_undegraded":"2024-09-21T08:00:03.994068+0000","last_fullsized":"2024-09-21T08:00:03.994068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996376+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:00:03.996376+0000","last_peered":"2024-09-21T08:00:03.996376+0000","last_clean":"2024-09-21T08:00:03.996376+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:00:03.996376+0000","last_undegraded":"2024-09-21T08:00:03.996376+0000","last_fullsized":"2024-09-21T08:00:03.996376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993932+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:00:03.993932+0000","last_peered":"2024-09-21T08:00:03.993932+0000","last_clean":"2024-09-21T08:00:03.993932+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:00:03.993932+0000","last_undegraded":"2024-09-21T08:00:03.993932+0000","last_fullsized":"2024-09-21T08:00:03.993932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.175055+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:00:04.175055+0000","last_peered":"2024-09-21T08:00:04.175055+0000","last_clean":"2024-09-21T08:00:04.175055+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:00:04.175055+0000","last_undegraded":"2024-09-21T08:00:04.175055+0000","last_fullsized":"2024-09-21T08:00:04.175055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994402+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:00:03.994402+0000","last_peered":"2024-09-21T08:00:03.994402+0000","last_clean":"2024-09-21T08:00:03.994402+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:00:03.994402+0000","last_undegraded":"2024-09-21T08:00:03.994402+0000","last_fullsized":"2024-09-21T08:00:03.994402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336120+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:00:04.336120+0000","last_peered":"2024-09-21T08:00:04.336120+0000","last_clean":"2024-09-21T08:00:04.336120+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:00:04.336120+0000","last_undegraded":"2024-09-21T08:00:04.336120+0000","last_fullsized":"2024-09-21T08:00:04.336120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935172+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:01:01.935172+0000","last_peered":"2024-09-21T08:01:01.935172+0000","last_clean":"2024-09-21T08:01:01.935172+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:01:01.935172+0000","last_undegraded":"2024-09-21T08:01:01.935172+0000","last_fullsized":"2024-09-21T08:01:01.935172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335638+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:00:04.335638+0000","last_peered":"2024-09-21T08:00:04.335638+0000","last_clean":"2024-09-21T08:00:04.335638+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:00:04.335638+0000","last_undegraded":"2024-09-21T08:00:04.335638+0000","last_fullsized":"2024-09-21T08:00:04.335638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216691+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:00:04.216691+0000","last_peered":"2024-09-21T08:00:04.216691+0000","last_clean":"2024-09-21T08:00:04.216691+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:00:04.216691+0000","last_undegraded":"2024-09-21T08:00:04.216691+0000","last_fullsized":"2024-09-21T08:00:04.216691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993593+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:00:03.993593+0000","last_peered":"2024-09-21T08:00:03.993593+0000","last_clean":"2024-09-21T08:00:03.993593+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:00:03.993593+0000","last_undegraded":"2024-09-21T08:00:03.993593+0000","last_fullsized":"2024-09-21T08:00:03.993593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998191+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:00:03.998191+0000","last_peered":"2024-09-21T08:00:03.998191+0000","last_clean":"2024-09-21T08:00:03.998191+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:00:03.998191+0000","last_undegraded":"2024-09-21T08:00:03.998191+0000","last_fullsized":"2024-09-21T08:00:03.998191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994637+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:00:03.994637+0000","last_peered":"2024-09-21T08:00:03.994637+0000","last_clean":"2024-09-21T08:00:03.994637+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:00:03.994637+0000","last_undegraded":"2024-09-21T08:00:03.994637+0000","last_fullsized":"2024-09-21T08:00:03.994637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943730+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:01:01.943730+0000","last_peered":"2024-09-21T08:01:01.943730+0000","last_clean":"2024-09-21T08:01:01.943730+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:01:01.943730+0000","last_undegraded":"2024-09-21T08:01:01.943730+0000","last_fullsized":"2024-09-21T08:01:01.943730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998621+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:00:03.998621+0000","last_peered":"2024-09-21T08:00:03.998621+0000","last_clean":"2024-09-21T08:00:03.998621+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:00:03.998621+0000","last_undegraded":"2024-09-21T08:00:03.998621+0000","last_fullsized":"2024-09-21T08:00:03.998621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216277+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:00:04.216277+0000","last_peered":"2024-09-21T08:00:04.216277+0000","last_clean":"2024-09-21T08:00:04.216277+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:00:04.216277+0000","last_undegraded":"2024-09-21T08:00:04.216277+0000","last_fullsized":"2024-09-21T08:00:04.216277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998478+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:00:03.998478+0000","last_peered":"2024-09-21T08:00:03.998478+0000","last_clean":"2024-09-21T08:00:03.998478+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:00:03.998478+0000","last_undegraded":"2024-09-21T08:00:03.998478+0000","last_fullsized":"2024-09-21T08:00:03.998478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996090+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:00:03.996090+0000","last_peered":"2024-09-21T08:00:03.996090+0000","last_clean":"2024-09-21T08:00:03.996090+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:00:03.996090+0000","last_undegraded":"2024-09-21T08:00:03.996090+0000","last_fullsized":"2024-09-21T08:00:03.996090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993526+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:00:03.993526+0000","last_peered":"2024-09-21T08:00:03.993526+0000","last_clean":"2024-09-21T08:00:03.993526+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:00:03.993526+0000","last_undegraded":"2024-09-21T08:00:03.993526+0000","last_fullsized":"2024-09-21T08:00:03.993526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935063+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:01:01.935063+0000","last_peered":"2024-09-21T08:01:01.935063+0000","last_clean":"2024-09-21T08:01:01.935063+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:01:01.935063+0000","last_undegraded":"2024-09-21T08:01:01.935063+0000","last_fullsized":"2024-09-21T08:01:01.935063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994496+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:00:03.994496+0000","last_peered":"2024-09-21T08:00:03.994496+0000","last_clean":"2024-09-21T08:00:03.994496+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:00:03.994496+0000","last_undegraded":"2024-09-21T08:00:03.994496+0000","last_fullsized":"2024-09-21T08:00:03.994496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935921+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:01:01.935921+0000","last_peered":"2024-09-21T08:01:01.935921+0000","last_clean":"2024-09-21T08:01:01.935921+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:01:01.935921+0000","last_undegraded":"2024-09-21T08:01:01.935921+0000","last_fullsized":"2024-09-21T08:01:01.935921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216766+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:00:04.216766+0000","last_peered":"2024-09-21T08:00:04.216766+0000","last_clean":"2024-09-21T08:00:04.216766+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:00:04.216766+0000","last_undegraded":"2024-09-21T08:00:04.216766+0000","last_fullsized":"2024-09-21T08:00:04.216766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993837+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:00:03.993837+0000","last_peered":"2024-09-21T08:00:03.993837+0000","last_clean":"2024-09-21T08:00:03.993837+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:00:03.993837+0000","last_undegraded":"2024-09-21T08:00:03.993837+0000","last_fullsized":"2024-09-21T08:00:03.993837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.931072+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:01:01.931072+0000","last_peered":"2024-09-21T08:01:01.931072+0000","last_clean":"2024-09-21T08:01:01.931072+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:01:01.931072+0000","last_undegraded":"2024-09-21T08:01:01.931072+0000","last_fullsized":"2024-09-21T08:01:01.931072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084504+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:00:04.084504+0000","last_peered":"2024-09-21T08:00:04.084504+0000","last_clean":"2024-09-21T08:00:04.084504+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:00:04.084504+0000","last_undegraded":"2024-09-21T08:00:04.084504+0000","last_fullsized":"2024-09-21T08:00:04.084504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.922290+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:01:01.922290+0000","last_peered":"2024-09-21T08:01:01.922290+0000","last_clean":"2024-09-21T08:01:01.922290+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:01:01.922290+0000","last_undegraded":"2024-09-21T08:01:01.922290+0000","last_fullsized":"2024-09-21T08:01:01.922290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998667+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:00:03.998667+0000","last_peered":"2024-09-21T08:00:03.998667+0000","last_clean":"2024-09-21T08:00:03.998667+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:00:03.998667+0000","last_undegraded":"2024-09-21T08:00:03.998667+0000","last_fullsized":"2024-09-21T08:00:03.998667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997007+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:00:03.997007+0000","last_peered":"2024-09-21T08:00:03.997007+0000","last_clean":"2024-09-21T08:00:03.997007+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:00:03.997007+0000","last_undegraded":"2024-09-21T08:00:03.997007+0000","last_fullsized":"2024-09-21T08:00:03.997007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998603+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:00:03.998603+0000","last_peered":"2024-09-21T08:00:03.998603+0000","last_clean":"2024-09-21T08:00:03.998603+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:00:03.998603+0000","last_undegraded":"2024-09-21T08:00:03.998603+0000","last_fullsized":"2024-09-21T08:00:03.998603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75140,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":211,"num_read_kb":182,"num_write":93,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":224922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939694,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1160544,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103219,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299448,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462972,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626498,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1086190,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986253,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":569767,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542237,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":569733,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":74093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:03.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:03 smithi119 ceph-mon[33564]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:03 smithi145 ceph-mon[34049]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 -- 172.21.15.6:0/2014585357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 msgr2=0x7f266c109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 --2- 172.21.15.6:0/2014585357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c109900 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2660009900 tx=0x7f266002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 -- 172.21.15.6:0/2014585357 shutdown_connections 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 --2- 172.21.15.6:0/2014585357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c109e40 0x7f266c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 --2- 172.21.15.6:0/2014585357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c109900 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 --2- 172.21.15.6:0/2014585357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c103bb0 0x7f266c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 -- 172.21.15.6:0/2014585357 >> 172.21.15.6:0/2014585357 conn(0x7f266c0ff600 msgr2=0x7f266c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 -- 172.21.15.6:0/2014585357 shutdown_connections 2024-09-21T08:01:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.744+0000 7f2673a7f640 1 -- 172.21.15.6:0/2014585357 wait complete. 2024-09-21T08:01:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 Processor -- start 2024-09-21T08:01:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 -- start start 2024-09-21T08:01:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c103bb0 0x7f266c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c109e40 0x7f266c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f266c1139d0 con 0x7f266c1094f0 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f266c113850 con 0x7f266c109e40 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f2673a7f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f266c113b50 con 0x7f266c103bb0 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f267101a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f267101a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40190/0 (socket says 172.21.15.6:40190) 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f267101a640 1 -- 172.21.15.6:0/3169994640 learned_addr learned my addr 172.21.15.6:0/3169994640 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f267181b640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c103bb0 0x7f266c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.745+0000 7f267201c640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c109e40 0x7f266c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 -- 172.21.15.6:0/3169994640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c103bb0 msgr2=0x7f266c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c103bb0 0x7f266c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 -- 172.21.15.6:0/3169994640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c109e40 msgr2=0x7f266c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c109e40 0x7f266c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 -- 172.21.15.6:0/3169994640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c1a03b0 con 0x7f266c1094f0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f267101a640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2660005940 tx=0x7f26600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266003f030 con 0x7f266c1094f0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2660003c90 con 0x7f266c1094f0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660035070 con 0x7f266c1094f0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266c1a0640 con 0x7f266c1094f0 2024-09-21T08:01:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.746+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266c1a6e00 con 0x7f266c1094f0 2024-09-21T08:01:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.747+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266c103fc0 con 0x7f266c1094f0 2024-09-21T08:01:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.749+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f2660042030 con 0x7f266c1094f0 2024-09-21T08:01:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.750+0000 7f265effd640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 0x7f26580b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.750+0000 7f267181b640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 0x7f26580b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.750+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f2660108210 con 0x7f266c1094f0 2024-09-21T08:01:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.750+0000 7f267181b640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 0x7f26580b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f26680058c0 tx=0x7f266800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:04.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.753+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26600d2980 con 0x7f266c1094f0 2024-09-21T08:01:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:04 smithi119 ceph-mon[33564]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:04 smithi119 ceph-mon[33564]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T08:01:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:04 smithi119 ceph-mon[33564]: mgrmap e22: x(active, since 9m), standbys: z, y 2024-09-21T08:01:04.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:04 smithi119 ceph-mon[33564]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:04 smithi145 ceph-mon[34049]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:04 smithi145 ceph-mon[34049]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T08:01:04.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:04 smithi145 ceph-mon[34049]: mgrmap e22: x(active, since 9m), standbys: z, y 2024-09-21T08:01:04.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:04 smithi145 ceph-mon[34049]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:04 smithi006 ceph-mon[30970]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:04 smithi006 ceph-mon[30970]: pgmap v344: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T08:01:04.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:04 smithi006 ceph-mon[30970]: mgrmap e22: x(active, since 9m), standbys: z, y 2024-09-21T08:01:04.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:04 smithi006 ceph-mon[30970]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.977+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f266c19b570 con 0x7f266c1094f0 2024-09-21T08:01:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.978+0000 7f265effd640 1 -- 172.21.15.6:0/3169994640 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f266c19b570 con 0x7f266c1094f0 2024-09-21T08:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:04.980 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.980+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 msgr2=0x7f26580b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.980+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 0x7f26580b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f26680058c0 tx=0x7f266800a2d0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.980+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 msgr2=0x7f266c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.980+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2660005940 tx=0x7f26600042f0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 shutdown_connections 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26580b65e0 0x7f26580b8af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f266c109e40 0x7f266c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f266c1094f0 0x7f266c19a9e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 --2- 172.21.15.6:0/3169994640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f266c103bb0 0x7f266c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 >> 172.21.15.6:0/3169994640 conn(0x7f266c0ff600 msgr2=0x7f266c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 shutdown_connections 2024-09-21T08:01:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:04.981+0000 7f2673a7f640 1 -- 172.21.15.6:0/3169994640 wait complete. 2024-09-21T08:01:05.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:01:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:05.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:05 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3169994640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:05.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:05 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3169994640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:05.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:05 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3169994640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 -- 172.21.15.6:0/1340463729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3658109df0 msgr2=0x7f3658110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 --2- 172.21.15.6:0/1340463729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3658109df0 0x7f3658110620 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3650009900 tx=0x7f365002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 -- 172.21.15.6:0/1340463729 shutdown_connections 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 --2- 172.21.15.6:0/1340463729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36581094a0 0x7f36581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 --2- 172.21.15.6:0/1340463729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3658109df0 0x7f3658110620 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 --2- 172.21.15.6:0/1340463729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658103b60 0x7f3658103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 -- 172.21.15.6:0/1340463729 >> 172.21.15.6:0/1340463729 conn(0x7f365807b850 msgr2=0x7f365807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 -- 172.21.15.6:0/1340463729 shutdown_connections 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.363+0000 7f365ffa0640 1 -- 172.21.15.6:0/1340463729 wait complete. 2024-09-21T08:01:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 Processor -- start 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 -- start start 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3658103b60 0x7f365819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658109df0 0x7f365819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3658113960 con 0x7f36581094a0 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36581137e0 con 0x7f3658109df0 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365ffa0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3658113ae0 con 0x7f3658103b60 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365d53b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365d53b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53118/0 (socket says 172.21.15.6:53118) 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365d53b640 1 -- 172.21.15.6:0/2857420407 learned_addr learned my addr 172.21.15.6:0/2857420407 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365dd3c640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3658103b60 0x7f365819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.364+0000 7f365e53d640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658109df0 0x7f365819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 -- 172.21.15.6:0/2857420407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3658103b60 msgr2=0x7f365819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3658103b60 0x7f365819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 -- 172.21.15.6:0/2857420407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658109df0 msgr2=0x7f365819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658109df0 0x7f365819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 -- 172.21.15.6:0/2857420407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36581a02e0 con 0x7f36581094a0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365d53b640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f364800d740 tx=0x7f364800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648017070 con 0x7f36581094a0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36581a05d0 con 0x7f36581094a0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f364800de50 con 0x7f36581094a0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800f620 con 0x7f36581094a0 2024-09-21T08:01:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.365+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36581a6d30 con 0x7f36581094a0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.366+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3658103f70 con 0x7f36581094a0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.368+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f364801a070 con 0x7f36581094a0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.369+0000 7f364effd640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 0x7f36440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.369+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f36480e7150 con 0x7f36581094a0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.369+0000 7f365dd3c640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 0x7f36440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.369+0000 7f365dd3c640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 0x7f36440b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3654005fd0 tx=0x7f3654009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.372+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36480b18c0 con 0x7f36581094a0 2024-09-21T08:01:06.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.560+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f365819b4a0 con 0x7f36581094a0 2024-09-21T08:01:06.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.562+0000 7f364effd640 1 -- 172.21.15.6:0/2857420407 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25204 (secure 0 0 0) 0x7f36480b6800 con 0x7f36581094a0 2024-09-21T08:01:06.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:06.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:00:03.985299+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 msgr2=0x7f36440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 0x7f36440b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3654005fd0 tx=0x7f3654009680 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 msgr2=0x7f365819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f364800d740 tx=0x7f364800dc00 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 shutdown_connections 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36440b6560 0x7f36440b8a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3658109df0 0x7f365819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36581094a0 0x7f365819a910 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 --2- 172.21.15.6:0/2857420407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3658103b60 0x7f365819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 >> 172.21.15.6:0/2857420407 conn(0x7f365807b850 msgr2=0x7f3658107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 shutdown_connections 2024-09-21T08:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:06.564+0000 7f365ffa0640 1 -- 172.21.15.6:0/2857420407 wait complete. 2024-09-21T08:01:06.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:06 smithi119 ceph-mon[33564]: pgmap v345: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:06.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:06 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2857420407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:06.935 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:06 smithi006 ceph-mon[30970]: pgmap v345: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:06.935 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:06 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2857420407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:06 smithi145 ceph-mon[34049]: pgmap v345: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:06 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2857420407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:07.253 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T08:01:07.253 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T08:01:07.264 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T08:01:07.265 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:01:07.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T08:01:07.265 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T08:01:07.265 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:01:07.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 -- 172.21.15.6:0/2056968034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98102180 msgr2=0x7f4c98102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 --2- 172.21.15.6:0/2056968034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98102180 0x7f4c98102590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009900 tx=0x7f4c8802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 -- 172.21.15.6:0/2056968034 shutdown_connections 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 --2- 172.21.15.6:0/2056968034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98107ab0 0x7f4c98107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 --2- 172.21.15.6:0/2056968034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98108400 0x7f4c9810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 --2- 172.21.15.6:0/2056968034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98102180 0x7f4c98102590 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 -- 172.21.15.6:0/2056968034 >> 172.21.15.6:0/2056968034 conn(0x7f4c98079e90 msgr2=0x7f4c9807a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 -- 172.21.15.6:0/2056968034 shutdown_connections 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.387+0000 7f4c9e020640 1 -- 172.21.15.6:0/2056968034 wait complete. 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 Processor -- start 2024-09-21T08:01:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 -- start start 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98102180 0x7f4c9819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98108400 0x7f4c9819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4c981138e0 con 0x7f4c98107ab0 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98113760 con 0x7f4c98102180 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c9e020640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98113a60 con 0x7f4c98108400 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c8effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c8effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53134/0 (socket says 172.21.15.6:53134) 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c8effd640 1 -- 172.21.15.6:0/407915190 learned_addr learned my addr 172.21.15.6:0/407915190 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c977fe640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98102180 0x7f4c9819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.388+0000 7f4c97fff640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98108400 0x7f4c9819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 -- 172.21.15.6:0/407915190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98108400 msgr2=0x7f4c9819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98108400 0x7f4c9819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 -- 172.21.15.6:0/407915190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98102180 msgr2=0x7f4c9819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98102180 0x7f4c9819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 -- 172.21.15.6:0/407915190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981a0330 con 0x7f4c98107ab0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c8effd640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000d950 tx=0x7f4c8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80017070 con 0x7f4c98107ab0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c80009c30 con 0x7f4c98107ab0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981a0620 con 0x7f4c98107ab0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c800047a0 con 0x7f4c98107ab0 2024-09-21T08:01:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.389+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a6db0 con 0x7f4c98107ab0 2024-09-21T08:01:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.390+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98102590 con 0x7f4c98107ab0 2024-09-21T08:01:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.392+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f4c80004020 con 0x7f4c98107ab0 2024-09-21T08:01:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.393+0000 7f4c957fa640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 0x7f4c840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.394+0000 7f4c977fe640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 0x7f4c840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.394+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4c800e7910 con 0x7f4c98107ab0 2024-09-21T08:01:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.394+0000 7f4c977fe640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 0x7f4c840b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c880057c0 tx=0x7f4c880058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.397+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c80020020 con 0x7f4c98107ab0 2024-09-21T08:01:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:07.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.616+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4c98063800 con 0x7f4c840b6560 2024-09-21T08:01:07.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.786+0000 7f4c957fa640 1 -- 172.21.15.6:0/407915190 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4c98063800 con 0x7f4c840b6560 2024-09-21T08:01:07.788 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path / 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 msgr2=0x7f4c840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 0x7f4c840b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c880057c0 tx=0x7f4c880058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 msgr2=0x7f4c9819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000d950 tx=0x7f4c8000de10 comp rx=0 tx=0).stop 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 shutdown_connections 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4c840b6560 0x7f4c840b8a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.788+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98108400 0x7f4c9819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.789+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c98107ab0 0x7f4c9819a9a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.789+0000 7f4c9e020640 1 --2- 172.21.15.6:0/407915190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c98102180 0x7f4c9819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.789+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 >> 172.21.15.6:0/407915190 conn(0x7f4c98079e90 msgr2=0x7f4c98105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.789+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 shutdown_connections 2024-09-21T08:01:07.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.789+0000 7f4c9e020640 1 -- 172.21.15.6:0/407915190 wait complete. 2024-09-21T08:01:07.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 -- 172.21.15.6:0/2966361965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 msgr2=0x7f99f410f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 --2- 172.21.15.6:0/2966361965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f410f460 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009ca0 tx=0x7f99ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 -- 172.21.15.6:0/2966361965 shutdown_connections 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 --2- 172.21.15.6:0/2966361965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f410f460 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 --2- 172.21.15.6:0/2966361965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f41086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 --2- 172.21.15.6:0/2966361965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 0x7f99f4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 -- 172.21.15.6:0/2966361965 >> 172.21.15.6:0/2966361965 conn(0x7f99f407a740 msgr2=0x7f99f407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 -- 172.21.15.6:0/2966361965 shutdown_connections 2024-09-21T08:01:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.917+0000 7f99fc694640 1 -- 172.21.15.6:0/2966361965 wait complete. 2024-09-21T08:01:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 Processor -- start 2024-09-21T08:01:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 -- start start 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 0x7f99f419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99f41138f0 con 0x7f99f4108c30 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4113770 con 0x7f99f41082e0 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fc694640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4113a70 con 0x7f99f41029b0 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fac31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fac31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53180/0 (socket says 172.21.15.6:53180) 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fac31640 1 -- 172.21.15.6:0/3722250600 learned_addr learned my addr 172.21.15.6:0/3722250600 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.918+0000 7f99fa430640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 0x7f99f419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99f9c2f640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 -- 172.21.15.6:0/3722250600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 msgr2=0x7f99f419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 0x7f99f419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 -- 172.21.15.6:0/3722250600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 msgr2=0x7f99f419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 -- 172.21.15.6:0/3722250600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f41a0260 con 0x7f99f4108c30 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99f9c2f640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fac31640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99ec031040 tx=0x7f99ec032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec004040 con 0x7f99f4108c30 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99ec004670 con 0x7f99f4108c30 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f41a04f0 con 0x7f99f4108c30 2024-09-21T08:01:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec030bb0 con 0x7f99f4108c30 2024-09-21T08:01:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.919+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f41a6ce0 con 0x7f99f4108c30 2024-09-21T08:01:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.920+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f4102dc0 con 0x7f99f4108c30 2024-09-21T08:01:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.923+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f99ec0041e0 con 0x7f99f4108c30 2024-09-21T08:01:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.923+0000 7f99eb7fe640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 0x7f99e00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.924+0000 7f99fa430640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 0x7f99e00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.924+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f99ec108b00 con 0x7f99f4108c30 2024-09-21T08:01:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.924+0000 7f99fa430640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 0x7f99e00b8af0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99f0005fd0 tx=0x7f99f000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:07.927+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99ec0ceef0 con 0x7f99f4108c30 2024-09-21T08:01:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.146+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f99f4063800 con 0x7f99e00b65e0 2024-09-21T08:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.215+0000 7f99eb7fe640 1 -- 172.21.15.6:0/3722250600 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f99f4063800 con 0x7f99e00b65e0 2024-09-21T08:01:08.217 INFO:teuthology.orchestra.run.smithi006.stdout:Retention added to path / 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.217+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 msgr2=0x7f99e00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.217+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 0x7f99e00b8af0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99f0005fd0 tx=0x7f99f000b390 comp rx=0 tx=0).stop 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.217+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 msgr2=0x7f99f419fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.217+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99ec031040 tx=0x7f99ec032bc0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 shutdown_connections 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99e00b65e0 0x7f99e00b8af0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f4108c30 0x7f99f419fb60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99f41082e0 0x7f99f419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 --2- 172.21.15.6:0/3722250600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99f41029b0 0x7f99f419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 >> 172.21.15.6:0/3722250600 conn(0x7f99f407a740 msgr2=0x7f99f41042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 shutdown_connections 2024-09-21T08:01:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.218+0000 7f99fc694640 1 -- 172.21.15.6:0/3722250600 wait complete. 2024-09-21T08:01:08.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 -- 172.21.15.6:0/179601961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8102050 msgr2=0x7fddc8102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 --2- 172.21.15.6:0/179601961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8102050 0x7fddc8102460 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009900 tx=0x7fddb802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 -- 172.21.15.6:0/179601961 shutdown_connections 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 --2- 172.21.15.6:0/179601961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8106bf0 0x7fddc8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 --2- 172.21.15.6:0/179601961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 0x7fddc81066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 --2- 172.21.15.6:0/179601961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8102050 0x7fddc8102460 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 -- 172.21.15.6:0/179601961 >> 172.21.15.6:0/179601961 conn(0x7fddc8077c60 msgr2=0x7fddc80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 -- 172.21.15.6:0/179601961 shutdown_connections 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.230+0000 7fddcd810640 1 -- 172.21.15.6:0/179601961 wait complete. 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 Processor -- start 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 -- start start 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 0x7fddc819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 0x7fddc819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8113950 con 0x7fddc8106bf0 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81137d0 con 0x7fddc81062a0 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddcd810640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8113ad0 con 0x7fddc8102050 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.231+0000 7fddc77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53194/0 (socket says 172.21.15.6:53194) 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc6ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 0x7fddc819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 -- 172.21.15.6:0/2259607148 learned_addr learned my addr 172.21.15.6:0/2259607148 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc67fc640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 0x7fddc819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 -- 172.21.15.6:0/2259607148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 msgr2=0x7fddc819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 0x7fddc819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 -- 172.21.15.6:0/2259607148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 msgr2=0x7fddc819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 0x7fddc819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 -- 172.21.15.6:0/2259607148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc81a0330 con 0x7fddc8106bf0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 0x7fddc819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddc77fe640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fddc000cad0 tx=0x7fddc000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddcc80e640 1 -- 172.21.15.6:0/2259607148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc000ae20 con 0x7fddc8106bf0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc81a0620 con 0x7fddc8106bf0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddcc80e640 1 -- 172.21.15.6:0/2259607148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc0005020 con 0x7fddc8106bf0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.232+0000 7fddcc80e640 1 -- 172.21.15.6:0/2259607148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc000f6b0 con 0x7fddc8106bf0 2024-09-21T08:01:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.233+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc81a6d80 con 0x7fddc8106bf0 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.235+0000 7fddd3d84740 1 Processor -- start 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddcc80e640 1 -- 172.21.15.6:0/2259607148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fddc00051d0 con 0x7fddc8106bf0 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 -- start start 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d605670 0x55657d9cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55657d943e60 con 0x55657d5fd490 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55657d933290 con 0x55657d605670 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddd3d84740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55657d9370a0 con 0x55657d626350 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddc6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddc6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53202/0 (socket says 172.21.15.6:53202) 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddc6ffd640 1 -- 172.21.15.6:0/436926888 learned_addr learned my addr 172.21.15.6:0/436926888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddc67fc640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d605670 0x55657d9cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.236+0000 7fddc67fc640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 -- 172.21.15.6:0/436926888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 msgr2=0x55657d9cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 -- 172.21.15.6:0/436926888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d605670 msgr2=0x55657d9cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d605670 0x55657d9cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddcc80e640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 0x7fddb40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 -- 172.21.15.6:0/436926888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55657d691930 con 0x55657d5fd490 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc67fc640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc77fe640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 0x7fddb40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009900 tx=0x7fddb8031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e4b7f5ec426f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.237+0000 7fddcc80e640 1 -- 172.21.15.6:0/2259607148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fddc00e7ae0 con 0x7fddc8106bf0 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.238+0000 7fddbdffb640 1 -- 172.21.15.6:0/436926888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8035040 con 0x55657d5fd490 2024-09-21T08:01:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.238+0000 7fddc77fe640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 0x7fddb40b8a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fddc00e5190 tx=0x7fddc00eb2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.238+0000 7fddbdffb640 1 -- 172.21.15.6:0/436926888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddb80044c0 con 0x55657d5fd490 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.238+0000 7fddbdffb640 1 -- 172.21.15.6:0/436926888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8003850 con 0x55657d5fd490 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- 172.21.15.6:0/436926888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 msgr2=0x55657d9cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009900 tx=0x7fddb8031b10 comp rx=0 tx=0).stop 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- 172.21.15.6:0/436926888 shutdown_connections 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d605670 0x55657d9cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5fd490 0x55657d9cd970 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 --2- 172.21.15.6:0/436926888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- 172.21.15.6:0/436926888 >> 172.21.15.6:0/436926888 conn(0x55657d61a740 msgr2=0x55657d9cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- 172.21.15.6:0/436926888 shutdown_connections 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- 172.21.15.6:0/436926888 wait complete. 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.239+0000 7fddd3d84740 1 -- start start 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 Processor -- start 2024-09-21T08:01:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55657d794890 con 0x55657d605670 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55657d8cdd40 con 0x55657d5fd490 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55657d9dbbb0 con 0x55657d626350 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddc6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddd3d84740 10 client.0 _ll_register_callbacks cb 0x55657d931c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddc6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53204/0 (socket says 172.21.15.6:53204) 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddc6ffd640 1 -- 172.21.15.6:0/592600553 learned_addr learned my addr 172.21.15.6:0/592600553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.240+0000 7fddc67fc640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc67fc640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 -- 172.21.15.6:0/592600553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 msgr2=0x55657d9e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 -- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 msgr2=0x55657d9d8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9d8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 -- 172.21.15.6:0/592600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55657d9e5440 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc67fc640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fddb80098a0 tx=0x7fddb802ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ecfc85e9bc5368 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fdda6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8050070 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fddb803fbf0 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.241+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55657d945db0 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fddb805c050 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 10 client.15492 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55657d9e7ce0 con 0x55657d605670 2024-09-21T08:01:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddb80054d0 con 0x55657d605670 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fddb8048470 con 0x55657d605670 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 10 client.15492 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 20 client.15492 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d5e4cd0 0x55657d9eb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 4 client.15492 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.242+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55657d945db0 con 0x55657d5e4cd0 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.243+0000 7fddc67fc640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d5e4cd0 0x55657d9eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.243+0000 7fddc67fc640 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d5e4cd0 0x55657d9eb040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0ca4924fdeacc69 server_cookie=e2c4032d5a4cacbf in_seq=0 out_seq=0 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.243+0000 7fdda6ffd640 10 client.15492 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fdda6ffd640 1 -- 172.21.15.6:0/592600553 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55657d945db0 con 0x55657d5e4cd0 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fdda6ffd640 10 client.15492 handle_command_reply: tid=0 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 client.15492 shutdown 2024-09-21T08:01:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 msgr2=0x55657d9d9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fddb80098a0 tx=0x7fddb802ab10 comp rx=0 tx=0).stop 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 shutdown_connections 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d5e4cd0 0x55657d9eb040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fdda6ffd640 0 client.15492 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d626350 0x55657d9e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d9480 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 --2- 172.21.15.6:0/592600553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9d8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 >> 172.21.15.6:0/592600553 conn(0x55657d61a740 msgr2=0x55657d9d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 shutdown_connections 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 1 -- 172.21.15.6:0/592600553 wait complete. 2024-09-21T08:01:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.244+0000 7fddd3d84740 20 client.15492 trim_cache size 0 max 16384 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 Processor -- start 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 -- start start 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d5e4cd0 0x55657d9d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81acad0 con 0x55657d605670 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81af350 con 0x55657d5fd490 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.263+0000 7fddd3d84740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81ad140 con 0x55657d5e4cd0 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53220/0 (socket says 172.21.15.6:53220) 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 -- 172.21.15.6:0/1818698711 learned_addr learned my addr 172.21.15.6:0/1818698711 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d5e4cd0 0x55657d9d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 -- 172.21.15.6:0/1818698711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d5e4cd0 msgr2=0x55657d9d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d5e4cd0 0x55657d9d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 -- 172.21.15.6:0/1818698711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 msgr2=0x55657d9e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9e4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 -- 172.21.15.6:0/1818698711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55657d9cf720 con 0x55657d605670 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fddc81091a0 tx=0x7fddb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d000785b5dbd02cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddbd7fa640 1 -- 172.21.15.6:0/1818698711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb001b040 con 0x55657d605670 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddbd7fa640 1 -- 172.21.15.6:0/1818698711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddb0012e40 con 0x55657d605670 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.264+0000 7fddbd7fa640 1 -- 172.21.15.6:0/1818698711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0005620 con 0x55657d605670 2024-09-21T08:01:08.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 -- 172.21.15.6:0/1818698711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 msgr2=0x55657d9d3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fddc81091a0 tx=0x7fddb0004730 comp rx=0 tx=0).stop 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 -- 172.21.15.6:0/1818698711 shutdown_connections 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d605670 0x55657d9d3550 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1818698711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d5e4cd0 0x55657d9d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 -- 172.21.15.6:0/1818698711 >> 172.21.15.6:0/1818698711 conn(0x55657d61a740 msgr2=0x55657d9d75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.265+0000 7fddd3d84740 1 -- 172.21.15.6:0/1818698711 shutdown_connections 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 -- 172.21.15.6:0/1818698711 wait complete. 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 -- start start 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 Processor -- start 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9ec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d605670 0x55657d9ec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81ad810 con 0x55657d5e4cd0 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81aec80 con 0x55657d5fd490 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.266+0000 7fddd3d84740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddc81adee0 con 0x55657d605670 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddd3d84740 10 client.0 _ll_register_callbacks cb 0x7fddb80319e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53226/0 (socket says 172.21.15.6:53226) 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 -- 172.21.15.6:0/1562598808 learned_addr learned my addr 172.21.15.6:0/1562598808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d605670 0x55657d9ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 -- 172.21.15.6:0/1562598808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d605670 msgr2=0x55657d9ec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d605670 0x55657d9ec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 -- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 msgr2=0x55657d9ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 -- 172.21.15.6:0/1562598808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55657da547c0 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fddc67fc640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fddb000b410 tx=0x7fddb0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ae764180f3735d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fdda6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.267+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb00055a0 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fddb00129b0 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55657d941860 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fddb0012bb0 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 10 client.15498 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55657da55980 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55657d941860 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fddb0021040 con 0x55657d5e4cd0 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 10 client.15498 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 20 client.15498 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d626350 0x55657da57fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 4 client.15498 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.268+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55657d93ec90 con 0x55657d626350 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.269+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d626350 0x55657da57fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.269+0000 7fdda6ffd640 10 client.15498 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.269+0000 7fddc6ffd640 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d626350 0x55657da57fb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22c208d156c53b5 server_cookie=4ebe8ca7450fb64a in_seq=0 out_seq=0 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fdda6ffd640 1 -- 172.21.15.6:0/1562598808 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55657d93ec90 con 0x55657d626350 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fdda6ffd640 10 client.15498 handle_command_reply: tid=0 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 client.15498 shutdown 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 msgr2=0x55657d9eea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fddb000b410 tx=0x7fddb0014040 comp rx=0 tx=0).stop 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 shutdown_connections 2024-09-21T08:01:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55657d626350 0x55657da57fb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55657d605670 0x55657d9ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fdda6ffd640 0 client.15498 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55657d5fd490 0x55657d9ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 --2- 172.21.15.6:0/1562598808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55657d5e4cd0 0x55657d9eea80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 >> 172.21.15.6:0/1562598808 conn(0x55657d61a740 msgr2=0x55657d9d7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 shutdown_connections 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 1 -- 172.21.15.6:0/1562598808 wait complete. 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.271+0000 7fddd3d84740 20 client.15498 trim_cache size 0 max 16384 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:01:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "02c52d1c-f2d1-4deb-a790-30e7b25fb30e", 2024-09-21T08:01:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:01:08.280 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 msgr2=0x7fddb40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 0x7fddb40b8a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fddc00e5190 tx=0x7fddc00eb2d0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 msgr2=0x7fddc819fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fddc000cad0 tx=0x7fddc000cf90 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 shutdown_connections 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fddb40b6560 0x7fddb40b8a70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddc8106bf0 0x7fddc819fc00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc81062a0 0x7fddc819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 --2- 172.21.15.6:0/2259607148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddc8102050 0x7fddc819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 >> 172.21.15.6:0/2259607148 conn(0x7fddc8077c60 msgr2=0x7fddc8107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 shutdown_connections 2024-09-21T08:01:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.272+0000 7fddcd810640 1 -- 172.21.15.6:0/2259607148 wait complete. 2024-09-21T08:01:08.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/2090094074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281082e0 msgr2=0x7fbf281086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/2090094074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281082e0 0x7fbf281086f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009900 tx=0x7fbf2402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/2090094074 shutdown_connections 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/2090094074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 0x7fbf2810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/2090094074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281082e0 0x7fbf281086f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/2090094074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281029b0 0x7fbf28102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/2090094074 >> 172.21.15.6:0/2090094074 conn(0x7fbf2807a740 msgr2=0x7fbf2807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/2090094074 shutdown_connections 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.352+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/2090094074 wait complete. 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 Processor -- start 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 -- start start 2024-09-21T08:01:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281082e0 0x7fbf2819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 0x7fbf2819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281127f0 con 0x7fbf281029b0 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28112670 con 0x7fbf28108c30 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2fcbd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28112970 con 0x7fbf281082e0 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53244/0 (socket says 172.21.15.6:53244) 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 -- 172.21.15.6:0/4109129154 learned_addr learned my addr 172.21.15.6:0/4109129154 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2d258640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281082e0 0x7fbf2819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2e25a640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 0x7fbf2819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 -- 172.21.15.6:0/4109129154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281082e0 msgr2=0x7fbf2819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281082e0 0x7fbf2819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 -- 172.21.15.6:0/4109129154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 msgr2=0x7fbf2819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.353+0000 7fbf2da59640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 0x7fbf2819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf2da59640 1 -- 172.21.15.6:0/4109129154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf281a02b0 con 0x7fbf281029b0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf2da59640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00e9f0 tx=0x7fbf1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00cd80 con 0x7fbf281029b0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf1c0054b0 con 0x7fbf281029b0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c010430 con 0x7fbf281029b0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf281a05a0 con 0x7fbf281029b0 2024-09-21T08:01:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.354+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf281a6d30 con 0x7fbf281029b0 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.355+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf28102dc0 con 0x7fbf281029b0 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.357+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fbf1c0046c0 con 0x7fbf281029b0 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.357+0000 7fbf1affd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 0x7fbf140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.357+0000 7fbf2d258640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 0x7fbf140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.358+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fbf1c0e7dd0 con 0x7fbf281029b0 2024-09-21T08:01:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.358+0000 7fbf2d258640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 0x7fbf140b8a70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402a930 tx=0x7fbf24005a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.360+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf1c0ae160 con 0x7fbf281029b0 2024-09-21T08:01:08.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.571+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fbf28063800 con 0x7fbf140b6560 2024-09-21T08:01:08.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.578+0000 7fbf1affd640 1 -- 172.21.15.6:0/4109129154 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fbf28063800 con 0x7fbf140b6560 2024-09-21T08:01:08.580 INFO:teuthology.orchestra.run.smithi006.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T08:01:07", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 msgr2=0x7fbf140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 0x7fbf140b8a70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402a930 tx=0x7fbf24005a40 comp rx=0 tx=0).stop 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 msgr2=0x7fbf2819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00e9f0 tx=0x7fbf1c00edf0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 shutdown_connections 2024-09-21T08:01:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf140b6560 0x7fbf140b8a70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf281082e0 0x7fbf2819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf28108c30 0x7fbf2819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 --2- 172.21.15.6:0/4109129154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf281029b0 0x7fbf2819a380 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.580+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 >> 172.21.15.6:0/4109129154 conn(0x7fbf2807a740 msgr2=0x7fbf28101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.581+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 shutdown_connections 2024-09-21T08:01:08.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.581+0000 7fbf2fcbd640 1 -- 172.21.15.6:0/4109129154 wait complete. 2024-09-21T08:01:08.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 -- 172.21.15.6:0/1629716181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c10dd60 msgr2=0x7f0e4c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 --2- 172.21.15.6:0/1629716181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c110250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009ca0 tx=0x7f0e4402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 -- 172.21.15.6:0/1629716181 shutdown_connections 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 --2- 172.21.15.6:0/1629716181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c105250 0x7f0e4c10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 --2- 172.21.15.6:0/1629716181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c110250 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 --2- 172.21.15.6:0/1629716181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c104900 0x7f0e4c104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 -- 172.21.15.6:0/1629716181 >> 172.21.15.6:0/1629716181 conn(0x7f0e4c07a740 msgr2=0x7f0e4c07ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 -- 172.21.15.6:0/1629716181 shutdown_connections 2024-09-21T08:01:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.750+0000 7f0e51012640 1 -- 172.21.15.6:0/1629716181 wait complete. 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.751+0000 7f0e51012640 1 Processor -- start 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.751+0000 7f0e51012640 1 -- start start 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105250 0x7f0e4c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1138c0 con 0x7f0e4c104900 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c113740 con 0x7f0e4c105250 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e51012640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c113a40 con 0x7f0e4c10dd60 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53258/0 (socket says 172.21.15.6:53258) 2024-09-21T08:01:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 -- 172.21.15.6:0/1692024034 learned_addr learned my addr 172.21.15.6:0/1692024034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4b59e640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105250 0x7f0e4c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 -- 172.21.15.6:0/1692024034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10dd60 msgr2=0x7f0e4c19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 -- 172.21.15.6:0/1692024034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105250 msgr2=0x7f0e4c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105250 0x7f0e4c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 -- 172.21.15.6:0/1692024034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c1a01f0 con 0x7f0e4c104900 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e4ad9d640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00ea60 tx=0x7f0e3c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.752+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00cde0 con 0x7f0e4c104900 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.753+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e3c0035f0 con 0x7f0e4c104900 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.753+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c1a04e0 con 0x7f0e4c104900 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.753+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c010690 con 0x7f0e4c104900 2024-09-21T08:01:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.753+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c1a6c70 con 0x7f0e4c104900 2024-09-21T08:01:08.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.754+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4c104d10 con 0x7f0e4c104900 2024-09-21T08:01:08.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.755+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f0e3c004000 con 0x7f0e4c104900 2024-09-21T08:01:08.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.757+0000 7f0e33fff640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 0x7f0e340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.757+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 0x7f0e340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.757+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0e3c0e7d90 con 0x7f0e4c104900 2024-09-21T08:01:08.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.757+0000 7f0e4a59c640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 0x7f0e340b8a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c10f9f0 tx=0x7f0e40005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.760+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e3c056710 con 0x7f0e4c104900 2024-09-21T08:01:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:08 smithi119 ceph-mon[33564]: pgmap v346: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:08 smithi119 ceph-mon[33564]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:08 smithi119 ceph-mon[33564]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:08 smithi145 ceph-mon[34049]: pgmap v346: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:08 smithi145 ceph-mon[34049]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:08 smithi145 ceph-mon[34049]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:08 smithi006 ceph-mon[30970]: pgmap v346: 129 pgs: 129 active+clean; 650 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T08:01:08.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:08 smithi006 ceph-mon[30970]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:08 smithi006 ceph-mon[30970]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.974+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f0e4c107f60 con 0x7f0e340b6560 2024-09-21T08:01:08.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.982+0000 7f0e33fff640 1 -- 172.21.15.6:0/1692024034 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f0e4c107f60 con 0x7f0e340b6560 2024-09-21T08:01:08.984 INFO:teuthology.orchestra.run.smithi006.stdout:/ 1m 6m3h 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 msgr2=0x7f0e340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 0x7f0e340b8a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c10f9f0 tx=0x7f0e40005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 msgr2=0x7f0e4c19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00ea60 tx=0x7f0e3c00ef20 comp rx=0 tx=0).stop 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 shutdown_connections 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0e340b6560 0x7f0e340b8a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c10dd60 0x7f0e4c19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e4c105250 0x7f0e4c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 --2- 172.21.15.6:0/1692024034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e4c104900 0x7f0e4c19a2c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 >> 172.21.15.6:0/1692024034 conn(0x7f0e4c07a740 msgr2=0x7f0e4c107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 shutdown_connections 2024-09-21T08:01:08.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:08.985+0000 7f0e51012640 1 -- 172.21.15.6:0/1692024034 wait complete. 2024-09-21T08:01:08.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T08:01:09.025 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T08:01:09.037 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T08:01:09.077 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T08:01:09.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T08:01:09.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:01:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:01:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:01:09.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:09.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:09 smithi006 ceph-mon[30970]: from='client.15510 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:09 smithi119 ceph-mon[33564]: from='client.15510 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:09 smithi145 ceph-mon[34049]: from='client.15510 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 -- 172.21.15.6:0/833796188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c102a80 msgr2=0x7f347c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 --2- 172.21.15.6:0/833796188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c102a80 0x7f347c102e90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3478009900 tx=0x7f347802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 -- 172.21.15.6:0/833796188 shutdown_connections 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 --2- 172.21.15.6:0/833796188 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c1083c0 0x7f347c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 --2- 172.21.15.6:0/833796188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c108d10 0x7f347c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 --2- 172.21.15.6:0/833796188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c102a80 0x7f347c102e90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 -- 172.21.15.6:0/833796188 >> 172.21.15.6:0/833796188 conn(0x7f347c079740 msgr2=0x7f347c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 -- 172.21.15.6:0/833796188 shutdown_connections 2024-09-21T08:01:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.040+0000 7f348411d640 1 -- 172.21.15.6:0/833796188 wait complete. 2024-09-21T08:01:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.041+0000 7f348411d640 1 Processor -- start 2024-09-21T08:01:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.041+0000 7f348411d640 1 -- start start 2024-09-21T08:01:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.041+0000 7f348411d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c102a80 0x7f347c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.041+0000 7f348411d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f348411d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 0x7f347c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f348411d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f347c112830 con 0x7f347c1083c0 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f348411d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1126b0 con 0x7f347c102a80 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f348411d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1129b0 con 0x7f347c108d10 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53278/0 (socket says 172.21.15.6:53278) 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 -- 172.21.15.6:0/1123402766 learned_addr learned my addr 172.21.15.6:0/1123402766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f3481eb9640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c102a80 0x7f347c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34826ba640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 0x7f347c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 -- 172.21.15.6:0/1123402766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 msgr2=0x7f347c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 0x7f347c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 -- 172.21.15.6:0/1123402766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c102a80 msgr2=0x7f347c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c102a80 0x7f347c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 -- 172.21.15.6:0/1123402766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c1a0340 con 0x7f347c1083c0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34826ba640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 0x7f347c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.042+0000 7f34816b8640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f346c00d740 tx=0x7f346c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.043+0000 7f3472ffd640 1 -- 172.21.15.6:0/1123402766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c017070 con 0x7f347c1083c0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.043+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c1a0630 con 0x7f347c1083c0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.043+0000 7f3472ffd640 1 -- 172.21.15.6:0/1123402766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f346c00de50 con 0x7f347c1083c0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.043+0000 7f3472ffd640 1 -- 172.21.15.6:0/1123402766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c004c60 con 0x7f347c1083c0 2024-09-21T08:01:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.043+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c1a6d90 con 0x7f347c1083c0 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.045+0000 7f348a691740 1 Processor -- start 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.045+0000 7f348a691740 1 -- start start 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3472ffd640 1 -- 172.21.15.6:0/1123402766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f346c010460 con 0x7f347c1083c0 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 0x555dbb3d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555dbb34ce50 con 0x555dbb02f070 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555dbb33c280 con 0x555dbb0061b0 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f348a691740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555dbb340090 con 0x555dbb00e390 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34826ba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34826ba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53290/0 (socket says 172.21.15.6:53290) 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34826ba640 1 -- 172.21.15.6:0/1140608659 learned_addr learned my addr 172.21.15.6:0/1140608659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 0x555dbb3d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34816b8640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 -- 172.21.15.6:0/1140608659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 msgr2=0x555dbb3d70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3d70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 -- 172.21.15.6:0/1140608659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 msgr2=0x555dbb3d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f3481eb9640 1 -- 172.21.15.6:0/1140608659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb09a650 con 0x555dbb0061b0 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34826ba640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.046+0000 7f34816b8640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3d70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3481eb9640 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 0x555dbb3d6b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3478005940 tx=0x7f3478031ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba9274cee0524a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3472ffd640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 0x7f34680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3467fff640 1 -- 172.21.15.6:0/1140608659 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478035030 con 0x555dbb0061b0 2024-09-21T08:01:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3467fff640 1 -- 172.21.15.6:0/1140608659 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3478040070 con 0x555dbb0061b0 2024-09-21T08:01:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3467fff640 1 -- 172.21.15.6:0/1140608659 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34780038e0 con 0x555dbb0061b0 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f34826ba640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 0x7f34680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.047+0000 7f3472ffd640 1 -- 172.21.15.6:0/1123402766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f346c0e7350 con 0x7f347c1083c0 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f34826ba640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 0x7f34680b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3474009fd0 tx=0x7f34740098a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- 172.21.15.6:0/1140608659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 msgr2=0x555dbb3d6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 0x555dbb3d6b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3478005940 tx=0x7f3478031ba0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- 172.21.15.6:0/1140608659 shutdown_connections 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3d70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb0061b0 0x555dbb3d6b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 --2- 172.21.15.6:0/1140608659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb3d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- 172.21.15.6:0/1140608659 >> 172.21.15.6:0/1140608659 conn(0x555dbb023460 msgr2=0x555dbb3d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- 172.21.15.6:0/1140608659 shutdown_connections 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- 172.21.15.6:0/1140608659 wait complete. 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.048+0000 7f348a691740 1 -- start start 2024-09-21T08:01:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 Processor -- start 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3e2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555dbb19d700 con 0x555dbb0061b0 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555dbb2d7110 con 0x555dbb02f070 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555dbb3e4dd0 con 0x555dbb00e390 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f348a691740 10 client.0 _ll_register_callbacks cb 0x555dbb2f0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f3481eb9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f3481eb9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53304/0 (socket says 172.21.15.6:53304) 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f3481eb9640 1 -- 172.21.15.6:0/3133759755 learned_addr learned my addr 172.21.15.6:0/3133759755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f34816b8640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3e2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.049+0000 7f34826ba640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 -- 172.21.15.6:0/3133759755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 msgr2=0x555dbb3e2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3e2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 -- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 msgr2=0x555dbb3ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 -- 172.21.15.6:0/3133759755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb304c40 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f347802a450 tx=0x7f34780316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782674aee8d50b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f34657fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347804c070 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3478004440 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3478040070 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3478058050 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f348a691740 10 client.15522 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.050+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555dbb3f0a50 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3478040070 con 0x555dbb0061b0 2024-09-21T08:01:10.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f347803c670 con 0x555dbb0061b0 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 10 client.15522 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 20 client.15522 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafed9f0 0x555dbb3f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 4 client.15522 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dbb34eda0 con 0x555dbafed9f0 2024-09-21T08:01:10.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f34816b8640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafed9f0 0x555dbb3f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f34657fa640 10 client.15522 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.051+0000 7f34816b8640 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafed9f0 0x555dbb3f3db0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86adf1b1f0f84925 server_cookie=1eb185eeb6da6539 in_seq=0 out_seq=0 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f34657fa640 1 -- 172.21.15.6:0/3133759755 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f346c086e50 con 0x555dbafed9f0 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f34657fa640 10 client.15522 handle_command_reply: tid=0 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 client.15522 shutdown 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 msgr2=0x555dbb3e1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f347802a450 tx=0x7f34780316b0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 shutdown_connections 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafed9f0 0x555dbb3f3db0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb00e390 0x555dbb3e2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 --2- 172.21.15.6:0/3133759755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb0061b0 0x555dbb3e1d40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f34657fa640 0 client.15522 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.052+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 >> 172.21.15.6:0/3133759755 conn(0x555dbb023460 msgr2=0x555dbb3d9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.053+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 shutdown_connections 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.053+0000 7f348a691740 1 -- 172.21.15.6:0/3133759755 wait complete. 2024-09-21T08:01:10.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.053+0000 7f348a691740 20 client.15522 trim_cache size 0 max 16384 2024-09-21T08:01:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 Processor -- start 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 -- start start 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3d9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3df470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1aed60 con 0x555dbb00e390 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1b15e0 con 0x555dbb02f070 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.070+0000 7f348a691740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1af3d0 con 0x555dbb0061b0 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53310/0 (socket says 172.21.15.6:53310) 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 -- 172.21.15.6:0/2248296935 learned_addr learned my addr 172.21.15.6:0/2248296935 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f3481eb9640 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3d9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34826ba640 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 -- 172.21.15.6:0/2248296935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 msgr2=0x555dbb3d9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3d9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 -- 172.21.15.6:0/2248296935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 msgr2=0x555dbb3df470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3df470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 -- 172.21.15.6:0/2248296935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb3da3a0 con 0x555dbb00e390 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34816b8640 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f346c0e4890 tx=0x7f346c094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de8fad3ddd67f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34677fe640 1 -- 172.21.15.6:0/2248296935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c020040 con 0x555dbb00e390 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34677fe640 1 -- 172.21.15.6:0/2248296935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555dbb34eda0 con 0x555dbb00e390 2024-09-21T08:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.071+0000 7f34677fe640 1 -- 172.21.15.6:0/2248296935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0a9150 con 0x555dbb00e390 2024-09-21T08:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- 172.21.15.6:0/2248296935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 msgr2=0x555dbb3def30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f346c0e4890 tx=0x7f346c094040 comp rx=0 tx=0).stop 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- 172.21.15.6:0/2248296935 shutdown_connections 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb02f070 0x555dbb3df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb00e390 0x555dbb3def30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 --2- 172.21.15.6:0/2248296935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3d9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- 172.21.15.6:0/2248296935 >> 172.21.15.6:0/2248296935 conn(0x555dbb023460 msgr2=0x555dbb3d9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- 172.21.15.6:0/2248296935 shutdown_connections 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- 172.21.15.6:0/2248296935 wait complete. 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.072+0000 7f348a691740 1 -- start start 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 Processor -- start 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 0x555dbb3f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1afaa0 con 0x555dbb02f070 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1b0f10 con 0x555dbb00e390 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1b0170 con 0x555dbb0061b0 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f348a691740 10 client.0 _ll_register_callbacks cb 0x7f3474009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f34826ba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f34826ba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53312/0 (socket says 172.21.15.6:53312) 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f34826ba640 1 -- 172.21.15.6:0/3637761517 learned_addr learned my addr 172.21.15.6:0/3637761517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.073+0000 7f34816b8640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 0x555dbb3f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 -- 172.21.15.6:0/3637761517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 msgr2=0x555dbb3f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 -- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 msgr2=0x555dbb3f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 0x555dbb3f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 -- 172.21.15.6:0/3637761517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb457be0 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34816b8640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 0x555dbb3f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34826ba640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3474011f20 tx=0x7f3474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4526f49aef1c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34657fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474004b20 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dbb34eda0 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3474004cc0 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3474036050 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f348a691740 10 client.15528 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.074+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555dbb45f010 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555dbb34eda0 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f347400f040 con 0x555dbb02f070 2024-09-21T08:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 10 client.15528 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 20 client.15528 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafc2da0 0x555dbb461800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 4 client.15528 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555dbb34a850 con 0x555dbafc2da0 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.075+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafc2da0 0x555dbb461800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f3481eb9640 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafc2da0 0x555dbb461800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e59a5a2bdac610b9 server_cookie=6fdd21b3fe2c9505 in_seq=0 out_seq=0 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f34657fa640 10 client.15528 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f34657fa640 1 -- 172.21.15.6:0/3637761517 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x555dbb34a850 con 0x555dbafc2da0 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f34657fa640 10 client.15528 handle_command_reply: tid=0 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 client.15528 shutdown 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 msgr2=0x555dbb457570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3474011f20 tx=0x7f3474004a40 comp rx=0 tx=0).stop 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 shutdown_connections 2024-09-21T08:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555dbafc2da0 0x555dbb461800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555dbb02f070 0x555dbb457570 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dbb00e390 0x555dbb3f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f34657fa640 0 client.15528 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 --2- 172.21.15.6:0/3637761517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555dbb0061b0 0x555dbb3f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 >> 172.21.15.6:0/3637761517 conn(0x555dbb023460 msgr2=0x555dbb3d7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 shutdown_connections 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 1 -- 172.21.15.6:0/3637761517 wait complete. 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.076+0000 7f348a691740 20 client.15528 trim_cache size 0 max 16384 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:10.082 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "02c52d1c-f2d1-4deb-a790-30e7b25fb30e", 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:01:10.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 msgr2=0x7f34680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 0x7f34680b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3474009fd0 tx=0x7f34740098a0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 msgr2=0x7f347c19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f346c00d740 tx=0x7f346c00dc00 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 shutdown_connections 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34680b65f0 0x7f34680b8b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f347c108d10 0x7f347c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f347c1083c0 0x7f347c19a970 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 --2- 172.21.15.6:0/1123402766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f347c102a80 0x7f347c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 >> 172.21.15.6:0/1123402766 conn(0x7f347c079740 msgr2=0x7f347c101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 shutdown_connections 2024-09-21T08:01:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.077+0000 7f348411d640 1 -- 172.21.15.6:0/1123402766 wait complete. 2024-09-21T08:01:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 -- 172.21.15.6:0/1042571522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 msgr2=0x7f2db01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 --2- 172.21.15.6:0/1042571522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db01087b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009900 tx=0x7f2da402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 -- 172.21.15.6:0/1042571522 shutdown_connections 2024-09-21T08:01:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 --2- 172.21.15.6:0/1042571522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0108cf0 0x7f2db010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 --2- 172.21.15.6:0/1042571522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db01087b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 --2- 172.21.15.6:0/1042571522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0102a60 0x7f2db0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 -- 172.21.15.6:0/1042571522 >> 172.21.15.6:0/1042571522 conn(0x7f2db0079730 msgr2=0x7f2db0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 -- 172.21.15.6:0/1042571522 shutdown_connections 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.246+0000 7f2db6787640 1 -- 172.21.15.6:0/1042571522 wait complete. 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 Processor -- start 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 -- start start 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 0x7f2db019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0108cf0 0x7f2db019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0113930 con 0x7f2db01083a0 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01137b0 con 0x7f2db0102a60 2024-09-21T08:01:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.247+0000 7f2db6787640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0113ab0 con 0x7f2db0108cf0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53326/0 (socket says 172.21.15.6:53326) 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 -- 172.21.15.6:0/507070176 learned_addr learned my addr 172.21.15.6:0/507070176 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daffff640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 0x7f2db019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2db4d24640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0108cf0 0x7f2db019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 -- 172.21.15.6:0/507070176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0108cf0 msgr2=0x7f2db019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0108cf0 0x7f2db019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 -- 172.21.15.6:0/507070176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 msgr2=0x7f2db019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 0x7f2db019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 -- 172.21.15.6:0/507070176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db01a02d0 con 0x7f2db01083a0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daffff640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 0x7f2db019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2daf7fe640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2da4005940 tx=0x7f2da4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da403f030 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.248+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db01a0560 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.249+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2da4004440 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.249+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4035070 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.249+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db01a6d20 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.250+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db0102e70 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.251+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f2da4042030 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.252+0000 7f2dad7fa640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 0x7f2d980b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.252+0000 7f2daffff640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 0x7f2d980b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.252+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f2da4108310 con 0x7f2db01083a0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.252+0000 7f2daffff640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 0x7f2d980b8b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2da00058c0 tx=0x7f2da0005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.255+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2da40ce540 con 0x7f2db01083a0 2024-09-21T08:01:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.440+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2db0063800 con 0x7f2d980b65f0 2024-09-21T08:01:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.446+0000 7f2dad7fa640 1 -- 172.21.15.6:0/507070176 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340799 (secure 0 0 0) 0x7f2db0063800 con 0x7f2d980b65f0 2024-09-21T08:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 msgr2=0x7f2d980b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 0x7f2d980b8b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2da00058c0 tx=0x7f2da0005850 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 msgr2=0x7f2db019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2da4005940 tx=0x7f2da4004040 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 shutdown_connections 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d980b65f0 0x7f2d980b8b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2db0108cf0 0x7f2db019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db01083a0 0x7f2db019a900 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 --2- 172.21.15.6:0/507070176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0102a60 0x7f2db019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 >> 172.21.15.6:0/507070176 conn(0x7f2db0079730 msgr2=0x7f2db01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 shutdown_connections 2024-09-21T08:01:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:10.451+0000 7f2db6787640 1 -- 172.21.15.6:0/507070176 wait complete. 2024-09-21T08:01:10.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:10 smithi006 ceph-mon[30970]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-21T08:01:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:10 smithi006 ceph-mon[30970]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T08:01:10.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:10 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:01:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:10 smithi119 ceph-mon[33564]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-21T08:01:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:10 smithi119 ceph-mon[33564]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T08:01:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:10 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:01:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:10 smithi145 ceph-mon[34049]: pgmap v347: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-21T08:01:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:10 smithi145 ceph-mon[34049]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T08:01:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:10 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:01:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-21T08:01:09.564993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1059518,"num_objects":27,"num_object_clones":0,"num_object_copies":83,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":329,"num_read_kb":282,"num_write":290,"num_write_kb":3132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":732,"ondisk_log_size":732,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352352,"kb_used_data":11424,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589472,"statfs":{"total":1151940427776,"available":1151579619328,"internally_reserved":0,"allocated":11698176,"data_stored":8370748,"data_compressed":480830,"data_compressed_allocated":651264,"data_compressed_original":3121152,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":398851,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":48,"num_write":77,"num_write_kb":881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003858"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174094+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174094+0000","last_peered":"2024-09-21T08:00:04.174094+0000","last_clean":"2024-09-21T08:00:04.174094+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174094+0000","last_undegraded":"2024-09-21T08:00:04.174094+0000","last_fullsized":"2024-09-21T08:00:04.174094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939465+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:01:01.939465+0000","last_peered":"2024-09-21T08:01:01.939465+0000","last_clean":"2024-09-21T08:01:01.939465+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:01:01.939465+0000","last_undegraded":"2024-09-21T08:01:01.939465+0000","last_fullsized":"2024-09-21T08:01:01.939465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944424+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:01:01.944424+0000","last_peered":"2024-09-21T08:01:01.944424+0000","last_clean":"2024-09-21T08:01:01.944424+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:01:01.944424+0000","last_undegraded":"2024-09-21T08:01:01.944424+0000","last_fullsized":"2024-09-21T08:01:01.944424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939448+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:01:01.939448+0000","last_peered":"2024-09-21T08:01:01.939448+0000","last_clean":"2024-09-21T08:01:01.939448+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:01:01.939448+0000","last_undegraded":"2024-09-21T08:01:01.939448+0000","last_fullsized":"2024-09-21T08:01:01.939448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944309+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:01:01.944309+0000","last_peered":"2024-09-21T08:01:01.944309+0000","last_clean":"2024-09-21T08:01:01.944309+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:01:01.944309+0000","last_undegraded":"2024-09-21T08:01:01.944309+0000","last_fullsized":"2024-09-21T08:01:01.944309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950151+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:01:01.950151+0000","last_peered":"2024-09-21T08:01:01.950151+0000","last_clean":"2024-09-21T08:01:01.950151+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:01:01.950151+0000","last_undegraded":"2024-09-21T08:01:01.950151+0000","last_fullsized":"2024-09-21T08:01:01.950151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217411+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217411+0000","last_peered":"2024-09-21T08:00:04.217411+0000","last_clean":"2024-09-21T08:00:04.217411+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217411+0000","last_undegraded":"2024-09-21T08:00:04.217411+0000","last_fullsized":"2024-09-21T08:00:04.217411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.934994+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:01:01.934994+0000","last_peered":"2024-09-21T08:01:01.934994+0000","last_clean":"2024-09-21T08:01:01.934994+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:01:01.934994+0000","last_undegraded":"2024-09-21T08:01:01.934994+0000","last_fullsized":"2024-09-21T08:01:01.934994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217517+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217517+0000","last_peered":"2024-09-21T08:00:04.217517+0000","last_clean":"2024-09-21T08:00:04.217517+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217517+0000","last_undegraded":"2024-09-21T08:00:04.217517+0000","last_fullsized":"2024-09-21T08:00:04.217517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.933274+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:01:01.933274+0000","last_peered":"2024-09-21T08:01:01.933274+0000","last_clean":"2024-09-21T08:01:01.933274+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:01:01.933274+0000","last_undegraded":"2024-09-21T08:01:01.933274+0000","last_fullsized":"2024-09-21T08:01:01.933274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173908+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173908+0000","last_peered":"2024-09-21T08:00:04.173908+0000","last_clean":"2024-09-21T08:00:04.173908+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173908+0000","last_undegraded":"2024-09-21T08:00:04.173908+0000","last_fullsized":"2024-09-21T08:00:04.173908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.913417+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:01:01.913417+0000","last_peered":"2024-09-21T08:01:01.913417+0000","last_clean":"2024-09-21T08:01:01.913417+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:01:01.913417+0000","last_undegraded":"2024-09-21T08:01:01.913417+0000","last_fullsized":"2024-09-21T08:01:01.913417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218029+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.218029+0000","last_peered":"2024-09-21T08:00:04.218029+0000","last_clean":"2024-09-21T08:00:04.218029+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.218029+0000","last_undegraded":"2024-09-21T08:00:04.218029+0000","last_fullsized":"2024-09-21T08:00:04.218029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932571+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:01:01.932571+0000","last_peered":"2024-09-21T08:01:01.932571+0000","last_clean":"2024-09-21T08:01:01.932571+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:01:01.932571+0000","last_undegraded":"2024-09-21T08:01:01.932571+0000","last_fullsized":"2024-09-21T08:01:01.932571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947447+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:01:01.947447+0000","last_peered":"2024-09-21T08:01:01.947447+0000","last_clean":"2024-09-21T08:01:01.947447+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:01:01.947447+0000","last_undegraded":"2024-09-21T08:01:01.947447+0000","last_fullsized":"2024-09-21T08:01:01.947447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:57.242708+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:57.242708+0000","last_peered":"2024-09-21T08:00:57.242708+0000","last_clean":"2024-09-21T08:00:57.242708+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:57.242708+0000","last_undegraded":"2024-09-21T08:00:57.242708+0000","last_fullsized":"2024-09-21T08:00:57.242708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937924+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:01:01.937924+0000","last_peered":"2024-09-21T08:01:01.937924+0000","last_clean":"2024-09-21T08:01:01.937924+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:01:01.937924+0000","last_undegraded":"2024-09-21T08:01:01.937924+0000","last_fullsized":"2024-09-21T08:01:01.937924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936395+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:01:01.936395+0000","last_peered":"2024-09-21T08:01:01.936395+0000","last_clean":"2024-09-21T08:01:01.936395+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:01:01.936395+0000","last_undegraded":"2024-09-21T08:01:01.936395+0000","last_fullsized":"2024-09-21T08:01:01.936395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930026+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:01:01.930026+0000","last_peered":"2024-09-21T08:01:01.930026+0000","last_clean":"2024-09-21T08:01:01.930026+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:01:01.930026+0000","last_undegraded":"2024-09-21T08:01:01.930026+0000","last_fullsized":"2024-09-21T08:01:01.930026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930274+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:01:01.930274+0000","last_peered":"2024-09-21T08:01:01.930274+0000","last_clean":"2024-09-21T08:01:01.930274+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:01:01.930274+0000","last_undegraded":"2024-09-21T08:01:01.930274+0000","last_fullsized":"2024-09-21T08:01:01.930274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994069+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994069+0000","last_peered":"2024-09-21T08:00:03.994069+0000","last_clean":"2024-09-21T08:00:03.994069+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994069+0000","last_undegraded":"2024-09-21T08:00:03.994069+0000","last_fullsized":"2024-09-21T08:00:03.994069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938322+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:01:01.938322+0000","last_peered":"2024-09-21T08:01:01.938322+0000","last_clean":"2024-09-21T08:01:01.938322+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:01:01.938322+0000","last_undegraded":"2024-09-21T08:01:01.938322+0000","last_fullsized":"2024-09-21T08:01:01.938322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073047+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.073047+0000","last_peered":"2024-09-21T08:00:04.073047+0000","last_clean":"2024-09-21T08:00:04.073047+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.073047+0000","last_undegraded":"2024-09-21T08:00:04.073047+0000","last_fullsized":"2024-09-21T08:00:04.073047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943928+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:01:01.943928+0000","last_peered":"2024-09-21T08:01:01.943928+0000","last_clean":"2024-09-21T08:01:01.943928+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:01:01.943928+0000","last_undegraded":"2024-09-21T08:01:01.943928+0000","last_fullsized":"2024-09-21T08:01:01.943928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949835+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:01:01.949835+0000","last_peered":"2024-09-21T08:01:01.949835+0000","last_clean":"2024-09-21T08:01:01.949835+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:01:01.949835+0000","last_undegraded":"2024-09-21T08:01:01.949835+0000","last_fullsized":"2024-09-21T08:01:01.949835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216269+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216269+0000","last_peered":"2024-09-21T08:00:04.216269+0000","last_clean":"2024-09-21T08:00:04.216269+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216269+0000","last_undegraded":"2024-09-21T08:00:04.216269+0000","last_fullsized":"2024-09-21T08:00:04.216269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944698+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:01:01.944698+0000","last_peered":"2024-09-21T08:01:01.944698+0000","last_clean":"2024-09-21T08:01:01.944698+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:01:01.944698+0000","last_undegraded":"2024-09-21T08:01:01.944698+0000","last_fullsized":"2024-09-21T08:01:01.944698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'60","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:08.189164+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:01:08.189164+0000","last_peered":"2024-09-21T08:01:08.189164+0000","last_clean":"2024-09-21T08:01:08.189164+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:01:08.189164+0000","last_undegraded":"2024-09-21T08:01:08.189164+0000","last_fullsized":"2024-09-21T08:01:08.189164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996206+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996206+0000","last_peered":"2024-09-21T08:00:03.996206+0000","last_clean":"2024-09-21T08:00:03.996206+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996206+0000","last_undegraded":"2024-09-21T08:00:03.996206+0000","last_fullsized":"2024-09-21T08:00:03.996206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944973+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:01:01.944973+0000","last_peered":"2024-09-21T08:01:01.944973+0000","last_clean":"2024-09-21T08:01:01.944973+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:01:01.944973+0000","last_undegraded":"2024-09-21T08:01:01.944973+0000","last_fullsized":"2024-09-21T08:01:01.944973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072310+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072310+0000","last_peered":"2024-09-21T08:00:04.072310+0000","last_clean":"2024-09-21T08:00:04.072310+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072310+0000","last_undegraded":"2024-09-21T08:00:04.072310+0000","last_fullsized":"2024-09-21T08:00:04.072310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919572+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:01:01.919572+0000","last_peered":"2024-09-21T08:01:01.919572+0000","last_clean":"2024-09-21T08:01:01.919572+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:01:01.919572+0000","last_undegraded":"2024-09-21T08:01:01.919572+0000","last_fullsized":"2024-09-21T08:01:01.919572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072425+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072425+0000","last_peered":"2024-09-21T08:00:04.072425+0000","last_clean":"2024-09-21T08:00:04.072425+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072425+0000","last_undegraded":"2024-09-21T08:00:04.072425+0000","last_fullsized":"2024-09-21T08:00:04.072425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938130+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:01:01.938130+0000","last_peered":"2024-09-21T08:01:01.938130+0000","last_clean":"2024-09-21T08:01:01.938130+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:01:01.938130+0000","last_undegraded":"2024-09-21T08:01:01.938130+0000","last_fullsized":"2024-09-21T08:01:01.938130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084792+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084792+0000","last_peered":"2024-09-21T08:00:04.084792+0000","last_clean":"2024-09-21T08:00:04.084792+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084792+0000","last_undegraded":"2024-09-21T08:00:04.084792+0000","last_fullsized":"2024-09-21T08:00:04.084792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.941729+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:01:01.941729+0000","last_peered":"2024-09-21T08:01:01.941729+0000","last_clean":"2024-09-21T08:01:01.941729+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:01:01.941729+0000","last_undegraded":"2024-09-21T08:01:01.941729+0000","last_fullsized":"2024-09-21T08:01:01.941729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217516+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217516+0000","last_peered":"2024-09-21T08:00:04.217516+0000","last_clean":"2024-09-21T08:00:04.217516+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217516+0000","last_undegraded":"2024-09-21T08:00:04.217516+0000","last_fullsized":"2024-09-21T08:00:04.217516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950338+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:01:01.950338+0000","last_peered":"2024-09-21T08:01:01.950338+0000","last_clean":"2024-09-21T08:01:01.950338+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:01:01.950338+0000","last_undegraded":"2024-09-21T08:01:01.950338+0000","last_fullsized":"2024-09-21T08:01:01.950338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072872+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072872+0000","last_peered":"2024-09-21T08:00:04.072872+0000","last_clean":"2024-09-21T08:00:04.072872+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072872+0000","last_undegraded":"2024-09-21T08:00:04.072872+0000","last_fullsized":"2024-09-21T08:00:04.072872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.929503+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:01:01.929503+0000","last_peered":"2024-09-21T08:01:01.929503+0000","last_clean":"2024-09-21T08:01:01.929503+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:01:01.929503+0000","last_undegraded":"2024-09-21T08:01:01.929503+0000","last_fullsized":"2024-09-21T08:01:01.929503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994544+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994544+0000","last_peered":"2024-09-21T08:00:03.994544+0000","last_clean":"2024-09-21T08:00:03.994544+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994544+0000","last_undegraded":"2024-09-21T08:00:03.994544+0000","last_fullsized":"2024-09-21T08:00:03.994544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.945048+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:01:01.945048+0000","last_peered":"2024-09-21T08:01:01.945048+0000","last_clean":"2024-09-21T08:01:01.945048+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:01:01.945048+0000","last_undegraded":"2024-09-21T08:01:01.945048+0000","last_fullsized":"2024-09-21T08:01:01.945048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":293,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:07.854712+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:01:07.854712+0000","last_peered":"2024-09-21T08:01:07.854712+0000","last_clean":"2024-09-21T08:01:07.854712+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:01:07.854712+0000","last_undegraded":"2024-09-21T08:01:07.854712+0000","last_fullsized":"2024-09-21T08:01:07.854712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74342,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":182,"num_write":37,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942435+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:01:01.942435+0000","last_peered":"2024-09-21T08:01:01.942435+0000","last_clean":"2024-09-21T08:01:01.942435+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:01:01.942435+0000","last_undegraded":"2024-09-21T08:01:01.942435+0000","last_fullsized":"2024-09-21T08:01:01.942435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073344+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073344+0000","last_peered":"2024-09-21T08:00:04.073344+0000","last_clean":"2024-09-21T08:00:04.073344+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073344+0000","last_undegraded":"2024-09-21T08:00:04.073344+0000","last_fullsized":"2024-09-21T08:00:04.073344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.933818+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:01:01.933818+0000","last_peered":"2024-09-21T08:01:01.933818+0000","last_clean":"2024-09-21T08:01:01.933818+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:01:01.933818+0000","last_undegraded":"2024-09-21T08:01:01.933818+0000","last_fullsized":"2024-09-21T08:01:01.933818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994516+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994516+0000","last_peered":"2024-09-21T08:00:03.994516+0000","last_clean":"2024-09-21T08:00:03.994516+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994516+0000","last_undegraded":"2024-09-21T08:00:03.994516+0000","last_fullsized":"2024-09-21T08:00:03.994516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942830+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:01:01.942830+0000","last_peered":"2024-09-21T08:01:01.942830+0000","last_clean":"2024-09-21T08:01:01.942830+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:01:01.942830+0000","last_undegraded":"2024-09-21T08:01:01.942830+0000","last_fullsized":"2024-09-21T08:01:01.942830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217437+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217437+0000","last_peered":"2024-09-21T08:00:04.217437+0000","last_clean":"2024-09-21T08:00:04.217437+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217437+0000","last_undegraded":"2024-09-21T08:00:04.217437+0000","last_fullsized":"2024-09-21T08:00:04.217437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938616+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:01:01.938616+0000","last_peered":"2024-09-21T08:01:01.938616+0000","last_clean":"2024-09-21T08:01:01.938616+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:01:01.938616+0000","last_undegraded":"2024-09-21T08:01:01.938616+0000","last_fullsized":"2024-09-21T08:01:01.938616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072827+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072827+0000","last_peered":"2024-09-21T08:00:04.072827+0000","last_clean":"2024-09-21T08:00:04.072827+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072827+0000","last_undegraded":"2024-09-21T08:00:04.072827+0000","last_fullsized":"2024-09-21T08:00:04.072827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936171+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:01:01.936171+0000","last_peered":"2024-09-21T08:01:01.936171+0000","last_clean":"2024-09-21T08:01:01.936171+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:01:01.936171+0000","last_undegraded":"2024-09-21T08:01:01.936171+0000","last_fullsized":"2024-09-21T08:01:01.936171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993426+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993426+0000","last_peered":"2024-09-21T08:00:03.993426+0000","last_clean":"2024-09-21T08:00:03.993426+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993426+0000","last_undegraded":"2024-09-21T08:00:03.993426+0000","last_fullsized":"2024-09-21T08:00:03.993426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935389+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:01:01.935389+0000","last_peered":"2024-09-21T08:01:01.935389+0000","last_clean":"2024-09-21T08:01:01.935389+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:01:01.935389+0000","last_undegraded":"2024-09-21T08:01:01.935389+0000","last_fullsized":"2024-09-21T08:01:01.935389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919336+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:01:01.919336+0000","last_peered":"2024-09-21T08:01:01.919336+0000","last_clean":"2024-09-21T08:01:01.919336+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:01:01.919336+0000","last_undegraded":"2024-09-21T08:01:01.919336+0000","last_fullsized":"2024-09-21T08:01:01.919336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932581+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:01:01.932581+0000","last_peered":"2024-09-21T08:01:01.932581+0000","last_clean":"2024-09-21T08:01:01.932581+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:01:01.932581+0000","last_undegraded":"2024-09-21T08:01:01.932581+0000","last_fullsized":"2024-09-21T08:01:01.932581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935761+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:01:01.935761+0000","last_peered":"2024-09-21T08:01:01.935761+0000","last_clean":"2024-09-21T08:01:01.935761+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:01:01.935761+0000","last_undegraded":"2024-09-21T08:01:01.935761+0000","last_fullsized":"2024-09-21T08:01:01.935761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938826+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:01:01.938826+0000","last_peered":"2024-09-21T08:01:01.938826+0000","last_clean":"2024-09-21T08:01:01.938826+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:01:01.938826+0000","last_undegraded":"2024-09-21T08:01:01.938826+0000","last_fullsized":"2024-09-21T08:01:01.938826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930860+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:01:01.930860+0000","last_peered":"2024-09-21T08:01:01.930860+0000","last_clean":"2024-09-21T08:01:01.930860+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:01:01.930860+0000","last_undegraded":"2024-09-21T08:01:01.930860+0000","last_fullsized":"2024-09-21T08:01:01.930860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.923532+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:01:01.923532+0000","last_peered":"2024-09-21T08:01:01.923532+0000","last_clean":"2024-09-21T08:01:01.923532+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:01:01.923532+0000","last_undegraded":"2024-09-21T08:01:01.923532+0000","last_fullsized":"2024-09-21T08:01:01.923532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.920132+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:01:01.920132+0000","last_peered":"2024-09-21T08:01:01.920132+0000","last_clean":"2024-09-21T08:01:01.920132+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:01:01.920132+0000","last_undegraded":"2024-09-21T08:01:01.920132+0000","last_fullsized":"2024-09-21T08:01:01.920132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943392+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:01:01.943392+0000","last_peered":"2024-09-21T08:01:01.943392+0000","last_clean":"2024-09-21T08:01:01.943392+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:01:01.943392+0000","last_undegraded":"2024-09-21T08:01:01.943392+0000","last_fullsized":"2024-09-21T08:01:01.943392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939067+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:01:01.939067+0000","last_peered":"2024-09-21T08:01:01.939067+0000","last_clean":"2024-09-21T08:01:01.939067+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:01:01.939067+0000","last_undegraded":"2024-09-21T08:01:01.939067+0000","last_fullsized":"2024-09-21T08:01:01.939067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935172+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:01:01.935172+0000","last_peered":"2024-09-21T08:01:01.935172+0000","last_clean":"2024-09-21T08:01:01.935172+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:01:01.935172+0000","last_undegraded":"2024-09-21T08:01:01.935172+0000","last_fullsized":"2024-09-21T08:01:01.935172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939702+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:01:01.939702+0000","last_peered":"2024-09-21T08:01:01.939702+0000","last_clean":"2024-09-21T08:01:01.939702+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:01:01.939702+0000","last_undegraded":"2024-09-21T08:01:01.939702+0000","last_fullsized":"2024-09-21T08:01:01.939702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949169+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:01:01.949169+0000","last_peered":"2024-09-21T08:01:01.949169+0000","last_clean":"2024-09-21T08:01:01.949169+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:01:01.949169+0000","last_undegraded":"2024-09-21T08:01:01.949169+0000","last_fullsized":"2024-09-21T08:01:01.949169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949929+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:01:01.949929+0000","last_peered":"2024-09-21T08:01:01.949929+0000","last_clean":"2024-09-21T08:01:01.949929+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:01:01.949929+0000","last_undegraded":"2024-09-21T08:01:01.949929+0000","last_fullsized":"2024-09-21T08:01:01.949929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.921023+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:01:01.921023+0000","last_peered":"2024-09-21T08:01:01.921023+0000","last_clean":"2024-09-21T08:01:01.921023+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:01:01.921023+0000","last_undegraded":"2024-09-21T08:01:01.921023+0000","last_fullsized":"2024-09-21T08:01:01.921023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.940162+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:01:01.940162+0000","last_peered":"2024-09-21T08:01:01.940162+0000","last_clean":"2024-09-21T08:01:01.940162+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:01:01.940162+0000","last_undegraded":"2024-09-21T08:01:01.940162+0000","last_fullsized":"2024-09-21T08:01:01.940162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943891+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:01:01.943891+0000","last_peered":"2024-09-21T08:01:01.943891+0000","last_clean":"2024-09-21T08:01:01.943891+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:01:01.943891+0000","last_undegraded":"2024-09-21T08:01:01.943891+0000","last_fullsized":"2024-09-21T08:01:01.943891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944585+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:01:01.944585+0000","last_peered":"2024-09-21T08:01:01.944585+0000","last_clean":"2024-09-21T08:01:01.944585+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:01:01.944585+0000","last_undegraded":"2024-09-21T08:01:01.944585+0000","last_fullsized":"2024-09-21T08:01:01.944585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949394+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:01:01.949394+0000","last_peered":"2024-09-21T08:01:01.949394+0000","last_clean":"2024-09-21T08:01:01.949394+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:01:01.949394+0000","last_undegraded":"2024-09-21T08:01:01.949394+0000","last_fullsized":"2024-09-21T08:01:01.949394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944990+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:01:01.944990+0000","last_peered":"2024-09-21T08:01:01.944990+0000","last_clean":"2024-09-21T08:01:01.944990+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:01:01.944990+0000","last_undegraded":"2024-09-21T08:01:01.944990+0000","last_fullsized":"2024-09-21T08:01:01.944990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935509+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:01:01.935509+0000","last_peered":"2024-09-21T08:01:01.935509+0000","last_clean":"2024-09-21T08:01:01.935509+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:01:01.935509+0000","last_undegraded":"2024-09-21T08:01:01.935509+0000","last_fullsized":"2024-09-21T08:01:01.935509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937158+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:01:01.937158+0000","last_peered":"2024-09-21T08:01:01.937158+0000","last_clean":"2024-09-21T08:01:01.937158+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:01:01.937158+0000","last_undegraded":"2024-09-21T08:01:01.937158+0000","last_fullsized":"2024-09-21T08:01:01.937158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935063+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:01:01.935063+0000","last_peered":"2024-09-21T08:01:01.935063+0000","last_clean":"2024-09-21T08:01:01.935063+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:01:01.935063+0000","last_undegraded":"2024-09-21T08:01:01.935063+0000","last_fullsized":"2024-09-21T08:01:01.935063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947970+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:01:01.947970+0000","last_peered":"2024-09-21T08:01:01.947970+0000","last_clean":"2024-09-21T08:01:01.947970+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:01:01.947970+0000","last_undegraded":"2024-09-21T08:01:01.947970+0000","last_fullsized":"2024-09-21T08:01:01.947970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935921+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:01:01.935921+0000","last_peered":"2024-09-21T08:01:01.935921+0000","last_clean":"2024-09-21T08:01:01.935921+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:01:01.935921+0000","last_undegraded":"2024-09-21T08:01:01.935921+0000","last_fullsized":"2024-09-21T08:01:01.935921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942981+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:01:01.942981+0000","last_peered":"2024-09-21T08:01:01.942981+0000","last_clean":"2024-09-21T08:01:01.942981+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:01:01.942981+0000","last_undegraded":"2024-09-21T08:01:01.942981+0000","last_fullsized":"2024-09-21T08:01:01.942981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938872+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:01:01.938872+0000","last_peered":"2024-09-21T08:01:01.938872+0000","last_clean":"2024-09-21T08:01:01.938872+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:01:01.938872+0000","last_undegraded":"2024-09-21T08:01:01.938872+0000","last_fullsized":"2024-09-21T08:01:01.938872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947918+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:01:01.947918+0000","last_peered":"2024-09-21T08:01:01.947918+0000","last_clean":"2024-09-21T08:01:01.947918+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:01:01.947918+0000","last_undegraded":"2024-09-21T08:01:01.947918+0000","last_fullsized":"2024-09-21T08:01:01.947918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.931072+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:01:01.931072+0000","last_peered":"2024-09-21T08:01:01.931072+0000","last_clean":"2024-09-21T08:01:01.931072+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:01:01.931072+0000","last_undegraded":"2024-09-21T08:01:01.931072+0000","last_fullsized":"2024-09-21T08:01:01.931072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930528+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:01:01.930528+0000","last_peered":"2024-09-21T08:01:01.930528+0000","last_clean":"2024-09-21T08:01:01.930528+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:01:01.930528+0000","last_undegraded":"2024-09-21T08:01:01.930528+0000","last_fullsized":"2024-09-21T08:01:01.930528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.922290+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:01:01.922290+0000","last_peered":"2024-09-21T08:01:01.922290+0000","last_clean":"2024-09-21T08:01:01.922290+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:01:01.922290+0000","last_undegraded":"2024-09-21T08:01:01.922290+0000","last_fullsized":"2024-09-21T08:01:01.922290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943819+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:01:01.943819+0000","last_peered":"2024-09-21T08:01:01.943819+0000","last_clean":"2024-09-21T08:01:01.943819+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:01:01.943819+0000","last_undegraded":"2024-09-21T08:01:01.943819+0000","last_fullsized":"2024-09-21T08:01:01.943819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935105+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:01:01.935105+0000","last_peered":"2024-09-21T08:01:01.935105+0000","last_clean":"2024-09-21T08:01:01.935105+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:01:01.935105+0000","last_undegraded":"2024-09-21T08:01:01.935105+0000","last_fullsized":"2024-09-21T08:01:01.935105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944327+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:01:01.944327+0000","last_peered":"2024-09-21T08:01:01.944327+0000","last_clean":"2024-09-21T08:01:01.944327+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:01:01.944327+0000","last_undegraded":"2024-09-21T08:01:01.944327+0000","last_fullsized":"2024-09-21T08:01:01.944327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":468916,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":248,"num_read_kb":213,"num_write":165,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":1012972,"data_compressed":36182,"data_compressed_allocated":49152,"data_compressed_original":737280,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743466,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939695,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1160544,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103220,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299449,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462973,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":1479966,"data_compressed":83239,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986254,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":495744,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":570016,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542238,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":569982,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":74342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":468312,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:11.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T08:01:11.622 INFO:tasks.cephfs.filesystem:scrub status for tag:02c52d1c-f2d1-4deb-a790-30e7b25fb30e - {'path': '/', 'tag': '02c52d1c-f2d1-4deb-a790-30e7b25fb30e', 'options': 'recursive,force'} 2024-09-21T08:01:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:11.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:11 smithi006 ceph-mon[30970]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:11 smithi145 ceph-mon[34049]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:12.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:11 smithi119 ceph-mon[33564]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 -- 172.21.15.6:0/814063087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064108cf0 msgr2=0x7fc06410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 --2- 172.21.15.6:0/814063087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064108cf0 0x7fc06410f520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009ca0 tx=0x7fc05c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 -- 172.21.15.6:0/814063087 shutdown_connections 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 --2- 172.21.15.6:0/814063087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc0641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 --2- 172.21.15.6:0/814063087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064108cf0 0x7fc06410f520 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 --2- 172.21.15.6:0/814063087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064102a60 0x7fc064102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 -- 172.21.15.6:0/814063087 >> 172.21.15.6:0/814063087 conn(0x7fc064079730 msgr2=0x7fc064079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.229+0000 7fc068f2f640 1 -- 172.21.15.6:0/814063087 shutdown_connections 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.230+0000 7fc068f2f640 1 -- 172.21.15.6:0/814063087 wait complete. 2024-09-21T08:01:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.230+0000 7fc068f2f640 1 Processor -- start 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.230+0000 7fc068f2f640 1 -- start start 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc06419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064108cf0 0x7fc0641a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc064112860 con 0x7fc064102a60 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc0641126e0 con 0x7fc064108cf0 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc068f2f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc0641129e0 con 0x7fc0641083a0 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53358/0 (socket says 172.21.15.6:53358) 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 -- 172.21.15.6:0/1205262013 learned_addr learned my addr 172.21.15.6:0/1205262013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc062d9d640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064108cf0 0x7fc0641a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc061d9b640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc06419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 -- 172.21.15.6:0/1205262013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 msgr2=0x7fc06419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc06419caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 -- 172.21.15.6:0/1205262013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064108cf0 msgr2=0x7fc0641a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064108cf0 0x7fc0641a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 -- 172.21.15.6:0/1205262013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0641a2470 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc061d9b640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc06419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.231+0000 7fc06259c640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d950 tx=0x7fc05400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.232+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054017070 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.232+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0641a2760 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.232+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc054009c30 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.232+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05400f620 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.232+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0641a8ec0 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.233+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc064102e70 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.234+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7fc054010460 con 0x7fc064102a60 2024-09-21T08:01:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.235+0000 7fc05b7fe640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 0x7fc0500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:12.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.235+0000 7fc061d9b640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 0x7fc0500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:12.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.236+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc0540e7620 con 0x7fc064102a60 2024-09-21T08:01:12.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.236+0000 7fc061d9b640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 0x7fc0500b8b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0058c0 tx=0x7fc04c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:12.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.239+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0540ad850 con 0x7fc064102a60 2024-09-21T08:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.423+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc064104980 con 0x7fc0500b65f0 2024-09-21T08:01:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.429+0000 7fc05b7fe640 1 -- 172.21.15.6:0/1205262013 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340747 (secure 0 0 0) 0x7fc064104980 con 0x7fc0500b65f0 2024-09-21T08:01:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 msgr2=0x7fc0500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 0x7fc0500b8b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0058c0 tx=0x7fc04c005850 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 msgr2=0x7fc06419c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d950 tx=0x7fc05400de10 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 shutdown_connections 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0500b65f0 0x7fc0500b8b00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0641083a0 0x7fc06419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc064108cf0 0x7fc0641a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 --2- 172.21.15.6:0/1205262013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc064102a60 0x7fc06419c500 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.432+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 >> 172.21.15.6:0/1205262013 conn(0x7fc064079730 msgr2=0x7fc064104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.433+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 shutdown_connections 2024-09-21T08:01:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:12.433+0000 7fc068f2f640 1 -- 172.21.15.6:0/1205262013 wait complete. 2024-09-21T08:01:12.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:12 smithi006 ceph-mon[30970]: pgmap v348: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T08:01:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:12 smithi145 ceph-mon[34049]: pgmap v348: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T08:01:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:12 smithi119 ceph-mon[33564]: pgmap v348: 129 pgs: 129 active+clean; 1.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T08:01:13.183 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T08:01:11.565591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1059518,"num_objects":27,"num_object_clones":0,"num_object_copies":83,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":329,"num_read_kb":282,"num_write":290,"num_write_kb":3132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":732,"ondisk_log_size":732,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352456,"kb_used_data":11524,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589368,"statfs":{"total":1151940427776,"available":1151579512832,"internally_reserved":0,"allocated":11800576,"data_stored":9550956,"data_compressed":537499,"data_compressed_allocated":724992,"data_compressed_original":4276224,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":398851,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":43,"num_write":77,"num_write_kb":881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003864"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.174094+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:04.174094+0000","last_peered":"2024-09-21T08:00:04.174094+0000","last_clean":"2024-09-21T08:00:04.174094+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:04.174094+0000","last_undegraded":"2024-09-21T08:00:04.174094+0000","last_fullsized":"2024-09-21T08:00:04.174094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939465+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:01:01.939465+0000","last_peered":"2024-09-21T08:01:01.939465+0000","last_clean":"2024-09-21T08:01:01.939465+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:01:01.939465+0000","last_undegraded":"2024-09-21T08:01:01.939465+0000","last_fullsized":"2024-09-21T08:01:01.939465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944424+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:01:01.944424+0000","last_peered":"2024-09-21T08:01:01.944424+0000","last_clean":"2024-09-21T08:01:01.944424+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:01:01.944424+0000","last_undegraded":"2024-09-21T08:01:01.944424+0000","last_fullsized":"2024-09-21T08:01:01.944424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939448+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:01:01.939448+0000","last_peered":"2024-09-21T08:01:01.939448+0000","last_clean":"2024-09-21T08:01:01.939448+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:01:01.939448+0000","last_undegraded":"2024-09-21T08:01:01.939448+0000","last_fullsized":"2024-09-21T08:01:01.939448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944309+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:01:01.944309+0000","last_peered":"2024-09-21T08:01:01.944309+0000","last_clean":"2024-09-21T08:01:01.944309+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:01:01.944309+0000","last_undegraded":"2024-09-21T08:01:01.944309+0000","last_fullsized":"2024-09-21T08:01:01.944309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950151+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:01:01.950151+0000","last_peered":"2024-09-21T08:01:01.950151+0000","last_clean":"2024-09-21T08:01:01.950151+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:01:01.950151+0000","last_undegraded":"2024-09-21T08:01:01.950151+0000","last_fullsized":"2024-09-21T08:01:01.950151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217411+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217411+0000","last_peered":"2024-09-21T08:00:04.217411+0000","last_clean":"2024-09-21T08:00:04.217411+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217411+0000","last_undegraded":"2024-09-21T08:00:04.217411+0000","last_fullsized":"2024-09-21T08:00:04.217411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.934994+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:01:01.934994+0000","last_peered":"2024-09-21T08:01:01.934994+0000","last_clean":"2024-09-21T08:01:01.934994+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:01:01.934994+0000","last_undegraded":"2024-09-21T08:01:01.934994+0000","last_fullsized":"2024-09-21T08:01:01.934994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217517+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217517+0000","last_peered":"2024-09-21T08:00:04.217517+0000","last_clean":"2024-09-21T08:00:04.217517+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217517+0000","last_undegraded":"2024-09-21T08:00:04.217517+0000","last_fullsized":"2024-09-21T08:00:04.217517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.933274+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:01:01.933274+0000","last_peered":"2024-09-21T08:01:01.933274+0000","last_clean":"2024-09-21T08:01:01.933274+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:01:01.933274+0000","last_undegraded":"2024-09-21T08:01:01.933274+0000","last_fullsized":"2024-09-21T08:01:01.933274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173908+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173908+0000","last_peered":"2024-09-21T08:00:04.173908+0000","last_clean":"2024-09-21T08:00:04.173908+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173908+0000","last_undegraded":"2024-09-21T08:00:04.173908+0000","last_fullsized":"2024-09-21T08:00:04.173908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.913417+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:01:01.913417+0000","last_peered":"2024-09-21T08:01:01.913417+0000","last_clean":"2024-09-21T08:01:01.913417+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:01:01.913417+0000","last_undegraded":"2024-09-21T08:01:01.913417+0000","last_fullsized":"2024-09-21T08:01:01.913417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218029+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.218029+0000","last_peered":"2024-09-21T08:00:04.218029+0000","last_clean":"2024-09-21T08:00:04.218029+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.218029+0000","last_undegraded":"2024-09-21T08:00:04.218029+0000","last_fullsized":"2024-09-21T08:00:04.218029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932571+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:01:01.932571+0000","last_peered":"2024-09-21T08:01:01.932571+0000","last_clean":"2024-09-21T08:01:01.932571+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:01:01.932571+0000","last_undegraded":"2024-09-21T08:01:01.932571+0000","last_fullsized":"2024-09-21T08:01:01.932571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947447+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:01:01.947447+0000","last_peered":"2024-09-21T08:01:01.947447+0000","last_clean":"2024-09-21T08:01:01.947447+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:01:01.947447+0000","last_undegraded":"2024-09-21T08:01:01.947447+0000","last_fullsized":"2024-09-21T08:01:01.947447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:57.242708+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:00:57.242708+0000","last_peered":"2024-09-21T08:00:57.242708+0000","last_clean":"2024-09-21T08:00:57.242708+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:00:57.242708+0000","last_undegraded":"2024-09-21T08:00:57.242708+0000","last_fullsized":"2024-09-21T08:00:57.242708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937924+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:01:01.937924+0000","last_peered":"2024-09-21T08:01:01.937924+0000","last_clean":"2024-09-21T08:01:01.937924+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:01:01.937924+0000","last_undegraded":"2024-09-21T08:01:01.937924+0000","last_fullsized":"2024-09-21T08:01:01.937924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936395+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:01:01.936395+0000","last_peered":"2024-09-21T08:01:01.936395+0000","last_clean":"2024-09-21T08:01:01.936395+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:01:01.936395+0000","last_undegraded":"2024-09-21T08:01:01.936395+0000","last_fullsized":"2024-09-21T08:01:01.936395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930026+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:01:01.930026+0000","last_peered":"2024-09-21T08:01:01.930026+0000","last_clean":"2024-09-21T08:01:01.930026+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:01:01.930026+0000","last_undegraded":"2024-09-21T08:01:01.930026+0000","last_fullsized":"2024-09-21T08:01:01.930026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930274+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:01:01.930274+0000","last_peered":"2024-09-21T08:01:01.930274+0000","last_clean":"2024-09-21T08:01:01.930274+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:01:01.930274+0000","last_undegraded":"2024-09-21T08:01:01.930274+0000","last_fullsized":"2024-09-21T08:01:01.930274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994069+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994069+0000","last_peered":"2024-09-21T08:00:03.994069+0000","last_clean":"2024-09-21T08:00:03.994069+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994069+0000","last_undegraded":"2024-09-21T08:00:03.994069+0000","last_fullsized":"2024-09-21T08:00:03.994069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938322+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:01:01.938322+0000","last_peered":"2024-09-21T08:01:01.938322+0000","last_clean":"2024-09-21T08:01:01.938322+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:01:01.938322+0000","last_undegraded":"2024-09-21T08:01:01.938322+0000","last_fullsized":"2024-09-21T08:01:01.938322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073047+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.073047+0000","last_peered":"2024-09-21T08:00:04.073047+0000","last_clean":"2024-09-21T08:00:04.073047+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.073047+0000","last_undegraded":"2024-09-21T08:00:04.073047+0000","last_fullsized":"2024-09-21T08:00:04.073047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943928+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:01:01.943928+0000","last_peered":"2024-09-21T08:01:01.943928+0000","last_clean":"2024-09-21T08:01:01.943928+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:01:01.943928+0000","last_undegraded":"2024-09-21T08:01:01.943928+0000","last_fullsized":"2024-09-21T08:01:01.943928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949835+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:01:01.949835+0000","last_peered":"2024-09-21T08:01:01.949835+0000","last_clean":"2024-09-21T08:01:01.949835+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:01:01.949835+0000","last_undegraded":"2024-09-21T08:01:01.949835+0000","last_fullsized":"2024-09-21T08:01:01.949835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216269+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216269+0000","last_peered":"2024-09-21T08:00:04.216269+0000","last_clean":"2024-09-21T08:00:04.216269+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216269+0000","last_undegraded":"2024-09-21T08:00:04.216269+0000","last_fullsized":"2024-09-21T08:00:04.216269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944698+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:01:01.944698+0000","last_peered":"2024-09-21T08:01:01.944698+0000","last_clean":"2024-09-21T08:01:01.944698+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:01:01.944698+0000","last_undegraded":"2024-09-21T08:01:01.944698+0000","last_fullsized":"2024-09-21T08:01:01.944698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'60","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:08.189164+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:01:08.189164+0000","last_peered":"2024-09-21T08:01:08.189164+0000","last_clean":"2024-09-21T08:01:08.189164+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:01:08.189164+0000","last_undegraded":"2024-09-21T08:01:08.189164+0000","last_fullsized":"2024-09-21T08:01:08.189164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996282+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996282+0000","last_peered":"2024-09-21T08:00:03.996282+0000","last_clean":"2024-09-21T08:00:03.996282+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996282+0000","last_undegraded":"2024-09-21T08:00:03.996282+0000","last_fullsized":"2024-09-21T08:00:03.996282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944973+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:01:01.944973+0000","last_peered":"2024-09-21T08:01:01.944973+0000","last_clean":"2024-09-21T08:01:01.944973+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:01:01.944973+0000","last_undegraded":"2024-09-21T08:01:01.944973+0000","last_fullsized":"2024-09-21T08:01:01.944973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072310+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072310+0000","last_peered":"2024-09-21T08:00:04.072310+0000","last_clean":"2024-09-21T08:00:04.072310+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072310+0000","last_undegraded":"2024-09-21T08:00:04.072310+0000","last_fullsized":"2024-09-21T08:00:04.072310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919572+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:01:01.919572+0000","last_peered":"2024-09-21T08:01:01.919572+0000","last_clean":"2024-09-21T08:01:01.919572+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:01:01.919572+0000","last_undegraded":"2024-09-21T08:01:01.919572+0000","last_fullsized":"2024-09-21T08:01:01.919572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072425+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072425+0000","last_peered":"2024-09-21T08:00:04.072425+0000","last_clean":"2024-09-21T08:00:04.072425+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072425+0000","last_undegraded":"2024-09-21T08:00:04.072425+0000","last_fullsized":"2024-09-21T08:00:04.072425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938130+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:01:01.938130+0000","last_peered":"2024-09-21T08:01:01.938130+0000","last_clean":"2024-09-21T08:01:01.938130+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:01:01.938130+0000","last_undegraded":"2024-09-21T08:01:01.938130+0000","last_fullsized":"2024-09-21T08:01:01.938130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084792+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084792+0000","last_peered":"2024-09-21T08:00:04.084792+0000","last_clean":"2024-09-21T08:00:04.084792+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084792+0000","last_undegraded":"2024-09-21T08:00:04.084792+0000","last_fullsized":"2024-09-21T08:00:04.084792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.941729+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:01:01.941729+0000","last_peered":"2024-09-21T08:01:01.941729+0000","last_clean":"2024-09-21T08:01:01.941729+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:01:01.941729+0000","last_undegraded":"2024-09-21T08:01:01.941729+0000","last_fullsized":"2024-09-21T08:01:01.941729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217516+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217516+0000","last_peered":"2024-09-21T08:00:04.217516+0000","last_clean":"2024-09-21T08:00:04.217516+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217516+0000","last_undegraded":"2024-09-21T08:00:04.217516+0000","last_fullsized":"2024-09-21T08:00:04.217516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950338+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:01:01.950338+0000","last_peered":"2024-09-21T08:01:01.950338+0000","last_clean":"2024-09-21T08:01:01.950338+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:01:01.950338+0000","last_undegraded":"2024-09-21T08:01:01.950338+0000","last_fullsized":"2024-09-21T08:01:01.950338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072872+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072872+0000","last_peered":"2024-09-21T08:00:04.072872+0000","last_clean":"2024-09-21T08:00:04.072872+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072872+0000","last_undegraded":"2024-09-21T08:00:04.072872+0000","last_fullsized":"2024-09-21T08:00:04.072872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.929503+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:01:01.929503+0000","last_peered":"2024-09-21T08:01:01.929503+0000","last_clean":"2024-09-21T08:01:01.929503+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:01:01.929503+0000","last_undegraded":"2024-09-21T08:01:01.929503+0000","last_fullsized":"2024-09-21T08:01:01.929503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994544+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994544+0000","last_peered":"2024-09-21T08:00:03.994544+0000","last_clean":"2024-09-21T08:00:03.994544+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994544+0000","last_undegraded":"2024-09-21T08:00:03.994544+0000","last_fullsized":"2024-09-21T08:00:03.994544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.945142+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:01:01.945142+0000","last_peered":"2024-09-21T08:01:01.945142+0000","last_clean":"2024-09-21T08:01:01.945142+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:01:01.945142+0000","last_undegraded":"2024-09-21T08:01:01.945142+0000","last_fullsized":"2024-09-21T08:01:01.945142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":293,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:07.854712+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:01:07.854712+0000","last_peered":"2024-09-21T08:01:07.854712+0000","last_clean":"2024-09-21T08:01:07.854712+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:01:07.854712+0000","last_undegraded":"2024-09-21T08:01:07.854712+0000","last_fullsized":"2024-09-21T08:01:07.854712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74342,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":182,"num_write":37,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942435+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:01:01.942435+0000","last_peered":"2024-09-21T08:01:01.942435+0000","last_clean":"2024-09-21T08:01:01.942435+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:01:01.942435+0000","last_undegraded":"2024-09-21T08:01:01.942435+0000","last_fullsized":"2024-09-21T08:01:01.942435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073344+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073344+0000","last_peered":"2024-09-21T08:00:04.073344+0000","last_clean":"2024-09-21T08:00:04.073344+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073344+0000","last_undegraded":"2024-09-21T08:00:04.073344+0000","last_fullsized":"2024-09-21T08:00:04.073344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218222+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218222+0000","last_peered":"2024-09-21T08:00:04.218222+0000","last_clean":"2024-09-21T08:00:04.218222+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218222+0000","last_undegraded":"2024-09-21T08:00:04.218222+0000","last_fullsized":"2024-09-21T08:00:04.218222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.934182+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:01:01.934182+0000","last_peered":"2024-09-21T08:01:01.934182+0000","last_clean":"2024-09-21T08:01:01.934182+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:01:01.934182+0000","last_undegraded":"2024-09-21T08:01:01.934182+0000","last_fullsized":"2024-09-21T08:01:01.934182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994587+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994587+0000","last_peered":"2024-09-21T08:00:03.994587+0000","last_clean":"2024-09-21T08:00:03.994587+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994587+0000","last_undegraded":"2024-09-21T08:00:03.994587+0000","last_fullsized":"2024-09-21T08:00:03.994587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942830+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:01:01.942830+0000","last_peered":"2024-09-21T08:01:01.942830+0000","last_clean":"2024-09-21T08:01:01.942830+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:01:01.942830+0000","last_undegraded":"2024-09-21T08:01:01.942830+0000","last_fullsized":"2024-09-21T08:01:01.942830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217437+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217437+0000","last_peered":"2024-09-21T08:00:04.217437+0000","last_clean":"2024-09-21T08:00:04.217437+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217437+0000","last_undegraded":"2024-09-21T08:00:04.217437+0000","last_fullsized":"2024-09-21T08:00:04.217437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938616+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:01:01.938616+0000","last_peered":"2024-09-21T08:01:01.938616+0000","last_clean":"2024-09-21T08:01:01.938616+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:01:01.938616+0000","last_undegraded":"2024-09-21T08:01:01.938616+0000","last_fullsized":"2024-09-21T08:01:01.938616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072827+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072827+0000","last_peered":"2024-09-21T08:00:04.072827+0000","last_clean":"2024-09-21T08:00:04.072827+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072827+0000","last_undegraded":"2024-09-21T08:00:04.072827+0000","last_fullsized":"2024-09-21T08:00:04.072827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936293+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:01:01.936293+0000","last_peered":"2024-09-21T08:01:01.936293+0000","last_clean":"2024-09-21T08:01:01.936293+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:01:01.936293+0000","last_undegraded":"2024-09-21T08:01:01.936293+0000","last_fullsized":"2024-09-21T08:01:01.936293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993426+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993426+0000","last_peered":"2024-09-21T08:00:03.993426+0000","last_clean":"2024-09-21T08:00:03.993426+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993426+0000","last_undegraded":"2024-09-21T08:00:03.993426+0000","last_fullsized":"2024-09-21T08:00:03.993426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217103+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217103+0000","last_peered":"2024-09-21T08:00:04.217103+0000","last_clean":"2024-09-21T08:00:04.217103+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217103+0000","last_undegraded":"2024-09-21T08:00:04.217103+0000","last_fullsized":"2024-09-21T08:00:04.217103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935389+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:01:01.935389+0000","last_peered":"2024-09-21T08:01:01.935389+0000","last_clean":"2024-09-21T08:01:01.935389+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:01:01.935389+0000","last_undegraded":"2024-09-21T08:01:01.935389+0000","last_fullsized":"2024-09-21T08:01:01.935389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072797+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072797+0000","last_peered":"2024-09-21T08:00:04.072797+0000","last_clean":"2024-09-21T08:00:04.072797+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072797+0000","last_undegraded":"2024-09-21T08:00:04.072797+0000","last_fullsized":"2024-09-21T08:00:04.072797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919336+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:01:01.919336+0000","last_peered":"2024-09-21T08:01:01.919336+0000","last_clean":"2024-09-21T08:01:01.919336+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:01:01.919336+0000","last_undegraded":"2024-09-21T08:01:01.919336+0000","last_fullsized":"2024-09-21T08:01:01.919336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932581+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:01:01.932581+0000","last_peered":"2024-09-21T08:01:01.932581+0000","last_clean":"2024-09-21T08:01:01.932581+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:01:01.932581+0000","last_undegraded":"2024-09-21T08:01:01.932581+0000","last_fullsized":"2024-09-21T08:01:01.932581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935761+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:01:01.935761+0000","last_peered":"2024-09-21T08:01:01.935761+0000","last_clean":"2024-09-21T08:01:01.935761+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:01:01.935761+0000","last_undegraded":"2024-09-21T08:01:01.935761+0000","last_fullsized":"2024-09-21T08:01:01.935761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938826+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:01:01.938826+0000","last_peered":"2024-09-21T08:01:01.938826+0000","last_clean":"2024-09-21T08:01:01.938826+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:01:01.938826+0000","last_undegraded":"2024-09-21T08:01:01.938826+0000","last_fullsized":"2024-09-21T08:01:01.938826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930860+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:01:01.930860+0000","last_peered":"2024-09-21T08:01:01.930860+0000","last_clean":"2024-09-21T08:01:01.930860+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:01:01.930860+0000","last_undegraded":"2024-09-21T08:01:01.930860+0000","last_fullsized":"2024-09-21T08:01:01.930860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.923532+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:01:01.923532+0000","last_peered":"2024-09-21T08:01:01.923532+0000","last_clean":"2024-09-21T08:01:01.923532+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:01:01.923532+0000","last_undegraded":"2024-09-21T08:01:01.923532+0000","last_fullsized":"2024-09-21T08:01:01.923532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.920132+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:01:01.920132+0000","last_peered":"2024-09-21T08:01:01.920132+0000","last_clean":"2024-09-21T08:01:01.920132+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:01:01.920132+0000","last_undegraded":"2024-09-21T08:01:01.920132+0000","last_fullsized":"2024-09-21T08:01:01.920132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943392+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:01:01.943392+0000","last_peered":"2024-09-21T08:01:01.943392+0000","last_clean":"2024-09-21T08:01:01.943392+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:01:01.943392+0000","last_undegraded":"2024-09-21T08:01:01.943392+0000","last_fullsized":"2024-09-21T08:01:01.943392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939067+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:01:01.939067+0000","last_peered":"2024-09-21T08:01:01.939067+0000","last_clean":"2024-09-21T08:01:01.939067+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:01:01.939067+0000","last_undegraded":"2024-09-21T08:01:01.939067+0000","last_fullsized":"2024-09-21T08:01:01.939067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935172+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:01:01.935172+0000","last_peered":"2024-09-21T08:01:01.935172+0000","last_clean":"2024-09-21T08:01:01.935172+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:01:01.935172+0000","last_undegraded":"2024-09-21T08:01:01.935172+0000","last_fullsized":"2024-09-21T08:01:01.935172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939702+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:01:01.939702+0000","last_peered":"2024-09-21T08:01:01.939702+0000","last_clean":"2024-09-21T08:01:01.939702+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:01:01.939702+0000","last_undegraded":"2024-09-21T08:01:01.939702+0000","last_fullsized":"2024-09-21T08:01:01.939702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949169+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:01:01.949169+0000","last_peered":"2024-09-21T08:01:01.949169+0000","last_clean":"2024-09-21T08:01:01.949169+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:01:01.949169+0000","last_undegraded":"2024-09-21T08:01:01.949169+0000","last_fullsized":"2024-09-21T08:01:01.949169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949929+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:01:01.949929+0000","last_peered":"2024-09-21T08:01:01.949929+0000","last_clean":"2024-09-21T08:01:01.949929+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:01:01.949929+0000","last_undegraded":"2024-09-21T08:01:01.949929+0000","last_fullsized":"2024-09-21T08:01:01.949929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.921023+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:01:01.921023+0000","last_peered":"2024-09-21T08:01:01.921023+0000","last_clean":"2024-09-21T08:01:01.921023+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:01:01.921023+0000","last_undegraded":"2024-09-21T08:01:01.921023+0000","last_fullsized":"2024-09-21T08:01:01.921023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.940162+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:01:01.940162+0000","last_peered":"2024-09-21T08:01:01.940162+0000","last_clean":"2024-09-21T08:01:01.940162+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:01:01.940162+0000","last_undegraded":"2024-09-21T08:01:01.940162+0000","last_fullsized":"2024-09-21T08:01:01.940162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943891+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:01:01.943891+0000","last_peered":"2024-09-21T08:01:01.943891+0000","last_clean":"2024-09-21T08:01:01.943891+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:01:01.943891+0000","last_undegraded":"2024-09-21T08:01:01.943891+0000","last_fullsized":"2024-09-21T08:01:01.943891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944585+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:01:01.944585+0000","last_peered":"2024-09-21T08:01:01.944585+0000","last_clean":"2024-09-21T08:01:01.944585+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:01:01.944585+0000","last_undegraded":"2024-09-21T08:01:01.944585+0000","last_fullsized":"2024-09-21T08:01:01.944585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949394+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:01:01.949394+0000","last_peered":"2024-09-21T08:01:01.949394+0000","last_clean":"2024-09-21T08:01:01.949394+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:01:01.949394+0000","last_undegraded":"2024-09-21T08:01:01.949394+0000","last_fullsized":"2024-09-21T08:01:01.949394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944990+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:01:01.944990+0000","last_peered":"2024-09-21T08:01:01.944990+0000","last_clean":"2024-09-21T08:01:01.944990+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:01:01.944990+0000","last_undegraded":"2024-09-21T08:01:01.944990+0000","last_fullsized":"2024-09-21T08:01:01.944990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935509+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:01:01.935509+0000","last_peered":"2024-09-21T08:01:01.935509+0000","last_clean":"2024-09-21T08:01:01.935509+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:01:01.935509+0000","last_undegraded":"2024-09-21T08:01:01.935509+0000","last_fullsized":"2024-09-21T08:01:01.935509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937158+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:01:01.937158+0000","last_peered":"2024-09-21T08:01:01.937158+0000","last_clean":"2024-09-21T08:01:01.937158+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:01:01.937158+0000","last_undegraded":"2024-09-21T08:01:01.937158+0000","last_fullsized":"2024-09-21T08:01:01.937158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935063+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:01:01.935063+0000","last_peered":"2024-09-21T08:01:01.935063+0000","last_clean":"2024-09-21T08:01:01.935063+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:01:01.935063+0000","last_undegraded":"2024-09-21T08:01:01.935063+0000","last_fullsized":"2024-09-21T08:01:01.935063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949623+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:01:01.949623+0000","last_peered":"2024-09-21T08:01:01.949623+0000","last_clean":"2024-09-21T08:01:01.949623+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:01:01.949623+0000","last_undegraded":"2024-09-21T08:01:01.949623+0000","last_fullsized":"2024-09-21T08:01:01.949623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935921+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:01:01.935921+0000","last_peered":"2024-09-21T08:01:01.935921+0000","last_clean":"2024-09-21T08:01:01.935921+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:01:01.935921+0000","last_undegraded":"2024-09-21T08:01:01.935921+0000","last_fullsized":"2024-09-21T08:01:01.935921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942981+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:01:01.942981+0000","last_peered":"2024-09-21T08:01:01.942981+0000","last_clean":"2024-09-21T08:01:01.942981+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:01:01.942981+0000","last_undegraded":"2024-09-21T08:01:01.942981+0000","last_fullsized":"2024-09-21T08:01:01.942981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938872+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:01:01.938872+0000","last_peered":"2024-09-21T08:01:01.938872+0000","last_clean":"2024-09-21T08:01:01.938872+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:01:01.938872+0000","last_undegraded":"2024-09-21T08:01:01.938872+0000","last_fullsized":"2024-09-21T08:01:01.938872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947918+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:01:01.947918+0000","last_peered":"2024-09-21T08:01:01.947918+0000","last_clean":"2024-09-21T08:01:01.947918+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:01:01.947918+0000","last_undegraded":"2024-09-21T08:01:01.947918+0000","last_fullsized":"2024-09-21T08:01:01.947918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.931072+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:01:01.931072+0000","last_peered":"2024-09-21T08:01:01.931072+0000","last_clean":"2024-09-21T08:01:01.931072+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:01:01.931072+0000","last_undegraded":"2024-09-21T08:01:01.931072+0000","last_fullsized":"2024-09-21T08:01:01.931072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930528+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:01:01.930528+0000","last_peered":"2024-09-21T08:01:01.930528+0000","last_clean":"2024-09-21T08:01:01.930528+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:01:01.930528+0000","last_undegraded":"2024-09-21T08:01:01.930528+0000","last_fullsized":"2024-09-21T08:01:01.930528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.922290+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:01:01.922290+0000","last_peered":"2024-09-21T08:01:01.922290+0000","last_clean":"2024-09-21T08:01:01.922290+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:01:01.922290+0000","last_undegraded":"2024-09-21T08:01:01.922290+0000","last_fullsized":"2024-09-21T08:01:01.922290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943819+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:01:01.943819+0000","last_peered":"2024-09-21T08:01:01.943819+0000","last_clean":"2024-09-21T08:01:01.943819+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:01:01.943819+0000","last_undegraded":"2024-09-21T08:01:01.943819+0000","last_fullsized":"2024-09-21T08:01:01.943819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935105+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:01:01.935105+0000","last_peered":"2024-09-21T08:01:01.935105+0000","last_clean":"2024-09-21T08:01:01.935105+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:01:01.935105+0000","last_undegraded":"2024-09-21T08:01:01.935105+0000","last_fullsized":"2024-09-21T08:01:01.935105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944327+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:01:01.944327+0000","last_peered":"2024-09-21T08:01:01.944327+0000","last_clean":"2024-09-21T08:01:01.944327+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:01:01.944327+0000","last_undegraded":"2024-09-21T08:01:01.944327+0000","last_fullsized":"2024-09-21T08:01:01.944327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":468916,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":248,"num_read_kb":213,"num_write":165,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":2193180,"data_compressed":92851,"data_compressed_allocated":122880,"data_compressed_original":1892352,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743467,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939695,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1160544,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103220,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":504414,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":897630,"data_compressed":48908,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462974,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":1479966,"data_compressed":83239,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986254,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":1282736,"data_compressed":66999,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":570016,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542238,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":569982,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":74342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":787096,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":468312,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:13.232 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T08:01:13.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T08:01:13.494 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:13.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:13 smithi006 ceph-mon[30970]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:13 smithi145 ceph-mon[34049]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 -- 172.21.15.6:0/1265803209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e501094a0 msgr2=0x7f9e501098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 --2- 172.21.15.6:0/1265803209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e501094a0 0x7f9e501098b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009900 tx=0x7f9e4402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 -- 172.21.15.6:0/1265803209 shutdown_connections 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 --2- 172.21.15.6:0/1265803209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e50109df0 0x7f9e50110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 --2- 172.21.15.6:0/1265803209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e501094a0 0x7f9e501098b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 --2- 172.21.15.6:0/1265803209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50103b60 0x7f9e50103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 -- 172.21.15.6:0/1265803209 >> 172.21.15.6:0/1265803209 conn(0x7f9e5007b850 msgr2=0x7f9e5007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 -- 172.21.15.6:0/1265803209 shutdown_connections 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.956+0000 7f9e567a5640 1 -- 172.21.15.6:0/1265803209 wait complete. 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.957+0000 7f9e567a5640 1 Processor -- start 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.957+0000 7f9e567a5640 1 -- start start 2024-09-21T08:01:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.957+0000 7f9e567a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.957+0000 7f9e567a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e501094a0 0x7f9e50075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e567a5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50109df0 0x7f9e50076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e567a5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50113960 con 0x7f9e50103b60 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e567a5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e501137e0 con 0x7f9e501094a0 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e567a5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50113ae0 con 0x7f9e50109df0 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53384/0 (socket says 172.21.15.6:53384) 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 -- 172.21.15.6:0/34142342 learned_addr learned my addr 172.21.15.6:0/34142342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4f7fe640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e501094a0 0x7f9e50075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e54d42640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50109df0 0x7f9e50076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 -- 172.21.15.6:0/34142342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50109df0 msgr2=0x7f9e50076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50109df0 0x7f9e50076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 -- 172.21.15.6:0/34142342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e501094a0 msgr2=0x7f9e50075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e501094a0 0x7f9e50075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 -- 172.21.15.6:0/34142342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e501a86b0 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4ffff640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000d770 tx=0x7f9e4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.958+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40017070 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.959+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501a89a0 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.959+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e400054b0 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.959+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501a8eb0 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.959+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40020060 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.960+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e50103f70 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.961+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f9e40004c00 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.962+0000 7f9e4d7fa640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 0x7f9e380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.962+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f9e400e7940 con 0x7f9e50103b60 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.962+0000 7f9e4f7fe640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 0x7f9e380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.963+0000 7f9e4f7fe640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 0x7f9e380b8b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005940 tx=0x7f9e440058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:13.966+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e400adbd0 con 0x7f9e50103b60 2024-09-21T08:01:14.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.150+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e50063800 con 0x7f9e380b65f0 2024-09-21T08:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.156+0000 7f9e4d7fa640 1 -- 172.21.15.6:0/34142342 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340764 (secure 0 0 0) 0x7f9e50063800 con 0x7f9e380b65f0 2024-09-21T08:01:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-21T08:01:14.164 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:13 smithi119 ceph-mon[33564]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.159+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 msgr2=0x7f9e380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.159+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 0x7f9e380b8b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005940 tx=0x7f9e440058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.159+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 msgr2=0x7f9e50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.159+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000d770 tx=0x7f9e4000dc30 comp rx=0 tx=0).stop 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.159+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 shutdown_connections 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9e380b65f0 0x7f9e380b8b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e50109df0 0x7f9e50076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e501094a0 0x7f9e50075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 --2- 172.21.15.6:0/34142342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e50103b60 0x7f9e50075710 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 >> 172.21.15.6:0/34142342 conn(0x7f9e5007b850 msgr2=0x7f9e501075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 shutdown_connections 2024-09-21T08:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:14.160+0000 7f9e567a5640 1 -- 172.21.15.6:0/34142342 wait complete. 2024-09-21T08:01:14.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:14 smithi006 ceph-mon[30970]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T08:01:14.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:14 smithi006 ceph-mon[30970]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:14.941 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-21T08:01:13.566392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1452734,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":648,"num_read_kb":562,"num_write":444,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2952444,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352540,"kb_used_data":11600,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589284,"statfs":{"total":1151940427776,"available":1151579426816,"internally_reserved":0,"allocated":11878400,"data_stored":10337948,"data_compressed":575241,"data_compressed_allocated":774144,"data_compressed_original":5038080,"omap_allocated":19139,"internal_metadata":348894525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":792067,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":323,"num_write":231,"num_write_kb":2097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004016"},"pg_stats":[{"pgid":"2.1f","version":"75'4","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:52.242276+0000","last_change":"2024-09-21T07:59:03.458191+0000","last_active":"2024-09-21T08:00:52.242276+0000","last_peered":"2024-09-21T08:00:52.242276+0000","last_clean":"2024-09-21T08:00:52.242276+0000","last_became_active":"2024-09-21T07:59:03.449709+0000","last_became_peered":"2024-09-21T07:59:03.449709+0000","last_unstale":"2024-09-21T08:00:52.242276+0000","last_undegraded":"2024-09-21T08:00:52.242276+0000","last_fullsized":"2024-09-21T08:00:52.242276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:26.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939465+0000","last_change":"2024-09-21T07:58:45.367712+0000","last_active":"2024-09-21T08:01:01.939465+0000","last_peered":"2024-09-21T08:01:01.939465+0000","last_clean":"2024-09-21T08:01:01.939465+0000","last_became_active":"2024-09-21T07:58:45.367386+0000","last_became_peered":"2024-09-21T07:58:45.367386+0000","last_unstale":"2024-09-21T08:01:01.939465+0000","last_undegraded":"2024-09-21T08:01:01.939465+0000","last_fullsized":"2024-09-21T08:01:01.939465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:42.130041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993883+0000","last_change":"2024-09-21T07:58:52.415947+0000","last_active":"2024-09-21T08:00:03.993883+0000","last_peered":"2024-09-21T08:00:03.993883+0000","last_clean":"2024-09-21T08:00:03.993883+0000","last_became_active":"2024-09-21T07:58:52.415368+0000","last_became_peered":"2024-09-21T07:58:52.415368+0000","last_unstale":"2024-09-21T08:00:03.993883+0000","last_undegraded":"2024-09-21T08:00:03.993883+0000","last_fullsized":"2024-09-21T08:00:03.993883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:21.240373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.336303+0000","last_change":"2024-09-21T07:58:43.430444+0000","last_active":"2024-09-21T08:00:04.336303+0000","last_peered":"2024-09-21T08:00:04.336303+0000","last_clean":"2024-09-21T08:00:04.336303+0000","last_became_active":"2024-09-21T07:58:43.430085+0000","last_became_peered":"2024-09-21T07:58:43.430085+0000","last_unstale":"2024-09-21T08:00:04.336303+0000","last_undegraded":"2024-09-21T08:00:04.336303+0000","last_fullsized":"2024-09-21T08:00:04.336303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:06.010009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944424+0000","last_change":"2024-09-21T07:58:45.363347+0000","last_active":"2024-09-21T08:01:01.944424+0000","last_peered":"2024-09-21T08:01:01.944424+0000","last_clean":"2024-09-21T08:01:01.944424+0000","last_became_active":"2024-09-21T07:58:45.361964+0000","last_became_peered":"2024-09-21T07:58:45.361964+0000","last_unstale":"2024-09-21T08:01:01.944424+0000","last_undegraded":"2024-09-21T08:01:01.944424+0000","last_fullsized":"2024-09-21T08:01:01.944424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:14.282953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216969+0000","last_change":"2024-09-21T07:58:52.407161+0000","last_active":"2024-09-21T08:00:04.216969+0000","last_peered":"2024-09-21T08:00:04.216969+0000","last_clean":"2024-09-21T08:00:04.216969+0000","last_became_active":"2024-09-21T07:58:52.406659+0000","last_became_peered":"2024-09-21T07:58:52.406659+0000","last_unstale":"2024-09-21T08:00:04.216969+0000","last_undegraded":"2024-09-21T08:00:04.216969+0000","last_fullsized":"2024-09-21T08:00:04.216969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:14.195644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085187+0000","last_change":"2024-09-21T07:58:43.343008+0000","last_active":"2024-09-21T08:00:04.085187+0000","last_peered":"2024-09-21T08:00:04.085187+0000","last_clean":"2024-09-21T08:00:04.085187+0000","last_became_active":"2024-09-21T07:58:43.342591+0000","last_became_peered":"2024-09-21T07:58:43.342591+0000","last_unstale":"2024-09-21T08:00:04.085187+0000","last_undegraded":"2024-09-21T08:00:04.085187+0000","last_fullsized":"2024-09-21T08:00:04.085187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:52.144678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939448+0000","last_change":"2024-09-21T07:58:45.361531+0000","last_active":"2024-09-21T08:01:01.939448+0000","last_peered":"2024-09-21T08:01:01.939448+0000","last_clean":"2024-09-21T08:01:01.939448+0000","last_became_active":"2024-09-21T07:58:45.361146+0000","last_became_peered":"2024-09-21T07:58:45.361146+0000","last_unstale":"2024-09-21T08:01:01.939448+0000","last_undegraded":"2024-09-21T08:01:01.939448+0000","last_fullsized":"2024-09-21T08:01:01.939448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:38.860408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217947+0000","last_change":"2024-09-21T07:58:52.409510+0000","last_active":"2024-09-21T08:00:04.217947+0000","last_peered":"2024-09-21T08:00:04.217947+0000","last_clean":"2024-09-21T08:00:04.217947+0000","last_became_active":"2024-09-21T07:58:52.408993+0000","last_became_peered":"2024-09-21T07:58:52.408993+0000","last_unstale":"2024-09-21T08:00:04.217947+0000","last_undegraded":"2024-09-21T08:00:04.217947+0000","last_fullsized":"2024-09-21T08:00:04.217947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:10.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085049+0000","last_change":"2024-09-21T07:58:43.337151+0000","last_active":"2024-09-21T08:00:04.085049+0000","last_peered":"2024-09-21T08:00:04.085049+0000","last_clean":"2024-09-21T08:00:04.085049+0000","last_became_active":"2024-09-21T07:58:43.336753+0000","last_became_peered":"2024-09-21T07:58:43.336753+0000","last_unstale":"2024-09-21T08:00:04.085049+0000","last_undegraded":"2024-09-21T08:00:04.085049+0000","last_fullsized":"2024-09-21T08:00:04.085049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:54.013933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944309+0000","last_change":"2024-09-21T07:58:45.364649+0000","last_active":"2024-09-21T08:01:01.944309+0000","last_peered":"2024-09-21T08:01:01.944309+0000","last_clean":"2024-09-21T08:01:01.944309+0000","last_became_active":"2024-09-21T07:58:45.364326+0000","last_became_peered":"2024-09-21T07:58:45.364326+0000","last_unstale":"2024-09-21T08:01:01.944309+0000","last_undegraded":"2024-09-21T08:01:01.944309+0000","last_fullsized":"2024-09-21T08:01:01.944309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:54.491406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217238+0000","last_change":"2024-09-21T07:58:52.409410+0000","last_active":"2024-09-21T08:00:04.217238+0000","last_peered":"2024-09-21T08:00:04.217238+0000","last_clean":"2024-09-21T08:00:04.217238+0000","last_became_active":"2024-09-21T07:58:52.406020+0000","last_became_peered":"2024-09-21T07:58:52.406020+0000","last_unstale":"2024-09-21T08:00:04.217238+0000","last_undegraded":"2024-09-21T08:00:04.217238+0000","last_fullsized":"2024-09-21T08:00:04.217238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:01.813613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950151+0000","last_change":"2024-09-21T07:58:45.366811+0000","last_active":"2024-09-21T08:01:01.950151+0000","last_peered":"2024-09-21T08:01:01.950151+0000","last_clean":"2024-09-21T08:01:01.950151+0000","last_became_active":"2024-09-21T07:58:45.366430+0000","last_became_peered":"2024-09-21T07:58:45.366430+0000","last_unstale":"2024-09-21T08:01:01.950151+0000","last_undegraded":"2024-09-21T08:01:01.950151+0000","last_fullsized":"2024-09-21T08:01:01.950151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.000797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084749+0000","last_change":"2024-09-21T07:58:43.341183+0000","last_active":"2024-09-21T08:00:04.084749+0000","last_peered":"2024-09-21T08:00:04.084749+0000","last_clean":"2024-09-21T08:00:04.084749+0000","last_became_active":"2024-09-21T07:58:43.340807+0000","last_became_peered":"2024-09-21T07:58:43.340807+0000","last_unstale":"2024-09-21T08:00:04.084749+0000","last_undegraded":"2024-09-21T08:00:04.084749+0000","last_fullsized":"2024-09-21T08:00:04.084749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:10.685686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217411+0000","last_change":"2024-09-21T07:58:52.652115+0000","last_active":"2024-09-21T08:00:04.217411+0000","last_peered":"2024-09-21T08:00:04.217411+0000","last_clean":"2024-09-21T08:00:04.217411+0000","last_became_active":"2024-09-21T07:58:52.651155+0000","last_became_peered":"2024-09-21T07:58:52.651155+0000","last_unstale":"2024-09-21T08:00:04.217411+0000","last_undegraded":"2024-09-21T08:00:04.217411+0000","last_fullsized":"2024-09-21T08:00:04.217411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:20.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.934994+0000","last_change":"2024-09-21T07:58:45.359620+0000","last_active":"2024-09-21T08:01:01.934994+0000","last_peered":"2024-09-21T08:01:01.934994+0000","last_clean":"2024-09-21T08:01:01.934994+0000","last_became_active":"2024-09-21T07:58:45.359267+0000","last_became_peered":"2024-09-21T07:58:45.359267+0000","last_unstale":"2024-09-21T08:01:01.934994+0000","last_undegraded":"2024-09-21T08:01:01.934994+0000","last_fullsized":"2024-09-21T08:01:01.934994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:05.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994148+0000","last_change":"2024-09-21T07:58:43.339718+0000","last_active":"2024-09-21T08:00:03.994148+0000","last_peered":"2024-09-21T08:00:03.994148+0000","last_clean":"2024-09-21T08:00:03.994148+0000","last_became_active":"2024-09-21T07:58:43.339126+0000","last_became_peered":"2024-09-21T07:58:43.339126+0000","last_unstale":"2024-09-21T08:00:03.994148+0000","last_undegraded":"2024-09-21T08:00:03.994148+0000","last_fullsized":"2024-09-21T08:00:03.994148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:05.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217517+0000","last_change":"2024-09-21T07:58:52.408013+0000","last_active":"2024-09-21T08:00:04.217517+0000","last_peered":"2024-09-21T08:00:04.217517+0000","last_clean":"2024-09-21T08:00:04.217517+0000","last_became_active":"2024-09-21T07:58:52.407393+0000","last_became_peered":"2024-09-21T07:58:52.407393+0000","last_unstale":"2024-09-21T08:00:04.217517+0000","last_undegraded":"2024-09-21T08:00:04.217517+0000","last_fullsized":"2024-09-21T08:00:04.217517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:54.229429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.933274+0000","last_change":"2024-09-21T07:58:45.364729+0000","last_active":"2024-09-21T08:01:01.933274+0000","last_peered":"2024-09-21T08:01:01.933274+0000","last_clean":"2024-09-21T08:01:01.933274+0000","last_became_active":"2024-09-21T07:58:45.364377+0000","last_became_peered":"2024-09-21T07:58:45.364377+0000","last_unstale":"2024-09-21T08:01:01.933274+0000","last_undegraded":"2024-09-21T08:01:01.933274+0000","last_fullsized":"2024-09-21T08:01:01.933274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:35.102948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335746+0000","last_change":"2024-09-21T07:58:43.333457+0000","last_active":"2024-09-21T08:00:04.335746+0000","last_peered":"2024-09-21T08:00:04.335746+0000","last_clean":"2024-09-21T08:00:04.335746+0000","last_became_active":"2024-09-21T07:58:43.333093+0000","last_became_peered":"2024-09-21T07:58:43.333093+0000","last_unstale":"2024-09-21T08:00:04.335746+0000","last_undegraded":"2024-09-21T08:00:04.335746+0000","last_fullsized":"2024-09-21T08:00:04.335746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:32.058913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173908+0000","last_change":"2024-09-21T07:58:52.414136+0000","last_active":"2024-09-21T08:00:04.173908+0000","last_peered":"2024-09-21T08:00:04.173908+0000","last_clean":"2024-09-21T08:00:04.173908+0000","last_became_active":"2024-09-21T07:58:52.413637+0000","last_became_peered":"2024-09-21T07:58:52.413637+0000","last_unstale":"2024-09-21T08:00:04.173908+0000","last_undegraded":"2024-09-21T08:00:04.173908+0000","last_fullsized":"2024-09-21T08:00:04.173908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:42.953995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.913417+0000","last_change":"2024-09-21T07:58:45.356131+0000","last_active":"2024-09-21T08:01:01.913417+0000","last_peered":"2024-09-21T08:01:01.913417+0000","last_clean":"2024-09-21T08:01:01.913417+0000","last_became_active":"2024-09-21T07:58:45.355773+0000","last_became_peered":"2024-09-21T07:58:45.355773+0000","last_unstale":"2024-09-21T08:01:01.913417+0000","last_undegraded":"2024-09-21T08:01:01.913417+0000","last_fullsized":"2024-09-21T08:01:01.913417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:43.163018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216522+0000","last_change":"2024-09-21T07:58:43.430823+0000","last_active":"2024-09-21T08:00:04.216522+0000","last_peered":"2024-09-21T08:00:04.216522+0000","last_clean":"2024-09-21T08:00:04.216522+0000","last_became_active":"2024-09-21T07:58:43.430369+0000","last_became_peered":"2024-09-21T07:58:43.430369+0000","last_unstale":"2024-09-21T08:00:04.216522+0000","last_undegraded":"2024-09-21T08:00:04.216522+0000","last_fullsized":"2024-09-21T08:00:04.216522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:25.185766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218029+0000","last_change":"2024-09-21T07:58:52.652203+0000","last_active":"2024-09-21T08:00:04.218029+0000","last_peered":"2024-09-21T08:00:04.218029+0000","last_clean":"2024-09-21T08:00:04.218029+0000","last_became_active":"2024-09-21T07:58:52.651734+0000","last_became_peered":"2024-09-21T07:58:52.651734+0000","last_unstale":"2024-09-21T08:00:04.218029+0000","last_undegraded":"2024-09-21T08:00:04.218029+0000","last_fullsized":"2024-09-21T08:00:04.218029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:26.096264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932571+0000","last_change":"2024-09-21T08:00:04.219548+0000","last_active":"2024-09-21T08:01:01.932571+0000","last_peered":"2024-09-21T08:01:01.932571+0000","last_clean":"2024-09-21T08:01:01.932571+0000","last_became_active":"2024-09-21T08:00:04.219024+0000","last_became_peered":"2024-09-21T08:00:04.219024+0000","last_unstale":"2024-09-21T08:01:01.932571+0000","last_undegraded":"2024-09-21T08:01:01.932571+0000","last_fullsized":"2024-09-21T08:01:01.932571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:27.010237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218081+0000","last_change":"2024-09-21T07:58:43.334442+0000","last_active":"2024-09-21T08:00:04.218081+0000","last_peered":"2024-09-21T08:00:04.218081+0000","last_clean":"2024-09-21T08:00:04.218081+0000","last_became_active":"2024-09-21T07:58:43.334002+0000","last_became_peered":"2024-09-21T07:58:43.334002+0000","last_unstale":"2024-09-21T08:00:04.218081+0000","last_undegraded":"2024-09-21T08:00:04.218081+0000","last_fullsized":"2024-09-21T08:00:04.218081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:10.203924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994208+0000","last_change":"2024-09-21T07:58:52.402820+0000","last_active":"2024-09-21T08:00:03.994208+0000","last_peered":"2024-09-21T08:00:03.994208+0000","last_clean":"2024-09-21T08:00:03.994208+0000","last_became_active":"2024-09-21T07:58:52.402325+0000","last_became_peered":"2024-09-21T07:58:52.402325+0000","last_unstale":"2024-09-21T08:00:03.994208+0000","last_undegraded":"2024-09-21T08:00:03.994208+0000","last_fullsized":"2024-09-21T08:00:03.994208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:54.222434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947447+0000","last_change":"2024-09-21T07:58:45.361651+0000","last_active":"2024-09-21T08:01:01.947447+0000","last_peered":"2024-09-21T08:01:01.947447+0000","last_clean":"2024-09-21T08:01:01.947447+0000","last_became_active":"2024-09-21T07:58:45.361287+0000","last_became_peered":"2024-09-21T07:58:45.361287+0000","last_unstale":"2024-09-21T08:01:01.947447+0000","last_undegraded":"2024-09-21T08:01:01.947447+0000","last_fullsized":"2024-09-21T08:01:01.947447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:26.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'94","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:08.980578+0000","last_change":"2024-09-21T07:58:43.338455+0000","last_active":"2024-09-21T08:01:08.980578+0000","last_peered":"2024-09-21T08:01:08.980578+0000","last_clean":"2024-09-21T08:01:08.980578+0000","last_became_active":"2024-09-21T07:58:43.338069+0000","last_became_peered":"2024-09-21T07:58:43.338069+0000","last_unstale":"2024-09-21T08:01:08.980578+0000","last_undegraded":"2024-09-21T08:01:08.980578+0000","last_fullsized":"2024-09-21T08:01:08.980578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:09.618582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":174,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335356+0000","last_change":"2024-09-21T07:58:52.651113+0000","last_active":"2024-09-21T08:00:04.335356+0000","last_peered":"2024-09-21T08:00:04.335356+0000","last_clean":"2024-09-21T08:00:04.335356+0000","last_became_active":"2024-09-21T07:58:52.650627+0000","last_became_peered":"2024-09-21T07:58:52.650627+0000","last_unstale":"2024-09-21T08:00:04.335356+0000","last_undegraded":"2024-09-21T08:00:04.335356+0000","last_fullsized":"2024-09-21T08:00:04.335356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937924+0000","last_change":"2024-09-21T07:58:45.360338+0000","last_active":"2024-09-21T08:01:01.937924+0000","last_peered":"2024-09-21T08:01:01.937924+0000","last_clean":"2024-09-21T08:01:01.937924+0000","last_became_active":"2024-09-21T07:58:45.359984+0000","last_became_peered":"2024-09-21T07:58:45.359984+0000","last_unstale":"2024-09-21T08:01:01.937924+0000","last_undegraded":"2024-09-21T08:01:01.937924+0000","last_fullsized":"2024-09-21T08:01:01.937924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:38.695886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.085232+0000","last_change":"2024-09-21T07:58:43.431284+0000","last_active":"2024-09-21T08:00:04.085232+0000","last_peered":"2024-09-21T08:00:04.085232+0000","last_clean":"2024-09-21T08:00:04.085232+0000","last_became_active":"2024-09-21T07:58:43.430832+0000","last_became_peered":"2024-09-21T07:58:43.430832+0000","last_unstale":"2024-09-21T08:00:04.085232+0000","last_undegraded":"2024-09-21T08:00:04.085232+0000","last_fullsized":"2024-09-21T08:00:04.085232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:03.306330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998132+0000","last_change":"2024-09-21T07:58:52.409641+0000","last_active":"2024-09-21T08:00:03.998132+0000","last_peered":"2024-09-21T08:00:03.998132+0000","last_clean":"2024-09-21T08:00:03.998132+0000","last_became_active":"2024-09-21T07:58:52.409099+0000","last_became_peered":"2024-09-21T07:58:52.409099+0000","last_unstale":"2024-09-21T08:00:03.998132+0000","last_undegraded":"2024-09-21T08:00:03.998132+0000","last_fullsized":"2024-09-21T08:00:03.998132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:31.726916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936395+0000","last_change":"2024-09-21T07:58:45.360302+0000","last_active":"2024-09-21T08:01:01.936395+0000","last_peered":"2024-09-21T08:01:01.936395+0000","last_clean":"2024-09-21T08:01:01.936395+0000","last_became_active":"2024-09-21T07:58:45.359734+0000","last_became_peered":"2024-09-21T07:58:45.359734+0000","last_unstale":"2024-09-21T08:01:01.936395+0000","last_undegraded":"2024-09-21T08:01:01.936395+0000","last_fullsized":"2024-09-21T08:01:01.936395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.465631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173820+0000","last_change":"2024-09-21T07:58:43.430464+0000","last_active":"2024-09-21T08:00:04.173820+0000","last_peered":"2024-09-21T08:00:04.173820+0000","last_clean":"2024-09-21T08:00:04.173820+0000","last_became_active":"2024-09-21T07:58:43.430099+0000","last_became_peered":"2024-09-21T07:58:43.430099+0000","last_unstale":"2024-09-21T08:00:04.173820+0000","last_undegraded":"2024-09-21T08:00:04.173820+0000","last_fullsized":"2024-09-21T08:00:04.173820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:12.840904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084533+0000","last_change":"2024-09-21T07:58:52.651890+0000","last_active":"2024-09-21T08:00:04.084533+0000","last_peered":"2024-09-21T08:00:04.084533+0000","last_clean":"2024-09-21T08:00:04.084533+0000","last_became_active":"2024-09-21T07:58:52.651393+0000","last_became_peered":"2024-09-21T07:58:52.651393+0000","last_unstale":"2024-09-21T08:00:04.084533+0000","last_undegraded":"2024-09-21T08:00:04.084533+0000","last_fullsized":"2024-09-21T08:00:04.084533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:48.552354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930026+0000","last_change":"2024-09-21T07:58:45.365093+0000","last_active":"2024-09-21T08:01:01.930026+0000","last_peered":"2024-09-21T08:01:01.930026+0000","last_clean":"2024-09-21T08:01:01.930026+0000","last_became_active":"2024-09-21T07:58:45.364750+0000","last_became_peered":"2024-09-21T07:58:45.364750+0000","last_unstale":"2024-09-21T08:01:01.930026+0000","last_undegraded":"2024-09-21T08:01:01.930026+0000","last_fullsized":"2024-09-21T08:01:01.930026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:44.002450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994217+0000","last_change":"2024-09-21T07:58:43.335970+0000","last_active":"2024-09-21T08:00:03.994217+0000","last_peered":"2024-09-21T08:00:03.994217+0000","last_clean":"2024-09-21T08:00:03.994217+0000","last_became_active":"2024-09-21T07:58:43.334942+0000","last_became_peered":"2024-09-21T07:58:43.334942+0000","last_unstale":"2024-09-21T08:00:03.994217+0000","last_undegraded":"2024-09-21T08:00:03.994217+0000","last_fullsized":"2024-09-21T08:00:03.994217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:34.547251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993711+0000","last_change":"2024-09-21T07:58:52.407522+0000","last_active":"2024-09-21T08:00:03.993711+0000","last_peered":"2024-09-21T08:00:03.993711+0000","last_clean":"2024-09-21T08:00:03.993711+0000","last_became_active":"2024-09-21T07:58:52.407099+0000","last_became_peered":"2024-09-21T07:58:52.407099+0000","last_unstale":"2024-09-21T08:00:03.993711+0000","last_undegraded":"2024-09-21T08:00:03.993711+0000","last_fullsized":"2024-09-21T08:00:03.993711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:48.470703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930274+0000","last_change":"2024-09-21T07:58:45.361992+0000","last_active":"2024-09-21T08:01:01.930274+0000","last_peered":"2024-09-21T08:01:01.930274+0000","last_clean":"2024-09-21T08:01:01.930274+0000","last_became_active":"2024-09-21T07:58:45.361531+0000","last_became_peered":"2024-09-21T07:58:45.361531+0000","last_unstale":"2024-09-21T08:01:01.930274+0000","last_undegraded":"2024-09-21T08:01:01.930274+0000","last_fullsized":"2024-09-21T08:01:01.930274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:41.809627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993486+0000","last_change":"2024-09-21T07:58:43.430610+0000","last_active":"2024-09-21T08:00:03.993486+0000","last_peered":"2024-09-21T08:00:03.993486+0000","last_clean":"2024-09-21T08:00:03.993486+0000","last_became_active":"2024-09-21T07:58:43.430177+0000","last_became_peered":"2024-09-21T07:58:43.430177+0000","last_unstale":"2024-09-21T08:00:03.993486+0000","last_undegraded":"2024-09-21T08:00:03.993486+0000","last_fullsized":"2024-09-21T08:00:03.993486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:55.096635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994069+0000","last_change":"2024-09-21T07:58:52.652271+0000","last_active":"2024-09-21T08:00:03.994069+0000","last_peered":"2024-09-21T08:00:03.994069+0000","last_clean":"2024-09-21T08:00:03.994069+0000","last_became_active":"2024-09-21T07:58:52.651692+0000","last_became_peered":"2024-09-21T07:58:52.651692+0000","last_unstale":"2024-09-21T08:00:03.994069+0000","last_undegraded":"2024-09-21T08:00:03.994069+0000","last_fullsized":"2024-09-21T08:00:03.994069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.335807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938322+0000","last_change":"2024-09-21T07:58:45.361227+0000","last_active":"2024-09-21T08:01:01.938322+0000","last_peered":"2024-09-21T08:01:01.938322+0000","last_clean":"2024-09-21T08:01:01.938322+0000","last_became_active":"2024-09-21T07:58:45.360894+0000","last_became_peered":"2024-09-21T07:58:45.360894+0000","last_unstale":"2024-09-21T08:01:01.938322+0000","last_undegraded":"2024-09-21T08:01:01.938322+0000","last_fullsized":"2024-09-21T08:01:01.938322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:31.761742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993949+0000","last_change":"2024-09-21T07:58:43.340863+0000","last_active":"2024-09-21T08:00:03.993949+0000","last_peered":"2024-09-21T08:00:03.993949+0000","last_clean":"2024-09-21T08:00:03.993949+0000","last_became_active":"2024-09-21T07:58:43.340320+0000","last_became_peered":"2024-09-21T07:58:43.340320+0000","last_unstale":"2024-09-21T08:00:03.993949+0000","last_undegraded":"2024-09-21T08:00:03.993949+0000","last_fullsized":"2024-09-21T08:00:03.993949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:15.352670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073047+0000","last_change":"2024-09-21T07:59:03.450267+0000","last_active":"2024-09-21T08:00:04.073047+0000","last_peered":"2024-09-21T08:00:04.073047+0000","last_clean":"2024-09-21T08:00:04.073047+0000","last_became_active":"2024-09-21T07:59:03.449761+0000","last_became_peered":"2024-09-21T07:59:03.449761+0000","last_unstale":"2024-09-21T08:00:04.073047+0000","last_undegraded":"2024-09-21T08:00:04.073047+0000","last_fullsized":"2024-09-21T08:00:04.073047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:44.003908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943928+0000","last_change":"2024-09-21T07:58:45.365108+0000","last_active":"2024-09-21T08:01:01.943928+0000","last_peered":"2024-09-21T08:01:01.943928+0000","last_clean":"2024-09-21T08:01:01.943928+0000","last_became_active":"2024-09-21T07:58:45.364746+0000","last_became_peered":"2024-09-21T07:58:45.364746+0000","last_unstale":"2024-09-21T08:01:01.943928+0000","last_undegraded":"2024-09-21T08:01:01.943928+0000","last_fullsized":"2024-09-21T08:01:01.943928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:13.049633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218345+0000","last_change":"2024-09-21T07:58:43.336712+0000","last_active":"2024-09-21T08:00:04.218345+0000","last_peered":"2024-09-21T08:00:04.218345+0000","last_clean":"2024-09-21T08:00:04.218345+0000","last_became_active":"2024-09-21T07:58:43.336326+0000","last_became_peered":"2024-09-21T07:58:43.336326+0000","last_unstale":"2024-09-21T08:00:04.218345+0000","last_undegraded":"2024-09-21T08:00:04.218345+0000","last_fullsized":"2024-09-21T08:00:04.218345+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:36.532535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994088+0000","last_change":"2024-09-21T07:57:30.218172+0000","last_active":"2024-09-21T08:00:03.994088+0000","last_peered":"2024-09-21T08:00:03.994088+0000","last_clean":"2024-09-21T08:00:03.994088+0000","last_became_active":"2024-09-21T07:57:30.212596+0000","last_became_peered":"2024-09-21T07:57:30.212596+0000","last_unstale":"2024-09-21T08:00:03.994088+0000","last_undegraded":"2024-09-21T08:00:03.994088+0000","last_fullsized":"2024-09-21T08:00:03.994088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:54:01.907562+0000","last_clean_scrub_stamp":"2024-09-21T07:54:01.907562+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:42.754533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994446+0000","last_change":"2024-09-21T07:59:03.452327+0000","last_active":"2024-09-21T08:00:03.994446+0000","last_peered":"2024-09-21T08:00:03.994446+0000","last_clean":"2024-09-21T08:00:03.994446+0000","last_became_active":"2024-09-21T07:59:03.451704+0000","last_became_peered":"2024-09-21T07:59:03.451704+0000","last_unstale":"2024-09-21T08:00:03.994446+0000","last_undegraded":"2024-09-21T08:00:03.994446+0000","last_fullsized":"2024-09-21T08:00:03.994446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:11.906122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949835+0000","last_change":"2024-09-21T07:58:45.365391+0000","last_active":"2024-09-21T08:01:01.949835+0000","last_peered":"2024-09-21T08:01:01.949835+0000","last_clean":"2024-09-21T08:01:01.949835+0000","last_became_active":"2024-09-21T07:58:45.364443+0000","last_became_peered":"2024-09-21T07:58:45.364443+0000","last_unstale":"2024-09-21T08:01:01.949835+0000","last_undegraded":"2024-09-21T08:01:01.949835+0000","last_fullsized":"2024-09-21T08:01:01.949835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:24.048548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994674+0000","last_change":"2024-09-21T07:58:43.432298+0000","last_active":"2024-09-21T08:00:03.994674+0000","last_peered":"2024-09-21T08:00:03.994674+0000","last_clean":"2024-09-21T08:00:03.994674+0000","last_became_active":"2024-09-21T07:58:43.431911+0000","last_became_peered":"2024-09-21T07:58:43.431911+0000","last_unstale":"2024-09-21T08:00:03.994674+0000","last_undegraded":"2024-09-21T08:00:03.994674+0000","last_fullsized":"2024-09-21T08:00:03.994674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:35.664987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216269+0000","last_change":"2024-09-21T07:58:52.403954+0000","last_active":"2024-09-21T08:00:04.216269+0000","last_peered":"2024-09-21T08:00:04.216269+0000","last_clean":"2024-09-21T08:00:04.216269+0000","last_became_active":"2024-09-21T07:58:52.403401+0000","last_became_peered":"2024-09-21T07:58:52.403401+0000","last_unstale":"2024-09-21T08:00:04.216269+0000","last_undegraded":"2024-09-21T08:00:04.216269+0000","last_fullsized":"2024-09-21T08:00:04.216269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:04.518217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944698+0000","last_change":"2024-09-21T07:58:45.362649+0000","last_active":"2024-09-21T08:01:01.944698+0000","last_peered":"2024-09-21T08:01:01.944698+0000","last_clean":"2024-09-21T08:01:01.944698+0000","last_became_active":"2024-09-21T07:58:45.362251+0000","last_became_peered":"2024-09-21T07:58:45.362251+0000","last_unstale":"2024-09-21T08:01:01.944698+0000","last_undegraded":"2024-09-21T08:01:01.944698+0000","last_fullsized":"2024-09-21T08:01:01.944698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:37.055180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'60","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:08.576717+0000","last_change":"2024-09-21T07:58:43.335807+0000","last_active":"2024-09-21T08:01:08.576717+0000","last_peered":"2024-09-21T08:01:08.576717+0000","last_clean":"2024-09-21T08:01:08.576717+0000","last_became_active":"2024-09-21T07:58:43.335405+0000","last_became_peered":"2024-09-21T07:58:43.335405+0000","last_unstale":"2024-09-21T08:01:08.576717+0000","last_undegraded":"2024-09-21T08:01:08.576717+0000","last_fullsized":"2024-09-21T08:01:08.576717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:04.807703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996282+0000","last_change":"2024-09-21T07:58:52.407447+0000","last_active":"2024-09-21T08:00:03.996282+0000","last_peered":"2024-09-21T08:00:03.996282+0000","last_clean":"2024-09-21T08:00:03.996282+0000","last_became_active":"2024-09-21T07:58:52.407035+0000","last_became_peered":"2024-09-21T07:58:52.407035+0000","last_unstale":"2024-09-21T08:00:03.996282+0000","last_undegraded":"2024-09-21T08:00:03.996282+0000","last_fullsized":"2024-09-21T08:00:03.996282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.799516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944973+0000","last_change":"2024-09-21T07:58:45.360016+0000","last_active":"2024-09-21T08:01:01.944973+0000","last_peered":"2024-09-21T08:01:01.944973+0000","last_clean":"2024-09-21T08:01:01.944973+0000","last_became_active":"2024-09-21T07:58:45.358497+0000","last_became_peered":"2024-09-21T07:58:45.358497+0000","last_unstale":"2024-09-21T08:01:01.944973+0000","last_undegraded":"2024-09-21T08:01:01.944973+0000","last_fullsized":"2024-09-21T08:01:01.944973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:07.658948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994154+0000","last_change":"2024-09-21T07:58:43.339651+0000","last_active":"2024-09-21T08:00:03.994154+0000","last_peered":"2024-09-21T08:00:03.994154+0000","last_clean":"2024-09-21T08:00:03.994154+0000","last_became_active":"2024-09-21T07:58:43.339280+0000","last_became_peered":"2024-09-21T07:58:43.339280+0000","last_unstale":"2024-09-21T08:00:03.994154+0000","last_undegraded":"2024-09-21T08:00:03.994154+0000","last_fullsized":"2024-09-21T08:00:03.994154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:12.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072310+0000","last_change":"2024-09-21T07:58:52.406469+0000","last_active":"2024-09-21T08:00:04.072310+0000","last_peered":"2024-09-21T08:00:04.072310+0000","last_clean":"2024-09-21T08:00:04.072310+0000","last_became_active":"2024-09-21T07:58:52.406015+0000","last_became_peered":"2024-09-21T07:58:52.406015+0000","last_unstale":"2024-09-21T08:00:04.072310+0000","last_undegraded":"2024-09-21T08:00:04.072310+0000","last_fullsized":"2024-09-21T08:00:04.072310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:13.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919572+0000","last_change":"2024-09-21T08:00:04.219541+0000","last_active":"2024-09-21T08:01:01.919572+0000","last_peered":"2024-09-21T08:01:01.919572+0000","last_clean":"2024-09-21T08:01:01.919572+0000","last_became_active":"2024-09-21T08:00:04.219032+0000","last_became_peered":"2024-09-21T08:00:04.219032+0000","last_unstale":"2024-09-21T08:01:01.919572+0000","last_undegraded":"2024-09-21T08:01:01.919572+0000","last_fullsized":"2024-09-21T08:01:01.919572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.426353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998178+0000","last_change":"2024-09-21T07:59:03.457856+0000","last_active":"2024-09-21T08:00:03.998178+0000","last_peered":"2024-09-21T08:00:03.998178+0000","last_clean":"2024-09-21T08:00:03.998178+0000","last_became_active":"2024-09-21T07:59:03.453811+0000","last_became_peered":"2024-09-21T07:59:03.453811+0000","last_unstale":"2024-09-21T08:00:03.998178+0000","last_undegraded":"2024-09-21T08:00:03.998178+0000","last_fullsized":"2024-09-21T08:00:03.998178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:33.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072425+0000","last_change":"2024-09-21T07:58:52.412584+0000","last_active":"2024-09-21T08:00:04.072425+0000","last_peered":"2024-09-21T08:00:04.072425+0000","last_clean":"2024-09-21T08:00:04.072425+0000","last_became_active":"2024-09-21T07:58:52.412185+0000","last_became_peered":"2024-09-21T07:58:52.412185+0000","last_unstale":"2024-09-21T08:00:04.072425+0000","last_undegraded":"2024-09-21T08:00:04.072425+0000","last_fullsized":"2024-09-21T08:00:04.072425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:07.638424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938130+0000","last_change":"2024-09-21T07:58:45.360745+0000","last_active":"2024-09-21T08:01:01.938130+0000","last_peered":"2024-09-21T08:01:01.938130+0000","last_clean":"2024-09-21T08:01:01.938130+0000","last_became_active":"2024-09-21T07:58:45.360385+0000","last_became_peered":"2024-09-21T07:58:45.360385+0000","last_unstale":"2024-09-21T08:01:01.938130+0000","last_undegraded":"2024-09-21T08:01:01.938130+0000","last_fullsized":"2024-09-21T08:01:01.938130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:20.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084792+0000","last_change":"2024-09-21T07:59:03.714201+0000","last_active":"2024-09-21T08:00:04.084792+0000","last_peered":"2024-09-21T08:00:04.084792+0000","last_clean":"2024-09-21T08:00:04.084792+0000","last_became_active":"2024-09-21T07:59:03.706299+0000","last_became_peered":"2024-09-21T07:59:03.706299+0000","last_unstale":"2024-09-21T08:00:04.084792+0000","last_undegraded":"2024-09-21T08:00:04.084792+0000","last_fullsized":"2024-09-21T08:00:04.084792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:45.026794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994081+0000","last_change":"2024-09-21T07:58:52.406091+0000","last_active":"2024-09-21T08:00:03.994081+0000","last_peered":"2024-09-21T08:00:03.994081+0000","last_clean":"2024-09-21T08:00:03.994081+0000","last_became_active":"2024-09-21T07:58:52.405695+0000","last_became_peered":"2024-09-21T07:58:52.405695+0000","last_unstale":"2024-09-21T08:00:03.994081+0000","last_undegraded":"2024-09-21T08:00:03.994081+0000","last_fullsized":"2024-09-21T08:00:03.994081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:58.806532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.941729+0000","last_change":"2024-09-21T07:58:45.361812+0000","last_active":"2024-09-21T08:01:01.941729+0000","last_peered":"2024-09-21T08:01:01.941729+0000","last_clean":"2024-09-21T08:01:01.941729+0000","last_became_active":"2024-09-21T07:58:45.360488+0000","last_became_peered":"2024-09-21T07:58:45.360488+0000","last_unstale":"2024-09-21T08:01:01.941729+0000","last_undegraded":"2024-09-21T08:01:01.941729+0000","last_fullsized":"2024-09-21T08:01:01.941729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:06.795760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217516+0000","last_change":"2024-09-21T07:58:43.337667+0000","last_active":"2024-09-21T08:00:04.217516+0000","last_peered":"2024-09-21T08:00:04.217516+0000","last_clean":"2024-09-21T08:00:04.217516+0000","last_became_active":"2024-09-21T07:58:43.337259+0000","last_became_peered":"2024-09-21T07:58:43.337259+0000","last_unstale":"2024-09-21T08:00:04.217516+0000","last_undegraded":"2024-09-21T08:00:04.217516+0000","last_fullsized":"2024-09-21T08:00:04.217516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:47.795831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.173916+0000","last_change":"2024-09-21T07:58:52.409511+0000","last_active":"2024-09-21T08:00:04.173916+0000","last_peered":"2024-09-21T08:00:04.173916+0000","last_clean":"2024-09-21T08:00:04.173916+0000","last_became_active":"2024-09-21T07:58:52.409125+0000","last_became_peered":"2024-09-21T07:58:52.409125+0000","last_unstale":"2024-09-21T08:00:04.173916+0000","last_undegraded":"2024-09-21T08:00:04.173916+0000","last_fullsized":"2024-09-21T08:00:04.173916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:20.987087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.950338+0000","last_change":"2024-09-21T07:58:45.360053+0000","last_active":"2024-09-21T08:01:01.950338+0000","last_peered":"2024-09-21T08:01:01.950338+0000","last_clean":"2024-09-21T08:01:01.950338+0000","last_became_active":"2024-09-21T07:58:45.358781+0000","last_became_peered":"2024-09-21T07:58:45.358781+0000","last_unstale":"2024-09-21T08:01:01.950338+0000","last_undegraded":"2024-09-21T08:01:01.950338+0000","last_fullsized":"2024-09-21T08:01:01.950338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:28.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072872+0000","last_change":"2024-09-21T07:58:43.336354+0000","last_active":"2024-09-21T08:00:04.072872+0000","last_peered":"2024-09-21T08:00:04.072872+0000","last_clean":"2024-09-21T08:00:04.072872+0000","last_became_active":"2024-09-21T07:58:43.335955+0000","last_became_peered":"2024-09-21T07:58:43.335955+0000","last_unstale":"2024-09-21T08:00:04.072872+0000","last_undegraded":"2024-09-21T08:00:04.072872+0000","last_fullsized":"2024-09-21T08:00:04.072872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:42.780781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.997974+0000","last_change":"2024-09-21T07:58:52.418193+0000","last_active":"2024-09-21T08:00:03.997974+0000","last_peered":"2024-09-21T08:00:03.997974+0000","last_clean":"2024-09-21T08:00:03.997974+0000","last_became_active":"2024-09-21T07:58:52.417745+0000","last_became_peered":"2024-09-21T07:58:52.417745+0000","last_unstale":"2024-09-21T08:00:03.997974+0000","last_undegraded":"2024-09-21T08:00:03.997974+0000","last_fullsized":"2024-09-21T08:00:03.997974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:14.716799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.929503+0000","last_change":"2024-09-21T07:58:45.359637+0000","last_active":"2024-09-21T08:01:01.929503+0000","last_peered":"2024-09-21T08:01:01.929503+0000","last_clean":"2024-09-21T08:01:01.929503+0000","last_became_active":"2024-09-21T07:58:45.359273+0000","last_became_peered":"2024-09-21T07:58:45.359273+0000","last_unstale":"2024-09-21T08:01:01.929503+0000","last_undegraded":"2024-09-21T08:01:01.929503+0000","last_fullsized":"2024-09-21T08:01:01.929503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:03.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994544+0000","last_change":"2024-09-21T07:58:43.341771+0000","last_active":"2024-09-21T08:00:03.994544+0000","last_peered":"2024-09-21T08:00:03.994544+0000","last_clean":"2024-09-21T08:00:03.994544+0000","last_became_active":"2024-09-21T07:58:43.341418+0000","last_became_peered":"2024-09-21T07:58:43.341418+0000","last_unstale":"2024-09-21T08:00:03.994544+0000","last_undegraded":"2024-09-21T08:00:03.994544+0000","last_fullsized":"2024-09-21T08:00:03.994544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:41.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072990+0000","last_change":"2024-09-21T07:58:52.408973+0000","last_active":"2024-09-21T08:00:04.072990+0000","last_peered":"2024-09-21T08:00:04.072990+0000","last_clean":"2024-09-21T08:00:04.072990+0000","last_became_active":"2024-09-21T07:58:52.408168+0000","last_became_peered":"2024-09-21T07:58:52.408168+0000","last_unstale":"2024-09-21T08:00:04.072990+0000","last_undegraded":"2024-09-21T08:00:04.072990+0000","last_fullsized":"2024-09-21T08:00:04.072990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:39.621522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.945142+0000","last_change":"2024-09-21T07:58:45.361742+0000","last_active":"2024-09-21T08:01:01.945142+0000","last_peered":"2024-09-21T08:01:01.945142+0000","last_clean":"2024-09-21T08:01:01.945142+0000","last_became_active":"2024-09-21T07:58:45.361396+0000","last_became_peered":"2024-09-21T07:58:45.361396+0000","last_unstale":"2024-09-21T08:01:01.945142+0000","last_undegraded":"2024-09-21T08:01:01.945142+0000","last_fullsized":"2024-09-21T08:01:01.945142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:55.761812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":303,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:12.862480+0000","last_change":"2024-09-21T07:58:43.336325+0000","last_active":"2024-09-21T08:01:12.862480+0000","last_peered":"2024-09-21T08:01:12.862480+0000","last_clean":"2024-09-21T08:01:12.862480+0000","last_became_active":"2024-09-21T07:58:43.335926+0000","last_became_peered":"2024-09-21T07:58:43.335926+0000","last_unstale":"2024-09-21T08:01:12.862480+0000","last_undegraded":"2024-09-21T08:01:12.862480+0000","last_fullsized":"2024-09-21T08:01:12.862480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:01.069149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74342,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":187,"num_write":37,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.216716+0000","last_change":"2024-09-21T07:59:03.450023+0000","last_active":"2024-09-21T08:00:04.216716+0000","last_peered":"2024-09-21T08:00:04.216716+0000","last_clean":"2024-09-21T08:00:04.216716+0000","last_became_active":"2024-09-21T07:59:03.449330+0000","last_became_peered":"2024-09-21T07:59:03.449330+0000","last_unstale":"2024-09-21T08:00:04.216716+0000","last_undegraded":"2024-09-21T08:00:04.216716+0000","last_fullsized":"2024-09-21T08:00:04.216716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:46.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942435+0000","last_change":"2024-09-21T07:58:45.366937+0000","last_active":"2024-09-21T08:01:01.942435+0000","last_peered":"2024-09-21T08:01:01.942435+0000","last_clean":"2024-09-21T08:01:01.942435+0000","last_became_active":"2024-09-21T07:58:45.366541+0000","last_became_peered":"2024-09-21T07:58:45.366541+0000","last_unstale":"2024-09-21T08:01:01.942435+0000","last_undegraded":"2024-09-21T08:01:01.942435+0000","last_fullsized":"2024-09-21T08:01:01.942435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:17.642456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.073344+0000","last_change":"2024-09-21T07:58:43.433163+0000","last_active":"2024-09-21T08:00:04.073344+0000","last_peered":"2024-09-21T08:00:04.073344+0000","last_clean":"2024-09-21T08:00:04.073344+0000","last_became_active":"2024-09-21T07:58:43.432301+0000","last_became_peered":"2024-09-21T07:58:43.432301+0000","last_unstale":"2024-09-21T08:00:04.073344+0000","last_undegraded":"2024-09-21T08:00:04.073344+0000","last_fullsized":"2024-09-21T08:00:04.073344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:53.705912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.218259+0000","last_change":"2024-09-21T07:58:52.407794+0000","last_active":"2024-09-21T08:00:04.218259+0000","last_peered":"2024-09-21T08:00:04.218259+0000","last_clean":"2024-09-21T08:00:04.218259+0000","last_became_active":"2024-09-21T07:58:52.407204+0000","last_became_peered":"2024-09-21T07:58:52.407204+0000","last_unstale":"2024-09-21T08:00:04.218259+0000","last_undegraded":"2024-09-21T08:00:04.218259+0000","last_fullsized":"2024-09-21T08:00:04.218259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:32.890107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.934182+0000","last_change":"2024-09-21T07:58:45.361516+0000","last_active":"2024-09-21T08:01:01.934182+0000","last_peered":"2024-09-21T08:01:01.934182+0000","last_clean":"2024-09-21T08:01:01.934182+0000","last_became_active":"2024-09-21T07:58:45.360758+0000","last_became_peered":"2024-09-21T07:58:45.360758+0000","last_unstale":"2024-09-21T08:01:01.934182+0000","last_undegraded":"2024-09-21T08:01:01.934182+0000","last_fullsized":"2024-09-21T08:01:01.934182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:17.059701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994587+0000","last_change":"2024-09-21T07:58:43.335593+0000","last_active":"2024-09-21T08:00:03.994587+0000","last_peered":"2024-09-21T08:00:03.994587+0000","last_clean":"2024-09-21T08:00:03.994587+0000","last_became_active":"2024-09-21T07:58:43.335174+0000","last_became_peered":"2024-09-21T07:58:43.335174+0000","last_unstale":"2024-09-21T08:00:03.994587+0000","last_undegraded":"2024-09-21T08:00:03.994587+0000","last_fullsized":"2024-09-21T08:00:03.994587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.730058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.084396+0000","last_change":"2024-09-21T07:59:03.454870+0000","last_active":"2024-09-21T08:00:04.084396+0000","last_peered":"2024-09-21T08:00:04.084396+0000","last_clean":"2024-09-21T08:00:04.084396+0000","last_became_active":"2024-09-21T07:59:03.454035+0000","last_became_peered":"2024-09-21T07:59:03.454035+0000","last_unstale":"2024-09-21T08:00:04.084396+0000","last_undegraded":"2024-09-21T08:00:04.084396+0000","last_fullsized":"2024-09-21T08:00:04.084396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.422475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.942932+0000","last_change":"2024-09-21T07:58:45.364938+0000","last_active":"2024-09-21T08:01:01.942932+0000","last_peered":"2024-09-21T08:01:01.942932+0000","last_clean":"2024-09-21T08:01:01.942932+0000","last_became_active":"2024-09-21T07:58:45.362270+0000","last_became_peered":"2024-09-21T07:58:45.362270+0000","last_unstale":"2024-09-21T08:01:01.942932+0000","last_undegraded":"2024-09-21T08:01:01.942932+0000","last_fullsized":"2024-09-21T08:01:01.942932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:35.329447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217437+0000","last_change":"2024-09-21T07:58:43.337585+0000","last_active":"2024-09-21T08:00:04.217437+0000","last_peered":"2024-09-21T08:00:04.217437+0000","last_clean":"2024-09-21T08:00:04.217437+0000","last_became_active":"2024-09-21T07:58:43.335240+0000","last_became_peered":"2024-09-21T07:58:43.335240+0000","last_unstale":"2024-09-21T08:00:04.217437+0000","last_undegraded":"2024-09-21T08:00:04.217437+0000","last_fullsized":"2024-09-21T08:00:04.217437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:36.398205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.335419+0000","last_change":"2024-09-21T07:58:52.410050+0000","last_active":"2024-09-21T08:00:04.335419+0000","last_peered":"2024-09-21T08:00:04.335419+0000","last_clean":"2024-09-21T08:00:04.335419+0000","last_became_active":"2024-09-21T07:58:52.409600+0000","last_became_peered":"2024-09-21T07:58:52.409600+0000","last_unstale":"2024-09-21T08:00:04.335419+0000","last_undegraded":"2024-09-21T08:00:04.335419+0000","last_fullsized":"2024-09-21T08:00:04.335419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:14.216343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.996895+0000","last_change":"2024-09-21T07:58:52.406633+0000","last_active":"2024-09-21T08:00:03.996895+0000","last_peered":"2024-09-21T08:00:03.996895+0000","last_clean":"2024-09-21T08:00:03.996895+0000","last_became_active":"2024-09-21T07:58:52.405065+0000","last_became_peered":"2024-09-21T07:58:52.405065+0000","last_unstale":"2024-09-21T08:00:03.996895+0000","last_undegraded":"2024-09-21T08:00:03.996895+0000","last_fullsized":"2024-09-21T08:00:03.996895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:51.195730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938778+0000","last_change":"2024-09-21T07:58:45.369249+0000","last_active":"2024-09-21T08:01:01.938778+0000","last_peered":"2024-09-21T08:01:01.938778+0000","last_clean":"2024-09-21T08:01:01.938778+0000","last_became_active":"2024-09-21T07:58:45.368926+0000","last_became_peered":"2024-09-21T07:58:45.368926+0000","last_unstale":"2024-09-21T08:01:01.938778+0000","last_undegraded":"2024-09-21T08:01:01.938778+0000","last_fullsized":"2024-09-21T08:01:01.938778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:32.324117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072827+0000","last_change":"2024-09-21T07:58:43.340609+0000","last_active":"2024-09-21T08:00:04.072827+0000","last_peered":"2024-09-21T08:00:04.072827+0000","last_clean":"2024-09-21T08:00:04.072827+0000","last_became_active":"2024-09-21T07:58:43.340228+0000","last_became_peered":"2024-09-21T07:58:43.340228+0000","last_unstale":"2024-09-21T08:00:04.072827+0000","last_undegraded":"2024-09-21T08:00:04.072827+0000","last_fullsized":"2024-09-21T08:00:04.072827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:47.907917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.998228+0000","last_change":"2024-09-21T07:58:52.418134+0000","last_active":"2024-09-21T08:00:03.998228+0000","last_peered":"2024-09-21T08:00:03.998228+0000","last_clean":"2024-09-21T08:00:03.998228+0000","last_became_active":"2024-09-21T07:58:52.417639+0000","last_became_peered":"2024-09-21T07:58:52.417639+0000","last_unstale":"2024-09-21T08:00:03.998228+0000","last_undegraded":"2024-09-21T08:00:03.998228+0000","last_fullsized":"2024-09-21T08:00:03.998228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:21.668535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936293+0000","last_change":"2024-09-21T07:58:45.361018+0000","last_active":"2024-09-21T08:01:01.936293+0000","last_peered":"2024-09-21T08:01:01.936293+0000","last_clean":"2024-09-21T08:01:01.936293+0000","last_became_active":"2024-09-21T07:58:45.359325+0000","last_became_peered":"2024-09-21T07:58:45.359325+0000","last_unstale":"2024-09-21T08:01:01.936293+0000","last_undegraded":"2024-09-21T08:01:01.936293+0000","last_fullsized":"2024-09-21T08:01:01.936293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:18.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.993426+0000","last_change":"2024-09-21T07:58:43.332303+0000","last_active":"2024-09-21T08:00:03.993426+0000","last_peered":"2024-09-21T08:00:03.993426+0000","last_clean":"2024-09-21T08:00:03.993426+0000","last_became_active":"2024-09-21T07:58:43.331877+0000","last_became_peered":"2024-09-21T07:58:43.331877+0000","last_unstale":"2024-09-21T08:00:03.993426+0000","last_undegraded":"2024-09-21T08:00:03.993426+0000","last_fullsized":"2024-09-21T08:00:03.993426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:32.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.217164+0000","last_change":"2024-09-21T07:58:43.338822+0000","last_active":"2024-09-21T08:00:04.217164+0000","last_peered":"2024-09-21T08:00:04.217164+0000","last_clean":"2024-09-21T08:00:04.217164+0000","last_became_active":"2024-09-21T07:58:43.338401+0000","last_became_peered":"2024-09-21T07:58:43.338401+0000","last_unstale":"2024-09-21T08:00:04.217164+0000","last_undegraded":"2024-09-21T08:00:04.217164+0000","last_fullsized":"2024-09-21T08:00:04.217164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:37.636036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935389+0000","last_change":"2024-09-21T07:58:45.360592+0000","last_active":"2024-09-21T08:01:01.935389+0000","last_peered":"2024-09-21T08:01:01.935389+0000","last_clean":"2024-09-21T08:01:01.935389+0000","last_became_active":"2024-09-21T07:58:45.359233+0000","last_became_peered":"2024-09-21T07:58:45.359233+0000","last_unstale":"2024-09-21T08:01:01.935389+0000","last_undegraded":"2024-09-21T08:01:01.935389+0000","last_fullsized":"2024-09-21T08:01:01.935389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:07.127227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994452+0000","last_change":"2024-09-21T07:58:52.416112+0000","last_active":"2024-09-21T08:00:03.994452+0000","last_peered":"2024-09-21T08:00:03.994452+0000","last_clean":"2024-09-21T08:00:03.994452+0000","last_became_active":"2024-09-21T07:58:52.415616+0000","last_became_peered":"2024-09-21T07:58:52.415616+0000","last_unstale":"2024-09-21T08:00:03.994452+0000","last_undegraded":"2024-09-21T08:00:03.994452+0000","last_fullsized":"2024-09-21T08:00:03.994452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:05.368990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:04.072894+0000","last_change":"2024-09-21T07:59:03.454781+0000","last_active":"2024-09-21T08:00:04.072894+0000","last_peered":"2024-09-21T08:00:04.072894+0000","last_clean":"2024-09-21T08:00:04.072894+0000","last_became_active":"2024-09-21T07:59:03.454290+0000","last_became_peered":"2024-09-21T07:59:03.454290+0000","last_unstale":"2024-09-21T08:00:04.072894+0000","last_undegraded":"2024-09-21T08:00:04.072894+0000","last_fullsized":"2024-09-21T08:00:04.072894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:42.307986+0000","last_clean_scrub_stamp":"2024-09-21T07:58:42.307986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.919336+0000","last_change":"2024-09-21T07:58:45.360690+0000","last_active":"2024-09-21T08:01:01.919336+0000","last_peered":"2024-09-21T08:01:01.919336+0000","last_clean":"2024-09-21T08:01:01.919336+0000","last_became_active":"2024-09-21T07:58:45.360289+0000","last_became_peered":"2024-09-21T07:58:45.360289+0000","last_unstale":"2024-09-21T08:01:01.919336+0000","last_undegraded":"2024-09-21T08:01:01.919336+0000","last_fullsized":"2024-09-21T08:01:01.919336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:08.644562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:00:03.994253+0000","last_change":"2024-09-21T07:58:52.406495+0000","last_active":"2024-09-21T08:00:03.994253+0000","last_peered":"2024-09-21T08:00:03.994253+0000","last_clean":"2024-09-21T08:00:03.994253+0000","last_became_active":"2024-09-21T07:58:52.405993+0000","last_became_peered":"2024-09-21T07:58:52.405993+0000","last_unstale":"2024-09-21T08:00:03.994253+0000","last_undegraded":"2024-09-21T08:00:03.994253+0000","last_fullsized":"2024-09-21T08:00:03.994253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:51.369896+0000","last_clean_scrub_stamp":"2024-09-21T07:58:51.369896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.104462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.932581+0000","last_change":"2024-09-21T07:58:45.363816+0000","last_active":"2024-09-21T08:01:01.932581+0000","last_peered":"2024-09-21T08:01:01.932581+0000","last_clean":"2024-09-21T08:01:01.932581+0000","last_became_active":"2024-09-21T07:58:45.363432+0000","last_became_peered":"2024-09-21T07:58:45.363432+0000","last_unstale":"2024-09-21T08:01:01.932581+0000","last_undegraded":"2024-09-21T08:01:01.932581+0000","last_fullsized":"2024-09-21T08:01:01.932581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:19.114118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935761+0000","last_change":"2024-09-21T07:58:45.363127+0000","last_active":"2024-09-21T08:01:01.935761+0000","last_peered":"2024-09-21T08:01:01.935761+0000","last_clean":"2024-09-21T08:01:01.935761+0000","last_became_active":"2024-09-21T07:58:45.360874+0000","last_became_peered":"2024-09-21T07:58:45.360874+0000","last_unstale":"2024-09-21T08:01:01.935761+0000","last_undegraded":"2024-09-21T08:01:01.935761+0000","last_fullsized":"2024-09-21T08:01:01.935761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:27.478150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938826+0000","last_change":"2024-09-21T07:58:45.360577+0000","last_active":"2024-09-21T08:01:01.938826+0000","last_peered":"2024-09-21T08:01:01.938826+0000","last_clean":"2024-09-21T08:01:01.938826+0000","last_became_active":"2024-09-21T07:58:45.360248+0000","last_became_peered":"2024-09-21T07:58:45.360248+0000","last_unstale":"2024-09-21T08:01:01.938826+0000","last_undegraded":"2024-09-21T08:01:01.938826+0000","last_fullsized":"2024-09-21T08:01:01.938826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:27.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930860+0000","last_change":"2024-09-21T07:58:45.365433+0000","last_active":"2024-09-21T08:01:01.930860+0000","last_peered":"2024-09-21T08:01:01.930860+0000","last_clean":"2024-09-21T08:01:01.930860+0000","last_became_active":"2024-09-21T07:58:45.365060+0000","last_became_peered":"2024-09-21T07:58:45.365060+0000","last_unstale":"2024-09-21T08:01:01.930860+0000","last_undegraded":"2024-09-21T08:01:01.930860+0000","last_fullsized":"2024-09-21T08:01:01.930860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:49.335587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.923532+0000","last_change":"2024-09-21T07:58:45.358103+0000","last_active":"2024-09-21T08:01:01.923532+0000","last_peered":"2024-09-21T08:01:01.923532+0000","last_clean":"2024-09-21T08:01:01.923532+0000","last_became_active":"2024-09-21T07:58:45.357740+0000","last_became_peered":"2024-09-21T07:58:45.357740+0000","last_unstale":"2024-09-21T08:01:01.923532+0000","last_undegraded":"2024-09-21T08:01:01.923532+0000","last_fullsized":"2024-09-21T08:01:01.923532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:31.221564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.920132+0000","last_change":"2024-09-21T08:00:04.174470+0000","last_active":"2024-09-21T08:01:01.920132+0000","last_peered":"2024-09-21T08:01:01.920132+0000","last_clean":"2024-09-21T08:01:01.920132+0000","last_became_active":"2024-09-21T08:00:04.174135+0000","last_became_peered":"2024-09-21T08:00:04.174135+0000","last_unstale":"2024-09-21T08:01:01.920132+0000","last_undegraded":"2024-09-21T08:01:01.920132+0000","last_fullsized":"2024-09-21T08:01:01.920132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:46.127734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943392+0000","last_change":"2024-09-21T07:58:45.368906+0000","last_active":"2024-09-21T08:01:01.943392+0000","last_peered":"2024-09-21T08:01:01.943392+0000","last_clean":"2024-09-21T08:01:01.943392+0000","last_became_active":"2024-09-21T07:58:45.368362+0000","last_became_peered":"2024-09-21T07:58:45.368362+0000","last_unstale":"2024-09-21T08:01:01.943392+0000","last_undegraded":"2024-09-21T08:01:01.943392+0000","last_fullsized":"2024-09-21T08:01:01.943392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:10.775945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939067+0000","last_change":"2024-09-21T07:59:03.448996+0000","last_active":"2024-09-21T08:01:01.939067+0000","last_peered":"2024-09-21T08:01:01.939067+0000","last_clean":"2024-09-21T08:01:01.939067+0000","last_became_active":"2024-09-21T07:59:03.448531+0000","last_became_peered":"2024-09-21T07:59:03.448531+0000","last_unstale":"2024-09-21T08:01:01.939067+0000","last_undegraded":"2024-09-21T08:01:01.939067+0000","last_fullsized":"2024-09-21T08:01:01.939067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:36.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935172+0000","last_change":"2024-09-21T07:58:45.360075+0000","last_active":"2024-09-21T08:01:01.935172+0000","last_peered":"2024-09-21T08:01:01.935172+0000","last_clean":"2024-09-21T08:01:01.935172+0000","last_became_active":"2024-09-21T07:58:45.359698+0000","last_became_peered":"2024-09-21T07:58:45.359698+0000","last_unstale":"2024-09-21T08:01:01.935172+0000","last_undegraded":"2024-09-21T08:01:01.935172+0000","last_fullsized":"2024-09-21T08:01:01.935172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:06.007714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.939702+0000","last_change":"2024-09-21T07:58:45.367908+0000","last_active":"2024-09-21T08:01:01.939702+0000","last_peered":"2024-09-21T08:01:01.939702+0000","last_clean":"2024-09-21T08:01:01.939702+0000","last_became_active":"2024-09-21T07:58:45.367495+0000","last_became_peered":"2024-09-21T07:58:45.367495+0000","last_unstale":"2024-09-21T08:01:01.939702+0000","last_undegraded":"2024-09-21T08:01:01.939702+0000","last_fullsized":"2024-09-21T08:01:01.939702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:19.000460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949169+0000","last_change":"2024-09-21T07:58:45.360293+0000","last_active":"2024-09-21T08:01:01.949169+0000","last_peered":"2024-09-21T08:01:01.949169+0000","last_clean":"2024-09-21T08:01:01.949169+0000","last_became_active":"2024-09-21T07:58:45.359948+0000","last_became_peered":"2024-09-21T07:58:45.359948+0000","last_unstale":"2024-09-21T08:01:01.949169+0000","last_undegraded":"2024-09-21T08:01:01.949169+0000","last_fullsized":"2024-09-21T08:01:01.949169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:38.456330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949929+0000","last_change":"2024-09-21T07:58:45.363014+0000","last_active":"2024-09-21T08:01:01.949929+0000","last_peered":"2024-09-21T08:01:01.949929+0000","last_clean":"2024-09-21T08:01:01.949929+0000","last_became_active":"2024-09-21T07:58:45.362568+0000","last_became_peered":"2024-09-21T07:58:45.362568+0000","last_unstale":"2024-09-21T08:01:01.949929+0000","last_undegraded":"2024-09-21T08:01:01.949929+0000","last_fullsized":"2024-09-21T08:01:01.949929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:14.505526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.921023+0000","last_change":"2024-09-21T07:58:45.357964+0000","last_active":"2024-09-21T08:01:01.921023+0000","last_peered":"2024-09-21T08:01:01.921023+0000","last_clean":"2024-09-21T08:01:01.921023+0000","last_became_active":"2024-09-21T07:58:45.357625+0000","last_became_peered":"2024-09-21T07:58:45.357625+0000","last_unstale":"2024-09-21T08:01:01.921023+0000","last_undegraded":"2024-09-21T08:01:01.921023+0000","last_fullsized":"2024-09-21T08:01:01.921023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:07.929912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.940162+0000","last_change":"2024-09-21T07:58:45.369810+0000","last_active":"2024-09-21T08:01:01.940162+0000","last_peered":"2024-09-21T08:01:01.940162+0000","last_clean":"2024-09-21T08:01:01.940162+0000","last_became_active":"2024-09-21T07:58:45.368589+0000","last_became_peered":"2024-09-21T07:58:45.368589+0000","last_unstale":"2024-09-21T08:01:01.940162+0000","last_undegraded":"2024-09-21T08:01:01.940162+0000","last_fullsized":"2024-09-21T08:01:01.940162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:05.206623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943891+0000","last_change":"2024-09-21T07:58:45.368105+0000","last_active":"2024-09-21T08:01:01.943891+0000","last_peered":"2024-09-21T08:01:01.943891+0000","last_clean":"2024-09-21T08:01:01.943891+0000","last_became_active":"2024-09-21T07:58:45.367517+0000","last_became_peered":"2024-09-21T07:58:45.367517+0000","last_unstale":"2024-09-21T08:01:01.943891+0000","last_undegraded":"2024-09-21T08:01:01.943891+0000","last_fullsized":"2024-09-21T08:01:01.943891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.617187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944585+0000","last_change":"2024-09-21T07:58:45.358110+0000","last_active":"2024-09-21T08:01:01.944585+0000","last_peered":"2024-09-21T08:01:01.944585+0000","last_clean":"2024-09-21T08:01:01.944585+0000","last_became_active":"2024-09-21T07:58:45.356395+0000","last_became_peered":"2024-09-21T07:58:45.356395+0000","last_unstale":"2024-09-21T08:01:01.944585+0000","last_undegraded":"2024-09-21T08:01:01.944585+0000","last_fullsized":"2024-09-21T08:01:01.944585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:17.522720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949394+0000","last_change":"2024-09-21T07:58:45.359781+0000","last_active":"2024-09-21T08:01:01.949394+0000","last_peered":"2024-09-21T08:01:01.949394+0000","last_clean":"2024-09-21T08:01:01.949394+0000","last_became_active":"2024-09-21T07:58:45.359146+0000","last_became_peered":"2024-09-21T07:58:45.359146+0000","last_unstale":"2024-09-21T08:01:01.949394+0000","last_undegraded":"2024-09-21T08:01:01.949394+0000","last_fullsized":"2024-09-21T08:01:01.949394+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:53.782878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944990+0000","last_change":"2024-09-21T08:00:03.998336+0000","last_active":"2024-09-21T08:01:01.944990+0000","last_peered":"2024-09-21T08:01:01.944990+0000","last_clean":"2024-09-21T08:01:01.944990+0000","last_became_active":"2024-09-21T08:00:03.997932+0000","last_became_peered":"2024-09-21T08:00:03.997932+0000","last_unstale":"2024-09-21T08:01:01.944990+0000","last_undegraded":"2024-09-21T08:01:01.944990+0000","last_fullsized":"2024-09-21T08:01:01.944990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:06.712090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935509+0000","last_change":"2024-09-21T07:58:45.359110+0000","last_active":"2024-09-21T08:01:01.935509+0000","last_peered":"2024-09-21T08:01:01.935509+0000","last_clean":"2024-09-21T08:01:01.935509+0000","last_became_active":"2024-09-21T07:58:45.358739+0000","last_became_peered":"2024-09-21T07:58:45.358739+0000","last_unstale":"2024-09-21T08:01:01.935509+0000","last_undegraded":"2024-09-21T08:01:01.935509+0000","last_fullsized":"2024-09-21T08:01:01.935509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:48.144783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.937158+0000","last_change":"2024-09-21T07:58:45.345746+0000","last_active":"2024-09-21T08:01:01.937158+0000","last_peered":"2024-09-21T08:01:01.937158+0000","last_clean":"2024-09-21T08:01:01.937158+0000","last_became_active":"2024-09-21T07:58:45.345296+0000","last_became_peered":"2024-09-21T07:58:45.345296+0000","last_unstale":"2024-09-21T08:01:01.937158+0000","last_undegraded":"2024-09-21T08:01:01.937158+0000","last_fullsized":"2024-09-21T08:01:01.937158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:13.680618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935063+0000","last_change":"2024-09-21T07:59:03.449011+0000","last_active":"2024-09-21T08:01:01.935063+0000","last_peered":"2024-09-21T08:01:01.935063+0000","last_clean":"2024-09-21T08:01:01.935063+0000","last_became_active":"2024-09-21T07:59:03.448605+0000","last_became_peered":"2024-09-21T07:59:03.448605+0000","last_unstale":"2024-09-21T08:01:01.935063+0000","last_undegraded":"2024-09-21T08:01:01.935063+0000","last_fullsized":"2024-09-21T08:01:01.935063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:13.107977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.949623+0000","last_change":"2024-09-21T07:58:45.368323+0000","last_active":"2024-09-21T08:01:01.949623+0000","last_peered":"2024-09-21T08:01:01.949623+0000","last_clean":"2024-09-21T08:01:01.949623+0000","last_became_active":"2024-09-21T07:58:45.367994+0000","last_became_peered":"2024-09-21T07:58:45.367994+0000","last_unstale":"2024-09-21T08:01:01.949623+0000","last_undegraded":"2024-09-21T08:01:01.949623+0000","last_fullsized":"2024-09-21T08:01:01.949623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.936212+0000","last_change":"2024-09-21T07:58:45.368300+0000","last_active":"2024-09-21T08:01:01.936212+0000","last_peered":"2024-09-21T08:01:01.936212+0000","last_clean":"2024-09-21T08:01:01.936212+0000","last_became_active":"2024-09-21T07:58:45.367960+0000","last_became_peered":"2024-09-21T07:58:45.367960+0000","last_unstale":"2024-09-21T08:01:01.936212+0000","last_undegraded":"2024-09-21T08:01:01.936212+0000","last_fullsized":"2024-09-21T08:01:01.936212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:24.415667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.945266+0000","last_change":"2024-09-21T07:58:45.367733+0000","last_active":"2024-09-21T08:01:01.945266+0000","last_peered":"2024-09-21T08:01:01.945266+0000","last_clean":"2024-09-21T08:01:01.945266+0000","last_became_active":"2024-09-21T07:58:45.367378+0000","last_became_peered":"2024-09-21T07:58:45.367378+0000","last_unstale":"2024-09-21T08:01:01.945266+0000","last_undegraded":"2024-09-21T08:01:01.945266+0000","last_fullsized":"2024-09-21T08:01:01.945266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:38.762811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.938872+0000","last_change":"2024-09-21T07:58:45.364337+0000","last_active":"2024-09-21T08:01:01.938872+0000","last_peered":"2024-09-21T08:01:01.938872+0000","last_clean":"2024-09-21T08:01:01.938872+0000","last_became_active":"2024-09-21T07:58:45.363999+0000","last_became_peered":"2024-09-21T07:58:45.363999+0000","last_unstale":"2024-09-21T08:01:01.938872+0000","last_undegraded":"2024-09-21T08:01:01.938872+0000","last_fullsized":"2024-09-21T08:01:01.938872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:29.750500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.947918+0000","last_change":"2024-09-21T07:58:45.363487+0000","last_active":"2024-09-21T08:01:01.947918+0000","last_peered":"2024-09-21T08:01:01.947918+0000","last_clean":"2024-09-21T08:01:01.947918+0000","last_became_active":"2024-09-21T07:58:45.363112+0000","last_became_peered":"2024-09-21T07:58:45.363112+0000","last_unstale":"2024-09-21T08:01:01.947918+0000","last_undegraded":"2024-09-21T08:01:01.947918+0000","last_fullsized":"2024-09-21T08:01:01.947918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:36.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.931072+0000","last_change":"2024-09-21T07:58:45.366421+0000","last_active":"2024-09-21T08:01:01.931072+0000","last_peered":"2024-09-21T08:01:01.931072+0000","last_clean":"2024-09-21T08:01:01.931072+0000","last_became_active":"2024-09-21T07:58:45.366031+0000","last_became_peered":"2024-09-21T07:58:45.366031+0000","last_unstale":"2024-09-21T08:01:01.931072+0000","last_undegraded":"2024-09-21T08:01:01.931072+0000","last_fullsized":"2024-09-21T08:01:01.931072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:17.234874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.930528+0000","last_change":"2024-09-21T07:58:45.368653+0000","last_active":"2024-09-21T08:01:01.930528+0000","last_peered":"2024-09-21T08:01:01.930528+0000","last_clean":"2024-09-21T08:01:01.930528+0000","last_became_active":"2024-09-21T07:58:45.368290+0000","last_became_peered":"2024-09-21T07:58:45.368290+0000","last_unstale":"2024-09-21T08:01:01.930528+0000","last_undegraded":"2024-09-21T08:01:01.930528+0000","last_fullsized":"2024-09-21T08:01:01.930528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:03.274844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.922290+0000","last_change":"2024-09-21T07:58:45.365794+0000","last_active":"2024-09-21T08:01:01.922290+0000","last_peered":"2024-09-21T08:01:01.922290+0000","last_clean":"2024-09-21T08:01:01.922290+0000","last_became_active":"2024-09-21T07:58:45.365442+0000","last_became_peered":"2024-09-21T07:58:45.365442+0000","last_unstale":"2024-09-21T08:01:01.922290+0000","last_undegraded":"2024-09-21T08:01:01.922290+0000","last_fullsized":"2024-09-21T08:01:01.922290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:08.735351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.943819+0000","last_change":"2024-09-21T07:58:45.366019+0000","last_active":"2024-09-21T08:01:01.943819+0000","last_peered":"2024-09-21T08:01:01.943819+0000","last_clean":"2024-09-21T08:01:01.943819+0000","last_became_active":"2024-09-21T07:58:45.365691+0000","last_became_peered":"2024-09-21T07:58:45.365691+0000","last_unstale":"2024-09-21T08:01:01.943819+0000","last_undegraded":"2024-09-21T08:01:01.943819+0000","last_fullsized":"2024-09-21T08:01:01.943819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.046229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.935105+0000","last_change":"2024-09-21T07:58:45.360089+0000","last_active":"2024-09-21T08:01:01.935105+0000","last_peered":"2024-09-21T08:01:01.935105+0000","last_clean":"2024-09-21T08:01:01.935105+0000","last_became_active":"2024-09-21T07:58:45.359738+0000","last_became_peered":"2024-09-21T07:58:45.359738+0000","last_unstale":"2024-09-21T08:01:01.935105+0000","last_undegraded":"2024-09-21T08:01:01.935105+0000","last_fullsized":"2024-09-21T08:01:01.935105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.866932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T08:01:01.944327+0000","last_change":"2024-09-21T07:58:45.362894+0000","last_active":"2024-09-21T08:01:01.944327+0000","last_peered":"2024-09-21T08:01:01.944327+0000","last_clean":"2024-09-21T08:01:01.944327+0000","last_became_active":"2024-09-21T07:58:45.362535+0000","last_became_peered":"2024-09-21T07:58:45.362535+0000","last_unstale":"2024-09-21T08:01:01.944327+0000","last_undegraded":"2024-09-21T08:01:01.944327+0000","last_fullsized":"2024-09-21T08:01:01.944327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:58:44.323232+0000","last_clean_scrub_stamp":"2024-09-21T07:58:44.323232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:49.920300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":862132,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":567,"num_read_kb":493,"num_write":319,"num_write_kb":2196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":2586396,"data_compressed":112140,"data_compressed_allocated":147456,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":210489,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743467,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":500340,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939696,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":1554320,"data_compressed":83601,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":897630,"data_compressed":48908,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":897630,"data_compressed":48908,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462974,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1094200,"data_compressed":65510,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":495640,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822730,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1044480,"data_stored":1479966,"data_compressed":83601,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":499758,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":1282736,"data_compressed":66999,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":570016,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":569982,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":495730,"data_compressed":29619,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34272,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35891,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":74342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":787096,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":468312,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:01:14.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:14.947 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:14 smithi145 ceph-mon[34049]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T08:01:14.947 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:14 smithi145 ceph-mon[34049]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:14 smithi119 ceph-mon[33564]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T08:01:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:14 smithi119 ceph-mon[33564]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T08:01:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:15.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.717+0000 7fc08c156640 1 -- 172.21.15.6:0/1559642350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 msgr2=0x7fc08410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.717+0000 7fc08c156640 1 --2- 172.21.15.6:0/1559642350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc08410f520 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009ca0 tx=0x7fc07c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 -- 172.21.15.6:0/1559642350 shutdown_connections 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 --2- 172.21.15.6:0/1559642350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0841083a0 0x7fc0841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 --2- 172.21.15.6:0/1559642350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc08410f520 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 --2- 172.21.15.6:0/1559642350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc084102a60 0x7fc084102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 -- 172.21.15.6:0/1559642350 >> 172.21.15.6:0/1559642350 conn(0x7fc084079730 msgr2=0x7fc084079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 -- 172.21.15.6:0/1559642350 shutdown_connections 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 -- 172.21.15.6:0/1559642350 wait complete. 2024-09-21T08:01:15.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 Processor -- start 2024-09-21T08:01:15.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.718+0000 7fc08c156640 1 -- start start 2024-09-21T08:01:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc084102a60 0x7fc08419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0841083a0 0x7fc08419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc084112860 con 0x7fc084108cf0 2024-09-21T08:01:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841126e0 con 0x7fc0841083a0 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08c156640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841129e0 con 0x7fc084102a60 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53402/0 (socket says 172.21.15.6:53402) 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 -- 172.21.15.6:0/244711815 learned_addr learned my addr 172.21.15.6:0/244711815 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc089ef2640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc084102a60 0x7fc08419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc0896f1640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0841083a0 0x7fc08419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 -- 172.21.15.6:0/244711815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc084102a60 msgr2=0x7fc08419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc084102a60 0x7fc08419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 -- 172.21.15.6:0/244711815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0841083a0 msgr2=0x7fc08419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0841083a0 0x7fc08419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.719+0000 7fc08a6f3640 1 -- 172.21.15.6:0/244711815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841a24a0 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc08a6f3640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005cc0 tx=0x7fc07c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c032e00 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc07c0044d0 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c030b70 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841a2730 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.720+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a8ef0 con 0x7fc084108cf0 2024-09-21T08:01:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.721+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc084102e70 con 0x7fc084108cf0 2024-09-21T08:01:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.723+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7fc07c030d10 con 0x7fc084108cf0 2024-09-21T08:01:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.723+0000 7fc07affd640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 0x7fc0700b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.723+0000 7fc089ef2640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 0x7fc0700b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.723+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc07c108cd0 con 0x7fc084108cf0 2024-09-21T08:01:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.724+0000 7fc089ef2640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 0x7fc0700b8b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc08000bbe0 tx=0x7fc08000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.727+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc07c0cef60 con 0x7fc084108cf0 2024-09-21T08:01:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.954+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc08419d660 con 0x7fc084108cf0 2024-09-21T08:01:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.954+0000 7fc07affd640 1 -- 172.21.15.6:0/244711815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fc08419d660 con 0x7fc084108cf0 2024-09-21T08:01:15.956 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:15.956 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 msgr2=0x7fc0700b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 0x7fc0700b8b80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc08000bbe0 tx=0x7fc08000b390 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 msgr2=0x7fc0841a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005cc0 tx=0x7fc07c032a10 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 shutdown_connections 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc0700b6670 0x7fc0700b8b80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084108cf0 0x7fc0841a1d70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0841083a0 0x7fc08419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 --2- 172.21.15.6:0/244711815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc084102a60 0x7fc08419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 >> 172.21.15.6:0/244711815 conn(0x7fc084079730 msgr2=0x7fc08406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 shutdown_connections 2024-09-21T08:01:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:15.957+0000 7fc08c156640 1 -- 172.21.15.6:0/244711815 wait complete. 2024-09-21T08:01:16.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:16 smithi145 ceph-mon[34049]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:16 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/244711815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:16.960 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:16 smithi119 ceph-mon[33564]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:16.960 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:16 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/244711815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:16.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:16 smithi006 ceph-mon[30970]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:16.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:16 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/244711815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 -- 172.21.15.6:0/4129654562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148103bc0 msgr2=0x7f4148103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 --2- 172.21.15.6:0/4129654562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148103bc0 0x7f4148103fd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4138009900 tx=0x7f413802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 -- 172.21.15.6:0/4129654562 shutdown_connections 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 --2- 172.21.15.6:0/4129654562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4148109e00 0x7f4148110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 --2- 172.21.15.6:0/4129654562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41481094b0 0x7f41481098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 --2- 172.21.15.6:0/4129654562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148103bc0 0x7f4148103fd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.370+0000 7f414d2f0640 1 -- 172.21.15.6:0/4129654562 >> 172.21.15.6:0/4129654562 conn(0x7f414807b910 msgr2=0x7f414807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.371+0000 7f414d2f0640 1 -- 172.21.15.6:0/4129654562 shutdown_connections 2024-09-21T08:01:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.371+0000 7f414d2f0640 1 -- 172.21.15.6:0/4129654562 wait complete. 2024-09-21T08:01:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.371+0000 7f414d2f0640 1 Processor -- start 2024-09-21T08:01:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.371+0000 7f414d2f0640 1 -- start start 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148103bc0 0x7f4148075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41481094b0 0x7f4148075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41481139f0 con 0x7f4148109e00 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4148113870 con 0x7f4148103bc0 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f414d2f0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4148113b70 con 0x7f41481094b0 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f4146ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148103bc0 0x7f4148075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42250/0 (socket says 172.21.15.6:42250) 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 -- 172.21.15.6:0/1304344756 learned_addr learned my addr 172.21.15.6:0/1304344756 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f413ffff640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41481094b0 0x7f4148075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 -- 172.21.15.6:0/1304344756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41481094b0 msgr2=0x7f4148075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41481094b0 0x7f4148075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 -- 172.21.15.6:0/1304344756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148103bc0 msgr2=0x7f4148075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148103bc0 0x7f4148075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.372+0000 7f41477fe640 1 -- 172.21.15.6:0/1304344756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41481a86d0 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f41477fe640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f414000b990 tx=0x7f414000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140019070 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4140014440 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400075d0 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41481a89c0 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.373+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41481a8eb0 con 0x7f4148109e00 2024-09-21T08:01:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.374+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4148103fd0 con 0x7f4148109e00 2024-09-21T08:01:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.377+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f414001c070 con 0x7f4148109e00 2024-09-21T08:01:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.377+0000 7f4144ff9640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 0x7f41340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.378+0000 7f4146ffd640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 0x7f41340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.378+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f41400e78f0 con 0x7f4148109e00 2024-09-21T08:01:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.378+0000 7f4146ffd640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 0x7f41340b8b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f41380057c0 tx=0x7f41380058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.381+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4140023030 con 0x7f4148109e00 2024-09-21T08:01:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.607+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4148076a10 con 0x7f4148109e00 2024-09-21T08:01:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.608+0000 7f4144ff9640 1 -- 172.21.15.6:0/1304344756 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f4148076a10 con 0x7f4148109e00 2024-09-21T08:01:17.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:17.609 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 msgr2=0x7f41340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 0x7f41340b8b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f41380057c0 tx=0x7f41380058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 msgr2=0x7f4148076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f414000b990 tx=0x7f414000bd90 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 shutdown_connections 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41340b65f0 0x7f41340b8b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41481094b0 0x7f4148075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148109e00 0x7f4148076190 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 --2- 172.21.15.6:0/1304344756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148103bc0 0x7f4148075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 >> 172.21.15.6:0/1304344756 conn(0x7f414807b910 msgr2=0x7f41481075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 shutdown_connections 2024-09-21T08:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:17.611+0000 7f414d2f0640 1 -- 172.21.15.6:0/1304344756 wait complete. 2024-09-21T08:01:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:17 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1304344756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:17 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1304344756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:18.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:17 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1304344756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:18.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:01:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:18.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:18 smithi145 ceph-mon[34049]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:18.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:18 smithi006 ceph-mon[30970]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 -- 172.21.15.6:0/2418122730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71601083b0 msgr2=0x7f71601087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2418122730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71601083b0 0x7f71601087c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7154009900 tx=0x7f715402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 -- 172.21.15.6:0/2418122730 shutdown_connections 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2418122730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7160108d00 0x7f716010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2418122730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71601083b0 0x7f71601087c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2418122730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160102a70 0x7f7160102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 -- 172.21.15.6:0/2418122730 >> 172.21.15.6:0/2418122730 conn(0x7f7160079710 msgr2=0x7f7160079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 -- 172.21.15.6:0/2418122730 shutdown_connections 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.060+0000 7f7165c3e640 1 -- 172.21.15.6:0/2418122730 wait complete. 2024-09-21T08:01:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 Processor -- start 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 -- start start 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71601083b0 0x7f71601998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160108d00 0x7f716019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7160112870 con 0x7f7160102a70 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71601126f0 con 0x7f71601083b0 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f7165c3e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71601129f0 con 0x7f7160108d00 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f715f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f715f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42270/0 (socket says 172.21.15.6:42270) 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.061+0000 7f715f7fe640 1 -- 172.21.15.6:0/2522656586 learned_addr learned my addr 172.21.15.6:0/2522656586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715effd640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71601083b0 0x7f71601998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715ffff640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160108d00 0x7f716019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 -- 172.21.15.6:0/2522656586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160108d00 msgr2=0x7f716019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160108d00 0x7f716019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 -- 172.21.15.6:0/2522656586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71601083b0 msgr2=0x7f71601998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71601083b0 0x7f71601998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 -- 172.21.15.6:0/2522656586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716019f270 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715f7fe640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f715000e9f0 tx=0x7f715000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715000cd80 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716019f560 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71500054b0 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150010430 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.062+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71601a5cc0 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.064+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7160103cf0 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.065+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f71500046c0 con 0x7f7160102a70 2024-09-21T08:01:19.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.066+0000 7f715cff9640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 0x7f71480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.066+0000 7f715effd640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 0x7f71480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.066+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f71500e7fb0 con 0x7f7160102a70 2024-09-21T08:01:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.067+0000 7f715effd640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 0x7f71480b8b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7154005940 tx=0x7f71540058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.070+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7150056710 con 0x7f7160102a70 2024-09-21T08:01:19.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:18 smithi119 ceph-mon[33564]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-09-21T08:01:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.262+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f716019a430 con 0x7f7160102a70 2024-09-21T08:01:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.264+0000 7f715cff9640 1 -- 172.21.15.6:0/2522656586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+25204 (secure 0 0 0) 0x7f716019a430 con 0x7f7160102a70 2024-09-21T08:01:19.265 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:19.266 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:00:03.985299+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 msgr2=0x7f71480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 0x7f71480b8b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7154005940 tx=0x7f71540058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 msgr2=0x7f7160199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f715000e9f0 tx=0x7f715000edf0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 shutdown_connections 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71480b65f0 0x7f71480b8b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7160108d00 0x7f716019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71601083b0 0x7f71601998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 --2- 172.21.15.6:0/2522656586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160102a70 0x7f7160199300 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.266+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 >> 172.21.15.6:0/2522656586 conn(0x7f7160079710 msgr2=0x7f7160104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.267+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 shutdown_connections 2024-09-21T08:01:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:19.267+0000 7f7165c3e640 1 -- 172.21.15.6:0/2522656586 wait complete. 2024-09-21T08:01:19.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2522656586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:19.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T08:01:20.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2522656586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:20.180 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:20.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2522656586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:01:20.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:20 smithi006 ceph-mon[30970]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-09-21T08:01:21.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:20 smithi119 ceph-mon[33564]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-09-21T08:01:21.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:20 smithi145 ceph-mon[34049]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-09-21T08:01:21.355 INFO:teuthology.orchestra.run.smithi006.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T08:01:21.356 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T08:01:21.356 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T08:01:21.356 DEBUG:tasks.quiescer:Yielding 2024-09-21T08:01:21.356 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T08:01:21.366 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T08:01:21.366 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:01:21.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-21T08:01:21.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:21.407 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2024-09-21T08:01:21.418 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-21T08:01:21.418 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-fuse 1.1T 348M 1.1T 1% /tmp/cephfs 2024-09-21T08:01:21.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-21T08:01:21.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-21T08:01:21.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-21T08:01:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/178198377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 msgr2=0x7f4cc8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/178198377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc8102e70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009900 tx=0x7f4cc402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/178198377 shutdown_connections 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/178198377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 0x7f4cc810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/178198377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/178198377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc8102e70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/178198377 >> 172.21.15.6:0/178198377 conn(0x7f4cc8079730 msgr2=0x7f4cc8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/178198377 shutdown_connections 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.135+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/178198377 wait complete. 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.136+0000 7f4ccfa4c640 1 Processor -- start 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.136+0000 7f4ccfa4c640 1 -- start start 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc8198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 0x7f4cc819da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111710 con 0x7f4cc8102a60 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111590 con 0x7f4cc81083a0 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccfa4c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111890 con 0x7f4cc8108cf0 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42286/0 (socket says 172.21.15.6:42286) 2024-09-21T08:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 -- 172.21.15.6:0/3927787993 learned_addr learned my addr 172.21.15.6:0/3927787993 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccdfe9640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 0x7f4cc819da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4cccfe7640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc8198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 -- 172.21.15.6:0/3927787993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 msgr2=0x7f4cc819da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 0x7f4cc819da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 -- 172.21.15.6:0/3927787993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 msgr2=0x7f4cc8198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc8198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 -- 172.21.15.6:0/3927787993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819e070 con 0x7f4cc8102a60 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4cccfe7640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc8198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.137+0000 7f4ccd7e8640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009230 tx=0x7f4cc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.138+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc403f030 con 0x7f4cc8102a60 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.138+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819e300 con 0x7f4cc8102a60 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.138+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cc4003a80 con 0x7f4cc8102a60 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.138+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4035070 con 0x7f4cc8102a60 2024-09-21T08:01:22.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.138+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc819e830 con 0x7f4cc8102a60 2024-09-21T08:01:22.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.139+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc8102e70 con 0x7f4cc8102a60 2024-09-21T08:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.142+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f4cc4042030 con 0x7f4cc8102a60 2024-09-21T08:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.142+0000 7f4cba7fc640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 0x7f4cb40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:22.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.142+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4cc41084a0 con 0x7f4cc8102a60 2024-09-21T08:01:22.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.142+0000 7f4cccfe7640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 0x7f4cb40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:22.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.143+0000 7f4cccfe7640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 0x7f4cb40b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8100e00 tx=0x7f4cbc00a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.145+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cc819e830 con 0x7f4cc8102a60 2024-09-21T08:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.370+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cc810ab20 con 0x7f4cc8102a60 2024-09-21T08:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.371+0000 7f4cba7fc640 1 -- 172.21.15.6:0/3927787993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f4cc40ce730 con 0x7f4cc8102a60 2024-09-21T08:01:22.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:22.373 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.374+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 msgr2=0x7f4cb40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.374+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 0x7f4cb40b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8100e00 tx=0x7f4cbc00a5c0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 msgr2=0x7f4cc81981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009230 tx=0x7f4cc4004270 comp rx=0 tx=0).stop 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 shutdown_connections 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4cb40b6620 0x7f4cb40b8b30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc8108cf0 0x7f4cc819da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc81083a0 0x7f4cc8198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 --2- 172.21.15.6:0/3927787993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc8102a60 0x7f4cc81981c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 >> 172.21.15.6:0/3927787993 conn(0x7f4cc8079730 msgr2=0x7f4cc8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 shutdown_connections 2024-09-21T08:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:22.375+0000 7f4ccfa4c640 1 -- 172.21.15.6:0/3927787993 wait complete. 2024-09-21T08:01:22.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:22 smithi006 ceph-mon[30970]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-21T08:01:22.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:22 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3927787993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:22 smithi119 ceph-mon[33564]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-21T08:01:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:22 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3927787993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:23.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:22 smithi145 ceph-mon[34049]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-21T08:01:23.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:22 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3927787993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:23.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-21T08:01:23.716 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-21T08:01:23.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-21T08:01:23.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T08:01:23.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:58:46.069948+0000', 'modified': '2024-09-21T07:59:28.356248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24713}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24694': {'gid': 24694, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6839/3378332428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3378332428}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3378332428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24713': {'gid': 24713, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/1644051507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1644051507}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1644051507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24713, 'qdb_cluster': [24713]} 2024-09-21T08:01:23.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T08:01:23.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.b status 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout:total 2 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 .. 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 data 2024-09-21T08:01:23.883 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:23.884 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2024-09-21T08:01:23.884 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:23.884 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:23.884 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 .. 2024-09-21T08:01:23.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-21T08:01:23.971 INFO:teuthology.orchestra.run.smithi006.stdout:[Service] 2024-09-21T08:01:23.971 INFO:teuthology.orchestra.run.smithi006.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-21T08:01:23.971 INFO:teuthology.orchestra.run.smithi006.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-21T08:01:23.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-21T08:01:24.091 INFO:teuthology.orchestra.run.smithi006.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-21T08:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 -- 172.21.15.6:0/541160139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b60108cf0 msgr2=0x7f5b6010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 --2- 172.21.15.6:0/541160139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b60108cf0 0x7f5b6010f520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009ca0 tx=0x7f5b5802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 -- 172.21.15.6:0/541160139 shutdown_connections 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 --2- 172.21.15.6:0/541160139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b601083a0 0x7f5b601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 --2- 172.21.15.6:0/541160139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b60108cf0 0x7f5b6010f520 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 --2- 172.21.15.6:0/541160139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60102a60 0x7f5b60102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 -- 172.21.15.6:0/541160139 >> 172.21.15.6:0/541160139 conn(0x7f5b60079730 msgr2=0x7f5b60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 -- 172.21.15.6:0/541160139 shutdown_connections 2024-09-21T08:01:24.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.663+0000 7f5b650bd640 1 -- 172.21.15.6:0/541160139 wait complete. 2024-09-21T08:01:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.664+0000 7f5b650bd640 1 Processor -- start 2024-09-21T08:01:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 -- start start 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 0x7f5b6010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 0x7f5b60110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60113980 con 0x7f5b601083a0 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60113800 con 0x7f5b60108cf0 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b650bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60113b00 con 0x7f5b60102a60 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42316/0 (socket says 172.21.15.6:42316) 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5e59c640 1 -- 172.21.15.6:0/3693346014 learned_addr learned my addr 172.21.15.6:0/3693346014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 0x7f5b6010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 0x7f5b60110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.665+0000 7f5b5ed9d640 1 -- 172.21.15.6:0/3693346014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 msgr2=0x7f5b60110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 0x7f5b60110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5ed9d640 1 -- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 msgr2=0x7f5b601102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5ed9d640 1 -- 172.21.15.6:0/3693346014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b601a8670 con 0x7f5b60102a60 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 0x7f5b60110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 0x7f5b6010fdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e9f0 tx=0x7f5b5000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b47fff640 1 -- 172.21.15.6:0/3693346014 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000ccc0 con 0x7f5b60102a60 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b601a8960 con 0x7f5b60102a60 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b47fff640 1 -- 172.21.15.6:0/3693346014 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b500108c0 con 0x7f5b60102a60 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b47fff640 1 -- 172.21.15.6:0/3693346014 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500187c0 con 0x7f5b60102a60 2024-09-21T08:01:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.666+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b601a8ef0 con 0x7f5b60102a60 2024-09-21T08:01:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 Processor -- start 2024-09-21T08:01:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 -- start start 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b47fff640 1 -- 172.21.15.6:0/3693346014 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f5b50018960 con 0x7f5b60102a60 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f26493dc10 con 0x55f26461ff60 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f26492d040 con 0x55f2645ff280 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.669+0000 7f5b6b631740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f264930e50 con 0x55f2645f70a0 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42324/0 (socket says 172.21.15.6:42324) 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 -- 172.21.15.6:0/3419884658 learned_addr learned my addr 172.21.15.6:0/3419884658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 -- 172.21.15.6:0/3419884658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 msgr2=0x55f2649c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 -- 172.21.15.6:0/3419884658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 msgr2=0x55f2649c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.670+0000 7f5b5f59e640 1 -- 172.21.15.6:0/3419884658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f26468b540 con 0x55f26461ff60 2024-09-21T08:01:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009ca0 tx=0x7f5b58009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d28b800a3f802c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b457fa640 1 -- 172.21.15.6:0/3419884658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58031c40 con 0x55f26461ff60 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b457fa640 1 -- 172.21.15.6:0/3419884658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b58036030 con 0x55f26461ff60 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b457fa640 1 -- 172.21.15.6:0/3419884658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580046f0 con 0x55f26461ff60 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b47fff640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 0x7f5b480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.671+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 0x7f5b480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b47fff640 1 -- 172.21.15.6:0/3693346014 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5b500e7c60 con 0x7f5b60102a60 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 -- 172.21.15.6:0/3419884658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 msgr2=0x55f2649c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b5ed9d640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 0x7f5b480b8b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55f2649c4b80 tx=0x7f5b50009700 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009ca0 tx=0x7f5b58009920 comp rx=0 tx=0).stop 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 -- 172.21.15.6:0/3419884658 shutdown_connections 2024-09-21T08:01:24.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3419884658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f26461ff60 0x55f2649c5f00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 -- 172.21.15.6:0/3419884658 >> 172.21.15.6:0/3419884658 conn(0x55f264614350 msgr2=0x55f2649c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 -- 172.21.15.6:0/3419884658 shutdown_connections 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.672+0000 7f5b6b631740 1 -- 172.21.15.6:0/3419884658 wait complete. 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 -- start start 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 Processor -- start 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f26461ff60 0x55f2649dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f26478e5f0 con 0x55f2645ff280 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2648c8010 con 0x55f26461ff60 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f2649d4500 con 0x55f2645f70a0 2024-09-21T08:01:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b6b631740 10 client.0 _ll_register_callbacks cb 0x55f264927340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42326/0 (socket says 172.21.15.6:42326) 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b5e59c640 1 -- 172.21.15.6:0/1837214634 learned_addr learned my addr 172.21.15.6:0/1837214634 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.673+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f26461ff60 0x55f2649dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 -- 172.21.15.6:0/1837214634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 msgr2=0x55f2649d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 -- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f26461ff60 msgr2=0x55f2649dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f26461ff60 0x55f2649dd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 -- 172.21.15.6:0/1837214634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2648f5a00 con 0x55f2645ff280 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5b54012790 tx=0x7f5b54012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e534b8d63cf105 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b42ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54010dc0 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5b54004030 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b58036030 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5b54004270 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b6b631740 10 client.15582 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.674+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f2649e04a0 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b58036030 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5b5401c460 con 0x55f2645ff280 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 10 client.15582 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 10 client.15582 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 20 client.15582 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f2645de8e0 0x55f2649e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 4 client.15582 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:24.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f26493fb60 con 0x55f2645de8e0 2024-09-21T08:01:24.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.675+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f2645de8e0 0x55f2649e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.676+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f2645de8e0 0x55f2649e3f40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4842691adefc8386 server_cookie=4314102ea815c458 in_seq=0 out_seq=0 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.676+0000 7f5b42ff5640 10 client.15582 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b42ff5640 1 -- 172.21.15.6:0/1837214634 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f26493fb60 con 0x55f2645de8e0 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b42ff5640 10 client.15582 handle_command_reply: tid=0 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 client.15582 shutdown 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 msgr2=0x55f2649d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5b54012790 tx=0x7f5b54012c50 comp rx=0 tx=0).stop 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 shutdown_connections 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f2645de8e0 0x55f2649e3f40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f26461ff60 0x55f2649dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b42ff5640 0 client.15582 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649d1f30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 --2- 172.21.15.6:0/1837214634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645f70a0 0x55f2649d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 >> 172.21.15.6:0/1837214634 conn(0x55f264614350 msgr2=0x55f2649c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 shutdown_connections 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 1 -- 172.21.15.6:0/1837214634 wait complete. 2024-09-21T08:01:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.677+0000 7f5b6b631740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T08:01:24.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 Processor -- start 2024-09-21T08:01:24.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 -- start start 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 0x55f2649ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e2280 con 0x55f2645f70a0 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e2950 con 0x55f2645ff280 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b6b631740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e3020 con 0x55f2645de8e0 2024-09-21T08:01:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 0x55f2649ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b5f59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 0x55f2649ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42330/0 (socket says 172.21.15.6:42330) 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b5e59c640 1 -- 172.21.15.6:0/2524931384 learned_addr learned my addr 172.21.15.6:0/2524931384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.696+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 -- 172.21.15.6:0/2524931384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 msgr2=0x55f2649dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 -- 172.21.15.6:0/2524931384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 msgr2=0x55f2649ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 0x55f2649ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 -- 172.21.15.6:0/2524931384 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2649c8d60 con 0x55f2645de8e0 2024-09-21T08:01:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649cc9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009bf0 tx=0x7f5b58009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870bceff9458ea6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b44ff9640 1 -- 172.21.15.6:0/2524931384 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58004670 con 0x55f2645de8e0 2024-09-21T08:01:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b44ff9640 1 -- 172.21.15.6:0/2524931384 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b58036040 con 0x55f2645de8e0 2024-09-21T08:01:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.697+0000 7f5b44ff9640 1 -- 172.21.15.6:0/2524931384 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580305c0 con 0x55f2645de8e0 2024-09-21T08:01:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 -- 172.21.15.6:0/2524931384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 msgr2=0x55f2649cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649cc9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009bf0 tx=0x7f5b58009920 comp rx=0 tx=0).stop 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 -- 172.21.15.6:0/2524931384 shutdown_connections 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645ff280 0x55f2649dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645f70a0 0x55f2649ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 --2- 172.21.15.6:0/2524931384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649cc9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.698+0000 7f5b6b631740 1 -- 172.21.15.6:0/2524931384 >> 172.21.15.6:0/2524931384 conn(0x55f264614350 msgr2=0x55f2649bead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 -- 172.21.15.6:0/2524931384 shutdown_connections 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 -- 172.21.15.6:0/2524931384 wait complete. 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 -- start start 2024-09-21T08:01:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 Processor -- start 2024-09-21T08:01:24.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.699+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b6b631740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649e6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b6b631740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e3dc0 con 0x55f2645ff280 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b6b631740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e36f0 con 0x55f2645f70a0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b6b631740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f2649e4490 con 0x55f2645de8e0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b6b631740 10 client.0 _ll_register_callbacks cb 0x7f5b5400bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38556/0 (socket says 172.21.15.6:38556) 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 -- 172.21.15.6:0/3947044901 learned_addr learned my addr 172.21.15.6:0/3947044901 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 -- 172.21.15.6:0/3947044901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 msgr2=0x55f2649ec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649ec7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 -- 172.21.15.6:0/3947044901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 msgr2=0x55f2649e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 -- 172.21.15.6:0/3947044901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2649e67a0 con 0x55f2645f70a0 2024-09-21T08:01:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b5e59c640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b5401ca70 tx=0x7f5b54010df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce15ab5828f4f351 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b42ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.700+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5402f070 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5b5401caf0 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b58036040 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5b5401ccf0 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b6b631740 10 client.25319 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f2649ec1e0 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.701+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b58036040 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5b54011740 con 0x55f2645f70a0 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 10 client.25319 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 10 client.25319 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 20 client.25319 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f26461ff60 0x55f264a52ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 4 client.25319 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T08:01:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "status"}) -- 0x55f26493b610 con 0x55f26461ff60 2024-09-21T08:01:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f26461ff60 0x55f264a52ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b42ff5640 10 client.25319 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.702+0000 7f5b5f59e640 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f26461ff60 0x55f264a52ae0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35b14b673f0256b server_cookie=c3d1c844f425a02 in_seq=0 out_seq=0 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b42ff5640 1 -- 172.21.15.6:0/3947044901 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f26493b610 con 0x55f26461ff60 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b42ff5640 10 client.25319 handle_command_reply: tid=0 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 client.25319 shutdown 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 msgr2=0x55f2649e5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b5401ca70 tx=0x7f5b54010df0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 shutdown_connections 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f26461ff60 0x55f264a52ae0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f2645ff280 0x55f2649e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2645f70a0 0x55f2649e5cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 --2- 172.21.15.6:0/3947044901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f2645de8e0 0x55f2649ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 >> 172.21.15.6:0/3947044901 conn(0x55f264614350 msgr2=0x55f2649bead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b42ff5640 0 client.25319 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 shutdown_connections 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 1 -- 172.21.15.6:0/3947044901 wait complete. 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.703+0000 7f5b6b631740 20 client.25319 trim_cache size 0 max 16384 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3246cac-77ed-11ef-baf6-efdc52797490", 2024-09-21T08:01:24.708 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24713, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 158.35525778300001, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 21, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 85, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 169.54726524399999 2024-09-21T08:01:24.709 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 msgr2=0x7f5b480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 0x7f5b480b8b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55f2649c4b80 tx=0x7f5b50009700 comp rx=0 tx=0).stop 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 msgr2=0x7f5b6010fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 0x7f5b6010fdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e9f0 tx=0x7f5b5000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 shutdown_connections 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5b480b65f0 0x7f5b480b8b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b60108cf0 0x7f5b60110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b601083a0 0x7f5b601102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 --2- 172.21.15.6:0/3693346014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b60102a60 0x7f5b6010fdb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.704+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 >> 172.21.15.6:0/3693346014 conn(0x7f5b60079730 msgr2=0x7f5b601052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.705+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 shutdown_connections 2024-09-21T08:01:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:24.705+0000 7f5b650bd640 1 -- 172.21.15.6:0/3693346014 wait complete. 2024-09-21T08:01:24.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:24 smithi006 ceph-mon[30970]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 41 op/s 2024-09-21T08:01:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:24 smithi119 ceph-mon[33564]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 41 op/s 2024-09-21T08:01:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:24 smithi145 ceph-mon[34049]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 41 op/s 2024-09-21T08:01:25.388 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T08:01:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:26 smithi006 ceph-mon[30970]: pgmap v355: 129 pgs: 129 active+clean; 5.6 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 357 KiB/s wr, 2 op/s 2024-09-21T08:01:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:26 smithi119 ceph-mon[33564]: pgmap v355: 129 pgs: 129 active+clean; 5.6 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 357 KiB/s wr, 2 op/s 2024-09-21T08:01:27.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:26 smithi145 ceph-mon[34049]: pgmap v355: 129 pgs: 129 active+clean; 5.6 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 357 KiB/s wr, 2 op/s 2024-09-21T08:01:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:28 smithi119 ceph-mon[33564]: pgmap v356: 129 pgs: 129 active+clean; 11 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 829 KiB/s wr, 7 op/s 2024-09-21T08:01:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:28 smithi145 ceph-mon[34049]: pgmap v356: 129 pgs: 129 active+clean; 11 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 829 KiB/s wr, 7 op/s 2024-09-21T08:01:29.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:28 smithi006 ceph-mon[30970]: pgmap v356: 129 pgs: 129 active+clean; 11 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 829 KiB/s wr, 7 op/s 2024-09-21T08:01:31.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:30 smithi119 ceph-mon[33564]: pgmap v357: 129 pgs: 129 active+clean; 25 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 30 op/s 2024-09-21T08:01:31.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:30 smithi145 ceph-mon[34049]: pgmap v357: 129 pgs: 129 active+clean; 25 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 30 op/s 2024-09-21T08:01:31.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:30 smithi006 ceph-mon[30970]: pgmap v357: 129 pgs: 129 active+clean; 25 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 30 op/s 2024-09-21T08:01:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:32 smithi119 ceph-mon[33564]: pgmap v358: 129 pgs: 129 active+clean; 31 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 3.0 MiB/s wr, 58 op/s 2024-09-21T08:01:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:32 smithi145 ceph-mon[34049]: pgmap v358: 129 pgs: 129 active+clean; 31 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 3.0 MiB/s wr, 58 op/s 2024-09-21T08:01:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:32 smithi006 ceph-mon[30970]: pgmap v358: 129 pgs: 129 active+clean; 31 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 3.0 MiB/s wr, 58 op/s 2024-09-21T08:01:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:34 smithi119 ceph-mon[33564]: pgmap v359: 129 pgs: 129 active+clean; 38 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.8 MiB/s wr, 86 op/s 2024-09-21T08:01:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:34 smithi145 ceph-mon[34049]: pgmap v359: 129 pgs: 129 active+clean; 38 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.8 MiB/s wr, 86 op/s 2024-09-21T08:01:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:34 smithi006 ceph-mon[30970]: pgmap v359: 129 pgs: 129 active+clean; 38 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.8 MiB/s wr, 86 op/s 2024-09-21T08:01:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:36 smithi119 ceph-mon[33564]: pgmap v360: 129 pgs: 129 active+clean; 39 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 92 op/s 2024-09-21T08:01:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:36 smithi145 ceph-mon[34049]: pgmap v360: 129 pgs: 129 active+clean; 39 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 92 op/s 2024-09-21T08:01:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:36 smithi006 ceph-mon[30970]: pgmap v360: 129 pgs: 129 active+clean; 39 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 92 op/s 2024-09-21T08:01:38.832 INFO:teuthology.orchestra.run.smithi006.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-21T08:01:38.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T08:01:39.138 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:total 2 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 . 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 data 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:total 45 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 . 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 21 08:01 base 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 21 08:01 global 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 log 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_commit_ts 2024-09-21T08:01:39.139 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_dynshmem 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 08:01 pg_hba.conf 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 08:01 pg_ident.conf 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:01 pg_logical 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 pg_multixact 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_notify 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_replslot 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_serial 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_snapshots 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_stat 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_stat_tmp 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 pg_subtrans 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_tblspc 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_twophase 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:01 pg_wal 2024-09-21T08:01:39.140 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 pg_xact 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 08:01 postgresql.auto.conf 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 08:01 postgresql.conf 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 21 08:01 . 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 1 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 13493 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 13494 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:total 7778 2024-09-21T08:01:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 . 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 21 08:01 .. 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 1247 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1247_vm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:01 1249 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1249_fsm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1249_vm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:01:39.142 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:01 1259 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1259_vm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:01:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:01:39.144 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2579 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:01:39.145 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606_vm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:01 2608 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2608_vm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:01:39.146 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2610 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2610_vm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:01:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 08:01 2619 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2619_fsm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2619_vm 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:01:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:01 2658 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 2659 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2662 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2663 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2664 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2665 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2666 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2667 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:01:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:01 2673 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:01 2674 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2678 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2679 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:01:39.150 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2696 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2703 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2704 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:01:39.151 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:01:39.152 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:01:39.153 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:01:39.154 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3455 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:01:39.155 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:01:39.156 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:01:39.157 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:01:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:01:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:01:39.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:38 smithi119 ceph-mon[33564]: pgmap v361: 129 pgs: 129 active+clean; 41 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 97 op/s 2024-09-21T08:01:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:38 smithi145 ceph-mon[34049]: pgmap v361: 129 pgs: 129 active+clean; 41 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 97 op/s 2024-09-21T08:01:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:38 smithi006 ceph-mon[30970]: pgmap v361: 129 pgs: 129 active+clean; 41 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.2 MiB/s wr, 97 op/s 2024-09-21T08:01:39.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:01:39.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:01:39.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:01:39.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:01:39.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:01:39.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:01:39.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:01:39.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:01:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:01:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:01:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:01:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:01:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:01:39.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T08:01:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:total 7778 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 . 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 21 08:01 .. 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 1247 2024-09-21T08:01:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:01:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1247_vm 2024-09-21T08:01:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:01 1249 2024-09-21T08:01:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1249_fsm 2024-09-21T08:01:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1249_vm 2024-09-21T08:01:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:01 1259 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1259_vm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:01:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:01:39.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:01:39.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2579 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:01:39.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606_vm 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:01:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:01 2608 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2608_vm 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:01:39.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2610 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2610_vm 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:01:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:01:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:01:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 08:01 2619 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2619_fsm 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2619_vm 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:01:39.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:01 2658 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 2659 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:01:39.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2662 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2663 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2664 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2665 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2666 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2667 2024-09-21T08:01:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:01 2673 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:01 2674 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2678 2024-09-21T08:01:39.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2679 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:01:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:01:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:01:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:01:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2696 2024-09-21T08:01:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:01:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:01:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2703 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2704 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:01:39.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:01:39.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:01:39.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:01:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:01:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:01:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:01:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:01:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:01:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:01:39.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:01:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:01:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3455 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:01:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:01:39.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:01:39.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:01:39.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:01:39.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:01:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:01:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:01:39.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:01:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:01:39.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:01:39.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:01:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:01:39.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:total 7778 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 . 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 21 08:01 .. 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:01:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 1247 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1247_vm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:01 1249 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1249_fsm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1249_vm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:01 1259 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:01:39.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1259_vm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:01:39.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:01:39.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2579 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:01:39.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606_vm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:01 2608 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:01:39.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2608_vm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2610 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2610_vm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:01:39.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 08:01 2619 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2619_fsm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2619_vm 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:01:39.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:01 2658 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 2659 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2662 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2663 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2664 2024-09-21T08:01:39.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2665 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2666 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2667 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:01 2673 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:01 2674 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2678 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2679 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:01:39.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2696 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:01:39.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2703 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2704 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:01:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:01:39.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:01:39.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3455 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:01:39.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:01:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:01:39.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:01:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:01:39.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:01:39.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:total 538 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 21 08:01 . 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1213 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1213_fsm 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1213_vm 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1214 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1214_fsm 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1214_vm 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 1232 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 1233 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1260 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1260_fsm 2024-09-21T08:01:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1260_vm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1261 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1261_fsm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1261_vm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1262 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1262_fsm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1262_vm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2396 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2396_fsm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2396_vm 2024-09-21T08:01:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2397 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2671 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2672 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2676 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2677 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2694 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2695 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2697 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2698 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2846 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2847 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2964 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2965 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2966 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2967 2024-09-21T08:01:39.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3592 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3593 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4060 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4061 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4175 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4176 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4177 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4178 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4181 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4182 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4183 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4184 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4185 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4186 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6000 2024-09-21T08:01:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6001 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6002 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6100 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6114 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6115 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 pg_control 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.718 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.718 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:01 . 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 mappings 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:01 replorigin_checkpoint 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 snapshots 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:01 .. 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:01 .. 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:total 2 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 . 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 members 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 offsets 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 .. 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 0000 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:01:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 .. 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 0000 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.722 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.723 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T08:01:39.724 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.724 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.724 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.724 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.724 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 0000 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T08:01:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:total 16386 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:01 . 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:01 000000010000000000000001 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 archive_status 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:01 .. 2024-09-21T08:01:39.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T08:01:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:01:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:01:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 21 08:01 .. 2024-09-21T08:01:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 0000 2024-09-21T08:01:39.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-21T08:01:39.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-21T08:01:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:dropping old tables... 2024-09-21T08:01:40.016 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-21T08:01:40.017 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-21T08:01:40.017 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-21T08:01:40.017 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-21T08:01:40.017 INFO:teuthology.orchestra.run.smithi006.stderr:creating tables... 2024-09-21T08:01:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:generating data (client-side)... 2024-09-21T08:01:40.389 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T08:01:40.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.54 s, remaining 16.77 s) 2024-09-21T08:01:40.686 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:40.991 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:40 smithi006 ceph-mon[30970]: pgmap v362: 129 pgs: 129 active+clean; 47 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 4.3 MiB/s wr, 144 op/s 2024-09-21T08:01:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:40 smithi119 ceph-mon[33564]: pgmap v362: 129 pgs: 129 active+clean; 47 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 4.3 MiB/s wr, 144 op/s 2024-09-21T08:01:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:40 smithi145 ceph-mon[34049]: pgmap v362: 129 pgs: 129 active+clean; 47 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 4.3 MiB/s wr, 144 op/s 2024-09-21T08:01:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 -- 172.21.15.6:0/3812422409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48108cf0 msgr2=0x7f5f4810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 --2- 172.21.15.6:0/3812422409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48108cf0 0x7f5f4810f520 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009ca0 tx=0x7f5f4002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 -- 172.21.15.6:0/3812422409 shutdown_connections 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 --2- 172.21.15.6:0/3812422409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 0x7f5f481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 --2- 172.21.15.6:0/3812422409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48108cf0 0x7f5f4810f520 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 --2- 172.21.15.6:0/3812422409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48102a60 0x7f5f48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 -- 172.21.15.6:0/3812422409 >> 172.21.15.6:0/3812422409 conn(0x7f5f48079730 msgr2=0x7f5f48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 -- 172.21.15.6:0/3812422409 shutdown_connections 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.194+0000 7f5f501c0640 1 -- 172.21.15.6:0/3812422409 wait complete. 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.195+0000 7f5f501c0640 1 Processor -- start 2024-09-21T08:01:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.195+0000 7f5f501c0640 1 -- start start 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 0x7f5f4819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48108cf0 0x7f5f4819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48112860 con 0x7f5f48102a60 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481126e0 con 0x7f5f48108cf0 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f501c0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481129e0 con 0x7f5f481083a0 2024-09-21T08:01:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35682/0 (socket says 172.21.15.6:35682) 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 -- 172.21.15.6:0/2924722215 learned_addr learned my addr 172.21.15.6:0/2924722215 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4d75b640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 0x7f5f4819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4e75d640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48108cf0 0x7f5f4819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 -- 172.21.15.6:0/2924722215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 msgr2=0x7f5f4819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 0x7f5f4819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 -- 172.21.15.6:0/2924722215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48108cf0 msgr2=0x7f5f4819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48108cf0 0x7f5f4819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.196+0000 7f5f4df5c640 1 -- 172.21.15.6:0/2924722215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f481a0350 con 0x7f5f48102a60 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f4df5c640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d950 tx=0x7f5f4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44017030 con 0x7f5f48102a60 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f44004020 con 0x7f5f48102a60 2024-09-21T08:01:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f481a0640 con 0x7f5f48102a60 2024-09-21T08:01:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440055d0 con 0x7f5f48102a60 2024-09-21T08:01:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.197+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a6da0 con 0x7f5f48102a60 2024-09-21T08:01:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.198+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f48102e70 con 0x7f5f48102a60 2024-09-21T08:01:41.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.200+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f5f44009a30 con 0x7f5f48102a60 2024-09-21T08:01:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.201+0000 7f5f3effd640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 0x7f5f340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.202+0000 7f5f4d75b640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 0x7f5f340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.202+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5f440e7940 con 0x7f5f48102a60 2024-09-21T08:01:41.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.202+0000 7f5f4d75b640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 0x7f5f340b8b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f48079c50 tx=0x7f5f38005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:41.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.205+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f440adbd0 con 0x7f5f48102a60 2024-09-21T08:01:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.491+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f4819b510 con 0x7f5f48102a60 2024-09-21T08:01:41.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.491+0000 7f5f3effd640 1 -- 172.21.15.6:0/2924722215 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f5f440b1fb0 con 0x7f5f48102a60 2024-09-21T08:01:41.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:41.493 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:41.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 msgr2=0x7f5f340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 0x7f5f340b8b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f48079c50 tx=0x7f5f38005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 msgr2=0x7f5f4819a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d950 tx=0x7f5f4400de10 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 shutdown_connections 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5f340b65f0 0x7f5f340b8b00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f481083a0 0x7f5f4819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f48108cf0 0x7f5f4819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 --2- 172.21.15.6:0/2924722215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f48102a60 0x7f5f4819a3e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 >> 172.21.15.6:0/2924722215 conn(0x7f5f48079730 msgr2=0x7f5f4806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 shutdown_connections 2024-09-21T08:01:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:41.494+0000 7f5f501c0640 1 -- 172.21.15.6:0/2924722215 wait complete. 2024-09-21T08:01:41.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:01:41.840 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:41 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2924722215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:200000 of 3200000 tuples (6%) done (elapsed 1.78 s, remaining 26.77 s) 2024-09-21T08:01:42.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:41 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2924722215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:42.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:41 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2924722215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:42.254 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T08:01:42.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T08:01:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:42.778 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:42 smithi006 ceph-mon[30970]: pgmap v363: 129 pgs: 129 active+clean; 52 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-21T08:01:42.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 -- 172.21.15.6:0/2070599145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83501094b0 msgr2=0x7f83501098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 --2- 172.21.15.6:0/2070599145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83501094b0 0x7f83501098c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:42.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 -- 172.21.15.6:0/2070599145 shutdown_connections 2024-09-21T08:01:42.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 --2- 172.21.15.6:0/2070599145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8350109e00 0x7f8350110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 --2- 172.21.15.6:0/2070599145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83501094b0 0x7f83501098c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 --2- 172.21.15.6:0/2070599145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 0x7f8350103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 -- 172.21.15.6:0/2070599145 >> 172.21.15.6:0/2070599145 conn(0x7f83500ff5e0 msgr2=0x7f8350101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 -- 172.21.15.6:0/2070599145 shutdown_connections 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.884+0000 7f8355d6e640 1 -- 172.21.15.6:0/2070599145 wait complete. 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 Processor -- start 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 -- start start 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 0x7f835019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83501094b0 0x7f835019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8350113970 con 0x7f8350109e00 2024-09-21T08:01:42.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83501137f0 con 0x7f83501094b0 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.885+0000 7f8355d6e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8350113af0 con 0x7f8350103b70 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35700/0 (socket says 172.21.15.6:35700) 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 -- 172.21.15.6:0/3255608433 learned_addr learned my addr 172.21.15.6:0/3255608433 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834effd640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83501094b0 0x7f835019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834f7fe640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 0x7f835019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 -- 172.21.15.6:0/3255608433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 msgr2=0x7f835019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 0x7f835019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 -- 172.21.15.6:0/3255608433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83501094b0 msgr2=0x7f835019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83501094b0 0x7f835019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 -- 172.21.15.6:0/3255608433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83501a0330 con 0x7f8350109e00 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834ffff640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f834800eaa0 tx=0x7f834800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f834cff9640 1 -- 172.21.15.6:0/3255608433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834800cdb0 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.886+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83501a0620 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.887+0000 7f834cff9640 1 -- 172.21.15.6:0/3255608433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8348005020 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.887+0000 7f834cff9640 1 -- 172.21.15.6:0/3255608433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83480116d0 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.887+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83501a6d80 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.890+0000 7f835c2e2740 1 Processor -- start 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.890+0000 7f834cff9640 1 -- 172.21.15.6:0/3255608433 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f83480051d0 con 0x7f8350109e00 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 -- start start 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cb7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55abe5c2de50 con 0x55abe58e71b0 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abe5c1d280 con 0x55abe58ef390 2024-09-21T08:01:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f835c2e2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55abe5c21090 con 0x55abe5910070 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37170/0 (socket says 172.21.15.6:37170) 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834effd640 1 -- 172.21.15.6:0/2151798587 learned_addr learned my addr 172.21.15.6:0/2151798587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cb7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834effd640 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834f7fe640 1 -- 172.21.15.6:0/2151798587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 msgr2=0x55abe5cb7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.891+0000 7f834cff9640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 0x7f83380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834f7fe640 1 -- 172.21.15.6:0/2151798587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 msgr2=0x55abe5cb80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834f7fe640 1 -- 172.21.15.6:0/2151798587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe597b650 con 0x55abe58e71b0 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834effd640 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834ffff640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 0x7f83380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cb7b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8340009c00 tx=0x7f8340011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9b1be4c41ebbca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834cff9640 1 -- 172.21.15.6:0/3255608433 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f83480e7ae0 con 0x7f8350109e00 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f8335ffb640 1 -- 172.21.15.6:0/2151798587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004230 con 0x55abe58e71b0 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f834ffff640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 0x7f83380b8b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f834807c1b0 tx=0x7f834807a3d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f8335ffb640 1 -- 172.21.15.6:0/2151798587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83400043d0 con 0x55abe58e71b0 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.892+0000 7f8335ffb640 1 -- 172.21.15.6:0/2151798587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004ba0 con 0x55abe58e71b0 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.893+0000 7f835c2e2740 1 -- 172.21.15.6:0/2151798587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 msgr2=0x55abe5cb7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.893+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cb7b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8340009c00 tx=0x7f8340011810 comp rx=0 tx=0).stop 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 -- 172.21.15.6:0/2151798587 shutdown_connections 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cb7b90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2151798587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 -- 172.21.15.6:0/2151798587 >> 172.21.15.6:0/2151798587 conn(0x55abe5904460 msgr2=0x55abe5cb5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 -- 172.21.15.6:0/2151798587 shutdown_connections 2024-09-21T08:01:42.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 -- 172.21.15.6:0/2151798587 wait complete. 2024-09-21T08:01:42.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 -- start start 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.894+0000 7f835c2e2740 1 Processor -- start 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cc3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe5910070 0x55abe5cd3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55abe5a7e700 con 0x55abe5910070 2024-09-21T08:01:42.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abe5bb8110 con 0x55abe58ef390 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55abe5cca240 con 0x55abe58e71b0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f835c2e2740 10 client.0 _ll_register_callbacks cb 0x55abe5bd1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cc3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37184/0 (socket says 172.21.15.6:37184) 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 -- 172.21.15.6:0/2304033097 learned_addr learned my addr 172.21.15.6:0/2304033097 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe5910070 0x55abe5cd3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 -- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 msgr2=0x55abe5cc3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cc3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 -- 172.21.15.6:0/2304033097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe5910070 msgr2=0x55abe5cd3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe5910070 0x55abe5cd3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834effd640 1 -- 172.21.15.6:0/2304033097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe5be5c40 con 0x55abe58e71b0 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.895+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cc3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:42.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f834effd640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8344009230 tx=0x7f8344009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d044f6eb7e532ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f832effd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035040 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83400043d0 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8344032040 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8344032240 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f835c2e2740 10 client.25381 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55abe5cd5fd0 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.896+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83400043d0 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f834404b610 con 0x55abe58e71b0 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 10 client.25381 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 10 client.25381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 20 client.25381 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58ce9f0 0x55abe5cd9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 4 client.25381 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abe5c2fda0 con 0x55abe58ce9f0 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.897+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58ce9f0 0x55abe5cd9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.898+0000 7f832effd640 10 client.25381 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.898+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58ce9f0 0x55abe5cd9800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bda61d76d3345ab server_cookie=3b48ee04f4e21c8e in_seq=0 out_seq=0 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.899+0000 7f832effd640 1 -- 172.21.15.6:0/2304033097 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abe5c2fda0 con 0x55abe58ce9f0 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.899+0000 7f832effd640 10 client.25381 handle_command_reply: tid=0 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.899+0000 7f835c2e2740 1 client.25381 shutdown 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.899+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 msgr2=0x55abe5cc2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.899+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8344009230 tx=0x7f8344009260 comp rx=0 tx=0).stop 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 shutdown_connections 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58ce9f0 0x55abe5cd9800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe5910070 0x55abe5cd3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cc3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 --2- 172.21.15.6:0/2304033097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58e71b0 0x55abe5cc2d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 >> 172.21.15.6:0/2304033097 conn(0x55abe5904460 msgr2=0x55abe5cba7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f832effd640 0 client.25381 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 shutdown_connections 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 1 -- 172.21.15.6:0/2304033097 wait complete. 2024-09-21T08:01:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.900+0000 7f835c2e2740 20 client.25381 trim_cache size 0 max 16384 2024-09-21T08:01:42.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.927+0000 7f835c2e2740 1 Processor -- start 2024-09-21T08:01:42.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.927+0000 7f835c2e2740 1 -- start start 2024-09-21T08:01:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83501acb70 con 0x55abe58e71b0 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83501af3f0 con 0x55abe58ef390 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f835c2e2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83501ad1e0 con 0x55abe5910070 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f834effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f834effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35730/0 (socket says 172.21.15.6:35730) 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f834effd640 1 -- 172.21.15.6:0/3354074542 learned_addr learned my addr 172.21.15.6:0/3354074542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f834f7fe640 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.928+0000 7f834effd640 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 -- 172.21.15.6:0/3354074542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 msgr2=0x55abe5cb50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 -- 172.21.15.6:0/3354074542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 msgr2=0x55abe5cb4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 -- 172.21.15.6:0/3354074542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe5cba4b0 con 0x55abe58e71b0 2024-09-21T08:01:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f834effd640 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f8344005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db15698149871e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f83357fa640 1 -- 172.21.15.6:0/3354074542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035070 con 0x55abe58e71b0 2024-09-21T08:01:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f83357fa640 1 -- 172.21.15.6:0/3354074542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83440318d0 con 0x55abe58e71b0 2024-09-21T08:01:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.929+0000 7f83357fa640 1 -- 172.21.15.6:0/3354074542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83440323e0 con 0x55abe58e71b0 2024-09-21T08:01:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.930+0000 7f835c2e2740 1 -- 172.21.15.6:0/3354074542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 msgr2=0x55abe5cc4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.930+0000 7f835c2e2740 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f8344005fd0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 -- 172.21.15.6:0/3354074542 shutdown_connections 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe5910070 0x55abe5cb50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe58ef390 0x55abe5cb4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 --2- 172.21.15.6:0/3354074542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5cc4970 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 -- 172.21.15.6:0/3354074542 >> 172.21.15.6:0/3354074542 conn(0x55abe5904460 msgr2=0x55abe5cc4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 -- 172.21.15.6:0/3354074542 shutdown_connections 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 -- 172.21.15.6:0/3354074542 wait complete. 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 -- start start 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.931+0000 7f835c2e2740 1 Processor -- start 2024-09-21T08:01:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f834effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f834effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35734/0 (socket says 172.21.15.6:35734) 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58ef390 0x55abe5ccb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f834effd640 1 -- 172.21.15.6:0/945830348 learned_addr learned my addr 172.21.15.6:0/945830348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe5910070 0x55abe5ccb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83501ad8b0 con 0x55abe58e71b0 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83501aed20 con 0x55abe5910070 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83501adf80 con 0x55abe58ef390 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f835c2e2740 10 client.0 _ll_register_callbacks cb 0x7f8344005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.932+0000 7f834f7fe640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58ef390 0x55abe5ccb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 -- 172.21.15.6:0/945830348 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58ef390 msgr2=0x55abe5ccb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58ef390 0x55abe5ccb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 -- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe5910070 msgr2=0x55abe5ccb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe5910070 0x55abe5ccb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe5ccbf30 con 0x55abe58e71b0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f834effd640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8344031ce0 tx=0x7f8344004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111a3289d96f8d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f832effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035070 con 0x55abe58e71b0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f83440323e0 con 0x55abe58e71b0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.933+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55abe5c2b850 con 0x55abe58e71b0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8344032070 con 0x55abe58e71b0 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 10 client.15612 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55abe5d441d0 con 0x55abe58e71b0 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55abe5c2b850 con 0x55abe58e71b0 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8344063020 con 0x55abe58e71b0 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 10 client.15612 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 20 client.15612 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58a3da0 0x55abe5d46880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 4 client.15612 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55abe5c28c80 con 0x55abe58a3da0 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.934+0000 7f834f7fe640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58a3da0 0x55abe5d46880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.935+0000 7f832effd640 10 client.15612 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.935+0000 7f834f7fe640 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58a3da0 0x55abe5d46880 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdc2d0020ad0873 server_cookie=c3eaee62d9e8a96c in_seq=0 out_seq=0 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.935+0000 7f832effd640 1 -- 172.21.15.6:0/945830348 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55abe5c28c80 con 0x55abe58a3da0 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.935+0000 7f832effd640 10 client.15612 handle_command_reply: tid=0 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.935+0000 7f835c2e2740 1 client.15612 shutdown 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 msgr2=0x55abe5ccfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8344031ce0 tx=0x7f8344004250 comp rx=0 tx=0).stop 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 shutdown_connections 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abe58a3da0 0x55abe5d46880 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abe58ef390 0x55abe5ccb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f832effd640 0 client.15612 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abe5910070 0x55abe5ccb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 --2- 172.21.15.6:0/945830348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abe58e71b0 0x55abe5ccfd30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 >> 172.21.15.6:0/945830348 conn(0x55abe5904460 msgr2=0x55abe5cb84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 shutdown_connections 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.936+0000 7f835c2e2740 1 -- 172.21.15.6:0/945830348 wait complete. 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.937+0000 7f835c2e2740 20 client.15612 trim_cache size 0 max 16384 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:01:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:42.942 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.937+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 msgr2=0x7f83380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.937+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 0x7f83380b8b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f834807c1b0 tx=0x7f834807a3d0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 msgr2=0x7f835019fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f834800eaa0 tx=0x7f834800ef60 comp rx=0 tx=0).stop 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 shutdown_connections 2024-09-21T08:01:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83380b65f0 0x7f83380b8b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8350109e00 0x7f835019fc00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83501094b0 0x7f835019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 --2- 172.21.15.6:0/3255608433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8350103b70 0x7f835019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 >> 172.21.15.6:0/3255608433 conn(0x7f83500ff5e0 msgr2=0x7f8350101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 shutdown_connections 2024-09-21T08:01:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:42.938+0000 7f8355d6e640 1 -- 172.21.15.6:0/3255608433 wait complete. 2024-09-21T08:01:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:42 smithi119 ceph-mon[33564]: pgmap v363: 129 pgs: 129 active+clean; 52 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-21T08:01:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:300000 of 3200000 tuples (9%) done (elapsed 3.07 s, remaining 29.69 s) 2024-09-21T08:01:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:42 smithi145 ceph-mon[34049]: pgmap v363: 129 pgs: 129 active+clean; 52 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-21T08:01:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:400000 of 3200000 tuples (12%) done (elapsed 3.92 s, remaining 27.42 s) 2024-09-21T08:01:44.796 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:44 smithi006 ceph-mon[30970]: pgmap v364: 129 pgs: 129 active+clean; 81 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 6.7 MiB/s wr, 118 op/s 2024-09-21T08:01:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:44 smithi119 ceph-mon[33564]: pgmap v364: 129 pgs: 129 active+clean; 81 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 6.7 MiB/s wr, 118 op/s 2024-09-21T08:01:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:44 smithi145 ceph-mon[34049]: pgmap v364: 129 pgs: 129 active+clean; 81 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 6.7 MiB/s wr, 118 op/s 2024-09-21T08:01:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:500000 of 3200000 tuples (15%) done (elapsed 5.25 s, remaining 28.37 s) 2024-09-21T08:01:46.304 INFO:teuthology.orchestra.run.smithi006.stderr:600000 of 3200000 tuples (18%) done (elapsed 6.20 s, remaining 26.88 s) 2024-09-21T08:01:46.467 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:01:46.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 -- 172.21.15.6:0/831921509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 msgr2=0x7fd2e0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/831921509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e0103f90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009900 tx=0x7fd2d002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 -- 172.21.15.6:0/831921509 shutdown_connections 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/831921509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 0x7fd2e0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/831921509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/831921509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e0103f90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 -- 172.21.15.6:0/831921509 >> 172.21.15.6:0/831921509 conn(0x7fd2e00ff5d0 msgr2=0x7fd2e0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 -- 172.21.15.6:0/831921509 shutdown_connections 2024-09-21T08:01:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.672+0000 7fd2e64d7640 1 -- 172.21.15.6:0/831921509 wait complete. 2024-09-21T08:01:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.673+0000 7fd2e64d7640 1 Processor -- start 2024-09-21T08:01:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.673+0000 7fd2e64d7640 1 -- start start 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 0x7fd2e019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01139d0 con 0x7fd2e0103b80 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0113850 con 0x7fd2e01094c0 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e64d7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0113b50 con 0x7fd2e0109e10 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55964/0 (socket says 172.21.15.6:55964) 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 -- 172.21.15.6:0/2203434288 learned_addr learned my addr 172.21.15.6:0/2203434288 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 0x7fd2e019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 -- 172.21.15.6:0/2203434288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 msgr2=0x7fd2e019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 0x7fd2e019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 -- 172.21.15.6:0/2203434288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 msgr2=0x7fd2e019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2dffff640 1 -- 172.21.15.6:0/2203434288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e01a0230 con 0x7fd2e0103b80 2024-09-21T08:01:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.674+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002a930 tx=0x7fd2d0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2dd7fa640 1 -- 172.21.15.6:0/2203434288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d003f070 con 0x7fd2e0103b80 2024-09-21T08:01:46.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e01a04c0 con 0x7fd2e0103b80 2024-09-21T08:01:46.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01a09f0 con 0x7fd2e0103b80 2024-09-21T08:01:46.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2dd7fa640 1 -- 172.21.15.6:0/2203434288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2d0003e40 con 0x7fd2e0103b80 2024-09-21T08:01:46.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.675+0000 7fd2dd7fa640 1 -- 172.21.15.6:0/2203434288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0035030 con 0x7fd2e0103b80 2024-09-21T08:01:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 Processor -- start 2024-09-21T08:01:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 -- start start 2024-09-21T08:01:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557665953b90 con 0x557665636840 2024-09-21T08:01:46.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557665942fc0 con 0x55766560d980 2024-09-21T08:01:46.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557665946dd0 con 0x557665615b60 2024-09-21T08:01:46.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.678+0000 7fd2df7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:33672/0 (socket says 172.21.15.6:33672) 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 -- 172.21.15.6:0/4145908675 learned_addr learned my addr 172.21.15.6:0/4145908675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 -- 172.21.15.6:0/4145908675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 msgr2=0x5576659ddb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ddb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 -- 172.21.15.6:0/4145908675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 msgr2=0x5576659dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 -- 172.21.15.6:0/4145908675 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576658ca060 con 0x557665615b60 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2dd7fa640 1 -- 172.21.15.6:0/2203434288 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7fd2d0042070 con 0x7fd2e0103b80 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400f3c0 tx=0x7fd2d400f880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b18ec1fb60a15b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.679+0000 7fd2c67fc640 1 -- 172.21.15.6:0/4145908675 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4005220 con 0x557665615b60 2024-09-21T08:01:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.680+0000 7fd2c67fc640 1 -- 172.21.15.6:0/4145908675 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2d4004c30 con 0x557665615b60 2024-09-21T08:01:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.680+0000 7fd2dd7fa640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 0x7fd2c80b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.680+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 0x7fd2c80b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.681+0000 7fd2c67fc640 1 -- 172.21.15.6:0/4145908675 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4010bc0 con 0x557665615b60 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.681+0000 7fd2dd7fa640 1 -- 172.21.15.6:0/2203434288 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fd2d0108420 con 0x7fd2e0103b80 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.681+0000 7fd2eca4b740 1 -- 172.21.15.6:0/4145908675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 msgr2=0x5576659de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.681+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 0x7fd2c80b8bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8005fd0 tx=0x7fd2d8009ae0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.681+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400f3c0 tx=0x7fd2d400f880 comp rx=0 tx=0).stop 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 -- 172.21.15.6:0/4145908675 shutdown_connections 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659de080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/4145908675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 -- 172.21.15.6:0/4145908675 >> 172.21.15.6:0/4145908675 conn(0x55766562a990 msgr2=0x5576659db4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 -- 172.21.15.6:0/4145908675 shutdown_connections 2024-09-21T08:01:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 -- 172.21.15.6:0/4145908675 wait complete. 2024-09-21T08:01:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 -- start start 2024-09-21T08:01:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.682+0000 7fd2eca4b740 1 Processor -- start 2024-09-21T08:01:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659eda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5576657a47a0 con 0x557665615b60 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5576658e80a0 con 0x55766560d980 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5576659f01e0 con 0x557665636840 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47388/0 (socket says 172.21.15.6:47388) 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2dffff640 1 -- 172.21.15.6:0/2404571211 learned_addr learned my addr 172.21.15.6:0/2404571211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.683+0000 7fd2eca4b740 10 client.0 _ll_register_callbacks cb 0x5576658c53c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 -- 172.21.15.6:0/2404571211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 msgr2=0x5576659f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 -- 172.21.15.6:0/2404571211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 msgr2=0x5576659eda90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 -- 172.21.15.6:0/2404571211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576658d6880 con 0x55766560d980 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2dffff640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00cb220 tx=0x7fd2d00cde40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194934e145390946 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0049030 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.684+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fd2d00d7540 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.685+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d4004c30 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.685+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd2d00cdac0 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.685+0000 7fd2eca4b740 10 client.25346 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.685+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5576656b0b90 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2d00ce6b0 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd2d00b9110 con 0x55766560d980 2024-09-21T08:01:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 10 client.25346 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 10 client.25346 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 20 client.25346 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655f51c0 0x5576659ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 4 client.25346 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd2d4004c30 con 0x5576655f51c0 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.686+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655f51c0 0x5576659ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.687+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655f51c0 0x5576659ff4f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2401602b9c9cb74e server_cookie=3a5774f91e243bc4 in_seq=0 out_seq=0 2024-09-21T08:01:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.687+0000 7fd2bf7fe640 10 client.25346 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/2404571211 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd2d4004c30 con 0x5576655f51c0 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2bf7fe640 10 client.25346 handle_command_reply: tid=0 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 client.25346 shutdown 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 msgr2=0x5576659ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00cb220 tx=0x7fd2d00cde40 comp rx=0 tx=0).stop 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 shutdown_connections 2024-09-21T08:01:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655f51c0 0x5576659ff4f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/2404571211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ed550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 >> 172.21.15.6:0/2404571211 conn(0x55766562a990 msgr2=0x5576659de630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2bf7fe640 0 client.25346 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 shutdown_connections 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 1 -- 172.21.15.6:0/2404571211 wait complete. 2024-09-21T08:01:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.688+0000 7fd2eca4b740 20 client.25346 trim_cache size 0 max 16384 2024-09-21T08:01:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 Processor -- start 2024-09-21T08:01:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 -- start start 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01aca70 con 0x557665636840 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01af2f0 con 0x55766560d980 2024-09-21T08:01:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01ad0e0 con 0x557665615b60 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.716+0000 7fd2e4a74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55992/0 (socket says 172.21.15.6:55992) 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 -- 172.21.15.6:0/680532599 learned_addr learned my addr 172.21.15.6:0/680532599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2dffff640 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 -- 172.21.15.6:0/680532599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 msgr2=0x5576659ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 -- 172.21.15.6:0/680532599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 msgr2=0x5576659ded40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ded40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 -- 172.21.15.6:0/680532599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576659db5c0 con 0x557665636840 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.717+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80127a0 tx=0x7fd2d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77fdb7058427760 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.718+0000 7fd2c5ffb640 1 -- 172.21.15.6:0/680532599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80118e0 con 0x557665636840 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.718+0000 7fd2c5ffb640 1 -- 172.21.15.6:0/680532599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2d8024070 con 0x557665636840 2024-09-21T08:01:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.718+0000 7fd2c5ffb640 1 -- 172.21.15.6:0/680532599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8020da0 con 0x557665636840 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 -- 172.21.15.6:0/680532599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 msgr2=0x5576659ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80127a0 tx=0x7fd2d8013000 comp rx=0 tx=0).stop 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 -- 172.21.15.6:0/680532599 shutdown_connections 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665615b60 0x5576659ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665636840 0x5576659ea6f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/680532599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659ded40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 -- 172.21.15.6:0/680532599 >> 172.21.15.6:0/680532599 conn(0x55766562a990 msgr2=0x5576659de630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 -- 172.21.15.6:0/680532599 shutdown_connections 2024-09-21T08:01:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.719+0000 7fd2eca4b740 1 -- 172.21.15.6:0/680532599 wait complete. 2024-09-21T08:01:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 -- start start 2024-09-21T08:01:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 Processor -- start 2024-09-21T08:01:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01ad7b0 con 0x557665615b60 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01aec20 con 0x55766560d980 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.720+0000 7fd2eca4b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01ade80 con 0x557665636840 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2eca4b740 10 client.0 _ll_register_callbacks cb 0x7fd2d0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2e4a74640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2e4a74640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:33686/0 (socket says 172.21.15.6:33686) 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2e4a74640 1 -- 172.21.15.6:0/901856816 learned_addr learned my addr 172.21.15.6:0/901856816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2dffff640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 -- 172.21.15.6:0/901856816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 msgr2=0x5576659f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 -- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 msgr2=0x5576659f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2df7fe640 1 -- 172.21.15.6:0/901856816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576659f3990 con 0x557665615b60 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.721+0000 7fd2e4a74640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2df7fe640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659f2f10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4010740 tx=0x7fd2d400a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b72ba9044b64e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4010d20 con 0x557665615b60 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fd2d4018440 con 0x557665615b60 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d8024070 con 0x557665615b60 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd2d4018640 con 0x557665615b60 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2eca4b740 10 client.15624 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557665a6bb50 con 0x557665615b60 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.722+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2d8024070 con 0x557665615b60 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd2d4030070 con 0x557665615b60 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 10 client.15624 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 10 client.15624 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 20 client.15624 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655ca570 0x557665a6e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 4 client.15624 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x557665955ae0 con 0x5576655ca570 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.723+0000 7fd2dffff640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655ca570 0x557665a6e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.724+0000 7fd2bf7fe640 10 client.15624 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:46.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:46.724+0000 7fd2dffff640 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655ca570 0x557665a6e160 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=523337b7f855b1f server_cookie=ebc6b533562d7f5f in_seq=0 out_seq=0 2024-09-21T08:01:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:46.945 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:46 smithi006 ceph-mon[30970]: pgmap v365: 129 pgs: 129 active+clean; 113 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 11 MiB/s wr, 93 op/s 2024-09-21T08:01:46.995 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:46 smithi145 ceph-mon[34049]: pgmap v365: 129 pgs: 129 active+clean; 113 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 11 MiB/s wr, 93 op/s 2024-09-21T08:01:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:46 smithi119 ceph-mon[33564]: pgmap v365: 129 pgs: 129 active+clean; 113 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 11 MiB/s wr, 93 op/s 2024-09-21T08:01:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.165+0000 7fd2bf7fe640 1 -- 172.21.15.6:0/901856816 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557665955ae0 con 0x5576655ca570 2024-09-21T08:01:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.165+0000 7fd2bf7fe640 10 client.15624 handle_command_reply: tid=0 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.165+0000 7fd2eca4b740 1 client.15624 shutdown 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 msgr2=0x5576659f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659f2f10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4010740 tx=0x7fd2d400a380 comp rx=0 tx=0).stop 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 shutdown_connections 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576655ca570 0x557665a6e160 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2bf7fe640 0 client.15624 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557665636840 0x5576659f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557665615b60 0x5576659f2f10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 --2- 172.21.15.6:0/901856816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55766560d980 0x5576659f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 >> 172.21.15.6:0/901856816 conn(0x55766562a990 msgr2=0x5576659de5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 shutdown_connections 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 1 -- 172.21.15.6:0/901856816 wait complete. 2024-09-21T08:01:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.166+0000 7fd2eca4b740 20 client.15624 trim_cache size 0 max 16384 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 2, 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "d120b9ce": { 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 2, 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:01:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 134.5, 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 msgr2=0x7fd2c80b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 0x7fd2c80b8bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8005fd0 tx=0x7fd2d8009ae0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 msgr2=0x7fd2e019a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002a930 tx=0x7fd2d0003c20 comp rx=0 tx=0).stop 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 shutdown_connections 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd2c80b66a0 0x7fd2c80b8bb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2e0109e10 0x7fd2e019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2e01094c0 0x7fd2e019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 --2- 172.21.15.6:0/2203434288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e0103b80 0x7fd2e019a380 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 >> 172.21.15.6:0/2203434288 conn(0x7fd2e00ff5d0 msgr2=0x7fd2e01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 shutdown_connections 2024-09-21T08:01:47.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.167+0000 7fd2e64d7640 1 -- 172.21.15.6:0/2203434288 wait complete. 2024-09-21T08:01:47.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- 172.21.15.6:0/2109779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 msgr2=0x7f3320103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 --2- 172.21.15.6:0/2109779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320103f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3310009900 tx=0x7f331002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- 172.21.15.6:0/2109779933 shutdown_connections 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 --2- 172.21.15.6:0/2109779933 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3320109e10 0x7f3320110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 --2- 172.21.15.6:0/2109779933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33201094c0 0x7f33201098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 --2- 172.21.15.6:0/2109779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320103f90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- 172.21.15.6:0/2109779933 >> 172.21.15.6:0/2109779933 conn(0x7f33200ff610 msgr2=0x7f3320101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- 172.21.15.6:0/2109779933 shutdown_connections 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- 172.21.15.6:0/2109779933 wait complete. 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 Processor -- start 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.292+0000 7f3325611640 1 -- start start 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33201094c0 0x7f3320075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 0x7f3320076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3320113980 con 0x7f3320103b80 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3320113800 con 0x7f3320109e10 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3325611640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3320113b00 con 0x7f33201094c0 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56018/0 (socket says 172.21.15.6:56018) 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 -- 172.21.15.6:0/1028703506 learned_addr learned my addr 172.21.15.6:0/1028703506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331f7fe640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 0x7f3320076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f3317fff640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33201094c0 0x7f3320075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 -- 172.21.15.6:0/1028703506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33201094c0 msgr2=0x7f3320075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33201094c0 0x7f3320075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 -- 172.21.15.6:0/1028703506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 msgr2=0x7f3320076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 0x7f3320076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331effd640 1 -- 172.21.15.6:0/1028703506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33201a8690 con 0x7f3320103b80 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.293+0000 7f331f7fe640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 0x7f3320076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f331effd640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3310009230 tx=0x7f33100319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331003f030 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33201a8920 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33100043d0 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310035070 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.294+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33201a8e00 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.295+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3320103f90 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.296+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f3310042030 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.297+0000 7f331cff9640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 0x7f330c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.297+0000 7f3317fff640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 0x7f330c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.297+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3310107cf0 con 0x7f3320103b80 2024-09-21T08:01:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.299+0000 7f3317fff640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 0x7f330c0b8b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3320109040 tx=0x7f3308005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:47.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.302+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33100d2360 con 0x7f3320103b80 2024-09-21T08:01:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.579+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f332010bc40 con 0x7f3320103b80 2024-09-21T08:01:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.580+0000 7f331cff9640 1 -- 172.21.15.6:0/1028703506 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f33100d72a0 con 0x7f3320103b80 2024-09-21T08:01:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:47.581 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 msgr2=0x7f330c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 0x7f330c0b8b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3320109040 tx=0x7f3308005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 msgr2=0x7f3320075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3310009230 tx=0x7f33100319a0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 shutdown_connections 2024-09-21T08:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f330c0b65f0 0x7f330c0b8b00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33201094c0 0x7f3320075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3320109e10 0x7f3320076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 --2- 172.21.15.6:0/1028703506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3320103b80 0x7f3320075710 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 >> 172.21.15.6:0/1028703506 conn(0x7f33200ff610 msgr2=0x7f3320101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 shutdown_connections 2024-09-21T08:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:47.582+0000 7f3325611640 1 -- 172.21.15.6:0/1028703506 wait complete. 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1028703506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:47.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:47 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1028703506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:48.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:48.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:48.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:47 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1028703506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:48.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:48.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:47 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:01:48.245 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd120b9ce', quiesce took 7.9 seconds. Will release after: 6.6 2024-09-21T08:01:48.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:01:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:49.433 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:49 smithi006 ceph-mon[30970]: pgmap v366: 129 pgs: 129 active+clean; 137 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 15 MiB/s wr, 88 op/s 2024-09-21T08:01:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:49 smithi145 ceph-mon[34049]: pgmap v366: 129 pgs: 129 active+clean; 137 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 15 MiB/s wr, 88 op/s 2024-09-21T08:01:49.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:49 smithi119 ceph-mon[33564]: pgmap v366: 129 pgs: 129 active+clean; 137 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 15 MiB/s wr, 88 op/s 2024-09-21T08:01:50.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2400288216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b4105340 msgr2=0x7ff9b410d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2400288216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b4105340 0x7ff9b410d890 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009900 tx=0x7ff99c02a410 comp rx=0 tx=0).stop 2024-09-21T08:01:50.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2400288216 shutdown_connections 2024-09-21T08:01:50.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2400288216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b410de50 0x7ff9b4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2400288216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b4105340 0x7ff9b410d890 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2400288216 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b41049f0 0x7ff9b4104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2400288216 >> 172.21.15.6:0/2400288216 conn(0x7ff9b4079750 msgr2=0x7ff9b4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.658+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2400288216 shutdown_connections 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.659+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2400288216 wait complete. 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 Processor -- start 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 -- start start 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b4105340 0x7ff9b419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b410de50 0x7ff9b419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4113920 con 0x7ff9b41049f0 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41137a0 con 0x7ff9b4105340 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b8cfb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4113aa0 con 0x7ff9b410de50 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56038/0 (socket says 172.21.15.6:56038) 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 -- 172.21.15.6:0/2696312367 learned_addr learned my addr 172.21.15.6:0/2696312367 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b410de50 0x7ff9b419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9abfff640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b4105340 0x7ff9b419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 -- 172.21.15.6:0/2696312367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b410de50 msgr2=0x7ff9b419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b410de50 0x7ff9b419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 -- 172.21.15.6:0/2696312367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b4105340 msgr2=0x7ff9b419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b4105340 0x7ff9b419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.660+0000 7ff9b259c640 1 -- 172.21.15.6:0/2696312367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41a0340 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400d950 tx=0x7ff9a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9ab7fe640 1 -- 172.21.15.6:0/2696312367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4017070 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9ab7fe640 1 -- 172.21.15.6:0/2696312367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9a4009c30 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41a0630 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9ab7fe640 1 -- 172.21.15.6:0/2696312367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400f620 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.661+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41a6d90 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.663+0000 7ff9bf26f740 1 Processor -- start 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 -- start start 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9ab7fe640 1 -- 172.21.15.6:0/2696312367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7ff9a4010460 con 0x7ff9b41049f0 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afa76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afa8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e23af1dea0 con 0x55e23abd71b0 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e23af0d2d0 con 0x55e23ac00070 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e23af110e0 con 0x55e23abdf390 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56040/0 (socket says 172.21.15.6:56040) 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9b259c640 1 -- 172.21.15.6:0/2169298736 learned_addr learned my addr 172.21.15.6:0/2169298736 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.664+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afa76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9abfff640 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afa8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 -- 172.21.15.6:0/2169298736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 msgr2=0x55e23afa8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afa8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 -- 172.21.15.6:0/2169298736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 msgr2=0x55e23afa76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afa76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 -- 172.21.15.6:0/2169298736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e23ac6b650 con 0x55e23abd71b0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40e4a40 tx=0x7ff9a40ef670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba025f83fb92f425 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9ab7fe640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 0x7ff9a00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 0x7ff9a00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9a8ff9640 1 -- 172.21.15.6:0/2169298736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40f6070 con 0x55e23abd71b0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9ab7fe640 1 -- 172.21.15.6:0/2696312367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff9a40e75f0 con 0x7ff9b41049f0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9a8ff9640 1 -- 172.21.15.6:0/2169298736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9a401c1c0 con 0x55e23abd71b0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.665+0000 7ff9a8ff9640 1 -- 172.21.15.6:0/2169298736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40a97d0 con 0x55e23abd71b0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2169298736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 msgr2=0x55e23afa7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 0x7ff9a00b8b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac008e40 tx=0x7ff9ac0085f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40e4a40 tx=0x7ff9a40ef670 comp rx=0 tx=0).stop 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2169298736 shutdown_connections 2024-09-21T08:01:50.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afa8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abd71b0 0x55e23afa7be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2169298736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afa76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2169298736 >> 172.21.15.6:0/2169298736 conn(0x55e23abf4460 msgr2=0x55e23afa5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2169298736 shutdown_connections 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.666+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2169298736 wait complete. 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 -- start start 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 Processor -- start 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afbf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e23ad6e700 con 0x55e23abdf390 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e23aea8160 con 0x55e23ac00070 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e23afb5e80 con 0x55e23abd71b0 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9bf26f740 10 client.0 _ll_register_callbacks cb 0x55e23aec19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56042/0 (socket says 172.21.15.6:56042) 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9abfff640 1 -- 172.21.15.6:0/2283464615 learned_addr learned my addr 172.21.15.6:0/2283464615 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.667+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afbf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 -- 172.21.15.6:0/2283464615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 msgr2=0x55e23afb2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 -- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 msgr2=0x55e23afbf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afbf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 -- 172.21.15.6:0/2283464615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e23aed5c90 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9abfff640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009230 tx=0x7ff99c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8f45c39e1de3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c03f070 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff99c004250 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a401c1c0 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff99c035070 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9bf26f740 10 client.15642 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e23afc1c40 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.668+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9a401c1c0 con 0x55e23abdf390 2024-09-21T08:01:50.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff99c0049a0 con 0x55e23abdf390 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 10 client.15642 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 20 client.15642 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23abbe9f0 0x55e23afc5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 4 client.15642 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e23af1fdf0 con 0x55e23abbe9f0 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23abbe9f0 0x55e23afc5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff999ffb640 10 client.15642 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.669+0000 7ff9b259c640 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23abbe9f0 0x55e23afc5110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a4ffe25aa3ec63 server_cookie=fb1845af80b0c6ed in_seq=0 out_seq=0 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff999ffb640 1 -- 172.21.15.6:0/2283464615 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e23af1fdf0 con 0x55e23abbe9f0 2024-09-21T08:01:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff999ffb640 10 client.15642 handle_command_reply: tid=0 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 client.15642 shutdown 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 msgr2=0x55e23afb3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009230 tx=0x7ff99c031630 comp rx=0 tx=0).stop 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 shutdown_connections 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23abbe9f0 0x55e23afc5110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23ac00070 0x55e23afbf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23abdf390 0x55e23afb3340 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff999ffb640 0 client.15642 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/2283464615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.670+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 >> 172.21.15.6:0/2283464615 conn(0x55e23abf4460 msgr2=0x55e23afaa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.671+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 shutdown_connections 2024-09-21T08:01:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.671+0000 7ff9bf26f740 1 -- 172.21.15.6:0/2283464615 wait complete. 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.671+0000 7ff9bf26f740 20 client.15642 trim_cache size 0 max 16384 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 Processor -- start 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 -- start start 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abd71b0 0x55e23afaaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afbf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41aee50 con 0x55e23ac00070 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41b16d0 con 0x55e23abd71b0 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.684+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41af4c0 con 0x55e23abdf390 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56048/0 (socket says 172.21.15.6:56048) 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3445423990 learned_addr learned my addr 172.21.15.6:0/3445423990 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9abfff640 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afbf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b259c640 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abd71b0 0x55e23afaaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3445423990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 msgr2=0x55e23afbf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afbf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3445423990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abd71b0 msgr2=0x55e23afaaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abd71b0 0x55e23afaaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3445423990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e23afb5540 con 0x55e23ac00070 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.685+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01e5e0 tx=0x7ff9ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4414956037dc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff99bfff640 1 -- 172.21.15.6:0/3445423990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02b070 con 0x55e23ac00070 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff99bfff640 1 -- 172.21.15.6:0/3445423990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9ac01ccd0 con 0x55e23ac00070 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff99bfff640 1 -- 172.21.15.6:0/3445423990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac026c50 con 0x55e23ac00070 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3445423990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 msgr2=0x55e23afa4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01e5e0 tx=0x7ff9ac014000 comp rx=0 tx=0).stop 2024-09-21T08:01:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3445423990 shutdown_connections 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abdf390 0x55e23afbf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23afa4eb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3445423990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abd71b0 0x55e23afaaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.686+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3445423990 >> 172.21.15.6:0/3445423990 conn(0x55e23abf4460 msgr2=0x55e23afaa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3445423990 shutdown_connections 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3445423990 wait complete. 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- start start 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 Processor -- start 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abdf390 0x55e23afb79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41afb90 con 0x55e23ac00070 2024-09-21T08:01:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41b1000 con 0x55e23abdf390 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41b0260 con 0x55e23abd71b0 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.687+0000 7ff9bf26f740 10 client.0 _ll_register_callbacks cb 0x7ff99c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56056/0 (socket says 172.21.15.6:56056) 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:33736/0 (socket says 172.21.15.6:33736) 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3856088167 learned_addr learned my addr 172.21.15.6:0/3856088167 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9abfff640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abdf390 0x55e23afb79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3856088167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 msgr2=0x55e23afb74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abdf390 msgr2=0x55e23afb79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abdf390 0x55e23afb79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 -- 172.21.15.6:0/3856088167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e23afb82c0 con 0x55e23ac00070 2024-09-21T08:01:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b259c640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff9b2d9d640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0086f0 tx=0x7ff9ac004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92217dc96141a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.688+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac035030 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff9ac01c640 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9ac01ccd0 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9ac03f050 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 10 client.15648 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e23b030070 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9ac01ccd0 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff9ac02e030 con 0x55e23ac00070 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 10 client.15648 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 20 client.15648 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23ab93da0 0x55e23b032720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 4 client.15648 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.689+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e23af1b8a0 con 0x55e23ab93da0 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff9b259c640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23ab93da0 0x55e23b032720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff9b259c640 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23ab93da0 0x55e23b032720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7592e7e9a92546d7 server_cookie=5886367944ad4d06 in_seq=0 out_seq=0 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff999ffb640 10 client.15648 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff999ffb640 1 -- 172.21.15.6:0/3856088167 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e23af1b8a0 con 0x55e23ab93da0 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff999ffb640 10 client.15648 handle_command_reply: tid=0 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.690+0000 7ff9bf26f740 1 client.15648 shutdown 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 msgr2=0x55e23b02eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0086f0 tx=0x7ff9ac004d60 comp rx=0 tx=0).stop 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 shutdown_connections 2024-09-21T08:01:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e23ab93da0 0x55e23b032720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e23ac00070 0x55e23b02eab0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff999ffb640 0 client.15648 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e23abdf390 0x55e23afb79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 --2- 172.21.15.6:0/3856088167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e23abd71b0 0x55e23afb74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 >> 172.21.15.6:0/3856088167 conn(0x55e23abf4460 msgr2=0x55e23afa4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 shutdown_connections 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 1 -- 172.21.15.6:0/3856088167 wait complete. 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.691+0000 7ff9bf26f740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T08:01:50.047 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 msgr2=0x7ff9a00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 0x7ff9a00b8b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac008e40 tx=0x7ff9ac0085f0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 msgr2=0x7ff9b419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400d950 tx=0x7ff9a400de10 comp rx=0 tx=0).stop 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 shutdown_connections 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff9a00b6670 0x7ff9a00b8b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9b410de50 0x7ff9b419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b4105340 0x7ff9b419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 --2- 172.21.15.6:0/2696312367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b41049f0 0x7ff9b419a3d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 >> 172.21.15.6:0/2696312367 conn(0x7ff9b4079750 msgr2=0x7ff9b4100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 shutdown_connections 2024-09-21T08:01:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:49.692+0000 7ff9b8cfb640 1 -- 172.21.15.6:0/2696312367 wait complete. 2024-09-21T08:01:51.369 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:01:51.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:01:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:51 smithi145 ceph-mon[34049]: pgmap v367: 129 pgs: 129 active+clean; 167 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 20 MiB/s wr, 85 op/s 2024-09-21T08:01:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:51 smithi006 ceph-mon[30970]: pgmap v367: 129 pgs: 129 active+clean; 167 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 20 MiB/s wr, 85 op/s 2024-09-21T08:01:51.645 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:51 smithi119 ceph-mon[33564]: pgmap v367: 129 pgs: 129 active+clean; 167 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 20 MiB/s wr, 85 op/s 2024-09-21T08:01:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 -- 172.21.15.6:0/1802489362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 msgr2=0x7f664010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 --2- 172.21.15.6:0/1802489362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664010fc70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6630009900 tx=0x7f663002a480 comp rx=0 tx=0).stop 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 -- 172.21.15.6:0/1802489362 shutdown_connections 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 --2- 172.21.15.6:0/1802489362 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66401101b0 0x7f66401125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 --2- 172.21.15.6:0/1802489362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664010fc70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 --2- 172.21.15.6:0/1802489362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6640102600 0x7f6640102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 -- 172.21.15.6:0/1802489362 >> 172.21.15.6:0/1802489362 conn(0x7f6640079750 msgr2=0x7f6640079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 -- 172.21.15.6:0/1802489362 shutdown_connections 2024-09-21T08:01:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.120+0000 7f6647bce640 1 -- 172.21.15.6:0/1802489362 wait complete. 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 Processor -- start 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 -- start start 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6640102600 0x7f664019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66401101b0 0x7f66401a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6640115b50 con 0x7f6640102f50 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f66401159d0 con 0x7f66401101b0 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6647bce640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6640115cd0 con 0x7f6640102600 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6645169640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6645169640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56070/0 (socket says 172.21.15.6:56070) 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f6645169640 1 -- 172.21.15.6:0/3325712095 learned_addr learned my addr 172.21.15.6:0/3325712095 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f664596a640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6640102600 0x7f664019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.121+0000 7f664616b640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66401101b0 0x7f66401a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 -- 172.21.15.6:0/3325712095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6640102600 msgr2=0x7f664019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6640102600 0x7f664019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 -- 172.21.15.6:0/3325712095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66401101b0 msgr2=0x7f66401a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66401101b0 0x7f66401a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 -- 172.21.15.6:0/3325712095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66401a25b0 con 0x7f6640102f50 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6645169640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6630009230 tx=0x7f6630004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6636ffd640 1 -- 172.21.15.6:0/3325712095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663003f030 con 0x7f6640102f50 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6636ffd640 1 -- 172.21.15.6:0/3325712095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6630003a80 con 0x7f6640102f50 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66401a2840 con 0x7f6640102f50 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6636ffd640 1 -- 172.21.15.6:0/3325712095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630035070 con 0x7f6640102f50 2024-09-21T08:01:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.122+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66401a9000 con 0x7f6640102f50 2024-09-21T08:01:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 Processor -- start 2024-09-21T08:01:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 -- start start 2024-09-21T08:01:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f6636ffd640 1 -- 172.21.15.6:0/3325712095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f6630042030 con 0x7f6640102f50 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb79b490 0x5555cbb6b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5555cbae1e60 con 0x5555cb7c4350 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5555cbad1290 con 0x5555cb79b490 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664e142740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5555cbad50a0 con 0x5555cb7a3670 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664616b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664616b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56074/0 (socket says 172.21.15.6:56074) 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.125+0000 7f664616b640 1 -- 172.21.15.6:0/1426972072 learned_addr learned my addr 172.21.15.6:0/1426972072 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664596a640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb79b490 0x5555cbb6b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f6645169640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 -- 172.21.15.6:0/1426972072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 msgr2=0x5555cbb6beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb6beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 -- 172.21.15.6:0/1426972072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb79b490 msgr2=0x5555cbb6b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb79b490 0x5555cbb6b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 -- 172.21.15.6:0/1426972072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cb82f930 con 0x5555cb7c4350 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f6645169640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb6beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664616b640 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6638009f90 tx=0x7f6638010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0824b31d22766c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f6636ffd640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 0x7f662c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f664596a640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 0x7f662c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f662bfff640 1 -- 172.21.15.6:0/1426972072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638011700 con 0x5555cb7c4350 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f662bfff640 1 -- 172.21.15.6:0/1426972072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6638011d30 con 0x5555cb7c4350 2024-09-21T08:01:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f662bfff640 1 -- 172.21.15.6:0/1426972072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638019cd0 con 0x5555cb7c4350 2024-09-21T08:01:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.126+0000 7f6636ffd640 1 -- 172.21.15.6:0/3325712095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6630108070 con 0x7f6640102f50 2024-09-21T08:01:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 -- 172.21.15.6:0/1426972072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 msgr2=0x5555cbb6b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6638009f90 tx=0x7f6638010860 comp rx=0 tx=0).stop 2024-09-21T08:01:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664596a640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 0x7f662c0b8b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5555cbb6a0b0 tx=0x7f663c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 -- 172.21.15.6:0/1426972072 shutdown_connections 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb6beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb79b490 0x5555cbb6b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 --2- 172.21.15.6:0/1426972072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb7c4350 0x5555cbb6b430 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.127+0000 7f664e142740 1 -- 172.21.15.6:0/1426972072 >> 172.21.15.6:0/1426972072 conn(0x5555cb7b8740 msgr2=0x5555cbb69320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.128+0000 7f664e142740 1 -- 172.21.15.6:0/1426972072 shutdown_connections 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.128+0000 7f664e142740 1 -- 172.21.15.6:0/1426972072 wait complete. 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.128+0000 7f664e142740 1 -- start start 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.128+0000 7f664e142740 1 Processor -- start 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb77620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb82f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5555cb932890 con 0x5555cb79b490 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5555cba6bd40 con 0x5555cb7c4350 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5555cbb79c10 con 0x5555cb7a3670 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56078/0 (socket says 172.21.15.6:56078) 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 -- 172.21.15.6:0/1488726343 learned_addr learned my addr 172.21.15.6:0/1488726343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664e142740 10 client.0 _ll_register_callbacks cb 0x5555cbacfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664616b640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb82f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f6645169640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb77620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 -- 172.21.15.6:0/1488726343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 msgr2=0x5555cbb77620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb77620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 -- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 msgr2=0x5555cbb82f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb82f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 -- 172.21.15.6:0/1488726343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cbb83570 con 0x5555cb79b490 2024-09-21T08:01:52.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f664596a640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f663c003cb0 tx=0x7f663c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe99294df889ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.129+0000 7f66297fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c02c060 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6638011d30 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f663c017030 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f663c033050 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 10 client.15660 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5555cbb85f50 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6638011d30 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f663c01c3f0 con 0x5555cb79b490 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 10 client.15660 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 20 client.15660 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb782cd0 0x5555cbb89430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 4 client.15660 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.130+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555cbae3db0 con 0x5555cb782cd0 2024-09-21T08:01:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.131+0000 7f6645169640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb782cd0 0x5555cbb89430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.131+0000 7f66297fa640 10 client.15660 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.131+0000 7f6645169640 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb782cd0 0x5555cbb89430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e85d32f0dcb5fa server_cookie=7b8b58f584cf1e6f in_seq=0 out_seq=0 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f66297fa640 1 -- 172.21.15.6:0/1488726343 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555cbae3db0 con 0x5555cb782cd0 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f66297fa640 10 client.15660 handle_command_reply: tid=0 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 client.15660 shutdown 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 msgr2=0x5555cbb77080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f663c003cb0 tx=0x7f663c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 shutdown_connections 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb782cd0 0x5555cbb89430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb77620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb82f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 --2- 172.21.15.6:0/1488726343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb77080 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f66297fa640 0 client.15660 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 >> 172.21.15.6:0/1488726343 conn(0x5555cb7b8740 msgr2=0x5555cbb6e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 shutdown_connections 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.132+0000 7f664e142740 1 -- 172.21.15.6:0/1488726343 wait complete. 2024-09-21T08:01:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.133+0000 7f664e142740 20 client.15660 trim_cache size 0 max 16384 2024-09-21T08:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 Processor -- start 2024-09-21T08:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 -- start start 2024-09-21T08:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb70510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb70a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b1010 con 0x5555cb79b490 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b3890 con 0x5555cb7c4350 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664e142740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b1680 con 0x5555cb7a3670 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.150+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56086/0 (socket says 172.21.15.6:56086) 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 -- 172.21.15.6:0/3187454231 learned_addr learned my addr 172.21.15.6:0/3187454231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 -- 172.21.15.6:0/3187454231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 msgr2=0x5555cbb70510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb70510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 -- 172.21.15.6:0/3187454231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 msgr2=0x5555cbb70a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664616b640 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb70a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb70a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 -- 172.21.15.6:0/3187454231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cbb75de0 con 0x5555cb79b490 2024-09-21T08:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664616b640 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb70a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f664596a640 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f663c018040 tx=0x7f663c01fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d610c98e7bb6b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f662b7fe640 1 -- 172.21.15.6:0/3187454231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c03c070 con 0x5555cb79b490 2024-09-21T08:01:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f662b7fe640 1 -- 172.21.15.6:0/3187454231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f663c00be80 con 0x5555cb79b490 2024-09-21T08:01:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.151+0000 7f662b7fe640 1 -- 172.21.15.6:0/3187454231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c004d30 con 0x5555cb79b490 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 -- 172.21.15.6:0/3187454231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 msgr2=0x5555cbb82e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f663c018040 tx=0x7f663c01fc90 comp rx=0 tx=0).stop 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 -- 172.21.15.6:0/3187454231 shutdown_connections 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7a3670 0x5555cbb70510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7c4350 0x5555cbb70a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 --2- 172.21.15.6:0/3187454231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb82e30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 -- 172.21.15.6:0/3187454231 >> 172.21.15.6:0/3187454231 conn(0x5555cb7b8740 msgr2=0x5555cbb72030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 -- 172.21.15.6:0/3187454231 shutdown_connections 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.152+0000 7f664e142740 1 -- 172.21.15.6:0/3187454231 wait complete. 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 -- start start 2024-09-21T08:01:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 Processor -- start 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7a3670 0x5555cbb79ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7c4350 0x5555cbb7a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b1d50 con 0x5555cb79b490 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b31c0 con 0x5555cb7a3670 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b2420 con 0x5555cb7c4350 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664e142740 10 client.0 _ll_register_callbacks cb 0x7f663c005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664596a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56088/0 (socket says 172.21.15.6:56088) 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664596a640 1 -- 172.21.15.6:0/1423878163 learned_addr learned my addr 172.21.15.6:0/1423878163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.153+0000 7f664616b640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7c4350 0x5555cbb7a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f6645169640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7a3670 0x5555cbb79ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 -- 172.21.15.6:0/1423878163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7c4350 msgr2=0x5555cbb7a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7c4350 0x5555cbb7a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 -- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7a3670 msgr2=0x5555cbb79ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7a3670 0x5555cbb79ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 -- 172.21.15.6:0/1423878163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cbbf3df0 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664596a640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f663c003cb0 tx=0x7f663c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52aa5aa111d9e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f66297fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c03c070 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f663c01c9b0 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555cbadf860 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f663c04a050 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664e142740 10 client.15666 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.154+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5555cbbf4fb0 con 0x5555cb79b490 2024-09-21T08:01:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5555cbadf860 con 0x5555cb79b490 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f663c041460 con 0x5555cb79b490 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 10 client.15666 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 20 client.15666 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb758080 0x5555cbbf76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 4 client.15666 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5555cbadcc90 con 0x5555cb758080 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f6645169640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb758080 0x5555cbbf76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f6645169640 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb758080 0x5555cbbf76b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e97b0f1d7901fe server_cookie=4f86d4fdfbf8e398 in_seq=0 out_seq=0 2024-09-21T08:01:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.155+0000 7f66297fa640 10 client.15666 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f66297fa640 1 -- 172.21.15.6:0/1423878163 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5555cbadcc90 con 0x5555cb758080 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f66297fa640 10 client.15666 handle_command_reply: tid=0 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 client.15666 shutdown 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 msgr2=0x5555cbb7f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f663c003cb0 tx=0x7f663c01c6a0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 shutdown_connections 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5555cb758080 0x5555cbbf76b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5555cb7c4350 0x5555cbb7a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555cb7a3670 0x5555cbb79ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 --2- 172.21.15.6:0/1423878163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555cb79b490 0x5555cbb7f8c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 >> 172.21.15.6:0/1423878163 conn(0x5555cb7b8740 msgr2=0x5555cbb72030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f66297fa640 0 client.15666 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 shutdown_connections 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 1 -- 172.21.15.6:0/1423878163 wait complete. 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.157+0000 7f664e142740 20 client.15666 trim_cache size 0 max 16384 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:52.162 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:01:52.163 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "1ae80109-8f73-4ee4-bf79-1193249d2bb0", 2024-09-21T08:01:52.163 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:01:52.163 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:52.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 msgr2=0x7f662c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 0x7f662c0b8b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5555cbb6a0b0 tx=0x7f663c00b390 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 msgr2=0x7f664019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6630009230 tx=0x7f6630004270 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 shutdown_connections 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f662c0b65f0 0x7f662c0b8b00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66401101b0 0x7f66401a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640102f50 0x7f664019cbe0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 --2- 172.21.15.6:0/3325712095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6640102600 0x7f664019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 >> 172.21.15.6:0/3325712095 conn(0x7f6640079750 msgr2=0x7f6640100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 shutdown_connections 2024-09-21T08:01:52.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:52.158+0000 7f6647bce640 1 -- 172.21.15.6:0/3325712095 wait complete. 2024-09-21T08:01:53.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:01:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:53 smithi145 ceph-mon[34049]: pgmap v368: 129 pgs: 129 active+clean; 183 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 21 MiB/s wr, 36 op/s 2024-09-21T08:01:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:53 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:01:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:53 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:53 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:01:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:53 smithi006 ceph-mon[30970]: pgmap v368: 129 pgs: 129 active+clean; 183 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 21 MiB/s wr, 36 op/s 2024-09-21T08:01:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:53 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:01:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:53 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:53 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:01:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:53 smithi119 ceph-mon[33564]: pgmap v368: 129 pgs: 129 active+clean; 183 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 21 MiB/s wr, 36 op/s 2024-09-21T08:01:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:53 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:01:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:53 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:53 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 -- 172.21.15.6:0/3130028629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0102a60 msgr2=0x7f01e0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 --2- 172.21.15.6:0/3130028629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0102a60 0x7f01e0102e70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009900 tx=0x7f01d002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 -- 172.21.15.6:0/3130028629 shutdown_connections 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 --2- 172.21.15.6:0/3130028629 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 0x7f01e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 --2- 172.21.15.6:0/3130028629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0108cf0 0x7f01e010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 --2- 172.21.15.6:0/3130028629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0102a60 0x7f01e0102e70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 -- 172.21.15.6:0/3130028629 >> 172.21.15.6:0/3130028629 conn(0x7f01e0079730 msgr2=0x7f01e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 -- 172.21.15.6:0/3130028629 shutdown_connections 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 -- 172.21.15.6:0/3130028629 wait complete. 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.728+0000 7f01e5d50640 1 Processor -- start 2024-09-21T08:01:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 -- start start 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0102a60 0x7f01e019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 0x7f01e019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112810 con 0x7f01e0108cf0 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112690 con 0x7f01e0102a60 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01e5d50640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112990 con 0x7f01e01083a0 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56114/0 (socket says 172.21.15.6:56114) 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 -- 172.21.15.6:0/2923032967 learned_addr learned my addr 172.21.15.6:0/2923032967 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01deffd640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 0x7f01e019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01df7fe640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0102a60 0x7f01e019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 -- 172.21.15.6:0/2923032967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 msgr2=0x7f01e019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 0x7f01e019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 -- 172.21.15.6:0/2923032967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0102a60 msgr2=0x7f01e019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0102a60 0x7f01e019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.729+0000 7f01dffff640 1 -- 172.21.15.6:0/2923032967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e01a0320 con 0x7f01e0108cf0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01dffff640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009fd0 tx=0x7f01d800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01dcff9640 1 -- 172.21.15.6:0/2923032967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01e0108cf0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e01a0610 con 0x7f01e0108cf0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01dcff9640 1 -- 172.21.15.6:0/2923032967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01d8003e00 con 0x7f01e0108cf0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01dcff9640 1 -- 172.21.15.6:0/2923032967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8010460 con 0x7f01e0108cf0 2024-09-21T08:01:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.730+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e01a6d70 con 0x7f01e0108cf0 2024-09-21T08:01:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01ec2c4740 1 Processor -- start 2024-09-21T08:01:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01dcff9640 1 -- 172.21.15.6:0/2923032967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f01d8003970 con 0x7f01e0108cf0 2024-09-21T08:01:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01ec2c4740 1 -- start start 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.733+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd242cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561dbd1b8e50 con 0x561dbce9b070 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561dbd1a8280 con 0x561dbce7a390 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561dbd1ac090 con 0x561dbce721b0 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56130/0 (socket says 172.21.15.6:56130) 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 -- 172.21.15.6:0/3943548817 learned_addr learned my addr 172.21.15.6:0/3943548817 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01df7fe640 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 -- 172.21.15.6:0/3943548817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 msgr2=0x561dbd2427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 -- 172.21.15.6:0/3943548817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 msgr2=0x561dbd242cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd242cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 -- 172.21.15.6:0/3943548817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dbcf06650 con 0x561dbce9b070 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01dcff9640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 0x7f01c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01deffd640 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f01d400b7c0 tx=0x7f01d400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735d55c11bde4b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01df7fe640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 0x7f01c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01dcff9640 1 -- 172.21.15.6:0/2923032967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f01d80e7a70 con 0x7f01e0108cf0 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.734+0000 7f01c5ffb640 1 -- 172.21.15.6:0/3943548817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4003dd0 con 0x561dbce9b070 2024-09-21T08:01:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01c5ffb640 1 -- 172.21.15.6:0/3943548817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01d4015070 con 0x561dbce9b070 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 -- 172.21.15.6:0/3943548817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 msgr2=0x561dbd242270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01df7fe640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 0x7f01c80b8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01d00057c0 tx=0x7f01d00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f01d400b7c0 tx=0x7f01d400bc80 comp rx=0 tx=0).stop 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 -- 172.21.15.6:0/3943548817 shutdown_connections 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd242cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/3943548817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd242270 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.735+0000 7f01ec2c4740 1 -- 172.21.15.6:0/3943548817 >> 172.21.15.6:0/3943548817 conn(0x561dbce8f460 msgr2=0x561dbd240160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.736+0000 7f01ec2c4740 1 -- 172.21.15.6:0/3943548817 shutdown_connections 2024-09-21T08:01:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.736+0000 7f01ec2c4740 1 -- 172.21.15.6:0/3943548817 wait complete. 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.736+0000 7f01ec2c4740 1 -- start start 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.736+0000 7f01ec2c4740 1 Processor -- start 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd24d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561dbd009700 con 0x561dbce9b070 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561dbd143110 con 0x561dbce721b0 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561dbd250aa0 con 0x561dbce7a390 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01ec2c4740 10 client.0 _ll_register_callbacks cb 0x561dbd15c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56146/0 (socket says 172.21.15.6:56146) 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01dffff640 1 -- 172.21.15.6:0/4042965717 learned_addr learned my addr 172.21.15.6:0/4042965717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01df7fe640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd24d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 -- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 msgr2=0x561dbd24d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd24d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 -- 172.21.15.6:0/4042965717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 msgr2=0x561dbd24e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 -- 172.21.15.6:0/4042965717 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dbd170c40 con 0x561dbce7a390 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01dffff640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01deffd640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24dd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d400b790 tx=0x7f01d400bfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d19b10a8f307db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.737+0000 7f01beffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4028060 con 0x561dbce7a390 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d4015070 con 0x561dbce7a390 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f01d4004820 con 0x561dbce7a390 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01d402f050 con 0x561dbce7a390 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 10 client.25456 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561dbd25c750 con 0x561dbce7a390 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01d4015070 con 0x561dbce7a390 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01d40119e0 con 0x561dbce7a390 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 10 client.25456 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 20 client.25456 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce599f0 0x561dbd25fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 4 client.25456 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.738+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dbd1bada0 con 0x561dbce599f0 2024-09-21T08:01:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.739+0000 7f01df7fe640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce599f0 0x561dbd25fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.739+0000 7f01df7fe640 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce599f0 0x561dbd25fbc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4937ad6ea80f1b0 server_cookie=3f7dcae73931e1d8 in_seq=0 out_seq=0 2024-09-21T08:01:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.739+0000 7f01beffd640 10 client.25456 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01beffd640 1 -- 172.21.15.6:0/4042965717 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561dbd1bada0 con 0x561dbce599f0 2024-09-21T08:01:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01beffd640 10 client.25456 handle_command_reply: tid=0 2024-09-21T08:01:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 client.25456 shutdown 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 msgr2=0x561dbd24dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24dd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d400b790 tx=0x7f01d400bfc0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 shutdown_connections 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce599f0 0x561dbd25fbc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24dd90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/4042965717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd24d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01beffd640 0 client.25456 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 >> 172.21.15.6:0/4042965717 conn(0x561dbce8f460 msgr2=0x561dbd245450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 shutdown_connections 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 1 -- 172.21.15.6:0/4042965717 wait complete. 2024-09-21T08:01:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.740+0000 7f01ec2c4740 20 client.25456 trim_cache size 0 max 16384 2024-09-21T08:01:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 Processor -- start 2024-09-21T08:01:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 -- start start 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd243c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01aed10 con 0x561dbce9b070 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b1590 con 0x561dbce721b0 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01af380 con 0x561dbce7a390 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56156/0 (socket says 172.21.15.6:56156) 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.758+0000 7f01dffff640 1 -- 172.21.15.6:0/2469594731 learned_addr learned my addr 172.21.15.6:0/2469594731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01df7fe640 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd243c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01deffd640 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 -- 172.21.15.6:0/2469594731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 msgr2=0x561dbd24f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 -- 172.21.15.6:0/2469594731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 msgr2=0x561dbd243c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd243c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 -- 172.21.15.6:0/2469594731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dbd250930 con 0x561dbce9b070 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01dffff640 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01d80aa920 tx=0x7f01d80ace20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801e8c64aaae519 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01c57fa640 1 -- 172.21.15.6:0/2469594731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8020040 con 0x561dbce9b070 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01c57fa640 1 -- 172.21.15.6:0/2469594731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01d80b20e0 con 0x561dbce9b070 2024-09-21T08:01:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.759+0000 7f01c57fa640 1 -- 172.21.15.6:0/2469594731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a9000 con 0x561dbce9b070 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- 172.21.15.6:0/2469594731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 msgr2=0x561dbd24aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f01d80aa920 tx=0x7f01d80ace20 comp rx=0 tx=0).stop 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- 172.21.15.6:0/2469594731 shutdown_connections 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce7a390 0x561dbd24f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd24aa40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/2469594731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce721b0 0x561dbd243c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- 172.21.15.6:0/2469594731 >> 172.21.15.6:0/2469594731 conn(0x561dbce8f460 msgr2=0x561dbd24ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- 172.21.15.6:0/2469594731 shutdown_connections 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- 172.21.15.6:0/2469594731 wait complete. 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.760+0000 7f01ec2c4740 1 -- start start 2024-09-21T08:01:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 Processor -- start 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd2c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01afa50 con 0x561dbce9b070 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b0ec0 con 0x561dbce7a390 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b0120 con 0x561dbce721b0 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01ec2c4740 10 client.0 _ll_register_callbacks cb 0x7f01d400b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56162/0 (socket says 172.21.15.6:56162) 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01dffff640 1 -- 172.21.15.6:0/255924563 learned_addr learned my addr 172.21.15.6:0/255924563 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01df7fe640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.761+0000 7f01deffd640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd2c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 -- 172.21.15.6:0/255924563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 msgr2=0x561dbd2c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 -- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 msgr2=0x561dbd2c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd2c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 -- 172.21.15.6:0/255924563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dbd262260 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01dffff640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f01d800dfd0 tx=0x7f01d80acf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5c26cf5a81d269 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01beffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8020070 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f01d80b6240 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d80b20e0 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01d80a9000 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01ec2c4740 10 client.15684 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.762+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561dbd2634f0 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01d80b20e0 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01d80b3290 con 0x561dbce9b070 2024-09-21T08:01:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 10 client.15684 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 20 client.15684 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce2eda0 0x561dbd2d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 4 client.15684 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561dbd1b6850 con 0x561dbce2eda0 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.763+0000 7f01df7fe640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce2eda0 0x561dbd2d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01df7fe640 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce2eda0 0x561dbd2d4f70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98af900df97c8bb server_cookie=64413a87dbcff0bf in_seq=0 out_seq=0 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01beffd640 10 client.15684 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01beffd640 1 -- 172.21.15.6:0/255924563 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x561dbd1b6850 con 0x561dbce2eda0 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01beffd640 10 client.15684 handle_command_reply: tid=0 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 client.15684 shutdown 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 msgr2=0x561dbd261bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f01d800dfd0 tx=0x7f01d80acf50 comp rx=0 tx=0).stop 2024-09-21T08:01:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 shutdown_connections 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561dbce2eda0 0x561dbd2d4f70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561dbce9b070 0x561dbd261bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561dbce7a390 0x561dbd2c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 --2- 172.21.15.6:0/255924563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561dbce721b0 0x561dbd2c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 >> 172.21.15.6:0/255924563 conn(0x561dbce8f460 msgr2=0x561dbd259500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01beffd640 0 client.15684 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 shutdown_connections 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 1 -- 172.21.15.6:0/255924563 wait complete. 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.764+0000 7f01ec2c4740 20 client.15684 trim_cache size 0 max 16384 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:53.770 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "1ae80109-8f73-4ee4-bf79-1193249d2bb0", 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 msgr2=0x7f01c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 0x7f01c80b8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01d00057c0 tx=0x7f01d00058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 msgr2=0x7f01e019fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009fd0 tx=0x7f01d800b260 comp rx=0 tx=0).stop 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 shutdown_connections 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01c80b65f0 0x7f01c80b8b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01e01083a0 0x7f01e019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e0108cf0 0x7f01e019fbf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 --2- 172.21.15.6:0/2923032967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e0102a60 0x7f01e019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 >> 172.21.15.6:0/2923032967 conn(0x7f01e0079730 msgr2=0x7f01e0101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 shutdown_connections 2024-09-21T08:01:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:53.765+0000 7f01e5d50640 1 -- 172.21.15.6:0/2923032967 wait complete. 2024-09-21T08:01:54.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:54 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:54.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:54 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:54.654 INFO:tasks.cephfs.filesystem:scrub status for tag:1ae80109-8f73-4ee4-bf79-1193249d2bb0 - {'path': '/', 'tag': '1ae80109-8f73-4ee4-bf79-1193249d2bb0', 'options': 'recursive,force'} 2024-09-21T08:01:54.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:54 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:54.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:55.116 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:55 smithi145 ceph-mon[34049]: pgmap v369: 129 pgs: 129 active+clean; 184 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 35 op/s 2024-09-21T08:01:55.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:55 smithi006 ceph-mon[30970]: pgmap v369: 129 pgs: 129 active+clean; 184 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 35 op/s 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 -- 172.21.15.6:0/1489077823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0102a60 msgr2=0x7fb2c0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/1489077823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0102a60 0x7fb2c0102e70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009900 tx=0x7fb2b002a410 comp rx=0 tx=0).stop 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 -- 172.21.15.6:0/1489077823 shutdown_connections 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/1489077823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 0x7fb2c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/1489077823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0108cf0 0x7fb2c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/1489077823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0102a60 0x7fb2c0102e70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 -- 172.21.15.6:0/1489077823 >> 172.21.15.6:0/1489077823 conn(0x7fb2c0079730 msgr2=0x7fb2c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 -- 172.21.15.6:0/1489077823 shutdown_connections 2024-09-21T08:01:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.546+0000 7fb2c65b1640 1 -- 172.21.15.6:0/1489077823 wait complete. 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 Processor -- start 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 -- start start 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0102a60 0x7fb2c010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 0x7fb2c01104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0113930 con 0x7fb2c0108cf0 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01137b0 con 0x7fb2c0102a60 2024-09-21T08:01:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.547+0000 7fb2c65b1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0113ab0 con 0x7fb2c01083a0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56178/0 (socket says 172.21.15.6:56178) 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 -- 172.21.15.6:0/3528142016 learned_addr learned my addr 172.21.15.6:0/3528142016 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2bf7fe640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 0x7fb2c01104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2bffff640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0102a60 0x7fb2c010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 -- 172.21.15.6:0/3528142016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 msgr2=0x7fb2c01104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 0x7fb2c01104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 -- 172.21.15.6:0/3528142016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0102a60 msgr2=0x7fb2c010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0102a60 0x7fb2c010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 -- 172.21.15.6:0/3528142016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c01a86a0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2c4b4e640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800cad0 tx=0x7fb2b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.548+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800ae20 con 0x7fb2c0108cf0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.549+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2b8005020 con 0x7fb2c0108cf0 2024-09-21T08:01:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.549+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c01a8990 con 0x7fb2c0108cf0 2024-09-21T08:01:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.549+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800f6b0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.549+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c01a8ed0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.550+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c0102e70 con 0x7fb2c0108cf0 2024-09-21T08:01:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.552+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7fb2b80051d0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.553+0000 7fb2bd7fa640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 0x7fb2a80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.553+0000 7fb2bffff640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 0x7fb2a80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.553+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb2b80e7de0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.554+0000 7fb2bffff640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 0x7fb2a80b8b80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0111a00 tx=0x7fb2b00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.556+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2b8014030 con 0x7fb2c0108cf0 2024-09-21T08:01:55.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:55 smithi119 ceph-mon[33564]: pgmap v369: 129 pgs: 129 active+clean; 184 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 35 op/s 2024-09-21T08:01:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.782+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2c01112b0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.783+0000 7fb2bd7fa640 1 -- 172.21.15.6:0/3528142016 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fb2c01112b0 con 0x7fb2c0108cf0 2024-09-21T08:01:55.785 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:01:55.785 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:01:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.785+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 msgr2=0x7fb2a80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.785+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 0x7fb2a80b8b80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0111a00 tx=0x7fb2b00058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.785+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 msgr2=0x7fb2c0110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.785+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800cad0 tx=0x7fb2b800cf90 comp rx=0 tx=0).stop 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 shutdown_connections 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb2a80b6670 0x7fb2a80b8b80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2c01083a0 0x7fb2c01104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0108cf0 0x7fb2c0110a30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 --2- 172.21.15.6:0/3528142016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c0102a60 0x7fb2c010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 >> 172.21.15.6:0/3528142016 conn(0x7fb2c0079730 msgr2=0x7fb2c0101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 shutdown_connections 2024-09-21T08:01:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:55.786+0000 7fb2c65b1640 1 -- 172.21.15.6:0/3528142016 wait complete. 2024-09-21T08:01:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:56 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3528142016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:56.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:56 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3528142016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:56.558 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id d120b9ce --release --await' 2024-09-21T08:01:56.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id d120b9ce --release --await 2024-09-21T08:01:56.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:56 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3528142016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:01:57.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:57 smithi006 ceph-mon[30970]: pgmap v370: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T08:01:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 -- 172.21.15.6:0/546891039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 msgr2=0x7f46841087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 --2- 172.21.15.6:0/546891039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f46841087d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4674009900 tx=0x7f467402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 -- 172.21.15.6:0/546891039 shutdown_connections 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 --2- 172.21.15.6:0/546891039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 0x7f468410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 --2- 172.21.15.6:0/546891039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f46841087d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 --2- 172.21.15.6:0/546891039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 0x7f4684102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 -- 172.21.15.6:0/546891039 >> 172.21.15.6:0/546891039 conn(0x7f4684079740 msgr2=0x7f4684079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 -- 172.21.15.6:0/546891039 shutdown_connections 2024-09-21T08:01:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.331+0000 7f468ba17640 1 -- 172.21.15.6:0/546891039 wait complete. 2024-09-21T08:01:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 Processor -- start 2024-09-21T08:01:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 -- start start 2024-09-21T08:01:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 0x7f468419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 0x7f468419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4684112830 con 0x7f46841083c0 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46841126b0 con 0x7f4684108d10 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f468ba17640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f46841129b0 con 0x7f4684102a80 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f4688fb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f4688fb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54808/0 (socket says 172.21.15.6:54808) 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f4688fb2640 1 -- 172.21.15.6:0/3620289187 learned_addr learned my addr 172.21.15.6:0/3620289187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f46897b3640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 0x7f468419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.332+0000 7f4689fb4640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 0x7f468419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 -- 172.21.15.6:0/3620289187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 msgr2=0x7f468419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 0x7f468419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 -- 172.21.15.6:0/3620289187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 msgr2=0x7f468419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 0x7f468419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 -- 172.21.15.6:0/3620289187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46841a0360 con 0x7f46841083c0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f4688fb2640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4674005940 tx=0x7f46740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f467a7fc640 1 -- 172.21.15.6:0/3620289187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467403f030 con 0x7f46841083c0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f467a7fc640 1 -- 172.21.15.6:0/3620289187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4674003c90 con 0x7f46841083c0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46841a05f0 con 0x7f46841083c0 2024-09-21T08:01:57.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f467a7fc640 1 -- 172.21.15.6:0/3620289187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674035070 con 0x7f46841083c0 2024-09-21T08:01:57.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.333+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46841a6db0 con 0x7f46841083c0 2024-09-21T08:01:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 Processor -- start 2024-09-21T08:01:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 -- start start 2024-09-21T08:01:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f467a7fc640 1 -- 172.21.15.6:0/3620289187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f4674042030 con 0x7f46841083c0 2024-09-21T08:01:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f252660 0x55587f621a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 0x55587f621f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55587f50cdc0 con 0x55587f25a840 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55587f5991f0 con 0x55587f27b520 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.336+0000 7f4691f8b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55587f588620 con 0x55587f252660 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4688fb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 0x55587f621f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4688fb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 0x55587f621f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54810/0 (socket says 172.21.15.6:54810) 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46608/0 (socket says 172.21.15.6:46608) 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4688fb2640 1 -- 172.21.15.6:0/2387484003 learned_addr learned my addr 172.21.15.6:0/2387484003 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f46897b3640 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f252660 0x55587f621a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 -- 172.21.15.6:0/2387484003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f252660 msgr2=0x55587f621a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f252660 0x55587f621a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 -- 172.21.15.6:0/2387484003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 msgr2=0x55587f621f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 0x55587f621f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 -- 172.21.15.6:0/2387484003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587f550fd0 con 0x55587f27b520 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f4689fb4640 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f467c00add0 tx=0x7f467c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf945d24ec90411c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f467a7fc640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 0x7f46700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f46897b3640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 0x7f46700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.337+0000 7f466f7fe640 1 -- 172.21.15.6:0/2387484003 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c003b70 con 0x55587f27b520 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.338+0000 7f467a7fc640 1 -- 172.21.15.6:0/3620289187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4674107e20 con 0x7f46841083c0 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.338+0000 7f466f7fe640 1 -- 172.21.15.6:0/2387484003 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f467c003d10 con 0x55587f27b520 2024-09-21T08:01:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.338+0000 7f466f7fe640 1 -- 172.21.15.6:0/2387484003 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c010aa0 con 0x55587f27b520 2024-09-21T08:01:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- 172.21.15.6:0/2387484003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 msgr2=0x55587f621510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f46897b3640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 0x7f46700b8b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55587f620190 tx=0x7f468000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f467c00add0 tx=0x7f467c00f790 comp rx=0 tx=0).stop 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- 172.21.15.6:0/2387484003 shutdown_connections 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f252660 0x55587f621a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f25a840 0x55587f621f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2387484003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f27b520 0x55587f621510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- 172.21.15.6:0/2387484003 >> 172.21.15.6:0/2387484003 conn(0x55587f26f910 msgr2=0x55587f61f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- 172.21.15.6:0/2387484003 shutdown_connections 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- 172.21.15.6:0/2387484003 wait complete. 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 -- start start 2024-09-21T08:01:57.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.339+0000 7f4691f8b740 1 Processor -- start 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f6314e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f63d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55587f523300 con 0x55587f27b520 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55587f58c430 con 0x55587f252660 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55587f3e9bb0 con 0x55587f25a840 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4691f8b740 10 client.0 _ll_register_callbacks cb 0x55587f53d120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f63d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46624/0 (socket says 172.21.15.6:46624) 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f63d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54814/0 (socket says 172.21.15.6:54814) 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 -- 172.21.15.6:0/2266640459 learned_addr learned my addr 172.21.15.6:0/2266640459 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f4688fb2640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f6314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 -- 172.21.15.6:0/2266640459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 msgr2=0x55587f6314e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f6314e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 -- 172.21.15.6:0/2266640459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 msgr2=0x55587f63d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f63d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 -- 172.21.15.6:0/2266640459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587f512780 con 0x55587f252660 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f46897b3640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4680003cb0 tx=0x7f4680004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24993ca8fe80bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.340+0000 7f466cff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:01:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468002c060 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f467c003d10 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4680017030 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4680033050 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 10 client.25409 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55587f2e6b00 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f467c003d10 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4680011440 con 0x55587f252660 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 10 client.25409 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 10 client.25409 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 20 client.25409 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.341+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f239ea0 0x55587f643430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.342+0000 7f4691f8b740 4 client.25409 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.342+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55587f59b140 con 0x55587f239ea0 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.342+0000 7f4688fb2640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f239ea0 0x55587f643430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.342+0000 7f4688fb2640 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f239ea0 0x55587f643430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=344b440ea195d0a1 server_cookie=33061f83e1e65fcb in_seq=0 out_seq=0 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.342+0000 7f466cff9640 10 client.25409 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f466cff9640 1 -- 172.21.15.6:0/2266640459 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55587f59b140 con 0x55587f239ea0 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f466cff9640 10 client.25409 handle_command_reply: tid=0 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 client.25409 shutdown 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 msgr2=0x55587f630fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4680003cb0 tx=0x7f4680004730 comp rx=0 tx=0).stop 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 shutdown_connections 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f239ea0 0x55587f643430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f6314e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f63d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f466cff9640 0 client.25409 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2266640459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f630fa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 >> 172.21.15.6:0/2266640459 conn(0x55587f26f910 msgr2=0x55587f622f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 shutdown_connections 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 1 -- 172.21.15.6:0/2266640459 wait complete. 2024-09-21T08:01:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.343+0000 7f4691f8b740 20 client.25409 trim_cache size 0 max 16384 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.360+0000 7f4691f8b740 1 Processor -- start 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 -- start start 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 0x55587f648a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f27b520 0x55587f648fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46841acb80 con 0x55587f252660 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46841af400 con 0x55587f25a840 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4691f8b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f46841ad1f0 con 0x55587f27b520 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54826/0 (socket says 172.21.15.6:54826) 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 -- 172.21.15.6:0/2088193564 learned_addr learned my addr 172.21.15.6:0/2088193564 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4688fb2640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 0x55587f648a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4689fb4640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f27b520 0x55587f648fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 -- 172.21.15.6:0/2088193564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f27b520 msgr2=0x55587f648fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f27b520 0x55587f648fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 -- 172.21.15.6:0/2088193564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 msgr2=0x55587f648a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 0x55587f648a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f46897b3640 1 -- 172.21.15.6:0/2088193564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587f35d960 con 0x55587f252660 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.361+0000 7f4688fb2640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 0x55587f648a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.362+0000 7f46897b3640 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4680011fe0 tx=0x7f4680005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beb0a3d183035a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.362+0000 7f466effd640 1 -- 172.21.15.6:0/2088193564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680011440 con 0x55587f252660 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.362+0000 7f466effd640 1 -- 172.21.15.6:0/2088193564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46800115e0 con 0x55587f252660 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.362+0000 7f466effd640 1 -- 172.21.15.6:0/2088193564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800052a0 con 0x55587f252660 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 -- 172.21.15.6:0/2088193564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 msgr2=0x55587f62c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4680011fe0 tx=0x7f4680005f30 comp rx=0 tx=0).stop 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 -- 172.21.15.6:0/2088193564 shutdown_connections 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f27b520 0x55587f648fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f25a840 0x55587f648a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 --2- 172.21.15.6:0/2088193564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f252660 0x55587f62c360 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 -- 172.21.15.6:0/2088193564 >> 172.21.15.6:0/2088193564 conn(0x55587f26f910 msgr2=0x55587f62bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 -- 172.21.15.6:0/2088193564 shutdown_connections 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.363+0000 7f4691f8b740 1 -- 172.21.15.6:0/2088193564 wait complete. 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.364+0000 7f4691f8b740 1 -- start start 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.364+0000 7f4691f8b740 1 Processor -- start 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f6377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f637cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46841ad8c0 con 0x55587f27b520 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46841aed30 con 0x55587f252660 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f46841adf90 con 0x55587f25a840 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4691f8b740 10 client.0 _ll_register_callbacks cb 0x7f4680003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54836/0 (socket says 172.21.15.6:54836) 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 -- 172.21.15.6:0/3001612854 learned_addr learned my addr 172.21.15.6:0/3001612854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4688fb2640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f637cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f46897b3640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f6377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 -- 172.21.15.6:0/3001612854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 msgr2=0x55587f637cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f637cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.365+0000 7f4689fb4640 1 -- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 msgr2=0x55587f6377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f4689fb4640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f6377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f4689fb4640 1 -- 172.21.15.6:0/3001612854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587f62b970 con 0x55587f27b520 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f46897b3640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f6377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f4689fb4640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f467c00add0 tx=0x7f467c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cf26de4cc8971c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f466cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c028070 con 0x55587f27b520 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46800115e0 con 0x55587f27b520 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.366+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f467c010950 con 0x55587f27b520 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f467c034050 con 0x55587f27b520 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 10 client.15708 fetch_fsmap learned FSMap version 21 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55587f6b3480 con 0x55587f27b520 2024-09-21T08:01:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46800115e0 con 0x55587f27b520 2024-09-21T08:01:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f467c024c90 con 0x55587f27b520 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 10 client.15708 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 10 client.15708 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 20 client.15708 populate_metadata read hostname 'smithi006' 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f20f250 0x55587f6b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 4 client.15708 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d120b9ce", "release": true, "await": true}] 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d120b9ce", "release": true, "await": true}) -- 0x55587f596bf0 con 0x55587f20f250 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.367+0000 7f46897b3640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f20f250 0x55587f6b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.368+0000 7f466cff9640 10 client.15708 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.368+0000 7f46897b3640 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f20f250 0x55587f6b5920 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2680c94e083dc557 server_cookie=abfee303a5db2720 in_seq=0 out_seq=0 2024-09-21T08:01:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:57 smithi145 ceph-mon[34049]: pgmap v370: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T08:01:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.646+0000 7f466cff9640 1 -- 172.21.15.6:0/3001612854 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55587f596bf0 con 0x55587f20f250 2024-09-21T08:01:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.646+0000 7f466cff9640 10 client.15708 handle_command_reply: tid=0 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.646+0000 7f4691f8b740 1 client.15708 shutdown 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 msgr2=0x55587f638230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f467c00add0 tx=0x7f467c004a00 comp rx=0 tx=0).stop 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 shutdown_connections 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55587f20f250 0x55587f6b5920 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55587f25a840 0x55587f637cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55587f27b520 0x55587f638230 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 --2- 172.21.15.6:0/3001612854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587f252660 0x55587f6377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f466cff9640 0 client.15708 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 >> 172.21.15.6:0/3001612854 conn(0x55587f26f910 msgr2=0x55587f622540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 shutdown_connections 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 1 -- 172.21.15.6:0/3001612854 wait complete. 2024-09-21T08:01:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.647+0000 7f4691f8b740 20 client.15708 trim_cache size 0 max 16384 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 4, 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "d120b9ce": { 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 4, 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:01:57.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 134.5, 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:57.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:57.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:01:57.652 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:01:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 msgr2=0x7f46700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 0x7f46700b8b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55587f620190 tx=0x7f468000b390 comp rx=0 tx=0).stop 2024-09-21T08:01:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 msgr2=0x7f468419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4674005940 tx=0x7f46740042f0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 shutdown_connections 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f46700b65f0 0x7f46700b8b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4684108d10 0x7f468419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46841083c0 0x7f468419a990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 --2- 172.21.15.6:0/3620289187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4684102a80 0x7f468419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 >> 172.21.15.6:0/3620289187 conn(0x7f4684079740 msgr2=0x7f468406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 shutdown_connections 2024-09-21T08:01:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:01:57.648+0000 7f468ba17640 1 -- 172.21.15.6:0/3620289187 wait complete. 2024-09-21T08:01:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:57 smithi119 ceph-mon[33564]: pgmap v370: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T08:01:58.485 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd120b9ce', total seconds elapsed: 18.1 2024-09-21T08:01:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:700000 of 3200000 tuples (21%) done (elapsed 18.67 s, remaining 66.67 s) 2024-09-21T08:01:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:01:59 smithi145 ceph-mon[34049]: pgmap v371: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 10 op/s 2024-09-21T08:01:59.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:01:59 smithi006 ceph-mon[30970]: pgmap v371: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 10 op/s 2024-09-21T08:01:59.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:01:59 smithi119 ceph-mon[33564]: pgmap v371: 129 pgs: 129 active+clean; 188 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 10 op/s 2024-09-21T08:01:59.951 INFO:teuthology.orchestra.run.smithi006.stderr:800000 of 3200000 tuples (25%) done (elapsed 19.85 s, remaining 59.55 s) 2024-09-21T08:02:00.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:02:00.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:02:00.226+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:02:00.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:02:00.226+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:02:00.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:02:00.226+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:02:00.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:02:00.226+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:02:00.461 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:02:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:02:00.226+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:02:00.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:00 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:02:00.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:00 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:02:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:900000 of 3200000 tuples (28%) done (elapsed 20.76 s, remaining 53.06 s) 2024-09-21T08:02:01.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:01 smithi006 ceph-mon[30970]: pgmap v372: 129 pgs: 129 active+clean; 188 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 8 op/s 2024-09-21T08:02:01.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:01 smithi119 ceph-mon[33564]: pgmap v372: 129 pgs: 129 active+clean; 188 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 8 op/s 2024-09-21T08:02:01.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:01 smithi145 ceph-mon[34049]: pgmap v372: 129 pgs: 129 active+clean; 188 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 8 op/s 2024-09-21T08:02:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:1000000 of 3200000 tuples (31%) done (elapsed 21.97 s, remaining 48.34 s) 2024-09-21T08:02:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:1100000 of 3200000 tuples (34%) done (elapsed 23.19 s, remaining 44.28 s) 2024-09-21T08:02:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:03 smithi006 ceph-mon[30970]: pgmap v373: 129 pgs: 129 active+clean; 220 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 9 op/s 2024-09-21T08:02:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:03 smithi006 ceph-mon[30970]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T08:02:03.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:03 smithi119 ceph-mon[33564]: pgmap v373: 129 pgs: 129 active+clean; 220 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 9 op/s 2024-09-21T08:02:03.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:03 smithi119 ceph-mon[33564]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T08:02:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:03 smithi145 ceph-mon[34049]: pgmap v373: 129 pgs: 129 active+clean; 220 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 9 op/s 2024-09-21T08:02:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:03 smithi145 ceph-mon[34049]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T08:02:04.142 INFO:teuthology.orchestra.run.smithi006.stderr:1200000 of 3200000 tuples (37%) done (elapsed 24.04 s, remaining 40.07 s) 2024-09-21T08:02:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:1300000 of 3200000 tuples (40%) done (elapsed 25.25 s, remaining 36.90 s) 2024-09-21T08:02:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:05 smithi006 ceph-mon[30970]: pgmap v374: 129 pgs: 129 active+clean; 282 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T08:02:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:05 smithi119 ceph-mon[33564]: pgmap v374: 129 pgs: 129 active+clean; 282 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T08:02:05.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:05 smithi145 ceph-mon[34049]: pgmap v374: 129 pgs: 129 active+clean; 282 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T08:02:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:1400000 of 3200000 tuples (43%) done (elapsed 26.48 s, remaining 34.05 s) 2024-09-21T08:02:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:1500000 of 3200000 tuples (46%) done (elapsed 27.32 s, remaining 30.97 s) 2024-09-21T08:02:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:07 smithi119 ceph-mon[33564]: pgmap v375: 129 pgs: 129 active+clean; 306 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 27 op/s 2024-09-21T08:02:07.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:07 smithi145 ceph-mon[34049]: pgmap v375: 129 pgs: 129 active+clean; 306 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 27 op/s 2024-09-21T08:02:07.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:07 smithi006 ceph-mon[30970]: pgmap v375: 129 pgs: 129 active+clean; 306 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 27 op/s 2024-09-21T08:02:08.687 INFO:teuthology.orchestra.run.smithi006.stderr:1600000 of 3200000 tuples (50%) done (elapsed 28.59 s, remaining 28.59 s) 2024-09-21T08:02:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:1700000 of 3200000 tuples (53%) done (elapsed 29.38 s, remaining 25.92 s) 2024-09-21T08:02:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:09 smithi119 ceph-mon[33564]: pgmap v376: 129 pgs: 129 active+clean; 350 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 30 op/s 2024-09-21T08:02:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:09 smithi145 ceph-mon[34049]: pgmap v376: 129 pgs: 129 active+clean; 350 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 30 op/s 2024-09-21T08:02:09.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:09 smithi006 ceph-mon[30970]: pgmap v376: 129 pgs: 129 active+clean; 350 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 30 op/s 2024-09-21T08:02:10.660 INFO:teuthology.orchestra.run.smithi006.stderr:1800000 of 3200000 tuples (56%) done (elapsed 30.56 s, remaining 23.77 s) 2024-09-21T08:02:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:11 smithi119 ceph-mon[33564]: pgmap v377: 129 pgs: 129 active+clean; 386 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-09-21T08:02:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:11 smithi145 ceph-mon[34049]: pgmap v377: 129 pgs: 129 active+clean; 386 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-09-21T08:02:11.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:11 smithi006 ceph-mon[30970]: pgmap v377: 129 pgs: 129 active+clean; 386 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-09-21T08:02:11.866 INFO:teuthology.orchestra.run.smithi006.stderr:1900000 of 3200000 tuples (59%) done (elapsed 31.76 s, remaining 21.73 s) 2024-09-21T08:02:12.761 INFO:teuthology.orchestra.run.smithi006.stderr:2000000 of 3200000 tuples (62%) done (elapsed 32.66 s, remaining 19.60 s) 2024-09-21T08:02:13.512 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:13 smithi006 ceph-mon[30970]: pgmap v378: 129 pgs: 129 active+clean; 442 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 38 op/s 2024-09-21T08:02:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:13 smithi119 ceph-mon[33564]: pgmap v378: 129 pgs: 129 active+clean; 442 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 38 op/s 2024-09-21T08:02:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:13 smithi145 ceph-mon[34049]: pgmap v378: 129 pgs: 129 active+clean; 442 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 38 op/s 2024-09-21T08:02:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2100000 of 3200000 tuples (65%) done (elapsed 33.85 s, remaining 17.73 s) 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2200000 of 3200000 tuples (68%) done (elapsed 35.09 s, remaining 15.95 s) 2024-09-21T08:02:15.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:15 smithi119 ceph-mon[33564]: pgmap v379: 129 pgs: 129 active+clean; 502 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 44 MiB/s wr, 39 op/s 2024-09-21T08:02:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:15 smithi145 ceph-mon[34049]: pgmap v379: 129 pgs: 129 active+clean; 502 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 44 MiB/s wr, 39 op/s 2024-09-21T08:02:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:15 smithi006 ceph-mon[30970]: pgmap v379: 129 pgs: 129 active+clean; 502 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 44 MiB/s wr, 39 op/s 2024-09-21T08:02:16.114 INFO:teuthology.orchestra.run.smithi006.stderr:2300000 of 3200000 tuples (71%) done (elapsed 36.01 s, remaining 14.09 s) 2024-09-21T08:02:17.308 INFO:teuthology.orchestra.run.smithi006.stderr:2400000 of 3200000 tuples (75%) done (elapsed 37.21 s, remaining 12.40 s) 2024-09-21T08:02:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:17 smithi119 ceph-mon[33564]: pgmap v380: 129 pgs: 129 active+clean; 526 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 26 op/s 2024-09-21T08:02:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:17 smithi145 ceph-mon[34049]: pgmap v380: 129 pgs: 129 active+clean; 526 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 26 op/s 2024-09-21T08:02:17.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:17 smithi006 ceph-mon[30970]: pgmap v380: 129 pgs: 129 active+clean; 526 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 26 op/s 2024-09-21T08:02:18.536 INFO:teuthology.orchestra.run.smithi006.stderr:2500000 of 3200000 tuples (78%) done (elapsed 38.44 s, remaining 10.76 s) 2024-09-21T08:02:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2600000 of 3200000 tuples (81%) done (elapsed 39.21 s, remaining 9.05 s) 2024-09-21T08:02:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:19 smithi119 ceph-mon[33564]: pgmap v381: 129 pgs: 129 active+clean; 566 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 MiB/s wr, 24 op/s 2024-09-21T08:02:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:19 smithi145 ceph-mon[34049]: pgmap v381: 129 pgs: 129 active+clean; 566 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 MiB/s wr, 24 op/s 2024-09-21T08:02:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:19 smithi006 ceph-mon[30970]: pgmap v381: 129 pgs: 129 active+clean; 566 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 MiB/s wr, 24 op/s 2024-09-21T08:02:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2700000 of 3200000 tuples (84%) done (elapsed 40.49 s, remaining 7.50 s) 2024-09-21T08:02:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2800000 of 3200000 tuples (87%) done (elapsed 41.35 s, remaining 5.91 s) 2024-09-21T08:02:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:21 smithi119 ceph-mon[33564]: pgmap v382: 129 pgs: 129 active+clean; 602 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 23 op/s 2024-09-21T08:02:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:21 smithi145 ceph-mon[34049]: pgmap v382: 129 pgs: 129 active+clean; 602 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 23 op/s 2024-09-21T08:02:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:21 smithi006 ceph-mon[30970]: pgmap v382: 129 pgs: 129 active+clean; 602 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 MiB/s wr, 23 op/s 2024-09-21T08:02:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:2900000 of 3200000 tuples (90%) done (elapsed 42.50 s, remaining 4.40 s) 2024-09-21T08:02:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:23 smithi119 ceph-mon[33564]: pgmap v383: 129 pgs: 129 active+clean; 654 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 MiB/s wr, 26 op/s 2024-09-21T08:02:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:23 smithi145 ceph-mon[34049]: pgmap v383: 129 pgs: 129 active+clean; 654 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 MiB/s wr, 26 op/s 2024-09-21T08:02:23.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:23 smithi006 ceph-mon[30970]: pgmap v383: 129 pgs: 129 active+clean; 654 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 MiB/s wr, 26 op/s 2024-09-21T08:02:23.811 INFO:teuthology.orchestra.run.smithi006.stderr:3000000 of 3200000 tuples (93%) done (elapsed 43.71 s, remaining 2.91 s) 2024-09-21T08:02:24.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:02:24.729 INFO:teuthology.orchestra.run.smithi006.stderr:3100000 of 3200000 tuples (96%) done (elapsed 44.63 s, remaining 1.44 s) 2024-09-21T08:02:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:25.346 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:25 smithi006 ceph-mon[30970]: pgmap v384: 129 pgs: 129 active+clean; 682 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 23 op/s 2024-09-21T08:02:25.414 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T08:02:25.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.605+0000 7fe870e10640 1 -- 172.21.15.6:0/1768659322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 msgr2=0x7fe86c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.605+0000 7fe870e10640 1 --2- 172.21.15.6:0/1768659322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c10d850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe860009900 tx=0x7fe86002a410 comp rx=0 tx=0).stop 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 -- 172.21.15.6:0/1768659322 shutdown_connections 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 --2- 172.21.15.6:0/1768659322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c10de10 0x7fe86c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 --2- 172.21.15.6:0/1768659322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c10d850 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 --2- 172.21.15.6:0/1768659322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c1049b0 0x7fe86c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 -- 172.21.15.6:0/1768659322 >> 172.21.15.6:0/1768659322 conn(0x7fe86c079730 msgr2=0x7fe86c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 -- 172.21.15.6:0/1768659322 shutdown_connections 2024-09-21T08:02:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.606+0000 7fe870e10640 1 -- 172.21.15.6:0/1768659322 wait complete. 2024-09-21T08:02:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 Processor -- start 2024-09-21T08:02:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 -- start start 2024-09-21T08:02:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c1049b0 0x7fe86c1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c1a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 0x7fe86c1ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c113920 con 0x7fe86c105300 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c1137a0 con 0x7fe86c10de10 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.607+0000 7fe870e10640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c113aa0 con 0x7fe86c1049b0 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c1049b0 0x7fe86c1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c1a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c1a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36922/0 (socket says 172.21.15.6:36922) 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 0x7fe86c1ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe869d9b640 1 -- 172.21.15.6:0/637815102 learned_addr learned my addr 172.21.15.6:0/637815102 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 -- 172.21.15.6:0/637815102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c1049b0 msgr2=0x7fe86c1a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c1049b0 0x7fe86c1a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 -- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 msgr2=0x7fe86c1a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c1a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.608+0000 7fe86ad9d640 1 -- 172.21.15.6:0/637815102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c1acb80 con 0x7fe86c10de10 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 0x7fe86c1ac640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe864009fd0 tx=0x7fe86400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe85b7fe640 1 -- 172.21.15.6:0/637815102 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86400ce20 con 0x7fe86c10de10 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c1acdb0 con 0x7fe86c10de10 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c1ad200 con 0x7fe86c10de10 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe85b7fe640 1 -- 172.21.15.6:0/637815102 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe864005020 con 0x7fe86c10de10 2024-09-21T08:02:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.609+0000 7fe85b7fe640 1 -- 172.21.15.6:0/637815102 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864010690 con 0x7fe86c10de10 2024-09-21T08:02:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.612+0000 7fe85b7fe640 1 -- 172.21.15.6:0/637815102 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe864010830 con 0x7fe86c10de10 2024-09-21T08:02:25.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.613+0000 7fe877384740 1 Processor -- start 2024-09-21T08:02:25.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.613+0000 7fe877384740 1 -- start start 2024-09-21T08:02:25.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.613+0000 7fe877384740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdece3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.613+0000 7fe877384740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.613+0000 7fe85b7fe640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 0x7fe8540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe877384740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdece40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe877384740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ccdec59e50 con 0x55ccde91b390 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe85b7fe640 1 -- 172.21.15.6:0/637815102 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe8640e7ee0 con 0x7fe86c10de10 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56686/0 (socket says 172.21.15.6:56686) 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe86a59c640 1 -- 172.21.15.6:0/24594834 learned_addr learned my addr 172.21.15.6:0/24594834 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe869d9b640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 0x7fe8540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ccdec49280 con 0x55ccde93c070 2024-09-21T08:02:25.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ccdec4d090 con 0x55ccde9131b0 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.614+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdece40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 -- 172.21.15.6:0/24594834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 msgr2=0x55ccdece3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 -- 172.21.15.6:0/24594834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 msgr2=0x55ccdece3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe869d9b640 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdece3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdece3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 -- 172.21.15.6:0/24594834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccde9a7650 con 0x55ccde91b390 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe869d9b640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 0x7fe8540b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe860000c00 tx=0x7fe8600058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdece40d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe8640e52b0 tx=0x7fe8640ad4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d691ea70b135536 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.615+0000 7fe858ff9640 1 -- 172.21.15.6:0/24594834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640b2070 con 0x55ccde91b390 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.616+0000 7fe858ff9640 1 -- 172.21.15.6:0/24594834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8640b73d0 con 0x55ccde91b390 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.616+0000 7fe858ff9640 1 -- 172.21.15.6:0/24594834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864010b20 con 0x55ccde91b390 2024-09-21T08:02:25.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 msgr2=0x55ccdece40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdece40d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe8640e52b0 tx=0x7fe8640ad4c0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 shutdown_connections 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdece40d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 --2- 172.21.15.6:0/24594834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdece3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 >> 172.21.15.6:0/24594834 conn(0x55ccde930460 msgr2=0x55ccdece1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 shutdown_connections 2024-09-21T08:02:25.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.617+0000 7fe877384740 1 -- 172.21.15.6:0/24594834 wait complete. 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 -- start start 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 Processor -- start 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdecfb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ccdeaaa700 con 0x55ccde91b390 2024-09-21T08:02:25.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ccdebe4110 con 0x55ccde93c070 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ccdecf1e30 con 0x55ccde9131b0 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.618+0000 7fe877384740 10 client.0 _ll_register_callbacks cb 0x55ccdebfd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56690/0 (socket says 172.21.15.6:56690) 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 -- 172.21.15.6:0/1960330753 learned_addr learned my addr 172.21.15.6:0/1960330753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36948/0 (socket says 172.21.15.6:36948) 2024-09-21T08:02:25.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdecfb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 -- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 msgr2=0x55ccdecfb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdecfb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 -- 172.21.15.6:0/1960330753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 msgr2=0x55ccdecef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe86a59c640 1 -- 172.21.15.6:0/1960330753 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccdec11c40 con 0x55ccde9131b0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.619+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe86a59c640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe85c012700 tx=0x7fe85c012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92fa87cc2feb0746 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c011bb0 con 0x55ccde9131b0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe85c011d50 con 0x55ccde9131b0 2024-09-21T08:02:25.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8640b73d0 con 0x55ccde9131b0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe85c00f460 con 0x55ccde9131b0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe877384740 10 client.25501 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.620+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ccdecfdc30 con 0x55ccde9131b0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8640b73d0 con 0x55ccde9131b0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe85c01c5b0 con 0x55ccde9131b0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 10 client.25501 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 10 client.25501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 20 client.25501 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8fa9f0 0x55ccded011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 4 client.25501 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.621+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccdec5bda0 con 0x55ccde8fa9f0 2024-09-21T08:02:25.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.622+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8fa9f0 0x55ccded011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.622+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8fa9f0 0x55ccded011b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c7e6b23ed5fc9e1 server_cookie=b64bb86df14661fa in_seq=0 out_seq=0 2024-09-21T08:02:25.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.622+0000 7fe851ffb640 10 client.25501 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe851ffb640 1 -- 172.21.15.6:0/1960330753 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ccdec5bda0 con 0x55ccde8fa9f0 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe851ffb640 10 client.25501 handle_command_reply: tid=0 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 client.25501 shutdown 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 msgr2=0x55ccdeceed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe85c012700 tx=0x7fe85c012bc0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 shutdown_connections 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8fa9f0 0x55ccded011b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde93c070 0x55ccdecfb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde91b390 0x55ccdecef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 --2- 172.21.15.6:0/1960330753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdeceed40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 >> 172.21.15.6:0/1960330753 conn(0x55ccde930460 msgr2=0x55ccdece67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.623+0000 7fe851ffb640 0 client.25501 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.624+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 shutdown_connections 2024-09-21T08:02:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.624+0000 7fe877384740 1 -- 172.21.15.6:0/1960330753 wait complete. 2024-09-21T08:02:25.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.624+0000 7fe877384740 20 client.25501 trim_cache size 0 max 16384 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.653+0000 7fe877384740 1 Processor -- start 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.653+0000 7fe877384740 1 -- start start 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdece0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdece10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c00dfe0 con 0x55ccde93c070 2024-09-21T08:02:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c010860 con 0x55ccde91b390 2024-09-21T08:02:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe877384740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c00e650 con 0x55ccde9131b0 2024-09-21T08:02:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56696/0 (socket says 172.21.15.6:56696) 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe86a59c640 1 -- 172.21.15.6:0/3545329272 learned_addr learned my addr 172.21.15.6:0/3545329272 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe869d9b640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdece0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.654+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdece10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 -- 172.21.15.6:0/3545329272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 msgr2=0x55ccdece0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdece0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 -- 172.21.15.6:0/3545329272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 msgr2=0x55ccdece10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdece10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 -- 172.21.15.6:0/3545329272 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccdecf0000 con 0x55ccde9131b0 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdece10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe86a59c640 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009850 tx=0x7fe85c009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38bdde500fa5f0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe853fff640 1 -- 172.21.15.6:0/3545329272 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c02f070 con 0x55ccde9131b0 2024-09-21T08:02:25.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe853fff640 1 -- 172.21.15.6:0/3545329272 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe85c01c420 con 0x55ccde9131b0 2024-09-21T08:02:25.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.655+0000 7fe853fff640 1 -- 172.21.15.6:0/3545329272 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0035f0 con 0x55ccde9131b0 2024-09-21T08:02:25.659 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:25 smithi119 ceph-mon[33564]: pgmap v384: 129 pgs: 129 active+clean; 682 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 23 op/s 2024-09-21T08:02:25.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.656+0000 7fe877384740 1 -- 172.21.15.6:0/3545329272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 msgr2=0x55ccdece4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.656+0000 7fe877384740 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009850 tx=0x7fe85c009880 comp rx=0 tx=0).stop 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.657+0000 7fe877384740 1 -- 172.21.15.6:0/3545329272 shutdown_connections 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.657+0000 7fe877384740 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdece10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.657+0000 7fe877384740 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdece0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.657+0000 7fe877384740 1 --2- 172.21.15.6:0/3545329272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdece4d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.657+0000 7fe877384740 1 -- 172.21.15.6:0/3545329272 >> 172.21.15.6:0/3545329272 conn(0x55ccde930460 msgr2=0x55ccdece4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.658+0000 7fe877384740 1 -- 172.21.15.6:0/3545329272 shutdown_connections 2024-09-21T08:02:25.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.658+0000 7fe877384740 1 -- 172.21.15.6:0/3545329272 wait complete. 2024-09-21T08:02:25.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.659+0000 7fe877384740 1 -- start start 2024-09-21T08:02:25.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.659+0000 7fe877384740 1 Processor -- start 2024-09-21T08:02:25.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.660+0000 7fe877384740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdecf7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.660+0000 7fe877384740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdecf2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.660+0000 7fe877384740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdecf3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.660+0000 7fe877384740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c00ed20 con 0x55ccde93c070 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe877384740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c010190 con 0x55ccde91b390 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe877384740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c00f3f0 con 0x55ccde9131b0 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdecf7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdecf2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe86a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdecf7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56706/0 (socket says 172.21.15.6:56706) 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe86a59c640 1 -- 172.21.15.6:0/1171203342 learned_addr learned my addr 172.21.15.6:0/1171203342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.661+0000 7fe86ad9d640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdecf3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 -- 172.21.15.6:0/1171203342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 msgr2=0x55ccdecf7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdecf7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 -- 172.21.15.6:0/1171203342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 msgr2=0x55ccdecf3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdecf3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 -- 172.21.15.6:0/1171203342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccdecf3b10 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe869d9b640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdecf2e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8600057c0 tx=0x7fe86002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d96ae78c8d67439e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe877384740 10 client.0 _ll_register_callbacks cb 0x7fe85c009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe851ffb640 1 -- 172.21.15.6:0/1171203342 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860035050 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe851ffb640 1 -- 172.21.15.6:0/1171203342 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe8600035f0 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.662+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe85c01c420 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe851ffb640 1 -- 172.21.15.6:0/1171203342 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe86005f050 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 10 client.25436 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55ccded6b940 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe851ffb640 1 -- 172.21.15.6:0/1171203342 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe860051070 con 0x55ccde91b390 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 10 client.25436 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 20 client.25436 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8cfda0 0x55ccded6e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 4 client.25436 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.663+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe85c01c420 con 0x55ccde8cfda0 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe86a59c640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8cfda0 0x55ccded6e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe86a59c640 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8cfda0 0x55ccded6e020 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f42d86d2e12abe98 server_cookie=c958515e652e3fd6 in_seq=0 out_seq=0 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe851ffb640 10 client.25436 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe851ffb640 1 -- 172.21.15.6:0/1171203342 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7fe85c01c420 con 0x55ccde8cfda0 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe851ffb640 10 client.25436 handle_command_reply: tid=0 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe877384740 1 client.25436 shutdown 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 msgr2=0x55ccdecf2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.664+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdecf2e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8600057c0 tx=0x7fe86002a410 comp rx=0 tx=0).stop 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 shutdown_connections 2024-09-21T08:02:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ccde8cfda0 0x55ccded6e020 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe851ffb640 0 client.25436 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ccde93c070 0x55ccdecf3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ccde91b390 0x55ccdecf2e00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 --2- 172.21.15.6:0/1171203342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ccde9131b0 0x55ccdecf7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.665+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 >> 172.21.15.6:0/1171203342 conn(0x55ccde930460 msgr2=0x55ccdecf01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.666+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 shutdown_connections 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.666+0000 7fe877384740 1 -- 172.21.15.6:0/1171203342 wait complete. 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.666+0000 7fe877384740 20 client.25436 trim_cache size 0 max 16384 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:02:25.672 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:02:25.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:02:25.674 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:02:25.674 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:02:25.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:25.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:25.674 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 msgr2=0x7fe8540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 0x7fe8540b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe860000c00 tx=0x7fe8600058d0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 msgr2=0x7fe86c1ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 0x7fe86c1ac640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe864009fd0 tx=0x7fe86400ef10 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 shutdown_connections 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8540b6700 0x7fe8540b8c10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe86c10de10 0x7fe86c1ac640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe86c105300 0x7fe86c1a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.667+0000 7fe870e10640 1 --2- 172.21.15.6:0/637815102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c1049b0 0x7fe86c1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.668+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 >> 172.21.15.6:0/637815102 conn(0x7fe86c079730 msgr2=0x7fe86c0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.668+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 shutdown_connections 2024-09-21T08:02:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:25.668+0000 7fe870e10640 1 -- 172.21.15.6:0/637815102 wait complete. 2024-09-21T08:02:25.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:25 smithi145 ceph-mon[34049]: pgmap v384: 129 pgs: 129 active+clean; 682 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 23 op/s 2024-09-21T08:02:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:3200000 of 3200000 tuples (100%) done (elapsed 45.90 s, remaining 0.00 s) 2024-09-21T08:02:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:vacuuming... 2024-09-21T08:02:26.514 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:02:26.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:26.596 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 -- 172.21.15.6:0/3317635399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 msgr2=0x7ff124102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 --2- 172.21.15.6:0/3317635399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff124102ac0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff114009900 tx=0x7ff11402a480 comp rx=0 tx=0).stop 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 -- 172.21.15.6:0/3317635399 shutdown_connections 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 --2- 172.21.15.6:0/3317635399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 --2- 172.21.15.6:0/3317635399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff124112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 --2- 172.21.15.6:0/3317635399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff124102ac0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 -- 172.21.15.6:0/3317635399 >> 172.21.15.6:0/3317635399 conn(0x7ff124079790 msgr2=0x7ff124079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:27.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 -- 172.21.15.6:0/3317635399 shutdown_connections 2024-09-21T08:02:27.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.130+0000 7ff129d7f640 1 -- 172.21.15.6:0/3317635399 wait complete. 2024-09-21T08:02:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.131+0000 7ff129d7f640 1 Processor -- start 2024-09-21T08:02:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.131+0000 7ff129d7f640 1 -- start start 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff1241a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff124115b50 con 0x7ff1241026b0 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241159d0 con 0x7ff124110260 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff129d7f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff124115cd0 con 0x7ff124103000 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46714/0 (socket says 172.21.15.6:46714) 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 -- 172.21.15.6:0/543233450 learned_addr learned my addr 172.21.15.6:0/543233450 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff122ffd640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff123fff640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff1241a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 -- 172.21.15.6:0/543233450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 msgr2=0x7ff12419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 -- 172.21.15.6:0/543233450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 msgr2=0x7ff1241a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff1241a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff1237fe640 1 -- 172.21.15.6:0/543233450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1241a2450 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff123fff640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff1241a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.132+0000 7ff122ffd640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff1237fe640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff114006010 tx=0x7ff1140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11403f030 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1241a26e0 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff114003a80 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114035070 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.133+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1241a2c10 con 0x7ff1241026b0 2024-09-21T08:02:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.135+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff124102ac0 con 0x7ff1241026b0 2024-09-21T08:02:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.136+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff114042030 con 0x7ff1241026b0 2024-09-21T08:02:27.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.137+0000 7ff120ff9640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 0x7ff10c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.137+0000 7ff122ffd640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 0x7ff10c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.137+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff114107e70 con 0x7ff1241026b0 2024-09-21T08:02:27.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.138+0000 7ff122ffd640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 0x7ff10c0b8c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff124102500 tx=0x7ff118005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:27.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.143+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1241a2c10 con 0x7ff1241026b0 2024-09-21T08:02:27.188 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.438+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff12419d6d0 con 0x7ff1241026b0 2024-09-21T08:02:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.438+0000 7ff120ff9640 1 -- 172.21.15.6:0/543233450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7ff1140ce040 con 0x7ff1241026b0 2024-09-21T08:02:27.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:02:27.441 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:02:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 msgr2=0x7ff10c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 0x7ff10c0b8c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff124102500 tx=0x7ff118005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 msgr2=0x7ff12419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff114006010 tx=0x7ff1140040c0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 shutdown_connections 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff10c0b6730 0x7ff10c0b8c40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124103000 0x7ff12419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff124110260 0x7ff1241a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 --2- 172.21.15.6:0/543233450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1241026b0 0x7ff12419c5a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.441+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 >> 172.21.15.6:0/543233450 conn(0x7ff124079790 msgr2=0x7ff1241008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.442+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 shutdown_connections 2024-09-21T08:02:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.442+0000 7ff129d7f640 1 -- 172.21.15.6:0/543233450 wait complete. 2024-09-21T08:02:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:27 smithi119 ceph-mon[33564]: pgmap v385: 129 pgs: 129 active+clean; 732 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 24 op/s 2024-09-21T08:02:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:27 smithi145 ceph-mon[34049]: pgmap v385: 129 pgs: 129 active+clean; 732 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 24 op/s 2024-09-21T08:02:27.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:27 smithi006 ceph-mon[30970]: pgmap v385: 129 pgs: 129 active+clean; 732 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 24 op/s 2024-09-21T08:02:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 -- 172.21.15.6:0/477975928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f81094b0 msgr2=0x7f90f81098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 --2- 172.21.15.6:0/477975928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f81094b0 0x7f90f81098c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec02a410 comp rx=0 tx=0).stop 2024-09-21T08:02:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 -- 172.21.15.6:0/477975928 shutdown_connections 2024-09-21T08:02:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 --2- 172.21.15.6:0/477975928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f8109e00 0x7f90f8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 --2- 172.21.15.6:0/477975928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f81094b0 0x7f90f81098c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 --2- 172.21.15.6:0/477975928 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 0x7f90f8103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.880+0000 7f90fd113640 1 -- 172.21.15.6:0/477975928 >> 172.21.15.6:0/477975928 conn(0x7f90f80ff5e0 msgr2=0x7f90f8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:27.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.881+0000 7f90fd113640 1 -- 172.21.15.6:0/477975928 shutdown_connections 2024-09-21T08:02:27.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.881+0000 7f90fd113640 1 -- 172.21.15.6:0/477975928 wait complete. 2024-09-21T08:02:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.881+0000 7f90fd113640 1 Processor -- start 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 -- start start 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 0x7f90f819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 0x7f90f819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8113970 con 0x7f90f8109e00 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90f81137f0 con 0x7f90f81094b0 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90fd113640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8113af0 con 0x7f90f8103b70 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90f759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90f6d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 0x7f90f819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90f759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46740/0 (socket says 172.21.15.6:46740) 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90f759e640 1 -- 172.21.15.6:0/3841145481 learned_addr learned my addr 172.21.15.6:0/3841145481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.882+0000 7f90f659c640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 0x7f90f819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 -- 172.21.15.6:0/3841145481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 msgr2=0x7f90f819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 0x7f90f819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 -- 172.21.15.6:0/3841145481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 msgr2=0x7f90f819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 0x7f90f819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 -- 172.21.15.6:0/3841145481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f81a0390 con 0x7f90f8109e00 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f659c640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 0x7f90f819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90f759e640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f90f000efd0 tx=0x7f90f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0003b70 con 0x7f90f8109e00 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f81a0680 con 0x7f90f8109e00 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90f0003d10 con 0x7f90f8109e00 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0010850 con 0x7f90f8109e00 2024-09-21T08:02:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.883+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f81a6de0 con 0x7f90f8109e00 2024-09-21T08:02:27.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.885+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f8103f80 con 0x7f90f8109e00 2024-09-21T08:02:27.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.886+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f90f0004020 con 0x7f90f8109e00 2024-09-21T08:02:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.887+0000 7f90dffff640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 0x7f90e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.887+0000 7f90f6d9d640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 0x7f90e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.887+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f90f00e7ea0 con 0x7f90f8109e00 2024-09-21T08:02:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.888+0000 7f90f6d9d640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 0x7f90e00b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90e80095f0 tx=0x7f90e8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:27.892+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90f00ae070 con 0x7f90f8109e00 2024-09-21T08:02:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.158+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90f802e640 con 0x7f90f8109e00 2024-09-21T08:02:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.159+0000 7f90dffff640 1 -- 172.21.15.6:0/3841145481 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f90f00b2450 con 0x7f90f8109e00 2024-09-21T08:02:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:02:28.162 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:02:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:02:28.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 msgr2=0x7f90e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:28.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 0x7f90e00b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90e80095f0 tx=0x7f90e8005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:28.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 msgr2=0x7f90f819fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:28.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f90f000efd0 tx=0x7f90f000c6a0 comp rx=0 tx=0).stop 2024-09-21T08:02:28.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 shutdown_connections 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90e00b6680 0x7f90e00b8b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90f8109e00 0x7f90f819fc60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81094b0 0x7f90f819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 --2- 172.21.15.6:0/3841145481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f8103b70 0x7f90f819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 >> 172.21.15.6:0/3841145481 conn(0x7f90f80ff5e0 msgr2=0x7f90f8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 shutdown_connections 2024-09-21T08:02:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:28.162+0000 7f90fd113640 1 -- 172.21.15.6:0/3841145481 wait complete. 2024-09-21T08:02:28.327 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T08:02:28.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T08:02:28.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:28 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/543233450' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:28 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3841145481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:28 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/543233450' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:28 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3841145481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:28 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/543233450' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:28 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3841145481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:28.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:02:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:29.465 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:29 smithi006 ceph-mon[30970]: pgmap v386: 129 pgs: 129 active+clean; 796 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-21T08:02:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.589+0000 7f3dd2102640 1 -- 172.21.15.6:0/770856599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc1049d0 msgr2=0x7f3dcc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.589+0000 7f3dd2102640 1 --2- 172.21.15.6:0/770856599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc104de0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009900 tx=0x7f3dbc02a410 comp rx=0 tx=0).stop 2024-09-21T08:02:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 -- 172.21.15.6:0/770856599 shutdown_connections 2024-09-21T08:02:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 --2- 172.21.15.6:0/770856599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc10de30 0x7f3dcc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 --2- 172.21.15.6:0/770856599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc105320 0x7f3dcc10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 --2- 172.21.15.6:0/770856599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc104de0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 -- 172.21.15.6:0/770856599 >> 172.21.15.6:0/770856599 conn(0x7f3dcc079760 msgr2=0x7f3dcc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 -- 172.21.15.6:0/770856599 shutdown_connections 2024-09-21T08:02:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.590+0000 7f3dd2102640 1 -- 172.21.15.6:0/770856599 wait complete. 2024-09-21T08:02:29.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 Processor -- start 2024-09-21T08:02:29.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 -- start start 2024-09-21T08:02:29.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 0x7f3dcc1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1139b0 con 0x7f3dcc105320 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc113830 con 0x7f3dcc10de30 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dd2102640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc113b30 con 0x7f3dcc1049d0 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46758/0 (socket says 172.21.15.6:46758) 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.591+0000 7f3dcaffd640 1 -- 172.21.15.6:0/638896380 learned_addr learned my addr 172.21.15.6:0/638896380 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 0x7f3dcc1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 -- 172.21.15.6:0/638896380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc1049d0 msgr2=0x7f3dcc19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 -- 172.21.15.6:0/638896380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 msgr2=0x7f3dcc1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 0x7f3dcc1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 -- 172.21.15.6:0/638896380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc1a25b0 con 0x7f3dcc105320 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 0x7f3dcc1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000e9f0 tx=0x7f3dc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dc8ff9640 1 -- 172.21.15.6:0/638896380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000ccc0 con 0x7f3dcc105320 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc1a28a0 con 0x7f3dcc105320 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dc8ff9640 1 -- 172.21.15.6:0/638896380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc00108c0 con 0x7f3dcc105320 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dc8ff9640 1 -- 172.21.15.6:0/638896380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0018660 con 0x7f3dcc105320 2024-09-21T08:02:29.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.592+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc1a9000 con 0x7f3dcc105320 2024-09-21T08:02:29.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.595+0000 7f3dd8676740 1 Processor -- start 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 -- start start 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dc8ff9640 1 -- 172.21.15.6:0/638896380 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3dc00188e0 con 0x7f3dcc105320 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e32600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a62980 0x55d1d5e32b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5da8b90 con 0x55d1d5a6ab60 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5d97fc0 con 0x55d1d5a8b840 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dd8676740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5d9bdd0 con 0x55d1d5a62980 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46760/0 (socket says 172.21.15.6:46760) 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dcaffd640 1 -- 172.21.15.6:0/1534605906 learned_addr learned my addr 172.21.15.6:0/1534605906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a62980 0x55d1d5e32b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.596+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e32600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 -- 172.21.15.6:0/1534605906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a62980 msgr2=0x55d1d5e32b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a62980 0x55d1d5e32b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 -- 172.21.15.6:0/1534605906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 msgr2=0x55d1d5e32600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e32600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 -- 172.21.15.6:0/1534605906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1d5d1f060 con 0x55d1d5a6ab60 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e32600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00e5230 tx=0x7f3dc00f05f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9d9f48b813ccba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dc8ff9640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3db1ffb640 1 -- 172.21.15.6:0/1534605906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00fb070 con 0x55d1d5a6ab60 2024-09-21T08:02:29.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3dc8ff9640 1 -- 172.21.15.6:0/638896380 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3dc00e7ef0 con 0x7f3dcc105320 2024-09-21T08:02:29.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3db1ffb640 1 -- 172.21.15.6:0/1534605906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc00ad4d0 con 0x55d1d5a6ab60 2024-09-21T08:02:29.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.597+0000 7f3db1ffb640 1 -- 172.21.15.6:0/1534605906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00a9860 con 0x55d1d5a6ab60 2024-09-21T08:02:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 -- 172.21.15.6:0/1534605906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 msgr2=0x55d1d5e33080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00e5230 tx=0x7f3dc00f05f0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 0x7f3db40b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4005fd0 tx=0x7f3dc4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 -- 172.21.15.6:0/1534605906 shutdown_connections 2024-09-21T08:02:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a62980 0x55d1d5e32b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e33080 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1534605906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e32600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.598+0000 7f3dd8676740 1 -- 172.21.15.6:0/1534605906 >> 172.21.15.6:0/1534605906 conn(0x55d1d5a7f990 msgr2=0x55d1d5e304f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.599+0000 7f3dd8676740 1 -- 172.21.15.6:0/1534605906 shutdown_connections 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.599+0000 7f3dd8676740 1 -- 172.21.15.6:0/1534605906 wait complete. 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.599+0000 7f3dd8676740 1 -- start start 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.599+0000 7f3dd8676740 1 Processor -- start 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e4a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5bf97a0 con 0x55d1d5a62980 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5d3d0a0 con 0x55d1d5a8b840 2024-09-21T08:02:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d1d5e40de0 con 0x55d1d5a6ab60 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dd8676740 10 client.0 _ll_register_callbacks cb 0x55d1d5d1a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46766/0 (socket says 172.21.15.6:46766) 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/4274533069 learned_addr learned my addr 172.21.15.6:0/4274533069 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/4274533069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 msgr2=0x55d1d5e3e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e3e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 msgr2=0x55d1d5e4a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e4a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/4274533069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1d5d2b880 con 0x55d1d5a62980 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.600+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e3e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06bc60 tx=0x7f3dbc004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b6aaf148480edf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc035040 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3dbc005460 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc00ad4d0 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3dbc0046c0 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3dd8676740 10 client.15756 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d1d5b05b90 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.601+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc00ad4d0 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3dbc003a40 con 0x55d1d5a62980 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 10 client.15756 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 10 client.15756 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 20 client.15756 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a4a1c0 0x55d1d5e501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 4 client.15756 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1d5daaae0 con 0x55d1d5a4a1c0 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a4a1c0 0x55d1d5e501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a4a1c0 0x55d1d5e501c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12249a42f98534a1 server_cookie=d8cf8084dac2a454 in_seq=0 out_seq=0 2024-09-21T08:02:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.602+0000 7f3daaffd640 10 client.15756 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.603+0000 7f3daaffd640 1 -- 172.21.15.6:0/4274533069 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1d5daaae0 con 0x55d1d5a4a1c0 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.603+0000 7f3daaffd640 10 client.15756 handle_command_reply: tid=0 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.603+0000 7f3dd8676740 1 client.15756 shutdown 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 msgr2=0x55d1d5e3e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06bc60 tx=0x7f3dbc004480 comp rx=0 tx=0).stop 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 shutdown_connections 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a4a1c0 0x55d1d5e501c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e3e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a8b840 0x55d1d5e4a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 --2- 172.21.15.6:0/4274533069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3e130 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 >> 172.21.15.6:0/4274533069 conn(0x55d1d5a7f990 msgr2=0x55d1d5e357e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3daaffd640 0 client.15756 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 shutdown_connections 2024-09-21T08:02:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 1 -- 172.21.15.6:0/4274533069 wait complete. 2024-09-21T08:02:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.604+0000 7f3dd8676740 20 client.15756 trim_cache size 0 max 16384 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 Processor -- start 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 -- start start 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e2faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5e2ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b1060 con 0x55d1d5a62980 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b38e0 con 0x55d1d5a6ab60 2024-09-21T08:02:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dd8676740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b16d0 con 0x55d1d5a8b840 2024-09-21T08:02:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.631+0000 7f3dcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46772/0 (socket says 172.21.15.6:46772) 2024-09-21T08:02:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/1124015821 learned_addr learned my addr 172.21.15.6:0/1124015821 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e2faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5e2ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/1124015821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 msgr2=0x55d1d5e2ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5e2ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/1124015821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a6ab60 msgr2=0x55d1d5e2faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e2faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 -- 172.21.15.6:0/1124015821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1d5e348f0 con 0x55d1d5a62980 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5e2ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.632+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc003de0 tx=0x7f3dbc005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1e63c4f9da05c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.633+0000 7f3db17fa640 1 -- 172.21.15.6:0/1124015821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc058070 con 0x55d1d5a62980 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.633+0000 7f3db17fa640 1 -- 172.21.15.6:0/1124015821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dbc041070 con 0x55d1d5a62980 2024-09-21T08:02:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.633+0000 7f3db17fa640 1 -- 172.21.15.6:0/1124015821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc035030 con 0x55d1d5a62980 2024-09-21T08:02:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- 172.21.15.6:0/1124015821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 msgr2=0x55d1d5e3fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc003de0 tx=0x7f3dbc005a20 comp rx=0 tx=0).stop 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- 172.21.15.6:0/1124015821 shutdown_connections 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5e2ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e2faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 --2- 172.21.15.6:0/1124015821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a62980 0x55d1d5e3fb60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- 172.21.15.6:0/1124015821 >> 172.21.15.6:0/1124015821 conn(0x55d1d5a7f990 msgr2=0x55d1d5e3f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- 172.21.15.6:0/1124015821 shutdown_connections 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- 172.21.15.6:0/1124015821 wait complete. 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 -- start start 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.634+0000 7f3dd8676740 1 Processor -- start 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 0x55d1d5e42b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5eb3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b1da0 con 0x55d1d5a6ab60 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b3210 con 0x55d1d5a62980 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1b2470 con 0x55d1d5a8b840 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dd8676740 10 client.0 _ll_register_callbacks cb 0x7f3dbc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46776/0 (socket says 172.21.15.6:46776) 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dcaffd640 1 -- 172.21.15.6:0/2498467500 learned_addr learned my addr 172.21.15.6:0/2498467500 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dcb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 0x55d1d5e42b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.635+0000 7f3dcbfff640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5eb3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 -- 172.21.15.6:0/2498467500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 msgr2=0x55d1d5eb3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5eb3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 -- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 msgr2=0x55d1d5e42b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 0x55d1d5e42b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 -- 172.21.15.6:0/2498467500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1d5eb4330 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 0x55d1d5e42b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dcaffd640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c6a0 tx=0x7f3dc001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4c53fe9b0c2678 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00ad130 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3dc0010d50 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dbc041070 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3dc00ad310 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dd8676740 10 client.15762 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.636+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d1d5ebb670 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dbc041070 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3dc00e5540 con 0x55d1d5a6ab60 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 10 client.15762 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 10 client.15762 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 20 client.15762 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a1f570 0x55d1d5ebd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 4 client.15762 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T08:02:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.637+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x55d1d5da6590 con 0x55d1d5a1f570 2024-09-21T08:02:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.638+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a1f570 0x55d1d5ebd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.638+0000 7f3daaffd640 10 client.15762 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.638+0000 7f3dcb7fe640 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a1f570 0x55d1d5ebd900 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b57287ac0f1998 server_cookie=78b96acf4742d28f in_seq=0 out_seq=0 2024-09-21T08:02:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:29 smithi119 ceph-mon[33564]: pgmap v386: 129 pgs: 129 active+clean; 796 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-21T08:02:29.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:29 smithi145 ceph-mon[34049]: pgmap v386: 129 pgs: 129 active+clean; 796 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-21T08:02:29.720 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.919+0000 7f3daaffd640 1 -- 172.21.15.6:0/2498467500 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d1d5da6590 con 0x55d1d5a1f570 2024-09-21T08:02:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.919+0000 7f3daaffd640 10 client.15762 handle_command_reply: tid=0 2024-09-21T08:02:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.919+0000 7f3dd8676740 1 client.15762 shutdown 2024-09-21T08:02:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 msgr2=0x55d1d5e43110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c6a0 tx=0x7f3dc001f000 comp rx=0 tx=0).stop 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 shutdown_connections 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d1d5a1f570 0x55d1d5ebd900 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1d5a8b840 0x55d1d5eb3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d1d5a6ab60 0x55d1d5e43110 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 --2- 172.21.15.6:0/2498467500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1d5a62980 0x55d1d5e42b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 >> 172.21.15.6:0/2498467500 conn(0x55d1d5a7f990 msgr2=0x55d1d5e3f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3daaffd640 0 client.15762 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 shutdown_connections 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 1 -- 172.21.15.6:0/2498467500 wait complete. 2024-09-21T08:02:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.920+0000 7f3dd8676740 20 client.15762 trim_cache size 0 max 16384 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 6, 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "57db5398": { 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 6, 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:02:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.0, 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 msgr2=0x7f3db40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 0x7f3db40b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4005fd0 tx=0x7f3dc4009500 comp rx=0 tx=0).stop 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 msgr2=0x7f3dcc19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000e9f0 tx=0x7f3dc000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 shutdown_connections 2024-09-21T08:02:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dcc10de30 0x7f3dcc1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc105320 0x7f3dcc19cbe0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 --2- 172.21.15.6:0/638896380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dcc1049d0 0x7f3dcc19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 >> 172.21.15.6:0/638896380 conn(0x7f3dcc079760 msgr2=0x7f3dcc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 shutdown_connections 2024-09-21T08:02:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:29.921+0000 7f3dd2102640 1 -- 172.21.15.6:0/638896380 wait complete. 2024-09-21T08:02:30.740 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '57db5398', quiesce took 5.3 seconds. Will release after: 11.7 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 -- 172.21.15.6:0/2772070173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108d70 msgr2=0x7f0cd010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 --2- 172.21.15.6:0/2772070173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108d70 0x7f0cd010f5a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ca0 tx=0x7f0cc802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 -- 172.21.15.6:0/2772070173 shutdown_connections 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 --2- 172.21.15.6:0/2772070173 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108420 0x7f0cd0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 --2- 172.21.15.6:0/2772070173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108d70 0x7f0cd010f5a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 --2- 172.21.15.6:0/2772070173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 0x7f0cd0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 -- 172.21.15.6:0/2772070173 >> 172.21.15.6:0/2772070173 conn(0x7f0cd0079770 msgr2=0x7f0cd0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 -- 172.21.15.6:0/2772070173 shutdown_connections 2024-09-21T08:02:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.935+0000 7f0cd6605640 1 -- 172.21.15.6:0/2772070173 wait complete. 2024-09-21T08:02:30.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.936+0000 7f0cd6605640 1 Processor -- start 2024-09-21T08:02:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.936+0000 7f0cd6605640 1 -- start start 2024-09-21T08:02:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 0x7f0cd0110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 0x7f0cd0110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0113a30 con 0x7f0cd0108420 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01138b0 con 0x7f0cd0102ae0 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd6605640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0113bb0 con 0x7f0cd0108d70 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46788/0 (socket says 172.21.15.6:46788) 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4187787530 learned_addr learned my addr 172.21.15.6:0/4187787530 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 0x7f0cd0110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccffff640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 0x7f0cd0110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4187787530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 msgr2=0x7f0cd0110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 0x7f0cd0110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4187787530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 msgr2=0x7f0cd0110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 0x7f0cd0110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4187787530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd01a8720 con 0x7f0cd0108420 2024-09-21T08:02:30.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 0x7f0cd0110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.937+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d740 tx=0x7f0cc400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.938+0000 7f0ccd7fa640 1 -- 172.21.15.6:0/4187787530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4017070 con 0x7f0cd0108420 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.938+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd01a8a10 con 0x7f0cd0108420 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.938+0000 7f0ccd7fa640 1 -- 172.21.15.6:0/4187787530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc400de50 con 0x7f0cd0108420 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.938+0000 7f0ccd7fa640 1 -- 172.21.15.6:0/4187787530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400f620 con 0x7f0cd0108420 2024-09-21T08:02:30.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.938+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a8f50 con 0x7f0cd0108420 2024-09-21T08:02:30.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.940+0000 7f0cdcb79740 1 Processor -- start 2024-09-21T08:02:30.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.940+0000 7f0cdcb79740 1 -- start start 2024-09-21T08:02:30.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.940+0000 7f0ccd7fa640 1 -- 172.21.15.6:0/4187787530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0cc401a070 con 0x7f0cd0108420 2024-09-21T08:02:30.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985be070 0x5577989652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985951b0 0x557798965800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5577988dbea0 con 0x55779859d390 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5577988cb2d0 con 0x5577985be070 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5577988cf0e0 con 0x5577985951b0 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985951b0 0x557798965800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46804/0 (socket says 172.21.15.6:46804) 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/795689269 learned_addr learned my addr 172.21.15.6:0/795689269 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:30.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985be070 0x5577989652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/795689269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985951b0 msgr2=0x557798965800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985951b0 0x557798965800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/795689269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985be070 msgr2=0x5577989652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985be070 0x5577989652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.941+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/795689269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557798629650 con 0x55779859d390 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0ccd7fa640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40e4880 tx=0x7f0cc40edbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5539fa235173cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0ccd7fa640 1 -- 172.21.15.6:0/4187787530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0cc40e7540 con 0x7f0cd0108420 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0cb67fc640 1 -- 172.21.15.6:0/795689269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40a9660 con 0x55779859d390 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0cb67fc640 1 -- 172.21.15.6:0/795689269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc40acb20 con 0x55779859d390 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.942+0000 7f0cb67fc640 1 -- 172.21.15.6:0/795689269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40ac780 con 0x55779859d390 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 -- 172.21.15.6:0/795689269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 msgr2=0x557798965d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8006010 tx=0x7f0cc8009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40e4880 tx=0x7f0cc40edbb0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 -- 172.21.15.6:0/795689269 shutdown_connections 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985951b0 0x557798965800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798965d40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/795689269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985be070 0x5577989652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 -- 172.21.15.6:0/795689269 >> 172.21.15.6:0/795689269 conn(0x5577985b2460 msgr2=0x5577989631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 -- 172.21.15.6:0/795689269 shutdown_connections 2024-09-21T08:02:30.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.943+0000 7f0cdcb79740 1 -- 172.21.15.6:0/795689269 wait complete. 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 -- start start 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 Processor -- start 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798970980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x55779897ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55779872c700 con 0x55779859d390 2024-09-21T08:02:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557798866160 con 0x5577985951b0 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557798973aa0 con 0x5577985be070 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.944+0000 7f0cdcb79740 10 client.0 _ll_register_callbacks cb 0x55779887f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46810/0 (socket says 172.21.15.6:46810) 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4158051326 learned_addr learned my addr 172.21.15.6:0/4158051326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccffff640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798970980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x55779897ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4158051326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 msgr2=0x55779897ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x55779897ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 msgr2=0x557798970980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798970980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 -- 172.21.15.6:0/4158051326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557798893c90 con 0x55779859d390 2024-09-21T08:02:30.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccffff640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798970980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x55779897ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40acfa0 tx=0x7f0cc40e48b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7d21824254386c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0caf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40eae60 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0cc40e4b90 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc40acb20 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0cc4021070 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.945+0000 7f0cdcb79740 10 client.15774 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55779897f830 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc40acb20 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0cc40981b0 con 0x55779859d390 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 10 client.15774 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 20 client.15774 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55779857c9f0 0x557798982b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 4 client.15774 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577988dddf0 con 0x55779857c9f0 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.946+0000 7f0ccffff640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55779857c9f0 0x557798982b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.947+0000 7f0ccffff640 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55779857c9f0 0x557798982b90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4d59ebfd5ff8e4e server_cookie=a046f037a1708823 in_seq=0 out_seq=0 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.947+0000 7f0caf7fe640 10 client.15774 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0caf7fe640 1 -- 172.21.15.6:0/4158051326 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577988dddf0 con 0x55779857c9f0 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0caf7fe640 10 client.15774 handle_command_reply: tid=0 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 client.15774 shutdown 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 msgr2=0x557798970ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40acfa0 tx=0x7f0cc40e48b0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 shutdown_connections 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55779857c9f0 0x557798982b90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x55779897ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55779859d390 0x557798970ec0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/4158051326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798970980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0caf7fe640 0 client.15774 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 >> 172.21.15.6:0/4158051326 conn(0x5577985b2460 msgr2=0x557798968450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 shutdown_connections 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 1 -- 172.21.15.6:0/4158051326 wait complete. 2024-09-21T08:02:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.948+0000 7f0cdcb79740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T08:02:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.962+0000 7f0cdcb79740 1 Processor -- start 2024-09-21T08:02:30.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.962+0000 7f0cdcb79740 1 -- start start 2024-09-21T08:02:30.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798971ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55779859d390 0x557798962760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b0fc0 con 0x5577985be070 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b3840 con 0x5577985951b0 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b1630 con 0x55779859d390 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46822/0 (socket says 172.21.15.6:46822) 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 -- 172.21.15.6:0/2666436771 learned_addr learned my addr 172.21.15.6:0/2666436771 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798971ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55779859d390 0x557798962760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 -- 172.21.15.6:0/2666436771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55779859d390 msgr2=0x557798962760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55779859d390 0x557798962760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 -- 172.21.15.6:0/2666436771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 msgr2=0x557798971ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798971ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.963+0000 7f0cd4ba2640 1 -- 172.21.15.6:0/2666436771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557798972d50 con 0x5577985be070 2024-09-21T08:02:30.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.964+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8003c90 tx=0x7f0cc8041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f96de3936e54f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.964+0000 7f0cb5ffb640 1 -- 172.21.15.6:0/2666436771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80305c0 con 0x5577985be070 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.964+0000 7f0cb5ffb640 1 -- 172.21.15.6:0/2666436771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc8036040 con 0x5577985be070 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.964+0000 7f0cb5ffb640 1 -- 172.21.15.6:0/2666436771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8052620 con 0x5577985be070 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2666436771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 msgr2=0x557798962ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8003c90 tx=0x7f0cc8041000 comp rx=0 tx=0).stop 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2666436771 shutdown_connections 2024-09-21T08:02:30.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55779859d390 0x557798962760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985be070 0x557798962ca0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2666436771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577985951b0 0x557798971ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2666436771 >> 172.21.15.6:0/2666436771 conn(0x5577985b2460 msgr2=0x557798966cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2666436771 shutdown_connections 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2666436771 wait complete. 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.965+0000 7f0cdcb79740 1 -- start start 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 Processor -- start 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55779859d390 0x5577989840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x5577989845f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b1d00 con 0x5577985951b0 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b3170 con 0x55779859d390 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01b23d0 con 0x5577985be070 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cdcb79740 10 client.0 _ll_register_callbacks cb 0x7f0cc8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46828/0 (socket says 172.21.15.6:46828) 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0ccffff640 1 -- 172.21.15.6:0/2999766587 learned_addr learned my addr 172.21.15.6:0/2999766587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55779859d390 0x5577989840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.966+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x5577989845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 -- 172.21.15.6:0/2999766587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 msgr2=0x5577989845f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x5577989845f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 -- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55779859d390 msgr2=0x5577989840b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55779859d390 0x5577989840b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 -- 172.21.15.6:0/2999766587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577989ec310 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0cd4ba2640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x5577989845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0005fd0 tx=0x7f0cc00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a8962ab596e05d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0caf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0027060 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0cc0010900 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc8036040 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0cc002e050 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0cdcb79740 10 client.15780 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.967+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5577989ed5d0 con 0x5577985951b0 2024-09-21T08:02:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc8036040 con 0x5577985951b0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0cc0021b60 con 0x5577985951b0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 10 client.15780 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 20 client.15780 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557798551da0 0x5577989efd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 4 client.15780 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577988d98a0 con 0x557798551da0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.968+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557798551da0 0x5577989efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0caf7fe640 10 client.15780 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0ccf7fe640 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557798551da0 0x5577989efd70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4de27f37ea93c4ad server_cookie=492d4e75563fde7a in_seq=0 out_seq=0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0caf7fe640 1 -- 172.21.15.6:0/2999766587 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577988d98a0 con 0x557798551da0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0caf7fe640 10 client.15780 handle_command_reply: tid=0 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 client.15780 shutdown 2024-09-21T08:02:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 msgr2=0x557798983b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0005fd0 tx=0x7f0cc00118d0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 shutdown_connections 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557798551da0 0x5577989efd70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577985be070 0x5577989845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55779859d390 0x5577989840b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 --2- 172.21.15.6:0/2999766587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577985951b0 0x557798983b70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 >> 172.21.15.6:0/2999766587 conn(0x5577985b2460 msgr2=0x557798966cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0caf7fe640 0 client.15780 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 shutdown_connections 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.969+0000 7f0cdcb79740 1 -- 172.21.15.6:0/2999766587 wait complete. 2024-09-21T08:02:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cdcb79740 20 client.15780 trim_cache size 0 max 16384 2024-09-21T08:02:30.976 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:02:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 msgr2=0x7f0cb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8006010 tx=0x7f0cc8009360 comp rx=0 tx=0).stop 2024-09-21T08:02:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 msgr2=0x7f0cd01105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d740 tx=0x7f0cc400dc00 comp rx=0 tx=0).stop 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 shutdown_connections 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd0108d70 0x7f0cd0110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd0108420 0x7f0cd01105c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 --2- 172.21.15.6:0/4187787530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0102ae0 0x7f0cd0110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 >> 172.21.15.6:0/4187787530 conn(0x7f0cd0079770 msgr2=0x7f0cd0106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 shutdown_connections 2024-09-21T08:02:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:30.970+0000 7f0cd6605640 1 -- 172.21.15.6:0/4187787530 wait complete. 2024-09-21T08:02:31.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:31 smithi006 ceph-mon[30970]: pgmap v387: 129 pgs: 129 active+clean; 848 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 44 MiB/s wr, 25 op/s 2024-09-21T08:02:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:31 smithi119 ceph-mon[33564]: pgmap v387: 129 pgs: 129 active+clean; 848 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 44 MiB/s wr, 25 op/s 2024-09-21T08:02:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:31 smithi145 ceph-mon[34049]: pgmap v387: 129 pgs: 129 active+clean; 848 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 44 MiB/s wr, 25 op/s 2024-09-21T08:02:32.661 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:02:32.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:33.309 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:33 smithi006 ceph-mon[30970]: pgmap v388: 129 pgs: 129 active+clean; 890 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 -- 172.21.15.6:0/2542860381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8001083d0 msgr2=0x7fe8001087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 --2- 172.21.15.6:0/2542860381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8001083d0 0x7fe8001087e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009900 tx=0x7fe7f002a410 comp rx=0 tx=0).stop 2024-09-21T08:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 -- 172.21.15.6:0/2542860381 shutdown_connections 2024-09-21T08:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 --2- 172.21.15.6:0/2542860381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 0x7fe80010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 --2- 172.21.15.6:0/2542860381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8001083d0 0x7fe8001087e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 --2- 172.21.15.6:0/2542860381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe800102ae0 0x7fe800102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 -- 172.21.15.6:0/2542860381 >> 172.21.15.6:0/2542860381 conn(0x7fe800079760 msgr2=0x7fe800079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 -- 172.21.15.6:0/2542860381 shutdown_connections 2024-09-21T08:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.403+0000 7fe807690640 1 -- 172.21.15.6:0/2542860381 wait complete. 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.404+0000 7fe807690640 1 Processor -- start 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.404+0000 7fe807690640 1 -- start start 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8001083d0 0x7fe80019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 0x7fe80019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe800112840 con 0x7fe800102ae0 2024-09-21T08:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001126c0 con 0x7fe8001083d0 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe807690640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001129c0 con 0x7fe800108d20 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46848/0 (socket says 172.21.15.6:46848) 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 -- 172.21.15.6:0/4185140726 learned_addr learned my addr 172.21.15.6:0/4185140726 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe805c2d640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 0x7fe80019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe804c2b640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8001083d0 0x7fe80019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 -- 172.21.15.6:0/4185140726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 msgr2=0x7fe80019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 0x7fe80019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 -- 172.21.15.6:0/4185140726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8001083d0 msgr2=0x7fe80019b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8001083d0 0x7fe80019b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 -- 172.21.15.6:0/4185140726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8001a64a0 con 0x7fe800102ae0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe80542c640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9f0 tx=0x7fe7fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.405+0000 7fe7f67fc640 1 -- 172.21.15.6:0/4185140726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00cd80 con 0x7fe800102ae0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.406+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe800199060 con 0x7fe800102ae0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.406+0000 7fe7f67fc640 1 -- 172.21.15.6:0/4185140726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7fc0108c0 con 0x7fe800102ae0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.406+0000 7fe7f67fc640 1 -- 172.21.15.6:0/4185140726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0187c0 con 0x7fe800102ae0 2024-09-21T08:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.406+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8001995c0 con 0x7fe800102ae0 2024-09-21T08:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.408+0000 7fe80dc04740 1 Processor -- start 2024-09-21T08:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.408+0000 7fe80dc04740 1 -- start start 2024-09-21T08:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.408+0000 7fe7f67fc640 1 -- 172.21.15.6:0/4185140726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe7fc010430 con 0x7fe800102ae0 2024-09-21T08:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 0x5582aad00430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad00eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5582aac76e60 con 0x5582aa930490 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5582aac66290 con 0x5582aa959350 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80dc04740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5582aac6a0a0 con 0x5582aa938670 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80542c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80542c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46860/0 (socket says 172.21.15.6:46860) 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80542c640 1 -- 172.21.15.6:0/1324046547 learned_addr learned my addr 172.21.15.6:0/1324046547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 0x5582aad00430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe804c2b640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad00eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 -- 172.21.15.6:0/1324046547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 msgr2=0x5582aad00eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad00eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 -- 172.21.15.6:0/1324046547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 msgr2=0x5582aad00970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe805c2d640 1 -- 172.21.15.6:0/1324046547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582aa9c4930 con 0x5582aa959350 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.409+0000 7fe80542c640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe7f67fc640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 0x7fe7ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe805c2d640 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 0x5582aad00430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009f30 tx=0x7fe7f8010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e98a86616a796 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe80542c640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 0x7fe7ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/1324046547 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8016070 con 0x5582aa959350 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe7f67fc640 1 -- 172.21.15.6:0/4185140726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe7fc0e7dc0 con 0x7fe800102ae0 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/1324046547 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f8004d20 con 0x5582aa959350 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.410+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/1324046547 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80126b0 con 0x5582aa959350 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- 172.21.15.6:0/1324046547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 msgr2=0x5582aad00430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 0x5582aad00430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009f30 tx=0x7fe7f8010800 comp rx=0 tx=0).stop 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80542c640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 0x7fe7ec0b8bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9c0 tx=0x7fe7fc0eb910 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- 172.21.15.6:0/1324046547 shutdown_connections 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad00eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa930490 0x5582aad00970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 --2- 172.21.15.6:0/1324046547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa959350 0x5582aad00430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- 172.21.15.6:0/1324046547 >> 172.21.15.6:0/1324046547 conn(0x5582aa94d740 msgr2=0x5582aacfe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- 172.21.15.6:0/1324046547 shutdown_connections 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- 172.21.15.6:0/1324046547 wait complete. 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 -- start start 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.411+0000 7fe80dc04740 1 Processor -- start 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad0c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 0x5582aad17f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5582aaac7890 con 0x5582aa938670 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5582aac00d40 con 0x5582aa930490 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5582aad0ec10 con 0x5582aa959350 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe80dc04740 10 client.0 _ll_register_callbacks cb 0x5582aac64c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46874/0 (socket says 172.21.15.6:46874) 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 -- 172.21.15.6:0/2654172894 learned_addr learned my addr 172.21.15.6:0/2654172894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad0c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 0x5582aad17f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 -- 172.21.15.6:0/2654172894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 msgr2=0x5582aad17f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 0x5582aad17f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 -- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 msgr2=0x5582aad0c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad0c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.412+0000 7fe804c2b640 1 -- 172.21.15.6:0/2654172894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582aad18570 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 0x5582aad17f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00057c0 tx=0x7fe7f0031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13ed2ffc2257589 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0035050 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe7f0004240 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7f8004d20 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe7f0052050 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe80dc04740 10 client.15792 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5582aad1aed0 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.413+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f8004d20 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe7f004d030 con 0x5582aa938670 2024-09-21T08:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 10 client.15792 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 20 client.15792 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa917cd0 0x5582aad1e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 4 client.15792 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582aac78db0 con 0x5582aa917cd0 2024-09-21T08:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa917cd0 0x5582aad1e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe7e8ff9640 10 client.15792 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.414+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa917cd0 0x5582aad1e450 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8092bfa242b5400 server_cookie=d3dc6758069b513e in_seq=0 out_seq=0 2024-09-21T08:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2654172894 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582aac78db0 con 0x5582aa917cd0 2024-09-21T08:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe7e8ff9640 10 client.15792 handle_command_reply: tid=0 2024-09-21T08:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 client.15792 shutdown 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 msgr2=0x5582aad0c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00057c0 tx=0x7fe7f0031630 comp rx=0 tx=0).stop 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 shutdown_connections 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa917cd0 0x5582aad1e450 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa959350 0x5582aad17f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa938670 0x5582aad0c690 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe7e8ff9640 0 client.15792 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2654172894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad0c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.415+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 >> 172.21.15.6:0/2654172894 conn(0x5582aa94d740 msgr2=0x5582aad03610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.416+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 shutdown_connections 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.416+0000 7fe80dc04740 1 -- 172.21.15.6:0/2654172894 wait complete. 2024-09-21T08:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.416+0000 7fe80dc04740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.433+0000 7fe80dc04740 1 Processor -- start 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.433+0000 7fe80dc04740 1 -- start start 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad01b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad05510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001acbc0 con 0x5582aa917cd0 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001af440 con 0x5582aa930490 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe80dc04740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001ad230 con 0x5582aa938670 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46890/0 (socket says 172.21.15.6:46890) 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 -- 172.21.15.6:0/2477593251 learned_addr learned my addr 172.21.15.6:0/2477593251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad05510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad01b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 -- 172.21.15.6:0/2477593251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 msgr2=0x5582aad05510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad05510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 -- 172.21.15.6:0/2477593251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 msgr2=0x5582aad01b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad01b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 -- 172.21.15.6:0/2477593251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582aad02720 con 0x5582aa917cd0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009a80 tx=0x7fe7f8009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fec85e982e63883 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe7eaffd640 1 -- 172.21.15.6:0/2477593251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8037070 con 0x5582aa917cd0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe7eaffd640 1 -- 172.21.15.6:0/2477593251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f8005660 con 0x5582aa917cd0 2024-09-21T08:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.434+0000 7fe7eaffd640 1 -- 172.21.15.6:0/2477593251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8016040 con 0x5582aa917cd0 2024-09-21T08:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 -- 172.21.15.6:0/2477593251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 msgr2=0x5582aad0c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009a80 tx=0x7fe7f8009600 comp rx=0 tx=0).stop 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 -- 172.21.15.6:0/2477593251 shutdown_connections 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa938670 0x5582aad05510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa930490 0x5582aad01b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2477593251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad0c740 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 -- 172.21.15.6:0/2477593251 >> 172.21.15.6:0/2477593251 conn(0x5582aa94d740 msgr2=0x5582aad01460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 -- 172.21.15.6:0/2477593251 shutdown_connections 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.435+0000 7fe80dc04740 1 -- 172.21.15.6:0/2477593251 wait complete. 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 -- start start 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 Processor -- start 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 0x5582aad10b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa938670 0x5582aad87e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001ad900 con 0x5582aa917cd0 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001aed70 con 0x5582aa938670 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001adfd0 con 0x5582aa930490 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.436+0000 7fe80dc04740 10 client.0 _ll_register_callbacks cb 0x7fe7f0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46898/0 (socket says 172.21.15.6:46898) 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 -- 172.21.15.6:0/2531634520 learned_addr learned my addr 172.21.15.6:0/2531634520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa938670 0x5582aad87e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 0x5582aad10b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 -- 172.21.15.6:0/2531634520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 msgr2=0x5582aad10b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 0x5582aad10b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 -- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa938670 msgr2=0x5582aad87e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa938670 0x5582aad87e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 -- 172.21.15.6:0/2531634520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582aad883a0 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 0x5582aad10b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe805c2d640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005fa0 tx=0x7fe7f8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fe6e482dfb6315 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8016070 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe7f8005150 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7f8005660 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe7f8046050 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.437+0000 7fe80dc04740 10 client.15798 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5582aad89660 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f8005660 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe7f800f040 con 0x5582aa917cd0 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 10 client.15798 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 20 client.15798 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa959350 0x5582aad8bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 4 client.15798 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5582aac74860 con 0x5582aa959350 2024-09-21T08:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.438+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa959350 0x5582aad8bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.439+0000 7fe7e8ff9640 10 client.15798 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.439+0000 7fe804c2b640 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa959350 0x5582aad8bb00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86cd9179a8df8f70 server_cookie=917c593baf9d9e79 in_seq=0 out_seq=0 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe7e8ff9640 1 -- 172.21.15.6:0/2531634520 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5582aac74860 con 0x5582aa959350 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe7e8ff9640 10 client.15798 handle_command_reply: tid=0 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 client.15798 shutdown 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 msgr2=0x5582aad105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005fa0 tx=0x7fe7f8005f10 comp rx=0 tx=0).stop 2024-09-21T08:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 shutdown_connections 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5582aa959350 0x5582aad8bb00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5582aa930490 0x5582aad10b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582aa938670 0x5582aad87e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 --2- 172.21.15.6:0/2531634520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582aa917cd0 0x5582aad105c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 >> 172.21.15.6:0/2531634520 conn(0x5582aa94d740 msgr2=0x5582aad01460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe7e8ff9640 0 client.15798 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.440+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 shutdown_connections 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe80dc04740 1 -- 172.21.15.6:0/2531634520 wait complete. 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe80dc04740 20 client.15798 trim_cache size 0 max 16384 2024-09-21T08:02:33.447 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:02:33.448 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:02:33.448 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "fe4e48e3-38b3-4933-b895-bdb23123142a", 2024-09-21T08:02:33.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:02:33.448 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 msgr2=0x7fe7ec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 0x7fe7ec0b8bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9c0 tx=0x7fe7fc0eb910 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 msgr2=0x7fe80019b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9f0 tx=0x7fe7fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 shutdown_connections 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7ec0b66b0 0x7fe7ec0b8bc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe800108d20 0x7fe80019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8001083d0 0x7fe80019b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 --2- 172.21.15.6:0/4185140726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe800102ae0 0x7fe80019b210 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.441+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 >> 172.21.15.6:0/4185140726 conn(0x7fe800079760 msgr2=0x7fe8001044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.442+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 shutdown_connections 2024-09-21T08:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:33.442+0000 7fe807690640 1 -- 172.21.15.6:0/4185140726 wait complete. 2024-09-21T08:02:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:33 smithi119 ceph-mon[33564]: pgmap v388: 129 pgs: 129 active+clean; 890 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:02:33.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:33 smithi145 ceph-mon[34049]: pgmap v388: 129 pgs: 129 active+clean; 890 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:02:34.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:34 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:02:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:34 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:34 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:02:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:34 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:34 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:02:34.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:34 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:34 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:02:34.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:34 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:34 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:02:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:34 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:34 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:02:34.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:34 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 -- 172.21.15.6:0/4110686094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4102aa0 msgr2=0x7f5ce4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/4110686094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4102eb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009900 tx=0x7f5cd402a410 comp rx=0 tx=0).stop 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 -- 172.21.15.6:0/4110686094 shutdown_connections 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/4110686094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce41083e0 0x7f5ce41087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/4110686094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4108d30 0x7f5ce410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/4110686094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4102eb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 -- 172.21.15.6:0/4110686094 >> 172.21.15.6:0/4110686094 conn(0x7f5ce4079750 msgr2=0x7f5ce4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 -- 172.21.15.6:0/4110686094 shutdown_connections 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.894+0000 7f5ce9c72640 1 -- 172.21.15.6:0/4110686094 wait complete. 2024-09-21T08:02:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.895+0000 7f5ce9c72640 1 Processor -- start 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.895+0000 7f5ce9c72640 1 -- start start 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.895+0000 7f5ce9c72640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce4108d30 0x7f5ce4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41128a0 con 0x7f5ce41083e0 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4112720 con 0x7f5ce4102aa0 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4112a20 con 0x7f5ce4108d30 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46910/0 (socket says 172.21.15.6:46910) 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 -- 172.21.15.6:0/2599046614 learned_addr learned my addr 172.21.15.6:0/2599046614 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce4108d30 0x7f5ce4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 -- 172.21.15.6:0/2599046614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce4108d30 msgr2=0x7f5ce4199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce4108d30 0x7f5ce4199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 -- 172.21.15.6:0/2599046614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4102aa0 msgr2=0x7f5ce4199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 -- 172.21.15.6:0/2599046614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce41a8710 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800d750 tx=0x7f5cd800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce0ff9640 1 -- 172.21.15.6:0/2599046614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8017070 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce0ff9640 1 -- 172.21.15.6:0/2599046614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cd80054b0 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.896+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce41a8a00 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.897+0000 7f5ce0ff9640 1 -- 172.21.15.6:0/2599046614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8004bc0 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.897+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce41a8ef0 con 0x7f5ce41083e0 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.899+0000 7f5cf01e6740 1 Processor -- start 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.899+0000 7f5cf01e6740 1 -- start start 2024-09-21T08:02:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.899+0000 7f5ce0ff9640 1 -- 172.21.15.6:0/2599046614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5cd8009c30 con 0x7f5ce41083e0 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ea31b0 0x55c7a4273b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a42740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c7a41e9e50 con 0x55c7a3ecc070 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c7a41d9280 con 0x55c7a3ea31b0 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c7a41dd090 con 0x55c7a3eab390 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46926/0 (socket says 172.21.15.6:46926) 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 -- 172.21.15.6:0/777546255 learned_addr learned my addr 172.21.15.6:0/777546255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ea31b0 0x55c7a4273b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a42740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 -- 172.21.15.6:0/777546255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 msgr2=0x55c7a42740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a42740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 -- 172.21.15.6:0/777546255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ea31b0 msgr2=0x55c7a4273b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ea31b0 0x55c7a4273b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 -- 172.21.15.6:0/777546255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a3f37650 con 0x55c7a3ecc070 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a42740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc008dc0 tx=0x7f5cdc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c1ecf3a650c982 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.900+0000 7f5ce0ff9640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 0x7f5ccc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/777546255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc014070 con 0x55c7a3ecc070 2024-09-21T08:02:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/777546255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cdc004020 con 0x55c7a3ecc070 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/777546255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc010690 con 0x55c7a3ecc070 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 0x7f5ccc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5ce0ff9640 1 -- 172.21.15.6:0/2599046614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5cd80e7470 con 0x7f5ce41083e0 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 0x7f5ccc0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4104900 tx=0x7f5cd40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5cf01e6740 1 -- 172.21.15.6:0/777546255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 msgr2=0x55c7a4273650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.901+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc008dc0 tx=0x7f5cdc00e720 comp rx=0 tx=0).stop 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 -- 172.21.15.6:0/777546255 shutdown_connections 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a42740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ea31b0 0x55c7a4273b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/777546255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a4273650 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 -- 172.21.15.6:0/777546255 >> 172.21.15.6:0/777546255 conn(0x55c7a3ec0460 msgr2=0x55c7a4271540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 -- 172.21.15.6:0/777546255 shutdown_connections 2024-09-21T08:02:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 -- 172.21.15.6:0/777546255 wait complete. 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 -- start start 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.902+0000 7f5cf01e6740 1 Processor -- start 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a427ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c7a403a700 con 0x55c7a3ecc070 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c7a4174110 con 0x55c7a3eab390 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c7a4281e30 con 0x55c7a3ea31b0 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cf01e6740 10 client.0 _ll_register_callbacks cb 0x55c7a418d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46930/0 (socket says 172.21.15.6:46930) 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1520305214 learned_addr learned my addr 172.21.15.6:0/1520305214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a427ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1520305214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 msgr2=0x55c7a427ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a427ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 msgr2=0x55c7a427f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1520305214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7a41a1c40 con 0x55c7a3ecc070 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a427ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc005af0 tx=0x7f5cdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bccc2b2d0eba22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.903+0000 7f5cc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc027060 con 0x55c7a3ecc070 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5cdc003e00 con 0x55c7a3ecc070 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cdc004020 con 0x55c7a3ecc070 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc02e050 con 0x55c7a3ecc070 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 10 client.15810 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7a428dba0 con 0x55c7a3ecc070 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cdc004020 con 0x55c7a3ecc070 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5cdc0185c0 con 0x55c7a3ecc070 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 10 client.15810 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 20 client.15810 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e8a9f0 0x55c7a4290fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 4 client.15810 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.904+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7a41ebda0 con 0x55c7a3e8a9f0 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.905+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e8a9f0 0x55c7a4290fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.905+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e8a9f0 0x55c7a4290fb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c64004e8111f99e server_cookie=38550192c8616a93 in_seq=0 out_seq=0 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.905+0000 7f5cc2ffd640 10 client.15810 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/1520305214 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7a41ebda0 con 0x55c7a3e8a9f0 2024-09-21T08:02:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cc2ffd640 10 client.15810 handle_command_reply: tid=0 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 client.15810 shutdown 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 msgr2=0x55c7a428b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc005af0 tx=0x7f5cdc0046b0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 shutdown_connections 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e8a9f0 0x55c7a4290fb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a428b120 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cc2ffd640 0 client.15810 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1520305214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a427ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 >> 172.21.15.6:0/1520305214 conn(0x55c7a3ec0460 msgr2=0x55c7a4276830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 shutdown_connections 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1520305214 wait complete. 2024-09-21T08:02:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.906+0000 7f5cf01e6740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T08:02:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 Processor -- start 2024-09-21T08:02:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 -- start start 2024-09-21T08:02:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a4276e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b0f90 con 0x55c7a3ecc070 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b3810 con 0x55c7a3eab390 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b1600 con 0x55c7a3ea31b0 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46934/0 (socket says 172.21.15.6:46934) 2024-09-21T08:02:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1032476710 learned_addr learned my addr 172.21.15.6:0/1032476710 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:34.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1032476710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 msgr2=0x55c7a4276e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a4276e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1032476710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 msgr2=0x55c7a427eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.925+0000 7f5ce3fff640 1 -- 172.21.15.6:0/1032476710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a427dcf0 con 0x55c7a3ecc070 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.926+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc008910 tx=0x7f5cdc008c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9638c8987c0586 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.926+0000 7f5cc97fa640 1 -- 172.21.15.6:0/1032476710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc037070 con 0x55c7a3ecc070 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.926+0000 7f5cc97fa640 1 -- 172.21.15.6:0/1032476710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cdc018d30 con 0x55c7a3ecc070 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.926+0000 7f5cc97fa640 1 -- 172.21.15.6:0/1032476710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc027070 con 0x55c7a3ecc070 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1032476710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 msgr2=0x55c7a427f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc008910 tx=0x7f5cdc008c50 comp rx=0 tx=0).stop 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1032476710 shutdown_connections 2024-09-21T08:02:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ecc070 0x55c7a427f080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3eab390 0x55c7a427eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/1032476710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3ea31b0 0x55c7a4276e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1032476710 >> 172.21.15.6:0/1032476710 conn(0x55c7a3ec0460 msgr2=0x55c7a4276750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1032476710 shutdown_connections 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- 172.21.15.6:0/1032476710 wait complete. 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.927+0000 7f5cf01e6740 1 -- start start 2024-09-21T08:02:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 Processor -- start 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a4291cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 0x55c7a4292210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b1cd0 con 0x55c7a3ea31b0 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b3140 con 0x55c7a3ecc070 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41b23a0 con 0x55c7a3eab390 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5cf01e6740 10 client.0 _ll_register_callbacks cb 0x7f5cd4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46942/0 (socket says 172.21.15.6:46942) 2024-09-21T08:02:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 -- 172.21.15.6:0/3355152580 learned_addr learned my addr 172.21.15.6:0/3355152580 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a4291cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 0x55c7a4292210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 -- 172.21.15.6:0/3355152580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 msgr2=0x55c7a4291cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a4291cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 -- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 msgr2=0x55c7a4292210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.928+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 0x55c7a4292210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5ce37fe640 1 -- 172.21.15.6:0/3355152580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7a42929a0 con 0x55c7a3ea31b0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5ce3fff640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 0x55c7a4292210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5ce37fe640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5cd402a930 tx=0x7f5cd402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c06e74b025b9143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4057060 con 0x55c7a3ea31b0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5cd4004310 con 0x55c7a3ea31b0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cdc018d30 con 0x55c7a3ea31b0 2024-09-21T08:02:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5cd4035040 con 0x55c7a3ea31b0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cf01e6740 10 client.15816 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7a42fb6d0 con 0x55c7a3ea31b0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.929+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cdc018d30 con 0x55c7a3ea31b0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5cd4044040 con 0x55c7a3ea31b0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 10 client.15816 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 20 client.15816 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e5fda0 0x55c7a42fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 4 client.15816 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c7a41e7850 con 0x55c7a3e5fda0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e5fda0 0x55c7a42fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5ce2ffd640 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e5fda0 0x55c7a42fde70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f5ae5c99411be3 server_cookie=a87a5d3851155431 in_seq=0 out_seq=0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.930+0000 7f5cc2ffd640 10 client.15816 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cc2ffd640 1 -- 172.21.15.6:0/3355152580 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55c7a41e7850 con 0x55c7a3e5fda0 2024-09-21T08:02:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cc2ffd640 10 client.15816 handle_command_reply: tid=0 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 client.15816 shutdown 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 msgr2=0x55c7a42947e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5cd402a930 tx=0x7f5cd402a410 comp rx=0 tx=0).stop 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 shutdown_connections 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7a3e5fda0 0x55c7a42fde70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7a3eab390 0x55c7a4291cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7a3ecc070 0x55c7a4292210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 --2- 172.21.15.6:0/3355152580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a3ea31b0 0x55c7a42947e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 >> 172.21.15.6:0/3355152580 conn(0x55c7a3ec0460 msgr2=0x55c7a427eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cc2ffd640 0 client.15816 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 shutdown_connections 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 1 -- 172.21.15.6:0/3355152580 wait complete. 2024-09-21T08:02:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.931+0000 7f5cf01e6740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "fe4e48e3-38b3-4933-b895-bdb23123142a", 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:34.938 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:02:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:34.940 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 msgr2=0x7f5ccc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 0x7f5ccc0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4104900 tx=0x7f5cd40058d0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 msgr2=0x7f5ce41995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800d750 tx=0x7f5cd800dc10 comp rx=0 tx=0).stop 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 shutdown_connections 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5ccc0b6680 0x7f5ccc0b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce4108d30 0x7f5ce4199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41083e0 0x7f5ce41995a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 --2- 172.21.15.6:0/2599046614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce4102aa0 0x7f5ce4199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 >> 172.21.15.6:0/2599046614 conn(0x7f5ce4079750 msgr2=0x7f5ce4106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 shutdown_connections 2024-09-21T08:02:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:34.932+0000 7f5ce9c72640 1 -- 172.21.15.6:0/2599046614 wait complete. 2024-09-21T08:02:35.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:35 smithi119 ceph-mon[33564]: pgmap v389: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 25 op/s 2024-09-21T08:02:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:35 smithi145 ceph-mon[34049]: pgmap v389: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 25 op/s 2024-09-21T08:02:35.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:35 smithi006 ceph-mon[30970]: pgmap v389: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 25 op/s 2024-09-21T08:02:35.738 INFO:tasks.cephfs.filesystem:scrub status for tag:fe4e48e3-38b3-4933-b895-bdb23123142a - {'path': '/', 'tag': 'fe4e48e3-38b3-4933-b895-bdb23123142a', 'options': 'recursive,force'} 2024-09-21T08:02:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:37 smithi119 ceph-mon[33564]: pgmap v390: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-09-21T08:02:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:37 smithi145 ceph-mon[34049]: pgmap v390: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-09-21T08:02:37.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:37 smithi006 ceph-mon[30970]: pgmap v390: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-09-21T08:02:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:39 smithi119 ceph-mon[33564]: pgmap v391: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 17 op/s 2024-09-21T08:02:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:39 smithi145 ceph-mon[34049]: pgmap v391: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 17 op/s 2024-09-21T08:02:39.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:39 smithi006 ceph-mon[30970]: pgmap v391: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 17 op/s 2024-09-21T08:02:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:41 smithi119 ceph-mon[33564]: pgmap v392: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T08:02:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:41 smithi145 ceph-mon[34049]: pgmap v392: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T08:02:41.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:41 smithi006 ceph-mon[30970]: pgmap v392: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T08:02:42.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:42.706 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:43.339 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:43 smithi006 ceph-mon[30970]: pgmap v393: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.6 MiB/s wr, 11 op/s 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.326+0000 7f24c8c5a640 1 -- 172.21.15.6:0/2944482778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4103b70 msgr2=0x7f24c4103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.326+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/2944482778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4103b70 0x7f24c4103f80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009900 tx=0x7f24ac02a410 comp rx=0 tx=0).stop 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 -- 172.21.15.6:0/2944482778 shutdown_connections 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/2944482778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c41094b0 0x7f24c41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/2944482778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c4109e00 0x7f24c4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/2944482778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4103b70 0x7f24c4103f80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 -- 172.21.15.6:0/2944482778 >> 172.21.15.6:0/2944482778 conn(0x7f24c40ff5e0 msgr2=0x7f24c4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 -- 172.21.15.6:0/2944482778 shutdown_connections 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.327+0000 7f24c8c5a640 1 -- 172.21.15.6:0/2944482778 wait complete. 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 Processor -- start 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 -- start start 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c4103b70 0x7f24c419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c41094b0 0x7f24c419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f24c41139b0 con 0x7f24c4109e00 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4113830 con 0x7f24c41094b0 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c8c5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4113b30 con 0x7f24c4103b70 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57868/0 (socket says 172.21.15.6:57868) 2024-09-21T08:02:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c2d9d640 1 -- 172.21.15.6:0/3510673115 learned_addr learned my addr 172.21.15.6:0/3510673115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c1d9b640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c41094b0 0x7f24c419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.328+0000 7f24c259c640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c4103b70 0x7f24c419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 -- 172.21.15.6:0/3510673115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c4103b70 msgr2=0x7f24c419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c4103b70 0x7f24c419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 -- 172.21.15.6:0/3510673115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c41094b0 msgr2=0x7f24c419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c41094b0 0x7f24c419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 -- 172.21.15.6:0/3510673115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c41a0390 con 0x7f24c4109e00 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c2d9d640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00eaa0 tx=0x7f24bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc004d20 con 0x7f24c4109e00 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c41a0680 con 0x7f24c4109e00 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24bc005020 con 0x7f24c4109e00 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0116d0 con 0x7f24c4109e00 2024-09-21T08:02:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.329+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c41a6de0 con 0x7f24c4109e00 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.331+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c4103f80 con 0x7f24c4109e00 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.332+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f24bc0051d0 con 0x7f24c4109e00 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.333+0000 7f24bb7fe640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 0x7f24b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.333+0000 7f24c259c640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 0x7f24b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.333+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f24bc0e7c30 con 0x7f24c4109e00 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.334+0000 7f24c259c640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 0x7f24b00b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0057c0 tx=0x7f24ac0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.337+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24bc016030 con 0x7f24c4109e00 2024-09-21T08:02:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.571+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24c410bc30 con 0x7f24c4109e00 2024-09-21T08:02:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.572+0000 7f24bb7fe640 1 -- 172.21.15.6:0/3510673115 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f24bc0adda0 con 0x7f24c4109e00 2024-09-21T08:02:43.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:02:43.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:02:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 msgr2=0x7f24b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 0x7f24b00b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0057c0 tx=0x7f24ac0058d0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 msgr2=0x7f24c419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00eaa0 tx=0x7f24bc00eea0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 shutdown_connections 2024-09-21T08:02:43.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24b00b6680 0x7f24b00b8b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c4109e00 0x7f24c419fc60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24c41094b0 0x7f24c419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 --2- 172.21.15.6:0/3510673115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24c4103b70 0x7f24c419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 >> 172.21.15.6:0/3510673115 conn(0x7f24c40ff5e0 msgr2=0x7f24c4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 shutdown_connections 2024-09-21T08:02:43.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:43.575+0000 7f24c8c5a640 1 -- 172.21.15.6:0/3510673115 wait complete. 2024-09-21T08:02:43.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:43 smithi119 ceph-mon[33564]: pgmap v393: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.6 MiB/s wr, 11 op/s 2024-09-21T08:02:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:43 smithi145 ceph-mon[34049]: pgmap v393: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.6 MiB/s wr, 11 op/s 2024-09-21T08:02:44.216 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 57db5398 --release --await' 2024-09-21T08:02:44.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 57db5398 --release --await 2024-09-21T08:02:44.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:44 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3510673115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:44.485 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:02:44.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:44 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3510673115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:44 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3510673115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 -- 172.21.15.6:0/1638591172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4102240 msgr2=0x7f14b4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 --2- 172.21.15.6:0/1638591172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4102240 0x7f14b4102650 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009900 tx=0x7f14b002a410 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 -- 172.21.15.6:0/1638591172 shutdown_connections 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 --2- 172.21.15.6:0/1638591172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b41084d0 0x7f14b410ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 --2- 172.21.15.6:0/1638591172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b4107b80 0x7f14b4107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 --2- 172.21.15.6:0/1638591172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4102240 0x7f14b4102650 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 -- 172.21.15.6:0/1638591172 >> 172.21.15.6:0/1638591172 conn(0x7f14b4079f90 msgr2=0x7f14b407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 -- 172.21.15.6:0/1638591172 shutdown_connections 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 -- 172.21.15.6:0/1638591172 wait complete. 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.973+0000 7f14bbc38640 1 Processor -- start 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 -- start start 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b4102240 0x7f14b419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b41084d0 0x7f14b419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41139a0 con 0x7f14b4107b80 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14b4113820 con 0x7f14b41084d0 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14bbc38640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14b4113b20 con 0x7f14b4102240 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57894/0 (socket says 172.21.15.6:57894) 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 -- 172.21.15.6:0/2428626358 learned_addr learned my addr 172.21.15.6:0/2428626358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b41084d0 0x7f14b419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b99d4640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b4102240 0x7f14b419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 -- 172.21.15.6:0/2428626358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b4102240 msgr2=0x7f14b419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b4102240 0x7f14b419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 -- 172.21.15.6:0/2428626358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b41084d0 msgr2=0x7f14b419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b41084d0 0x7f14b419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.974+0000 7f14b91d3640 1 -- 172.21.15.6:0/2428626358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b41a03e0 con 0x7f14b4107b80 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c970 tx=0x7f14a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14aaffd640 1 -- 172.21.15.6:0/2428626358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4007bb0 con 0x7f14b4107b80 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14aaffd640 1 -- 172.21.15.6:0/2428626358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14a4007d50 con 0x7f14b4107b80 2024-09-21T08:02:45.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14aaffd640 1 -- 172.21.15.6:0/2428626358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004da0 con 0x7f14b4107b80 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b41a06d0 con 0x7f14b4107b80 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.975+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b41a6e30 con 0x7f14b4107b80 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.977+0000 7f14aaffd640 1 -- 172.21.15.6:0/2428626358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f14a4004f80 con 0x7f14b4107b80 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 Processor -- start 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 -- start start 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034ea9520 0x55a03524f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 0x55a03524ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a03513adc0 con 0x55a034e80660 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a0351c71f0 con 0x55a034e88840 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14c21ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a0351b6620 con 0x55a034ea9520 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14b99d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14b99d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57906/0 (socket says 172.21.15.6:57906) 2024-09-21T08:02:45.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.978+0000 7f14b99d4640 1 -- 172.21.15.6:0/689630841 learned_addr learned my addr 172.21.15.6:0/689630841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034ea9520 0x55a03524f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b91d3640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 0x55a03524ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 -- 172.21.15.6:0/689630841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034ea9520 msgr2=0x55a03524f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034ea9520 0x55a03524f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 -- 172.21.15.6:0/689630841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 msgr2=0x55a03524ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14aaffd640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 0x7f14a00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 0x55a03524ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 -- 172.21.15.6:0/689630841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03517efd0 con 0x55a034e80660 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b91d3640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 0x55a03524ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 0x7f14a00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14b99d4640 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f14b002a930 tx=0x7f14b0031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ec0aba41b8de79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f14aaffd640 1 -- 172.21.15.6:0/2428626358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f14a40e7710 con 0x7f14b4107b80 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f149ffff640 1 -- 172.21.15.6:0/689630841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0035030 con 0x55a034e80660 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f149ffff640 1 -- 172.21.15.6:0/689630841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14b0040070 con 0x55a034e80660 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.979+0000 7f149ffff640 1 -- 172.21.15.6:0/689630841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0003a10 con 0x55a034e80660 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 -- 172.21.15.6:0/689630841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 msgr2=0x55a03524fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f14b002a930 tx=0x7f14b0031dc0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 0x7f14a00b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005fd0 tx=0x7f14ac009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 -- 172.21.15.6:0/689630841 shutdown_connections 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e88840 0x55a03524ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e80660 0x55a03524fa50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 --2- 172.21.15.6:0/689630841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034ea9520 0x55a03524f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 -- 172.21.15.6:0/689630841 >> 172.21.15.6:0/689630841 conn(0x55a034e9d910 msgr2=0x55a03524d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 -- 172.21.15.6:0/689630841 shutdown_connections 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.980+0000 7f14c21ac740 1 -- 172.21.15.6:0/689630841 wait complete. 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 -- start start 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 Processor -- start 2024-09-21T08:02:45.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e80660 0x55a03525abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 0x55a035266e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a035151300 con 0x55a034e88840 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a0351ba430 con 0x55a034ea9520 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a035017bb0 con 0x55a034e80660 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14c21ac740 10 client.0 _ll_register_callbacks cb 0x55a03516b120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.981+0000 7f14b91d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57912/0 (socket says 172.21.15.6:57912) 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 -- 172.21.15.6:0/2691620598 learned_addr learned my addr 172.21.15.6:0/2691620598 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b99d4640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e80660 0x55a03525abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 0x55a035266e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 -- 172.21.15.6:0/2691620598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e80660 msgr2=0x55a03525abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e80660 0x55a03525abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 -- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 msgr2=0x55a035266e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 0x55a035266e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 -- 172.21.15.6:0/2691620598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a035140780 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 0x55a035266e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14b91d3640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14a40e4b40 tx=0x7f14a40acbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4276e3ab0cdf9b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f149d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a401d070 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f14a40e7320 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.982+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14b0040070 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f14a40e7560 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 10 client.15834 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a034f14b00 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14b0040070 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f14a40e7bc0 con 0x55a034e88840 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 10 client.15834 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:45.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 10 client.15834 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 20 client.15834 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e67ea0 0x55a03526ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 4 client.15834 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0351c9140 con 0x55a034e67ea0 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.983+0000 7f14b99d4640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e67ea0 0x55a03526ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.984+0000 7f14b99d4640 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e67ea0 0x55a03526ce50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fa5d745c31ad76a server_cookie=ab8ee038340c355a in_seq=0 out_seq=0 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.984+0000 7f149d7fa640 10 client.15834 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f149d7fa640 1 -- 172.21.15.6:0/2691620598 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0351c9140 con 0x55a034e67ea0 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f149d7fa640 10 client.15834 handle_command_reply: tid=0 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 client.15834 shutdown 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 msgr2=0x55a03525b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14a40e4b40 tx=0x7f14a40acbe0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 shutdown_connections 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e67ea0 0x55a03526ce50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034ea9520 0x55a035266e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034e88840 0x55a03525b130 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f149d7fa640 0 client.15834 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 --2- 172.21.15.6:0/2691620598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e80660 0x55a03525abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 >> 172.21.15.6:0/2691620598 conn(0x55a034e9d910 msgr2=0x55a0352526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 shutdown_connections 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 1 -- 172.21.15.6:0/2691620598 wait complete. 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:44.985+0000 7f14c21ac740 20 client.15834 trim_cache size 0 max 16384 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 Processor -- start 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 -- start start 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a035266d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a035252d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41aee10 con 0x55a034ea9520 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41b1690 con 0x55a034e80660 2024-09-21T08:02:45.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14c21ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41af480 con 0x55a034e88840 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57926/0 (socket says 172.21.15.6:57926) 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3484345455 learned_addr learned my addr 172.21.15.6:0/3484345455 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14b91d3640 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a035252d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14b99d4640 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a035266d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3484345455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 msgr2=0x55a035252d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a035252d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3484345455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 msgr2=0x55a035266d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a035266d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.003+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3484345455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a034f8b960 con 0x55a034ea9520 2024-09-21T08:02:45.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.004+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f14ac01e6d0 tx=0x7f14ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af5ab034187ffe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.004+0000 7f149f7fe640 1 -- 172.21.15.6:0/3484345455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac01e310 con 0x55a034ea9520 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.004+0000 7f149f7fe640 1 -- 172.21.15.6:0/3484345455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14ac010620 con 0x55a034ea9520 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.004+0000 7f149f7fe640 1 -- 172.21.15.6:0/3484345455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac005280 con 0x55a034ea9520 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- 172.21.15.6:0/3484345455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 msgr2=0x55a035254770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f14ac01e6d0 tx=0x7f14ac015000 comp rx=0 tx=0).stop 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- 172.21.15.6:0/3484345455 shutdown_connections 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a035252d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a035254770 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3484345455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a035266d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- 172.21.15.6:0/3484345455 >> 172.21.15.6:0/3484345455 conn(0x55a034e9d910 msgr2=0x55a035252610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- 172.21.15.6:0/3484345455 shutdown_connections 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- 172.21.15.6:0/3484345455 wait complete. 2024-09-21T08:02:45.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 -- start start 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.005+0000 7f14c21ac740 1 Processor -- start 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a0352630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a0352636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41afb50 con 0x55a034ea9520 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41b0fc0 con 0x55a034e80660 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14b41b0220 con 0x55a034e88840 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14c21ac740 10 client.0 _ll_register_callbacks cb 0x7f14a40076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57942/0 (socket says 172.21.15.6:57942) 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3978033296 learned_addr learned my addr 172.21.15.6:0/3978033296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:02:45.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14b99d4640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a0352630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14b91d3640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a0352636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3978033296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 msgr2=0x55a0352636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a0352636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 msgr2=0x55a0352630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a0352630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.006+0000 7f14ba1d5640 1 -- 172.21.15.6:0/3978033296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03525e5a0 con 0x55a034ea9520 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14ba1d5640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f14ac011010 tx=0x7f14ac01e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a10bc36794c8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac02b040 con 0x55a034ea9520 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f14ac031440 con 0x55a034ea9520 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14ac010620 con 0x55a034ea9520 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f14ac03f050 con 0x55a034ea9520 2024-09-21T08:02:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 10 client.15840 fetch_fsmap learned FSMap version 21 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a0352d8310 con 0x55a034ea9520 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14ac010620 con 0x55a034ea9520 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f14ac02e030 con 0x55a034ea9520 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 10 client.15840 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 10 client.15840 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 20 client.15840 populate_metadata read hostname 'smithi006' 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e3d250 0x55a0352daac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 4 client.15840 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "57db5398", "release": true, "await": true}] 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.007+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "57db5398", "release": true, "await": true}) -- 0x55a0351c4bf0 con 0x55a034e3d250 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.008+0000 7f14b99d4640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e3d250 0x55a0352daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.008+0000 7f14b99d4640 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e3d250 0x55a0352daac0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888a0aab9b5f2fac server_cookie=f749b8f1b4f71bbf in_seq=0 out_seq=0 2024-09-21T08:02:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.008+0000 7f149d7fa640 10 client.15840 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.430+0000 7f149d7fa640 1 -- 172.21.15.6:0/3978033296 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a0351c4bf0 con 0x55a034e3d250 2024-09-21T08:02:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.430+0000 7f149d7fa640 10 client.15840 handle_command_reply: tid=0 2024-09-21T08:02:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.430+0000 7f14c21ac740 1 client.15840 shutdown 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.430+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 msgr2=0x55a03525de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.430+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f14ac011010 tx=0x7f14ac01e3c0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 shutdown_connections 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a034e3d250 0x55a0352daac0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a034e88840 0x55a0352636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f149d7fa640 0 client.15840 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a034ea9520 0x55a03525de10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 --2- 172.21.15.6:0/3978033296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a034e80660 0x55a0352630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 >> 172.21.15.6:0/3978033296 conn(0x55a034e9d910 msgr2=0x55a035265d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 shutdown_connections 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 1 -- 172.21.15.6:0/3978033296 wait complete. 2024-09-21T08:02:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14c21ac740 20 client.15840 trim_cache size 0 max 16384 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 8, 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "57db5398": { 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 8, 2024-09-21T08:02:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.0, 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:02:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:02:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 msgr2=0x7f14a00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 0x7f14a00b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005fd0 tx=0x7f14ac009600 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 msgr2=0x7f14b419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c970 tx=0x7f14a400ce30 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 shutdown_connections 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14a00b6700 0x7f14a00b8c10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14b41084d0 0x7f14b419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b4107b80 0x7f14b419aa10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 --2- 172.21.15.6:0/2428626358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14b4102240 0x7f14b419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 >> 172.21.15.6:0/2428626358 conn(0x7f14b4079f90 msgr2=0x7f14b4105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 shutdown_connections 2024-09-21T08:02:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:02:45.432+0000 7f14bbc38640 1 -- 172.21.15.6:0/2428626358 wait complete. 2024-09-21T08:02:45.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:45 smithi119 ceph-mon[33564]: pgmap v394: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 MiB/s wr, 6 op/s 2024-09-21T08:02:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:45 smithi145 ceph-mon[34049]: pgmap v394: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 MiB/s wr, 6 op/s 2024-09-21T08:02:45.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:45 smithi006 ceph-mon[30970]: pgmap v394: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 MiB/s wr, 6 op/s 2024-09-21T08:02:46.402 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '57db5398', total seconds elapsed: 21.0 2024-09-21T08:02:47.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:47 smithi119 ceph-mon[33564]: pgmap v395: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 923 KiB/s wr, 4 op/s 2024-09-21T08:02:47.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:47 smithi145 ceph-mon[34049]: pgmap v395: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 923 KiB/s wr, 4 op/s 2024-09-21T08:02:47.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:47 smithi006 ceph-mon[30970]: pgmap v395: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 923 KiB/s wr, 4 op/s 2024-09-21T08:02:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:48.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:02:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:48.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:02:48.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:48.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:48.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:48.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:02:49.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:49 smithi119 ceph-mon[33564]: pgmap v396: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-09-21T08:02:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:49 smithi145 ceph-mon[34049]: pgmap v396: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-09-21T08:02:49.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:49 smithi006 ceph-mon[30970]: pgmap v396: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-09-21T08:02:50.684 INFO:teuthology.orchestra.run.smithi006.stderr:creating primary keys... 2024-09-21T08:02:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:51 smithi119 ceph-mon[33564]: pgmap v397: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5.7 MiB/s wr, 7 op/s 2024-09-21T08:02:51.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:51 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:02:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:51 smithi145 ceph-mon[34049]: pgmap v397: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5.7 MiB/s wr, 7 op/s 2024-09-21T08:02:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:51 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:02:51.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:51 smithi006 ceph-mon[30970]: pgmap v397: 129 pgs: 129 active+clean; 894 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5.7 MiB/s wr, 7 op/s 2024-09-21T08:02:51.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:51 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:02:53.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:53 smithi119 ceph-mon[33564]: pgmap v398: 129 pgs: 129 active+clean; 910 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-21T08:02:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:53 smithi145 ceph-mon[34049]: pgmap v398: 129 pgs: 129 active+clean; 910 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-21T08:02:53.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:53 smithi006 ceph-mon[30970]: pgmap v398: 129 pgs: 129 active+clean; 910 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-21T08:02:55.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:55 smithi119 ceph-mon[33564]: pgmap v399: 129 pgs: 129 active+clean; 931 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 16 op/s 2024-09-21T08:02:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:55 smithi145 ceph-mon[34049]: pgmap v399: 129 pgs: 129 active+clean; 931 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 16 op/s 2024-09-21T08:02:55.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:55 smithi006 ceph-mon[30970]: pgmap v399: 129 pgs: 129 active+clean; 931 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 16 op/s 2024-09-21T08:02:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:done in 77.43 s (drop tables 0.01 s, create tables 0.06 s, client-side generate 46.02 s, vacuum 24.59 s, primary keys 6.75 s). 2024-09-21T08:02:57.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-21T08:02:57.579 INFO:teuthology.orchestra.run.smithi006.stderr:starting vacuum...end. 2024-09-21T08:02:57.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:57 smithi119 ceph-mon[33564]: pgmap v400: 129 pgs: 129 active+clean; 964 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-21T08:02:57.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:57 smithi145 ceph-mon[34049]: pgmap v400: 129 pgs: 129 active+clean; 964 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-21T08:02:57.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:57 smithi006 ceph-mon[30970]: pgmap v400: 129 pgs: 129 active+clean; 964 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-09-21T08:02:59.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:02:59 smithi119 ceph-mon[33564]: pgmap v401: 129 pgs: 129 active+clean; 992 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 25 op/s 2024-09-21T08:02:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:02:59 smithi145 ceph-mon[34049]: pgmap v401: 129 pgs: 129 active+clean; 992 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 25 op/s 2024-09-21T08:02:59.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:02:59 smithi006 ceph-mon[30970]: pgmap v401: 129 pgs: 129 active+clean; 992 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 25 op/s 2024-09-21T08:03:01.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:01 smithi119 ceph-mon[33564]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:03:01.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:01 smithi145 ceph-mon[34049]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:03:01.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:01 smithi006 ceph-mon[30970]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 28 op/s 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 5.0 s, 1430.0 tps, lat 65.401 ms stddev 82.678 2024-09-21T08:03:03.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:03 smithi119 ceph-mon[33564]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 41 MiB/s wr, 32 op/s 2024-09-21T08:03:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:03 smithi145 ceph-mon[34049]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 41 MiB/s wr, 32 op/s 2024-09-21T08:03:03.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:03 smithi006 ceph-mon[30970]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 41 MiB/s wr, 32 op/s 2024-09-21T08:03:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:05 smithi119 ceph-mon[33564]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 129 op/s 2024-09-21T08:03:05.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:05 smithi145 ceph-mon[34049]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 129 op/s 2024-09-21T08:03:05.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:05 smithi006 ceph-mon[30970]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 34 MiB/s wr, 129 op/s 2024-09-21T08:03:05.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:03:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.056+0000 7fb11ddee640 1 -- 172.21.15.6:0/3412883119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb11810f900 msgr2=0x7fb11810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.056+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3412883119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb11810f900 0x7fb11810fd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb108009ca0 tx=0x7fb10802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 -- 172.21.15.6:0/3412883119 shutdown_connections 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3412883119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb118110250 0x7fb118116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3412883119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb11810f900 0x7fb11810fd10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3412883119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118109fc0 0x7fb11810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 -- 172.21.15.6:0/3412883119 >> 172.21.15.6:0/3412883119 conn(0x7fb1180795c0 msgr2=0x7fb1181081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 -- 172.21.15.6:0/3412883119 shutdown_connections 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.057+0000 7fb11ddee640 1 -- 172.21.15.6:0/3412883119 wait complete. 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.058+0000 7fb11ddee640 1 Processor -- start 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.058+0000 7fb11ddee640 1 -- start start 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.058+0000 7fb11ddee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11ddee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb11810f900 0x7fb11806e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11ddee640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118110250 0x7fb11806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11ddee640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb118119db0 con 0x7fb11810f900 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11ddee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb118119c30 con 0x7fb118109fc0 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11ddee640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb118119f30 con 0x7fb118110250 2024-09-21T08:03:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11d5ed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118110250 0x7fb11806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:49004/0 (socket says 172.21.15.6:49004) 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 -- 172.21.15.6:0/3138582264 learned_addr learned my addr 172.21.15.6:0/3138582264 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb117fff640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb11810f900 0x7fb11806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 -- 172.21.15.6:0/3138582264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118110250 msgr2=0x7fb11806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118110250 0x7fb11806e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 -- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb11810f900 msgr2=0x7fb11806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb11810f900 0x7fb11806e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.059+0000 7fb11cdec640 1 -- 172.21.15.6:0/3138582264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11806efa0 con 0x7fb118109fc0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb11cdec640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb11000d950 tx=0x7fb11000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb115ffb640 1 -- 172.21.15.6:0/3138582264 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110017070 con 0x7fb118109fc0 2024-09-21T08:03:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb115ffb640 1 -- 172.21.15.6:0/3138582264 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb110009c30 con 0x7fb118109fc0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb115ffb640 1 -- 172.21.15.6:0/3138582264 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11000f620 con 0x7fb118109fc0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb118073c50 con 0x7fb118109fc0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.060+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb118074110 con 0x7fb118109fc0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.063+0000 7fb115ffb640 1 -- 172.21.15.6:0/3138582264 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb110010460 con 0x7fb118109fc0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.064+0000 7fb1255c4740 1 Processor -- start 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.064+0000 7fb1255c4740 1 -- start start 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb115ffb640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 0x7fb1040b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84da0d070 0x55c84ddb4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9ec390 0x55c84ddb4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c84dd2ae50 con 0x55c84d9ec390 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c84dd1a280 con 0x55c84da0d070 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb1255c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c84dd1e090 con 0x55c84d9e41b0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 0x7fb1040b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43138/0 (socket says 172.21.15.6:43138) 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 -- 172.21.15.6:0/2388107465 learned_addr learned my addr 172.21.15.6:0/2388107465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb115ffb640 1 -- 172.21.15.6:0/3138582264 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb1100e7650 con 0x7fb118109fc0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9ec390 0x55c84ddb4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb11cdec640 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84da0d070 0x55c84ddb4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 -- 172.21.15.6:0/2388107465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84da0d070 msgr2=0x55c84ddb4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84da0d070 0x55c84ddb4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 -- 172.21.15.6:0/2388107465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9ec390 msgr2=0x55c84ddb4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9ec390 0x55c84ddb4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.065+0000 7fb117fff640 1 -- 172.21.15.6:0/2388107465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84da78650 con 0x55c84d9e41b0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.066+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 0x7fb1040b8c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b590 tx=0x7fb10000b520 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.066+0000 7fb117fff640 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb11806c840 tx=0x7fb108009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66e0a146afb25ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.066+0000 7fb10effd640 1 -- 172.21.15.6:0/2388107465 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108031980 con 0x55c84d9e41b0 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.066+0000 7fb10effd640 1 -- 172.21.15.6:0/2388107465 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb108036030 con 0x55c84d9e41b0 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.066+0000 7fb10effd640 1 -- 172.21.15.6:0/2388107465 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108004460 con 0x55c84d9e41b0 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 -- 172.21.15.6:0/2388107465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 msgr2=0x55c84ddb4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb11806c840 tx=0x7fb108009a20 comp rx=0 tx=0).stop 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 -- 172.21.15.6:0/2388107465 shutdown_connections 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9e41b0 0x55c84ddb4950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9ec390 0x55c84ddb4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2388107465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84da0d070 0x55c84ddb4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 -- 172.21.15.6:0/2388107465 >> 172.21.15.6:0/2388107465 conn(0x55c84da01460 msgr2=0x55c84ddb2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 -- 172.21.15.6:0/2388107465 shutdown_connections 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.067+0000 7fb1255c4740 1 -- 172.21.15.6:0/2388107465 wait complete. 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 -- start start 2024-09-21T08:03:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 Processor -- start 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9e41b0 0x55c84ddbfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84da0d070 0x55c84ddcbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c84db7b700 con 0x55c84d9e41b0 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c84dcb5110 con 0x55c84d9ec390 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c84ddc2a10 con 0x55c84da0d070 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb1255c4740 10 client.0 _ll_register_callbacks cb 0x55c84dcce990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9e41b0 0x55c84ddbfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb117fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb117fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:49022/0 (socket says 172.21.15.6:49022) 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.068+0000 7fb117fff640 1 -- 172.21.15.6:0/2182870734 learned_addr learned my addr 172.21.15.6:0/2182870734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84da0d070 0x55c84ddcbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 -- 172.21.15.6:0/2182870734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84da0d070 msgr2=0x55c84ddcbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84da0d070 0x55c84ddcbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 -- 172.21.15.6:0/2182870734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9e41b0 msgr2=0x55c84ddbfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9e41b0 0x55c84ddbfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 -- 172.21.15.6:0/2182870734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84dce2c40 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb117fff640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb108005e30 tx=0x7fb108005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6139316eded58169 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10804a040 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb108003970 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb108036030 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb10805e050 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb1255c4740 10 client.25532 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.069+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c84ddce760 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb108036030 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb10804d030 con 0x55c84d9ec390 2024-09-21T08:03:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 10 client.25532 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 20 client.25532 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9cb9f0 0x55c84ddd1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 4 client.25532 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c84dd2cda0 con 0x55c84d9cb9f0 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.070+0000 7fb11cdec640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9cb9f0 0x55c84ddd1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb0f7fff640 10 client.25532 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb11cdec640 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9cb9f0 0x55c84ddd1ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c96d279f14eaad6 server_cookie=6fc7912f6efd0122 in_seq=0 out_seq=0 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb0f7fff640 1 -- 172.21.15.6:0/2182870734 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c84dd2cda0 con 0x55c84d9cb9f0 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb0f7fff640 10 client.25532 handle_command_reply: tid=0 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 client.25532 shutdown 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 msgr2=0x55c84ddbfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb108005e30 tx=0x7fb108005c50 comp rx=0 tx=0).stop 2024-09-21T08:03:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 shutdown_connections 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9cb9f0 0x55c84ddd1ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84da0d070 0x55c84ddcbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9ec390 0x55c84ddbfff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb0f7fff640 0 client.25532 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 --2- 172.21.15.6:0/2182870734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84d9e41b0 0x55c84ddbfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.071+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 >> 172.21.15.6:0/2182870734 conn(0x55c84da01460 msgr2=0x55c84ddb75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.072+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 shutdown_connections 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.072+0000 7fb1255c4740 1 -- 172.21.15.6:0/2182870734 wait complete. 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.072+0000 7fb1255c4740 20 client.25532 trim_cache size 0 max 16384 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 Processor -- start 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 -- start start 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddb1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddb1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181bd900 con 0x55c84da0d070 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181c0180 con 0x55c84d9e41b0 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.089+0000 7fb1255c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181bdf70 con 0x55c84d9ec390 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11d5ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddb1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:49026/0 (socket says 172.21.15.6:49026) 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 -- 172.21.15.6:0/4214479897 learned_addr learned my addr 172.21.15.6:0/4214479897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11d5ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddb1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53394/0 (socket says 172.21.15.6:53394) 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb117fff640 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddb1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 -- 172.21.15.6:0/4214479897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 msgr2=0x55c84ddb1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddb1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 -- 172.21.15.6:0/4214479897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 msgr2=0x55c84ddb1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddb1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 -- 172.21.15.6:0/4214479897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84ddb2bf0 con 0x55c84d9e41b0 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb11cdec640 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ad100 tx=0x7fb11000d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183ffc3dc092fe73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb10e7fc640 1 -- 172.21.15.6:0/4214479897 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110020070 con 0x55c84d9e41b0 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb10e7fc640 1 -- 172.21.15.6:0/4214479897 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1100b1ba0 con 0x55c84d9e41b0 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.090+0000 7fb10e7fc640 1 -- 172.21.15.6:0/4214479897 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1100109b0 con 0x55c84d9e41b0 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- 172.21.15.6:0/4214479897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 msgr2=0x55c84ddb5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ad100 tx=0x7fb11000d8d0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- 172.21.15.6:0/4214479897 shutdown_connections 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddb1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddb1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 --2- 172.21.15.6:0/4214479897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddb5b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- 172.21.15.6:0/4214479897 >> 172.21.15.6:0/4214479897 conn(0x55c84da01460 msgr2=0x55c84ddb5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- 172.21.15.6:0/4214479897 shutdown_connections 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- 172.21.15.6:0/4214479897 wait complete. 2024-09-21T08:03:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.091+0000 7fb1255c4740 1 -- start start 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 Processor -- start 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddc8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddc3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddc3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181be640 con 0x55c84da0d070 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181bfab0 con 0x55c84d9e41b0 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1181bed10 con 0x55c84d9ec390 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb1255c4740 10 client.0 _ll_register_callbacks cb 0x7fb1000123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddc8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb11d5ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddc3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb11cdec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddc8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:49030/0 (socket says 172.21.15.6:49030) 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb11cdec640 1 -- 172.21.15.6:0/789179411 learned_addr learned my addr 172.21.15.6:0/789179411 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:07.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.092+0000 7fb117fff640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddc3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 -- 172.21.15.6:0/789179411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 msgr2=0x55c84ddc3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddc3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 -- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 msgr2=0x55c84ddc8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddc8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 -- 172.21.15.6:0/789179411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84ddc4540 con 0x55c84da0d070 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb117fff640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddc3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:03:07.591 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:07.592 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:07.593 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb11d5ed640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddc3e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb100010740 tx=0x7fb100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3465482cf9369d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10002e030 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1100b1ba0 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb10001b030 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb100038050 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb1255c4740 10 client.15858 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c84de3c140 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.093+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1100b1ba0 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb100004930 con 0x55c84da0d070 2024-09-21T08:03:07.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 10 client.15858 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 20 client.15858 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9a0da0 0x55c84de3e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 4 client.15858 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c84dd28850 con 0x55c84d9a0da0 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb11cdec640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9a0da0 0x55c84de3e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb11cdec640 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9a0da0 0x55c84de3e9b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b95a58a2d0b21f server_cookie=34ebbe89eea66b79 in_seq=0 out_seq=0 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb0f7fff640 10 client.15858 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb0f7fff640 1 -- 172.21.15.6:0/789179411 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55c84dd28850 con 0x55c84d9a0da0 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb0f7fff640 10 client.15858 handle_command_reply: tid=0 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.094+0000 7fb1255c4740 1 client.15858 shutdown 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 msgr2=0x55c84ddc3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddc3e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb100010740 tx=0x7fb100004730 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 shutdown_connections 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c84d9a0da0 0x55c84de3e9b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c84d9ec390 0x55c84ddc3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb0f7fff640 0 client.15858 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c84da0d070 0x55c84ddc3e50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 --2- 172.21.15.6:0/789179411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c84d9e41b0 0x55c84ddc8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 >> 172.21.15.6:0/789179411 conn(0x55c84da01460 msgr2=0x55c84ddb5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 shutdown_connections 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 1 -- 172.21.15.6:0/789179411 wait complete. 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.095+0000 7fb1255c4740 20 client.15858 trim_cache size 0 max 16384 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 msgr2=0x7fb1040b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 0x7fb1040b8c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b590 tx=0x7fb10000b520 comp rx=0 tx=0).stop 2024-09-21T08:03:07.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 msgr2=0x7fb118074ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb11000d950 tx=0x7fb11000de10 comp rx=0 tx=0).stop 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 shutdown_connections 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1040b6780 0x7fb1040b8c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb118110250 0x7fb11806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb11810f900 0x7fb11806e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 --2- 172.21.15.6:0/3138582264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb118109fc0 0x7fb118074ec0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 >> 172.21.15.6:0/3138582264 conn(0x7fb1180795c0 msgr2=0x7fb11810df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 shutdown_connections 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:07.096+0000 7fb11ddee640 1 -- 172.21.15.6:0/3138582264 wait complete. 2024-09-21T08:03:07.597 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 10.0 s, 1200.2 tps, lat 82.915 ms stddev 35.784 2024-09-21T08:03:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:07 smithi119 ceph-mon[33564]: pgmap v405: 129 pgs: 129 active+clean; 1.0 GiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 137 op/s 2024-09-21T08:03:07.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:07 smithi145 ceph-mon[34049]: pgmap v405: 129 pgs: 129 active+clean; 1.0 GiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 137 op/s 2024-09-21T08:03:07.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:07 smithi006 ceph-mon[30970]: pgmap v405: 129 pgs: 129 active+clean; 1.0 GiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 137 op/s 2024-09-21T08:03:09.547 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:03:09.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:09.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:09 smithi006 ceph-mon[30970]: pgmap v406: 129 pgs: 129 active+clean; 1.0 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 224 op/s 2024-09-21T08:03:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:09 smithi119 ceph-mon[33564]: pgmap v406: 129 pgs: 129 active+clean; 1.0 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 224 op/s 2024-09-21T08:03:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:09 smithi145 ceph-mon[34049]: pgmap v406: 129 pgs: 129 active+clean; 1.0 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 224 op/s 2024-09-21T08:03:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 -- 172.21.15.6:0/4012449477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 msgr2=0x7f92b410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 --2- 172.21.15.6:0/4012449477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b410a7d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009ca0 tx=0x7f92ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 -- 172.21.15.6:0/4012449477 shutdown_connections 2024-09-21T08:03:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 --2- 172.21.15.6:0/4012449477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 --2- 172.21.15.6:0/4012449477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b410ad10 0x7f92b410fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 --2- 172.21.15.6:0/4012449477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b410a7d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.624+0000 7f92bae7d640 1 -- 172.21.15.6:0/4012449477 >> 172.21.15.6:0/4012449477 conn(0x7f92b406ee50 msgr2=0x7f92b406f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.625+0000 7f92bae7d640 1 -- 172.21.15.6:0/4012449477 shutdown_connections 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.625+0000 7f92bae7d640 1 -- 172.21.15.6:0/4012449477 wait complete. 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 Processor -- start 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 -- start start 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b41aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b410ad10 0x7f92b41ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92b4113d70 con 0x7f92b410ad10 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92b4113bf0 con 0x7f92b410a3c0 2024-09-21T08:03:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.626+0000 7f92bae7d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f92b4113ef0 con 0x7f92b4110230 2024-09-21T08:03:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.629+0000 7f92b9e7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b41aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.629+0000 7f92ba67c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.629+0000 7f92ba67c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43184/0 (socket says 172.21.15.6:43184) 2024-09-21T08:03:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.629+0000 7f92ba67c640 1 -- 172.21.15.6:0/1129142040 learned_addr learned my addr 172.21.15.6:0/1129142040 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 -- 172.21.15.6:0/1129142040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 msgr2=0x7f92b41aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b41aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 -- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b410ad10 msgr2=0x7f92b41ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b410ad10 0x7f92b41ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 -- 172.21.15.6:0/1129142040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b411e0b0 con 0x7f92b4110230 2024-09-21T08:03:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.630+0000 7f92ba67c640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e970 tx=0x7f92b000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.631+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000ccc0 con 0x7f92b4110230 2024-09-21T08:03:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.631+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92b000ce60 con 0x7f92b4110230 2024-09-21T08:03:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.631+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0010430 con 0x7f92b4110230 2024-09-21T08:03:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.631+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b411e340 con 0x7f92b4110230 2024-09-21T08:03:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.631+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b4118a20 con 0x7f92b4110230 2024-09-21T08:03:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.633+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b410fcf0 con 0x7f92b4110230 2024-09-21T08:03:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.636+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f92b0004ef0 con 0x7f92b4110230 2024-09-21T08:03:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.637+0000 7f92aaffd640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 0x7f92a00b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.637+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f92b00e8510 con 0x7f92b4110230 2024-09-21T08:03:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.638+0000 7f92b9e7b640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 0x7f92a00b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.638+0000 7f92b9e7b640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 0x7f92a00b8d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0094e0 tx=0x7f92ac000f40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:10.642+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92b00ae700 con 0x7f92b4110230 2024-09-21T08:03:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.104+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92b41140e0 con 0x7f92b4110230 2024-09-21T08:03:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.105+0000 7f92aaffd640 1 -- 172.21.15.6:0/1129142040 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f92b00c7e50 con 0x7f92b4110230 2024-09-21T08:03:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:03:11.106 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:03:11.107 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:03:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.110+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 msgr2=0x7f92a00b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.110+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 0x7f92a00b8d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0094e0 tx=0x7f92ac000f40 comp rx=0 tx=0).stop 2024-09-21T08:03:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.110+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 msgr2=0x7f92b411d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.110+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e970 tx=0x7f92b000ed70 comp rx=0 tx=0).stop 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 shutdown_connections 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92a00b6880 0x7f92a00b8d90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92b4110230 0x7f92b411d980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b410ad10 0x7f92b41ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 --2- 172.21.15.6:0/1129142040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92b410a3c0 0x7f92b41aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.111+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 >> 172.21.15.6:0/1129142040 conn(0x7f92b406ee50 msgr2=0x7f92b4073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.112+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 shutdown_connections 2024-09-21T08:03:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:11.112+0000 7f92bae7d640 1 -- 172.21.15.6:0/1129142040 wait complete. 2024-09-21T08:03:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:11 smithi119 ceph-mon[33564]: pgmap v407: 129 pgs: 129 active+clean; 1.1 GiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 357 op/s 2024-09-21T08:03:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:11 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1129142040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:11 smithi145 ceph-mon[34049]: pgmap v407: 129 pgs: 129 active+clean; 1.1 GiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 357 op/s 2024-09-21T08:03:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:11 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1129142040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:11.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:11 smithi006 ceph-mon[30970]: pgmap v407: 129 pgs: 129 active+clean; 1.1 GiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 357 op/s 2024-09-21T08:03:11.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:11 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1129142040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 15.0 s, 852.0 tps, lat 117.466 ms stddev 40.536 2024-09-21T08:03:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:13 smithi119 ceph-mon[33564]: pgmap v408: 129 pgs: 129 active+clean; 1.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 592 op/s 2024-09-21T08:03:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:13 smithi145 ceph-mon[34049]: pgmap v408: 129 pgs: 129 active+clean; 1.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 592 op/s 2024-09-21T08:03:13.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:13 smithi006 ceph-mon[30970]: pgmap v408: 129 pgs: 129 active+clean; 1.1 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 592 op/s 2024-09-21T08:03:15.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:15 smithi119 ceph-mon[33564]: pgmap v409: 129 pgs: 129 active+clean; 1.1 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 767 op/s 2024-09-21T08:03:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:15 smithi145 ceph-mon[34049]: pgmap v409: 129 pgs: 129 active+clean; 1.1 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 767 op/s 2024-09-21T08:03:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:15 smithi006 ceph-mon[30970]: pgmap v409: 129 pgs: 129 active+clean; 1.1 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 767 op/s 2024-09-21T08:03:15.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:03:16.328 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:16.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:16 smithi145 ceph-mon[34049]: pgmap v410: 129 pgs: 129 active+clean; 1.1 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T08:03:16.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:16 smithi006 ceph-mon[30970]: pgmap v410: 129 pgs: 129 active+clean; 1.1 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T08:03:16.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:16 smithi119 ceph-mon[33564]: pgmap v410: 129 pgs: 129 active+clean; 1.1 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T08:03:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 -- 172.21.15.6:0/3427177426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74107a20 msgr2=0x7f0c741016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 --2- 172.21.15.6:0/3427177426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74107a20 0x7f0c741016d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009be0 tx=0x7f0c6c02a790 comp rx=0 tx=0).stop 2024-09-21T08:03:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 -- 172.21.15.6:0/3427177426 shutdown_connections 2024-09-21T08:03:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 --2- 172.21.15.6:0/3427177426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c74101c10 0x7f0c74102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 --2- 172.21.15.6:0/3427177426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74107a20 0x7f0c741016d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 --2- 172.21.15.6:0/3427177426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c741070d0 0x7f0c741074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.917+0000 7f0c7a768640 1 -- 172.21.15.6:0/3427177426 >> 172.21.15.6:0/3427177426 conn(0x7f0c74078680 msgr2=0x7f0c74078ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.918+0000 7f0c7a768640 1 -- 172.21.15.6:0/3427177426 shutdown_connections 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.918+0000 7f0c7a768640 1 -- 172.21.15.6:0/3427177426 wait complete. 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 Processor -- start 2024-09-21T08:03:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 -- start start 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74101c10 0x7f0c741a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 0x7f0c741a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 0x7f0c741a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119d50 con 0x7f0c74101c10 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119bd0 con 0x7f0c74107a20 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.919+0000 7f0c7a768640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74119ed0 con 0x7f0c741070d0 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c78f65640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 0x7f0c741a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c78f65640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 0x7f0c741a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38376/0 (socket says 172.21.15.6:38376) 2024-09-21T08:03:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c78f65640 1 -- 172.21.15.6:0/2415942265 learned_addr learned my addr 172.21.15.6:0/2415942265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 0x7f0c741a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 -- 172.21.15.6:0/2415942265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 msgr2=0x7f0c741a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 0x7f0c741a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 -- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74101c10 msgr2=0x7f0c741a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74101c10 0x7f0c741a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.920+0000 7f0c79f67640 1 -- 172.21.15.6:0/2415942265 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c741a67b0 con 0x7f0c74107a20 2024-09-21T08:03:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.921+0000 7f0c79f67640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 0x7f0c741a6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000d6b0 tx=0x7f0c7000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.921+0000 7f0c6a7fc640 1 -- 172.21.15.6:0/2415942265 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70017070 con 0x7f0c74107a20 2024-09-21T08:03:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.921+0000 7f0c6a7fc640 1 -- 172.21.15.6:0/2415942265 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c70009cb0 con 0x7f0c74107a20 2024-09-21T08:03:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.922+0000 7f0c6a7fc640 1 -- 172.21.15.6:0/2415942265 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70003c20 con 0x7f0c74107a20 2024-09-21T08:03:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.923+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c741a6aa0 con 0x7f0c74107a20 2024-09-21T08:03:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.923+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741ad200 con 0x7f0c74107a20 2024-09-21T08:03:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.927+0000 7f0c81f3e740 1 Processor -- start 2024-09-21T08:03:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.927+0000 7f0c6a7fc640 1 -- 172.21.15.6:0/2415942265 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0c70009820 con 0x7f0c74107a20 2024-09-21T08:03:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.928+0000 7f0c81f3e740 1 -- start start 2024-09-21T08:03:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.928+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c5197860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 0x55d9c5197da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d9c510dea0 con 0x55d9c4dcf390 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d9c50fd2d0 con 0x55d9c4df0070 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d9c51010e0 con 0x55d9c4dc71b0 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c78f65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c5197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c78f65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c5197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58224/0 (socket says 172.21.15.6:58224) 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c78f65640 1 -- 172.21.15.6:0/912034471 learned_addr learned my addr 172.21.15.6:0/912034471 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 0x55d9c5197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 -- 172.21.15.6:0/912034471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 msgr2=0x55d9c5197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c5197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 -- 172.21.15.6:0/912034471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 msgr2=0x55d9c51982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c6a7fc640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 0x7f0c600b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.929+0000 7f0c79766640 1 -- 172.21.15.6:0/912034471 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c4e5b650 con 0x55d9c4dc71b0 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.930+0000 7f0c6a7fc640 1 -- 172.21.15.6:0/2415942265 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0c700e72e0 con 0x7f0c74107a20 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.930+0000 7f0c79766640 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 0x55d9c5197da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009ab0 tx=0x7f0c64009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36de51371fd35a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.931+0000 7f0c78f65640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 0x7f0c600b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.931+0000 7f0c5f7fe640 1 -- 172.21.15.6:0/912034471 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400ecb0 con 0x55d9c4dc71b0 2024-09-21T08:03:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.931+0000 7f0c5f7fe640 1 -- 172.21.15.6:0/912034471 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c640044c0 con 0x55d9c4dc71b0 2024-09-21T08:03:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.932+0000 7f0c5f7fe640 1 -- 172.21.15.6:0/912034471 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64010430 con 0x55d9c4dc71b0 2024-09-21T08:03:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 -- 172.21.15.6:0/912034471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 msgr2=0x55d9c5197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c78f65640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 0x7f0c600b8d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c030600 tx=0x7f0c6c009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 0x55d9c5197da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009ab0 tx=0x7f0c64009f70 comp rx=0 tx=0).stop 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 -- 172.21.15.6:0/912034471 shutdown_connections 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dc71b0 0x55d9c5197da0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009ab0 tx=0x7f0c64009f70 comp rx=0 tx=0).stop 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/912034471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c5197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 -- 172.21.15.6:0/912034471 >> 172.21.15.6:0/912034471 conn(0x55d9c4de4460 msgr2=0x55d9c5195750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 -- 172.21.15.6:0/912034471 shutdown_connections 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.933+0000 7f0c81f3e740 1 -- 172.21.15.6:0/912034471 wait complete. 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.934+0000 7f0c81f3e740 1 -- start start 2024-09-21T08:03:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.934+0000 7f0c81f3e740 1 Processor -- start 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51a3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 0x55d9c51a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d9c4f5e700 con 0x55d9c4dcf390 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c79f67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c79f67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58232/0 (socket says 172.21.15.6:58232) 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.935+0000 7f0c79f67640 1 -- 172.21.15.6:0/50883420 learned_addr learned my addr 172.21.15.6:0/50883420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.936+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d9c5098160 con 0x55d9c4dae9f0 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.936+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d9c51a6090 con 0x55d9c4df0070 2024-09-21T08:03:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.936+0000 7f0c81f3e740 10 client.0 _ll_register_callbacks cb 0x55d9c50b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.936+0000 7f0c79766640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.936+0000 7f0c78f65640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 0x55d9c51a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 -- 172.21.15.6:0/50883420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 msgr2=0x55d9c51a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 0x55d9c51a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 -- 172.21.15.6:0/50883420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 msgr2=0x55d9c51a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51a3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c50c5c90 con 0x55d9c4dae9f0 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c78f65640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 0x55d9c51a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c79f67640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005c20 tx=0x7f0c700ac600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a4b101402ef0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700e4ad0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.937+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0c700ac030 con 0x55d9c4dae9f0 2024-09-21T08:03:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.938+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9c510fdf0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.938+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0c700ac8e0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.939+0000 7f0c81f3e740 10 client.25556 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.939+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d9c51b1f80 con 0x55d9c4dae9f0 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.939+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d9c510fdf0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0c700d41a0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 10 client.25556 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 10 client.25556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 20 client.25556 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c4d83da0 0x55d9c51b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 4 client.25556 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9c510b8a0 con 0x55d9c4d83da0 2024-09-21T08:03:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.940+0000 7f0c79766640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c4d83da0 0x55d9c51b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.941+0000 7f0c5cff9640 10 client.25556 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.941+0000 7f0c79766640 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c4d83da0 0x55d9c51b5a10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d981f14b5e0cd1ec server_cookie=25b8eaec87ab97db in_seq=0 out_seq=0 2024-09-21T08:03:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.942+0000 7f0c5cff9640 1 -- 172.21.15.6:0/50883420 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9c510b8a0 con 0x55d9c4d83da0 2024-09-21T08:03:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.942+0000 7f0c5cff9640 10 client.25556 handle_command_reply: tid=0 2024-09-21T08:03:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.942+0000 7f0c81f3e740 1 client.25556 shutdown 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 msgr2=0x55d9c51af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005c20 tx=0x7f0c700ac600 comp rx=0 tx=0).stop 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 shutdown_connections 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c4d83da0 0x55d9c51b5a10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4df0070 0x55d9c51a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c51af3b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/50883420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dcf390 0x55d9c51a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 >> 172.21.15.6:0/50883420 conn(0x55d9c4de4460 msgr2=0x55d9c519a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.943+0000 7f0c5cff9640 0 client.25556 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.944+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 shutdown_connections 2024-09-21T08:03:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.944+0000 7f0c81f3e740 1 -- 172.21.15.6:0/50883420 wait complete. 2024-09-21T08:03:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.945+0000 7f0c81f3e740 20 client.25556 trim_cache size 0 max 16384 2024-09-21T08:03:16.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 Processor -- start 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 -- start start 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4df0070 0x55d9c51af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c79766640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c79766640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58244/0 (socket says 172.21.15.6:58244) 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c79766640 1 -- 172.21.15.6:0/2449454229 learned_addr learned my addr 172.21.15.6:0/2449454229 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b5240 con 0x55d9c4df0070 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b7ac0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b58b0 con 0x55d9c4dcf390 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c78f65640 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.972+0000 7f0c79f67640 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4df0070 0x55d9c51af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.973+0000 7f0c79766640 1 -- 172.21.15.6:0/2449454229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 msgr2=0x55d9c51af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.973+0000 7f0c79766640 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.973+0000 7f0c79766640 1 -- 172.21.15.6:0/2449454229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4df0070 msgr2=0x55d9c51af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.973+0000 7f0c79766640 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4df0070 0x55d9c51af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.973+0000 7f0c79766640 1 -- 172.21.15.6:0/2449454229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c51a33a0 con 0x55d9c4dae9f0 2024-09-21T08:03:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.974+0000 7f0c79766640 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009a80 tx=0x7f0c64000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba862685107ffdf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.974+0000 7f0c5effd640 1 -- 172.21.15.6:0/2449454229 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6402f070 con 0x55d9c4dae9f0 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.974+0000 7f0c5effd640 1 -- 172.21.15.6:0/2449454229 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c64003670 con 0x55d9c4dae9f0 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.974+0000 7f0c5effd640 1 -- 172.21.15.6:0/2449454229 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64004260 con 0x55d9c4dae9f0 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 msgr2=0x55d9c5195780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009a80 tx=0x7f0c64000bc0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 shutdown_connections 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4df0070 0x55d9c51af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/2449454229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4dae9f0 0x55d9c5195780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 >> 172.21.15.6:0/2449454229 conn(0x55d9c4de4460 msgr2=0x55d9c5195070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.975+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 shutdown_connections 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.976+0000 7f0c81f3e740 1 -- 172.21.15.6:0/2449454229 wait complete. 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.976+0000 7f0c81f3e740 1 -- start start 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.976+0000 7f0c81f3e740 1 Processor -- start 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dae9f0 0x55d9c51ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b5f80 con 0x55d9c4dae9f0 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b73f0 con 0x55d9c4df0070 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741b6650 con 0x55d9c4dcf390 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c79f67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c81f3e740 10 client.0 _ll_register_callbacks cb 0x7f0c700acc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c79f67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58260/0 (socket says 172.21.15.6:58260) 2024-09-21T08:03:16.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.977+0000 7f0c79f67640 1 -- 172.21.15.6:0/3621410001 learned_addr learned my addr 172.21.15.6:0/3621410001 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79766640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dae9f0 0x55d9c51ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79f67640 1 -- 172.21.15.6:0/3621410001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 msgr2=0x55d9c51a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c78f65640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79f67640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79f67640 1 -- 172.21.15.6:0/3621410001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dae9f0 msgr2=0x55d9c51ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79f67640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dae9f0 0x55d9c51ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.978+0000 7f0c79f67640 1 -- 172.21.15.6:0/3621410001 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c51a7740 con 0x55d9c4df0070 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.979+0000 7f0c79f67640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b2dd0 tx=0x7f0c700ac240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3123e013900975d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.979+0000 7f0c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.979+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700e4ad0 con 0x55d9c4df0070 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.979+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f0c700a8720 con 0x55d9c4df0070 2024-09-21T08:03:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.979+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c64003670 con 0x55d9c4df0070 2024-09-21T08:03:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.980+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0c700ce050 con 0x55d9c4df0070 2024-09-21T08:03:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.980+0000 7f0c81f3e740 10 client.25562 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.980+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d9c5231020 con 0x55d9c4df0070 2024-09-21T08:03:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c64003670 con 0x55d9c4df0070 2024-09-21T08:03:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0c700a8920 con 0x55d9c4df0070 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 10 client.25562 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 20 client.25562 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c5231610 0x55d9c5233a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 4 client.25562 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.981+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9c5108cd0 con 0x55d9c5231610 2024-09-21T08:03:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.982+0000 7f0c79766640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c5231610 0x55d9c5233a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.982+0000 7f0c79766640 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c5231610 0x55d9c5233a30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b679faaeaa8ccbf4 server_cookie=d3de06cd5bac89b7 in_seq=0 out_seq=0 2024-09-21T08:03:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.982+0000 7f0c5cff9640 10 client.25562 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.983+0000 7f0c5cff9640 1 -- 172.21.15.6:0/3621410001 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9c5108cd0 con 0x55d9c5231610 2024-09-21T08:03:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.983+0000 7f0c5cff9640 10 client.25562 handle_command_reply: tid=0 2024-09-21T08:03:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.983+0000 7f0c81f3e740 1 client.25562 shutdown 2024-09-21T08:03:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.983+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 msgr2=0x55d9c51a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.983+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b2dd0 tx=0x7f0c700ac240 comp rx=0 tx=0).stop 2024-09-21T08:03:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 shutdown_connections 2024-09-21T08:03:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d9c5231610 0x55d9c5233a30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d9c4dcf390 0x55d9c51a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9c4df0070 0x55d9c51a7200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 --2- 172.21.15.6:0/3621410001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9c4dae9f0 0x55d9c51ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 >> 172.21.15.6:0/3621410001 conn(0x55d9c4de4460 msgr2=0x55d9c519a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.984+0000 7f0c5cff9640 0 client.25562 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.985+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 shutdown_connections 2024-09-21T08:03:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.985+0000 7f0c81f3e740 1 -- 172.21.15.6:0/3621410001 wait complete. 2024-09-21T08:03:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.985+0000 7f0c81f3e740 20 client.25562 trim_cache size 0 max 16384 2024-09-21T08:03:16.987 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:03:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.987+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 msgr2=0x7f0c600b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.987+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 0x7f0c600b8d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c030600 tx=0x7f0c6c009800 comp rx=0 tx=0).stop 2024-09-21T08:03:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.987+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 msgr2=0x7f0c741a6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.987+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 0x7f0c741a6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000d6b0 tx=0x7f0c7000db70 comp rx=0 tx=0).stop 2024-09-21T08:03:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 shutdown_connections 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c600b6850 0x7f0c600b8d60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c741070d0 0x7f0c741a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c74107a20 0x7f0c741a6080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 --2- 172.21.15.6:0/2415942265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c74101c10 0x7f0c741a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 >> 172.21.15.6:0/2415942265 conn(0x7f0c74078680 msgr2=0x7f0c74104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 shutdown_connections 2024-09-21T08:03:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:16.988+0000 7f0c7a768640 1 -- 172.21.15.6:0/2415942265 wait complete. 2024-09-21T08:03:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 20.0 s, 947.0 tps, lat 105.623 ms stddev 36.159 2024-09-21T08:03:17.975 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:03:17.975 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T08:03:17.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:18.441 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:18.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:18 smithi145 ceph-mon[34049]: pgmap v411: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 937 op/s 2024-09-21T08:03:18.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:18 smithi006 ceph-mon[30970]: pgmap v411: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 937 op/s 2024-09-21T08:03:18.967 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:03:18.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/227291128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 msgr2=0x7f8f14108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/227291128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f14108400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009be0 tx=0x7f8f0402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/227291128 shutdown_connections 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/227291128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f14108400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/227291128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14107290 0x7f8f141076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/227291128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14101b60 0x7f8f14101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.130+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/227291128 >> 172.21.15.6:0/227291128 conn(0x7f8f14077800 msgr2=0x7f8f14077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:19.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.132+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/227291128 shutdown_connections 2024-09-21T08:03:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.132+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/227291128 wait complete. 2024-09-21T08:03:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.133+0000 7f8f1aa7a640 1 Processor -- start 2024-09-21T08:03:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 -- start start 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14101b60 0x7f8f141179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14107290 0x7f8f14110cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14119f50 con 0x7f8f14101b60 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14119dd0 con 0x7f8f14107290 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f1aa7a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1411a0d0 con 0x7f8f14107be0 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f19017640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f19017640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38430/0 (socket says 172.21.15.6:38430) 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.134+0000 7f8f19017640 1 -- 172.21.15.6:0/486374827 learned_addr learned my addr 172.21.15.6:0/486374827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f13fff640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14107290 0x7f8f14110cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f18816640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14101b60 0x7f8f141179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f19017640 1 -- 172.21.15.6:0/486374827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14107290 msgr2=0x7f8f14110cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f19017640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14107290 0x7f8f14110cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f19017640 1 -- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14101b60 msgr2=0x7f8f141179e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f19017640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14101b60 0x7f8f141179e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.135+0000 7f8f19017640 1 -- 172.21.15.6:0/486374827 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f14116650 con 0x7f8f14107be0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.136+0000 7f8f19017640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009b30 tx=0x7f8f04030d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.136+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04041020 con 0x7f8f14107be0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.136+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f14116880 con 0x7f8f14107be0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.137+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f14116d60 con 0x7f8f14107be0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.137+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f04037040 con 0x7f8f14107be0 2024-09-21T08:03:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.137+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04036070 con 0x7f8f14107be0 2024-09-21T08:03:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.138+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef40052c0 con 0x7f8f14107be0 2024-09-21T08:03:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.141+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8f04044020 con 0x7f8f14107be0 2024-09-21T08:03:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.143+0000 7f8f11ffb640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 0x7f8f000b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.143+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8f04003d80 con 0x7f8f14107be0 2024-09-21T08:03:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.144+0000 7f8f18816640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 0x7f8f000b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.145+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f040ce770 con 0x7f8f14107be0 2024-09-21T08:03:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.145+0000 7f8f18816640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 0x7f8f000b8ce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c005fd0 tx=0x7f8f0c009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:19.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:18 smithi119 ceph-mon[33564]: pgmap v411: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 937 op/s 2024-09-21T08:03:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:19.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:03:19.610 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:03:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.606+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ef40055b0 con 0x7f8f14107be0 2024-09-21T08:03:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.607+0000 7f8f11ffb640 1 -- 172.21.15.6:0/486374827 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f8f040d2b50 con 0x7f8f14107be0 2024-09-21T08:03:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.611+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 msgr2=0x7f8f000b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.611+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 0x7f8f000b8ce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c005fd0 tx=0x7f8f0c009260 comp rx=0 tx=0).stop 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.611+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 msgr2=0x7f8f141112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.611+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009b30 tx=0x7f8f04030d50 comp rx=0 tx=0).stop 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 shutdown_connections 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8f000b67d0 0x7f8f000b8ce0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c005fd0 tx=0x7f8f0c009260 comp rx=0 tx=0).stop 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f14107be0 0x7f8f141112e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f14107290 0x7f8f14110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 --2- 172.21.15.6:0/486374827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f14101b60 0x7f8f141179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.612+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 >> 172.21.15.6:0/486374827 conn(0x7f8f14077800 msgr2=0x7f8f141008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.614+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 shutdown_connections 2024-09-21T08:03:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:19.615+0000 7f8f1aa7a640 1 -- 172.21.15.6:0/486374827 wait complete. 2024-09-21T08:03:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/486374827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:19.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/486374827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:20.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/486374827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 -- 172.21.15.6:0/1883960107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 msgr2=0x7fb6201080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 --2- 172.21.15.6:0/1883960107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb6201080c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb614009890 tx=0x7fb61402a360 comp rx=0 tx=0).stop 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 -- 172.21.15.6:0/1883960107 shutdown_connections 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 --2- 172.21.15.6:0/1883960107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb620107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 --2- 172.21.15.6:0/1883960107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb6201080c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 --2- 172.21.15.6:0/1883960107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 -- 172.21.15.6:0/1883960107 >> 172.21.15.6:0/1883960107 conn(0x7fb620079730 msgr2=0x7fb620079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 -- 172.21.15.6:0/1883960107 shutdown_connections 2024-09-21T08:03:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.190+0000 7fb624ed4640 1 -- 172.21.15.6:0/1883960107 wait complete. 2024-09-21T08:03:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 Processor -- start 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 -- start start 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620074e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb62006f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb62006d540 con 0x7fb6201027a0 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb62006d3c0 con 0x7fb620107be0 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.192+0000 7fb624ed4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb62006d6c0 con 0x7fb6201030f0 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38446/0 (socket says 172.21.15.6:38446) 2024-09-21T08:03:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61dd9b640 1 -- 172.21.15.6:0/2450522873 learned_addr learned my addr 172.21.15.6:0/2450522873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb62006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61e59c640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620074e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 -- 172.21.15.6:0/2450522873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 msgr2=0x7fb62006f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 -- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 msgr2=0x7fb620074e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620074e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.193+0000 7fb61ed9d640 1 -- 172.21.15.6:0/2450522873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62006fe90 con 0x7fb620107be0 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb61e59c640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620074e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb62006f670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb614035040 tx=0x7fb614030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb60f7fe640 1 -- 172.21.15.6:0/2450522873 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614037040 con 0x7fb620107be0 2024-09-21T08:03:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb60f7fe640 1 -- 172.21.15.6:0/2450522873 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb614032df0 con 0x7fb620107be0 2024-09-21T08:03:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.194+0000 7fb60f7fe640 1 -- 172.21.15.6:0/2450522873 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140035f0 con 0x7fb620107be0 2024-09-21T08:03:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.195+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6201b5520 con 0x7fb620107be0 2024-09-21T08:03:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.195+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6201b58c0 con 0x7fb620107be0 2024-09-21T08:03:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.199+0000 7fb62b448740 1 Processor -- start 2024-09-21T08:03:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.199+0000 7fb60f7fe640 1 -- 172.21.15.6:0/2450522873 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb614043020 con 0x7fb620107be0 2024-09-21T08:03:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 -- start start 2024-09-21T08:03:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870eff2350 0x55870f399430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efc9490 0x55870f399970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55870f30fe60 con 0x55870eff2350 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55870f2ff290 con 0x55870efc9490 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.200+0000 7fb62b448740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55870f3030a0 con 0x55870efd1670 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.201+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.201+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38462/0 (socket says 172.21.15.6:38462) 2024-09-21T08:03:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.201+0000 7fb61dd9b640 1 -- 172.21.15.6:0/1044120573 learned_addr learned my addr 172.21.15.6:0/1044120573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.201+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870eff2350 0x55870f399430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 -- 172.21.15.6:0/1044120573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efc9490 msgr2=0x55870f399970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efc9490 0x55870f399970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 -- 172.21.15.6:0/1044120573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870eff2350 msgr2=0x55870f399430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870eff2350 0x55870f399430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 -- 172.21.15.6:0/1044120573 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870f05d930 con 0x55870efd1670 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb60f7fe640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 0x7fb6080b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.202+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6100118b0 tx=0x7fb610009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fb5681a9eb761fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.203+0000 7fb60f7fe640 1 -- 172.21.15.6:0/2450522873 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb614106df0 con 0x7fb620107be0 2024-09-21T08:03:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.203+0000 7fb60cff9640 1 -- 172.21.15.6:0/1044120573 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61000f8c0 con 0x55870efd1670 2024-09-21T08:03:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.203+0000 7fb61e59c640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 0x7fb6080b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.203+0000 7fb60cff9640 1 -- 172.21.15.6:0/1044120573 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb61001e420 con 0x55870efd1670 2024-09-21T08:03:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.204+0000 7fb60cff9640 1 -- 172.21.15.6:0/1044120573 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61000e640 con 0x55870efd1670 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.205+0000 7fb61e59c640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 0x7fb6080b8d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55870f3980b0 tx=0x7fb618009540 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.205+0000 7fb62b448740 1 -- 172.21.15.6:0/1044120573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 msgr2=0x55870f399eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.205+0000 7fb62b448740 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6100118b0 tx=0x7fb610009bb0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 -- 172.21.15.6:0/1044120573 shutdown_connections 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f399eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efc9490 0x55870f399970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 --2- 172.21.15.6:0/1044120573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870eff2350 0x55870f399430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 -- 172.21.15.6:0/1044120573 >> 172.21.15.6:0/1044120573 conn(0x55870efe6740 msgr2=0x55870f397320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 -- 172.21.15.6:0/1044120573 shutdown_connections 2024-09-21T08:03:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.206+0000 7fb62b448740 1 -- 172.21.15.6:0/1044120573 wait complete. 2024-09-21T08:03:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.207+0000 7fb62b448740 1 -- start start 2024-09-21T08:03:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.207+0000 7fb62b448740 1 Processor -- start 2024-09-21T08:03:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.208+0000 7fb62b448740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.208+0000 7fb62b448740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb61e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb61e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48514/0 (socket says 172.21.15.6:48514) 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.208+0000 7fb62b448740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f3b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb61e59c640 1 -- 172.21.15.6:0/989811877 learned_addr learned my addr 172.21.15.6:0/989811877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55870f160890 con 0x55870efc9490 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55870f299d40 con 0x55870eff2350 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55870f3a7c60 con 0x55870efd1670 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb62b448740 10 client.0 _ll_register_callbacks cb 0x55870f2fdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.209+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f3b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 -- 172.21.15.6:0/989811877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 msgr2=0x55870f3a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 -- 172.21.15.6:0/989811877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 msgr2=0x55870f3a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55870f3b1590 con 0x55870eff2350 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61e59c640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f3b0f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb614104130 tx=0x7fb6141046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6a15cb95d3c9df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140cbfd0 con 0x55870eff2350 2024-09-21T08:03:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.210+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb6140cbcd0 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.211+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb61001e420 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.211+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6140cc370 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.211+0000 7fb62b448740 10 client.25577 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.211+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55870f3b3e80 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.211+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb61001e420 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb6140cb530 con 0x55870eff2350 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 10 client.25577 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 20 client.25577 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870efb0cd0 0x55870f3b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 4 client.25577 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55870f311db0 con 0x55870efb0cd0 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.212+0000 7fb61e59c640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870efb0cd0 0x55870f3b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.213+0000 7fb61e59c640 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870efb0cd0 0x55870f3b72f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c5548e9f4f7826a server_cookie=76caaebf8e0443f3 in_seq=0 out_seq=0 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.213+0000 7fb605ffb640 10 client.25577 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb605ffb640 1 -- 172.21.15.6:0/989811877 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55870f311db0 con 0x55870efb0cd0 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb605ffb640 10 client.25577 handle_command_reply: tid=0 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 client.25577 shutdown 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 msgr2=0x55870f3b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f3b0f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb614104130 tx=0x7fb6141046e0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 shutdown_connections 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870efb0cd0 0x55870f3b72f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb605ffb640 0 client.25577 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f3b0f50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 --2- 172.21.15.6:0/989811877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.214+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 >> 172.21.15.6:0/989811877 conn(0x55870efe6740 msgr2=0x55870f39c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.215+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 shutdown_connections 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.215+0000 7fb62b448740 1 -- 172.21.15.6:0/989811877 wait complete. 2024-09-21T08:03:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.215+0000 7fb62b448740 20 client.25577 trim_cache size 0 max 16384 2024-09-21T08:03:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.251+0000 7fb62b448740 1 Processor -- start 2024-09-21T08:03:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.251+0000 7fb62b448740 1 -- start start 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f39cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb620070410 con 0x55870efc9490 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201b7be0 con 0x55870efd1670 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb62b448740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb620112400 con 0x55870eff2350 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.252+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38482/0 (socket says 172.21.15.6:38482) 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58322/0 (socket says 172.21.15.6:58322) 2024-09-21T08:03:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61dd9b640 1 -- 172.21.15.6:0/1405702191 learned_addr learned my addr 172.21.15.6:0/1405702191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61e59c640 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f39cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 -- 172.21.15.6:0/1405702191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 msgr2=0x55870f39ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 -- 172.21.15.6:0/1405702191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 msgr2=0x55870f39cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f39cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 -- 172.21.15.6:0/1405702191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870f39fad0 con 0x55870eff2350 2024-09-21T08:03:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.253+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb6140cc7f0 tx=0x7fb6140c8830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d3fbbe731a8fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.254+0000 7fb607fff640 1 -- 172.21.15.6:0/1405702191 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140cbfd0 con 0x55870eff2350 2024-09-21T08:03:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.254+0000 7fb607fff640 1 -- 172.21.15.6:0/1405702191 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6140ccf60 con 0x55870eff2350 2024-09-21T08:03:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.254+0000 7fb607fff640 1 -- 172.21.15.6:0/1405702191 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140cc630 con 0x55870eff2350 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 -- 172.21.15.6:0/1405702191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 msgr2=0x55870f39e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb6140cc7f0 tx=0x7fb6140c8830 comp rx=0 tx=0).stop 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 -- 172.21.15.6:0/1405702191 shutdown_connections 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870eff2350 0x55870f39e510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870efd1670 0x55870f39ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 --2- 172.21.15.6:0/1405702191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f39cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.255+0000 7fb62b448740 1 -- 172.21.15.6:0/1405702191 >> 172.21.15.6:0/1405702191 conn(0x55870efe6740 msgr2=0x55870f39a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.256+0000 7fb62b448740 1 -- 172.21.15.6:0/1405702191 shutdown_connections 2024-09-21T08:03:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.256+0000 7fb62b448740 1 -- 172.21.15.6:0/1405702191 wait complete. 2024-09-21T08:03:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.257+0000 7fb62b448740 1 -- start start 2024-09-21T08:03:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.257+0000 7fb62b448740 1 Processor -- start 2024-09-21T08:03:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201b60a0 con 0x55870efc9490 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201b7510 con 0x55870eff2350 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201b6770 con 0x55870efd1670 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb61ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb62b448740 10 client.0 _ll_register_callbacks cb 0x7fb614005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb61ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58332/0 (socket says 172.21.15.6:58332) 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.258+0000 7fb61ed9d640 1 -- 172.21.15.6:0/301444946 learned_addr learned my addr 172.21.15.6:0/301444946 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61dd9b640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 -- 172.21.15.6:0/301444946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 msgr2=0x55870f3a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 -- 172.21.15.6:0/301444946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 msgr2=0x55870f3a95b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a95b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 -- 172.21.15.6:0/301444946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55870f4211f0 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb61ed9d640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb614009230 tx=0x7fb6140cbf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875376bed3e938c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.259+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140c8eb0 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb6140cdb90 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6140ccf60 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6140cbfd0 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 10 client.25583 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55870f4211f0 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6140a4030 con 0x55870eff2350 2024-09-21T08:03:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb6140a6310 con 0x55870eff2350 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 10 client.25583 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 10 client.25583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.260+0000 7fb62b448740 20 client.25583 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.261+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870ef86080 0x55870f424750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.261+0000 7fb62b448740 4 client.25583 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.261+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb6140ccf60 con 0x55870ef86080 2024-09-21T08:03:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.261+0000 7fb61e59c640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870ef86080 0x55870f424750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.262+0000 7fb605ffb640 10 client.25583 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.262+0000 7fb61e59c640 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870ef86080 0x55870f424750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c67e3d2bf9ce8ed0 server_cookie=25a8f3b2d78b7306 in_seq=0 out_seq=0 2024-09-21T08:03:20.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.265+0000 7fb605ffb640 1 -- 172.21.15.6:0/301444946 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb6140ccf60 con 0x55870ef86080 2024-09-21T08:03:20.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.265+0000 7fb605ffb640 10 client.25583 handle_command_reply: tid=0 2024-09-21T08:03:20.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.265+0000 7fb62b448740 1 client.25583 shutdown 2024-09-21T08:03:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.265+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 msgr2=0x55870f420cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.265+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb614009230 tx=0x7fb6140cbf00 comp rx=0 tx=0).stop 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 shutdown_connections 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55870ef86080 0x55870f424750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55870efd1670 0x55870f3a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55870eff2350 0x55870f420cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 --2- 172.21.15.6:0/301444946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55870efc9490 0x55870f3a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 >> 172.21.15.6:0/301444946 conn(0x55870efe6740 msgr2=0x55870f3a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb605ffb640 0 client.25583 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 shutdown_connections 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.266+0000 7fb62b448740 1 -- 172.21.15.6:0/301444946 wait complete. 2024-09-21T08:03:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.267+0000 7fb62b448740 20 client.25583 trim_cache size 0 max 16384 2024-09-21T08:03:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:20.269 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:03:20.269 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "7de19529-7eca-4fce-8912-1b95b95dca42", 2024-09-21T08:03:20.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:03:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 msgr2=0x7fb6080b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 0x7fb6080b8d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55870f3980b0 tx=0x7fb618009540 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 msgr2=0x7fb62006f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb62006f670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb614035040 tx=0x7fb614030ce0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 shutdown_connections 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6080b6880 0x7fb6080b8d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6201030f0 0x7fb62006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb620107be0 0x7fb62006f670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 --2- 172.21.15.6:0/2450522873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6201027a0 0x7fb620074e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 >> 172.21.15.6:0/2450522873 conn(0x7fb620079730 msgr2=0x7fb6201055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 shutdown_connections 2024-09-21T08:03:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:20.268+0000 7fb624ed4640 1 -- 172.21.15.6:0/2450522873 wait complete. 2024-09-21T08:03:20.825 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T08:03:20.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T08:03:20.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:20 smithi145 ceph-mon[34049]: pgmap v412: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2024-09-21T08:03:20.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:20 smithi006 ceph-mon[30970]: pgmap v412: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2024-09-21T08:03:21.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:20 smithi119 ceph-mon[33564]: pgmap v412: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2024-09-21T08:03:21.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:03:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:21 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:21 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:21 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:21 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:21 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:03:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:21 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:21 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:03:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:21 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:21 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:03:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:21 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:21 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:03:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:21 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:03:22.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.542+0000 7f52da9a7640 1 -- 172.21.15.6:0/4251610054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 msgr2=0x7f52d4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 --2- 172.21.15.6:0/4251610054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4102e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d910 tx=0x7f52c402c380 comp rx=0 tx=0).stop 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 -- 172.21.15.6:0/4251610054 shutdown_connections 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 --2- 172.21.15.6:0/4251610054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 --2- 172.21.15.6:0/4251610054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 0x7f52d41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 --2- 172.21.15.6:0/4251610054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4102e90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 -- 172.21.15.6:0/4251610054 >> 172.21.15.6:0/4251610054 conn(0x7f52d4079760 msgr2=0x7f52d4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 -- 172.21.15.6:0/4251610054 shutdown_connections 2024-09-21T08:03:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.543+0000 7f52da9a7640 1 -- 172.21.15.6:0/4251610054 wait complete. 2024-09-21T08:03:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.545+0000 7f52da9a7640 1 Processor -- start 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.545+0000 7f52da9a7640 1 -- start start 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 0x7f52d41986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4111730 con 0x7f52d41083c0 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41115b0 con 0x7f52d4108d10 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52da9a7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41118b0 con 0x7f52d4102a80 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38504/0 (socket says 172.21.15.6:38504) 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52d3fff640 1 -- 172.21.15.6:0/1407611205 learned_addr learned my addr 172.21.15.6:0/1407611205 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.546+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 0x7f52d41986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 -- 172.21.15.6:0/1407611205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 msgr2=0x7f52d4198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 -- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 msgr2=0x7f52d41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 0x7f52d41986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 -- 172.21.15.6:0/1407611205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d419e070 con 0x7f52d4108d10 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d419d940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00da10 tx=0x7f52cc00ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d17fa640 1 -- 172.21.15.6:0/1407611205 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc018070 con 0x7f52d4108d10 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d17fa640 1 -- 172.21.15.6:0/1407611205 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52cc016070 con 0x7f52d4108d10 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.547+0000 7f52d17fa640 1 -- 172.21.15.6:0/1407611205 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc004030 con 0x7f52d4108d10 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.548+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d419e360 con 0x7f52d4108d10 2024-09-21T08:03:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.548+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41a4ac0 con 0x7f52d4108d10 2024-09-21T08:03:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.553+0000 7f52e0f1b740 1 Processor -- start 2024-09-21T08:03:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.554+0000 7f52e0f1b740 1 -- start start 2024-09-21T08:03:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.554+0000 7f52d17fa640 1 -- 172.21.15.6:0/1407611205 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f52cc004a40 con 0x7f52d4108d10 2024-09-21T08:03:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.556+0000 7f52d17fa640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 0x7f52bc0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.556+0000 7f52d17fa640 1 -- 172.21.15.6:0/1407611205 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f52cc0e73e0 con 0x7f52d4108d10 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.556+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 0x7f52bc0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef3e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55addeeabb90 con 0x55addeb6db60 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55addee9afc0 con 0x55addeb8e840 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55addee9edd0 con 0x55addeb65980 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58352/0 (socket says 172.21.15.6:58352) 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 -- 172.21.15.6:0/2438387227 learned_addr learned my addr 172.21.15.6:0/2438387227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d37fe640 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 0x7f52bc0b8c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f52d4100ce0 tx=0x7f52c8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 -- 172.21.15.6:0/2438387227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 msgr2=0x55addef3e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 -- 172.21.15.6:0/2438387227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 msgr2=0x55addef3e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef3e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.557+0000 7f52d3fff640 1 -- 172.21.15.6:0/2438387227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addee22060 con 0x55addeb8e840 2024-09-21T08:03:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.558+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52c402f040 tx=0x7f52c4004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c26d70d434dbff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.558+0000 7f52ba7fc640 1 -- 172.21.15.6:0/2438387227 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4042020 con 0x55addeb8e840 2024-09-21T08:03:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.558+0000 7f52ba7fc640 1 -- 172.21.15.6:0/2438387227 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52c4030070 con 0x55addeb8e840 2024-09-21T08:03:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.558+0000 7f52ba7fc640 1 -- 172.21.15.6:0/2438387227 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c400d050 con 0x55addeb8e840 2024-09-21T08:03:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2438387227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 msgr2=0x55addef3de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52c402f040 tx=0x7f52c4004800 comp rx=0 tx=0).stop 2024-09-21T08:03:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2438387227 shutdown_connections 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef3e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2438387227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef3de10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2438387227 >> 172.21.15.6:0/2438387227 conn(0x55addeb82990 msgr2=0x55addef3bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2438387227 shutdown_connections 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.560+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2438387227 wait complete. 2024-09-21T08:03:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.561+0000 7f52e0f1b740 1 -- start start 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.561+0000 7f52e0f1b740 1 Processor -- start 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef4a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb8e840 0x55addef558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55addecfc7a0 con 0x55addeb6db60 2024-09-21T08:03:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55addee400a0 con 0x55addeb65980 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55addef4c590 con 0x55addeb8e840 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52e0f1b740 10 client.0 _ll_register_callbacks cb 0x55addee1d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58362/0 (socket says 172.21.15.6:58362) 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52d3fff640 1 -- 172.21.15.6:0/2156828146 learned_addr learned my addr 172.21.15.6:0/2156828146 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52d8f44640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb8e840 0x55addef558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.562+0000 7f52d37fe640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef4a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 -- 172.21.15.6:0/2156828146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb8e840 msgr2=0x55addef558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb8e840 0x55addef558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 -- 172.21.15.6:0/2156828146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 msgr2=0x55addef4a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef4a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 -- 172.21.15.6:0/2156828146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addee2e880 con 0x55addeb65980 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52d3fff640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52c402de80 tx=0x7f52c402cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439599d696f8876d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.563+0000 7f52b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.564+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4042040 con 0x55addeb65980 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.564+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c4030070 con 0x55addeb65980 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.565+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f52c403ede0 con 0x55addeb65980 2024-09-21T08:03:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.565+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f52c4056050 con 0x55addeb65980 2024-09-21T08:03:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.566+0000 7f52e0f1b740 10 client.25595 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.566+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55addec08b90 con 0x55addeb65980 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52c4030070 con 0x55addeb65980 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f52c4051030 con 0x55addeb65980 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 10 client.25595 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 10 client.25595 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 20 client.25595 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb4d1c0 0x55addef5b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 4 client.25595 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.567+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55addeeadae0 con 0x55addeb4d1c0 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.568+0000 7f52d37fe640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb4d1c0 0x55addef5b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.570+0000 7f52d37fe640 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb4d1c0 0x55addef5b810 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=949f10185b399493 server_cookie=d1b86e4effc5b772 in_seq=0 out_seq=0 2024-09-21T08:03:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.570+0000 7f52b37fe640 10 client.25595 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.571+0000 7f52b37fe640 1 -- 172.21.15.6:0/2156828146 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55addeeadae0 con 0x55addeb4d1c0 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.571+0000 7f52b37fe640 10 client.25595 handle_command_reply: tid=0 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.571+0000 7f52e0f1b740 1 client.25595 shutdown 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 msgr2=0x55addef49a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52c402de80 tx=0x7f52c402cb30 comp rx=0 tx=0).stop 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 shutdown_connections 2024-09-21T08:03:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb4d1c0 0x55addef5b810 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb8e840 0x55addef558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb6db60 0x55addef4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/2156828146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb65980 0x55addef49a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 >> 172.21.15.6:0/2156828146 conn(0x55addeb82990 msgr2=0x55addef40fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52b37fe640 0 client.25595 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 shutdown_connections 2024-09-21T08:03:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 1 -- 172.21.15.6:0/2156828146 wait complete. 2024-09-21T08:03:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.572+0000 7f52e0f1b740 20 client.25595 trim_cache size 0 max 16384 2024-09-21T08:03:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 25.0 s, 917.4 tps, lat 108.963 ms stddev 56.668 2024-09-21T08:03:22.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.607+0000 7f52e0f1b740 1 Processor -- start 2024-09-21T08:03:22.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.607+0000 7f52e0f1b740 1 -- start start 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.607+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.607+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb8e840 0x55addef46a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52e0f1b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41acc20 con 0x55addeb8e840 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58368/0 (socket says 172.21.15.6:58368) 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 -- 172.21.15.6:0/1383010047 learned_addr learned my addr 172.21.15.6:0/1383010047 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb8e840 0x55addef46a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41af4a0 con 0x55addeb6db60 2024-09-21T08:03:22.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41ad290 con 0x55addeb65980 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 -- 172.21.15.6:0/1383010047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 msgr2=0x55addef3b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 -- 172.21.15.6:0/1383010047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb8e840 msgr2=0x55addef46a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.608+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb8e840 0x55addef46a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.609+0000 7f52d37fe640 1 -- 172.21.15.6:0/1383010047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addef47d90 con 0x55addeb6db60 2024-09-21T08:03:22.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.609+0000 7f52d37fe640 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52c8012600 tx=0x7f52c8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8353c6c454f012e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.610+0000 7f52b9ffb640 1 -- 172.21.15.6:0/1383010047 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8012df0 con 0x55addeb6db60 2024-09-21T08:03:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.610+0000 7f52b9ffb640 1 -- 172.21.15.6:0/1383010047 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52c80035f0 con 0x55addeb6db60 2024-09-21T08:03:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.610+0000 7f52b9ffb640 1 -- 172.21.15.6:0/1383010047 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c801f680 con 0x55addeb6db60 2024-09-21T08:03:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 msgr2=0x55addef3bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52c8012600 tx=0x7f52c8017000 comp rx=0 tx=0).stop 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 shutdown_connections 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb8e840 0x55addef46a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb6db60 0x55addef3bb60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1383010047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb65980 0x55addef3b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 >> 172.21.15.6:0/1383010047 conn(0x55addeb82990 msgr2=0x55addef44a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 shutdown_connections 2024-09-21T08:03:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.611+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1383010047 wait complete. 2024-09-21T08:03:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.612+0000 7f52e0f1b740 1 -- start start 2024-09-21T08:03:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.613+0000 7f52e0f1b740 1 Processor -- start 2024-09-21T08:03:22.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.613+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb65980 0x55addef4ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 0x55addef4cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52e0f1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef4d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 0x55addef4cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 0x55addef4cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38542/0 (socket says 172.21.15.6:38542) 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52d37fe640 1 -- 172.21.15.6:0/1253976988 learned_addr learned my addr 172.21.15.6:0/1253976988 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41ad960 con 0x55addeb65980 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41aedd0 con 0x55addeb8e840 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.614+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41ae030 con 0x55addeb6db60 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef4d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52e0f1b740 10 client.0 _ll_register_callbacks cb 0x7f52c4004750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:22.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d3fff640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb65980 0x55addef4ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 -- 172.21.15.6:0/1253976988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 msgr2=0x55addef4cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 0x55addef4cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 -- 172.21.15.6:0/1253976988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb65980 msgr2=0x55addef4ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb65980 0x55addef4ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addefc6380 con 0x55addeb8e840 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.615+0000 7f52d8f44640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef4d4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0e4750 tx=0x7f52cc0e4d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464b5a2960ec598d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.616+0000 7f52b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.616+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0d4070 con 0x55addeb8e840 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.616+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f52cc0940b0 con 0x55addeb8e840 2024-09-21T08:03:22.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.617+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c80035f0 con 0x55addeb8e840 2024-09-21T08:03:22.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.617+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f52cc0cee60 con 0x55addeb8e840 2024-09-21T08:03:22.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.618+0000 7f52e0f1b740 10 client.25601 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:22.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.618+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55addefc7620 con 0x55addeb8e840 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.618+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52c80035f0 con 0x55addeb8e840 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.618+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f52cc0a87a0 con 0x55addeb8e840 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 10 client.25601 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 10 client.25601 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 20 client.25601 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb22570 0x55addefc9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 4 client.25601 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T08:03:22.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.619+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55addeea9590 con 0x55addeb22570 2024-09-21T08:03:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.621+0000 7f52d3fff640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb22570 0x55addefc9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:22.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.623+0000 7f52b37fe640 10 client.25601 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:22.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.623+0000 7f52d3fff640 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb22570 0x55addefc9dd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58d06d7ad446f841 server_cookie=6bf938d23e1f99b3 in_seq=0 out_seq=0 2024-09-21T08:03:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:22.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:22 smithi006 ceph-mon[30970]: pgmap v413: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.919+0000 7f52b37fe640 1 -- 172.21.15.6:0/1253976988 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55addeea9590 con 0x55addeb22570 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52b37fe640 10 client.25601 handle_command_reply: tid=0 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 client.25601 shutdown 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 msgr2=0x55addef4d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef4d4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0e4750 tx=0x7f52cc0e4d10 comp rx=0 tx=0).stop 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 shutdown_connections 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55addeb22570 0x55addefc9dd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55addeb6db60 0x55addef4cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55addeb8e840 0x55addef4d4a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 --2- 172.21.15.6:0/1253976988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55addeb65980 0x55addef4ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52b37fe640 0 client.25601 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 >> 172.21.15.6:0/1253976988 conn(0x55addeb82990 msgr2=0x55addef44a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 shutdown_connections 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 1 -- 172.21.15.6:0/1253976988 wait complete. 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.920+0000 7f52e0f1b740 20 client.25601 trim_cache size 0 max 16384 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 10, 2024-09-21T08:03:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "e70b316d": { 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 10, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 147.8, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:03:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:22.925 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 msgr2=0x7f52bc0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 0x7f52bc0b8c90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f52d4100ce0 tx=0x7f52c8005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 msgr2=0x7f52d419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d419d940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00da10 tx=0x7f52cc00ded0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 shutdown_connections 2024-09-21T08:03:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52bc0b6780 0x7f52bc0b8c90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52d4108d10 0x7f52d419d940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d41083c0 0x7f52d41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 --2- 172.21.15.6:0/1407611205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52d4102a80 0x7f52d4198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.921+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 >> 172.21.15.6:0/1407611205 conn(0x7f52d4079760 msgr2=0x7f52d41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.922+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 shutdown_connections 2024-09-21T08:03:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:22.922+0000 7f52da9a7640 1 -- 172.21.15.6:0/1407611205 wait complete. 2024-09-21T08:03:22.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:22 smithi145 ceph-mon[34049]: pgmap v413: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2024-09-21T08:03:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:22 smithi119 ceph-mon[33564]: pgmap v413: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2024-09-21T08:03:23.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 -- 172.21.15.6:0/670955953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c1083d0 msgr2=0x7f119c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 --2- 172.21.15.6:0/670955953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c1083d0 0x7f119c1087e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1190009900 tx=0x7f119002a410 comp rx=0 tx=0).stop 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 -- 172.21.15.6:0/670955953 shutdown_connections 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 --2- 172.21.15.6:0/670955953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c108d20 0x7f119c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 --2- 172.21.15.6:0/670955953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c1083d0 0x7f119c1087e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 --2- 172.21.15.6:0/670955953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 0x7f119c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 -- 172.21.15.6:0/670955953 >> 172.21.15.6:0/670955953 conn(0x7f119c079760 msgr2=0x7f119c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 -- 172.21.15.6:0/670955953 shutdown_connections 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.375+0000 7f11a0a59640 1 -- 172.21.15.6:0/670955953 wait complete. 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.376+0000 7f11a0a59640 1 Processor -- start 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.376+0000 7f11a0a59640 1 -- start start 2024-09-21T08:03:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 0x7f119c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c1083d0 0x7f119c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f119c113960 con 0x7f119c108d20 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1137e0 con 0x7f119c102ae0 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f11a0a59640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f119c113ae0 con 0x7f119c1083d0 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48602/0 (socket says 172.21.15.6:48602) 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 -- 172.21.15.6:0/1002372482 learned_addr learned my addr 172.21.15.6:0/1002372482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c1083d0 0x7f119c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119a59c640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 0x7f119c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 -- 172.21.15.6:0/1002372482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c1083d0 msgr2=0x7f119c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c1083d0 0x7f119c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 -- 172.21.15.6:0/1002372482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 msgr2=0x7f119c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 0x7f119c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 -- 172.21.15.6:0/1002372482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c1a2640 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.377+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f119400eaa0 tx=0x7f119400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.378+0000 7f118b7fe640 1 -- 172.21.15.6:0/1002372482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119400cdb0 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.378+0000 7f118b7fe640 1 -- 172.21.15.6:0/1002372482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1194005020 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.378+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c1a2930 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.378+0000 7f118b7fe640 1 -- 172.21.15.6:0/1002372482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940116d0 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.378+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1a9090 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.380+0000 7f118b7fe640 1 -- 172.21.15.6:0/1002372482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f11940051d0 con 0x7f119c108d20 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.380+0000 7f11a6fcd740 1 Processor -- start 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 -- start start 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc3d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561e4cbb3e50 con 0x561e4c86d1b0 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e4cba3280 con 0x561e4c875390 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561e4cba7090 con 0x561e4c896070 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48618/0 (socket says 172.21.15.6:48618) 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 -- 172.21.15.6:0/1070726242 learned_addr learned my addr 172.21.15.6:0/1070726242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc3d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 -- 172.21.15.6:0/1070726242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 msgr2=0x561e4cc3d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc3d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 -- 172.21.15.6:0/1070726242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 msgr2=0x561e4cc3e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f119a59c640 1 -- 172.21.15.6:0/1070726242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4c901650 con 0x561e4c86d1b0 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.381+0000 7f118b7fe640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 0x7f11840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 0x7f11840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f119a59c640 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f118c00bd10 tx=0x7f118c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc4aa687e0f8b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f118b7fe640 1 -- 172.21.15.6:0/1002372482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f11940e7ac0 con 0x7f119c108d20 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f1188ff9640 1 -- 172.21.15.6:0/1070726242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c004030 con 0x561e4c86d1b0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f1188ff9640 1 -- 172.21.15.6:0/1070726242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f118c0035f0 con 0x561e4c86d1b0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.382+0000 7f1188ff9640 1 -- 172.21.15.6:0/1070726242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c011680 con 0x561e4c86d1b0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1070726242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 msgr2=0x561e4cc3db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 0x7f11840b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1190004770 tx=0x7f11900058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f118c00bd10 tx=0x7f118c0107a0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1070726242 shutdown_connections 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc3db90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1070726242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc3d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1070726242 >> 172.21.15.6:0/1070726242 conn(0x561e4c88a460 msgr2=0x561e4cc3b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1070726242 shutdown_connections 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.383+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1070726242 wait complete. 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 -- start start 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 Processor -- start 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc49200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561e4ca04700 con 0x561e4c86d1b0 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e4cb3e110 con 0x561e4c875390 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561e4cc4be30 con 0x561e4c896070 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f11a6fcd740 10 client.0 _ll_register_callbacks cb 0x561e4cb57990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48626/0 (socket says 172.21.15.6:48626) 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 -- 172.21.15.6:0/1108772508 learned_addr learned my addr 172.21.15.6:0/1108772508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc49200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 -- 172.21.15.6:0/1108772508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 msgr2=0x561e4cc55120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 -- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 msgr2=0x561e4cc49200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc49200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119a59c640 1 -- 172.21.15.6:0/1108772508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4cb6bc40 con 0x561e4c86d1b0 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc49200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.384+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f119a59c640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f118c000c00 tx=0x7f118c00bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb89f3590fd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c029060 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f118c003bf0 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f118c0035f0 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f118c030050 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f11a6fcd740 10 client.15921 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561e4cc57b00 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f118c0035f0 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f118c0046c0 con 0x561e4c86d1b0 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.385+0000 7f11a6fcd740 10 client.15921 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f11a6fcd740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f11a6fcd740 20 client.15921 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c8549f0 0x561e4cc5af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f11a6fcd740 4 client.15921 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e4cbb5da0 con 0x561e4c8549f0 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c8549f0 0x561e4cc5af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c8549f0 0x561e4cc5af10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d19c515b9850e6 server_cookie=c86199c7ddeae832 in_seq=0 out_seq=0 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.386+0000 7f1181ffb640 10 client.15921 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f1181ffb640 1 -- 172.21.15.6:0/1108772508 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e4cbb5da0 con 0x561e4c8549f0 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f1181ffb640 10 client.15921 handle_command_reply: tid=0 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 client.15921 shutdown 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 msgr2=0x561e4cc48cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f118c000c00 tx=0x7f118c00bfc0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 shutdown_connections 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c8549f0 0x561e4cc5af10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc49200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f1181ffb640 0 client.15921 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1108772508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc48cc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 >> 172.21.15.6:0/1108772508 conn(0x561e4c88a460 msgr2=0x561e4cc407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 shutdown_connections 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1108772508 wait complete. 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.387+0000 7f11a6fcd740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 Processor -- start 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 -- start start 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b1170 con 0x561e4c86d1b0 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b39f0 con 0x561e4c875390 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b17e0 con 0x561e4c896070 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48640/0 (socket says 172.21.15.6:48640) 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f119a59c640 1 -- 172.21.15.6:0/1320064920 learned_addr learned my addr 172.21.15.6:0/1320064920 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.406+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 -- 172.21.15.6:0/1320064920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 msgr2=0x561e4cc55090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 -- 172.21.15.6:0/1320064920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 msgr2=0x561e4cc3ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 -- 172.21.15.6:0/1320064920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4cc49f80 con 0x561e4c86d1b0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f119a59c640 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b7f0 tx=0x7f118c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825d9bda15d1ec48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f1183fff640 1 -- 172.21.15.6:0/1320064920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c029070 con 0x561e4c86d1b0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f1183fff640 1 -- 172.21.15.6:0/1320064920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f118c00be00 con 0x561e4c86d1b0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.407+0000 7f1183fff640 1 -- 172.21.15.6:0/1320064920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c0116a0 con 0x561e4c86d1b0 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1320064920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 msgr2=0x561e4cc47bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b7f0 tx=0x7f118c010d50 comp rx=0 tx=0).stop 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1320064920 shutdown_connections 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc55090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc3ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1320064920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc47bb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1320064920 >> 172.21.15.6:0/1320064920 conn(0x561e4c88a460 msgr2=0x561e4cc3e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1320064920 shutdown_connections 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1320064920 wait complete. 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 -- start start 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.408+0000 7f11a6fcd740 1 Processor -- start 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc5c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc5cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b1eb0 con 0x561e4c86d1b0 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b3320 con 0x561e4c875390 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1b2580 con 0x561e4c896070 2024-09-21T08:03:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 10 client.0 _ll_register_callbacks cb 0x7f1190032cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48656/0 (socket says 172.21.15.6:48656) 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 -- 172.21.15.6:0/1848727730 learned_addr learned my addr 172.21.15.6:0/1848727730 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119ad9d640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc5cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc5c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 -- 172.21.15.6:0/1848727730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 msgr2=0x561e4cc5cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc5cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 -- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 msgr2=0x561e4cc5c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc5c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 -- 172.21.15.6:0/1848727730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4ccc47c0 con 0x561e4c86d1b0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc5c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f119a59c640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f118c004fe0 tx=0x7f118c005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d98d958a5687346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f1181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c029040 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e4cbb1850 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.409+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f118c011440 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f118c045050 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 10 client.15927 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561e4ccc5a50 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561e4cbb1850 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f118c03f4a0 con 0x561e4c86d1b0 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:03:23.691 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "7de19529-7eca-4fce-8912-1b95b95dca42", 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:23.692 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:23.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 10 client.15927 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 20 client.15927 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c829da0 0x561e4ccc80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 4 client.15927 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e4cbaec80 con 0x561e4c829da0 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.410+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c829da0 0x561e4ccc80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f1199d9b640 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c829da0 0x561e4ccc80a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f427c640ee775c server_cookie=b36777acce28e439 in_seq=0 out_seq=0 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f1181ffb640 10 client.15927 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f1181ffb640 1 -- 172.21.15.6:0/1848727730 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x561e4cbaec80 con 0x561e4c829da0 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f1181ffb640 10 client.15927 handle_command_reply: tid=0 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 client.15927 shutdown 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 msgr2=0x561e4cc5c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f118c004fe0 tx=0x7f118c005010 comp rx=0 tx=0).stop 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 shutdown_connections 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561e4c829da0 0x561e4ccc80a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e4c896070 0x561e4cc5cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e4c875390 0x561e4cc5c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 --2- 172.21.15.6:0/1848727730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e4c86d1b0 0x561e4cc5c0b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 >> 172.21.15.6:0/1848727730 conn(0x561e4c88a460 msgr2=0x561e4cc42760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f1181ffb640 0 client.15927 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 shutdown_connections 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 1 -- 172.21.15.6:0/1848727730 wait complete. 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.411+0000 7f11a6fcd740 20 client.15927 trim_cache size 0 max 16384 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 msgr2=0x7f11840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 0x7f11840b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1190004770 tx=0x7f11900058d0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 msgr2=0x7f119c1a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f119400eaa0 tx=0x7f119400ef60 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 shutdown_connections 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11840b6700 0x7f11840b8c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c1083d0 0x7f119c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f119c108d20 0x7f119c1a1f10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 --2- 172.21.15.6:0/1002372482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f119c102ae0 0x7f119c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 >> 172.21.15.6:0/1002372482 conn(0x7f119c079760 msgr2=0x7f119c110060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 shutdown_connections 2024-09-21T08:03:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:23.412+0000 7f11a0a59640 1 -- 172.21.15.6:0/1002372482 wait complete. 2024-09-21T08:03:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:24 smithi145 ceph-mon[34049]: pgmap v414: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:03:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:24 smithi006 ceph-mon[30970]: pgmap v414: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:03:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:24 smithi119 ceph-mon[33564]: pgmap v414: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:03:26.503 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e70b316d', quiesce took 8.5 seconds. Will release after: 19.3 2024-09-21T08:03:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:26 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:03:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:26 smithi145 ceph-mon[34049]: pgmap v415: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.6 MiB/s wr, 982 op/s 2024-09-21T08:03:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:26 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:03:26.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:26 smithi006 ceph-mon[30970]: pgmap v415: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.6 MiB/s wr, 982 op/s 2024-09-21T08:03:27.021 INFO:tasks.cephfs.filesystem:scrub status for tag:7de19529-7eca-4fce-8912-1b95b95dca42 - {'path': '/', 'tag': '7de19529-7eca-4fce-8912-1b95b95dca42', 'options': 'recursive,force'} 2024-09-21T08:03:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:26 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:03:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:26 smithi119 ceph-mon[33564]: pgmap v415: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.6 MiB/s wr, 982 op/s 2024-09-21T08:03:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 30.0 s, 53.6 tps, lat 86.364 ms stddev 31.685 2024-09-21T08:03:28.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:28 smithi006 ceph-mon[30970]: pgmap v416: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 933 op/s 2024-09-21T08:03:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:28 smithi119 ceph-mon[33564]: pgmap v416: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 933 op/s 2024-09-21T08:03:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:28 smithi145 ceph-mon[34049]: pgmap v416: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 933 op/s 2024-09-21T08:03:30.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:30 smithi006 ceph-mon[30970]: pgmap v417: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-21T08:03:31.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:30 smithi119 ceph-mon[33564]: pgmap v417: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-21T08:03:31.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:30 smithi145 ceph-mon[34049]: pgmap v417: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-21T08:03:32.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 35.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:03:32.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:32 smithi006 ceph-mon[30970]: pgmap v418: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2024-09-21T08:03:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:32 smithi119 ceph-mon[33564]: pgmap v418: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2024-09-21T08:03:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:32 smithi145 ceph-mon[34049]: pgmap v418: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2024-09-21T08:03:34.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:34 smithi006 ceph-mon[30970]: pgmap v419: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-21T08:03:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:34 smithi119 ceph-mon[33564]: pgmap v419: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-21T08:03:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:34 smithi145 ceph-mon[34049]: pgmap v419: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.4 MiB/s wr, 382 op/s 2024-09-21T08:03:36.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:36 smithi006 ceph-mon[30970]: pgmap v420: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 145 op/s 2024-09-21T08:03:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:36 smithi119 ceph-mon[33564]: pgmap v420: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 145 op/s 2024-09-21T08:03:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:36 smithi145 ceph-mon[34049]: pgmap v420: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 145 op/s 2024-09-21T08:03:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 40.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:03:38.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:38 smithi006 ceph-mon[30970]: pgmap v421: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 602 KiB/s wr, 69 op/s 2024-09-21T08:03:39.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:38 smithi119 ceph-mon[33564]: pgmap v421: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 602 KiB/s wr, 69 op/s 2024-09-21T08:03:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:38 smithi145 ceph-mon[34049]: pgmap v421: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 602 KiB/s wr, 69 op/s 2024-09-21T08:03:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:40 smithi119 ceph-mon[33564]: pgmap v422: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 291 KiB/s wr, 37 op/s 2024-09-21T08:03:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:40 smithi145 ceph-mon[34049]: pgmap v422: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 291 KiB/s wr, 37 op/s 2024-09-21T08:03:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:40 smithi006 ceph-mon[30970]: pgmap v422: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 291 KiB/s wr, 37 op/s 2024-09-21T08:03:42.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 45.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:03:43.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:42 smithi006 ceph-mon[30970]: pgmap v423: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 315 KiB/s wr, 40 op/s 2024-09-21T08:03:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:42 smithi119 ceph-mon[33564]: pgmap v423: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 315 KiB/s wr, 40 op/s 2024-09-21T08:03:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:42 smithi145 ceph-mon[34049]: pgmap v423: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 315 KiB/s wr, 40 op/s 2024-09-21T08:03:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:44 smithi119 ceph-mon[33564]: pgmap v424: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-09-21T08:03:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:44 smithi145 ceph-mon[34049]: pgmap v424: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-09-21T08:03:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:44 smithi006 ceph-mon[30970]: pgmap v424: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-09-21T08:03:45.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:46.085 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 -- 172.21.15.6:0/3679322437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8107b80 msgr2=0x7f3ba8107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 --2- 172.21.15.6:0/3679322437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8107b80 0x7f3ba8107f90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009900 tx=0x7f3b9802a410 comp rx=0 tx=0).stop 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 -- 172.21.15.6:0/3679322437 shutdown_connections 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 --2- 172.21.15.6:0/3679322437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81084d0 0x7f3ba810ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 --2- 172.21.15.6:0/3679322437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8107b80 0x7f3ba8107f90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 --2- 172.21.15.6:0/3679322437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8102240 0x7f3ba8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 -- 172.21.15.6:0/3679322437 >> 172.21.15.6:0/3679322437 conn(0x7f3ba8079f90 msgr2=0x7f3ba807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 -- 172.21.15.6:0/3679322437 shutdown_connections 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.582+0000 7f3bb009c640 1 -- 172.21.15.6:0/3679322437 wait complete. 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 Processor -- start 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 -- start start 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8102240 0x7f3ba819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8107b80 0x7f3ba819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8112010 con 0x7f3ba81084d0 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8111e90 con 0x7f3ba8102240 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bb009c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8112190 con 0x7f3ba8107b80 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bae639640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bae639640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43976/0 (socket says 172.21.15.6:43976) 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bae639640 1 -- 172.21.15.6:0/4203890799 learned_addr learned my addr 172.21.15.6:0/4203890799 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bade38640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8102240 0x7f3ba819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.583+0000 7f3bad637640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8107b80 0x7f3ba819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 -- 172.21.15.6:0/4203890799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8107b80 msgr2=0x7f3ba819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8107b80 0x7f3ba819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 -- 172.21.15.6:0/4203890799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8102240 msgr2=0x7f3ba819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8102240 0x7f3ba819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 -- 172.21.15.6:0/4203890799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba81a6540 con 0x7f3ba81084d0 2024-09-21T08:03:46.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bae639640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009fd0 tx=0x7f3ba000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:46.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0017070 con 0x7f3ba81084d0 2024-09-21T08:03:46.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ba0003e00 con 0x7f3ba81084d0 2024-09-21T08:03:46.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba81a6830 con 0x7f3ba81084d0 2024-09-21T08:03:46.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0010460 con 0x7f3ba81084d0 2024-09-21T08:03:46.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.584+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba81a6d40 con 0x7f3ba81084d0 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.585+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba81034c0 con 0x7f3ba81084d0 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.588+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3ba0003970 con 0x7f3ba81084d0 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.588+0000 7f3b9effd640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 0x7f3b940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.589+0000 7f3bade38640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 0x7f3b940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.589+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3ba00e7b50 con 0x7f3ba81084d0 2024-09-21T08:03:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.589+0000 7f3bade38640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 0x7f3b940b8c10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ba81044d0 tx=0x7f3ba4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:46.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.592+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ba00b2180 con 0x7f3ba81084d0 2024-09-21T08:03:46.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.820+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ba8102650 con 0x7f3ba81084d0 2024-09-21T08:03:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.821+0000 7f3b9effd640 1 -- 172.21.15.6:0/4203890799 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f3ba00b70c0 con 0x7f3ba81084d0 2024-09-21T08:03:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:03:46.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:03:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 msgr2=0x7f3b940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 0x7f3b940b8c10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ba81044d0 tx=0x7f3ba4005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 msgr2=0x7f3ba819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009fd0 tx=0x7f3ba000b260 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 shutdown_connections 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3b940b6700 0x7f3b940b8c10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ba8107b80 0x7f3ba819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba81084d0 0x7f3ba819bcb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 --2- 172.21.15.6:0/4203890799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8102240 0x7f3ba819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 >> 172.21.15.6:0/4203890799 conn(0x7f3ba8079f90 msgr2=0x7f3ba8100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:46.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.823+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 shutdown_connections 2024-09-21T08:03:46.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:46.824+0000 7f3bb009c640 1 -- 172.21.15.6:0/4203890799 wait complete. 2024-09-21T08:03:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:46 smithi119 ceph-mon[33564]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 325 KiB/s wr, 41 op/s 2024-09-21T08:03:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:46 smithi145 ceph-mon[34049]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 325 KiB/s wr, 41 op/s 2024-09-21T08:03:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:46 smithi006 ceph-mon[30970]: pgmap v425: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 325 KiB/s wr, 41 op/s 2024-09-21T08:03:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:03:47.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id e70b316d --release --await' 2024-09-21T08:03:47.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id e70b316d --release --await 2024-09-21T08:03:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:48.059 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:47 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4203890799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:48.094 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:47 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4203890799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:48.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:47 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4203890799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 -- 172.21.15.6:0/208606193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 msgr2=0x7f3950104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 --2- 172.21.15.6:0/208606193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f3950104dc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3940009900 tx=0x7f394002a410 comp rx=0 tx=0).stop 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 -- 172.21.15.6:0/208606193 shutdown_connections 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 --2- 172.21.15.6:0/208606193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3950105300 0x7f395010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 --2- 172.21.15.6:0/208606193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395010de10 0x7f3950110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 --2- 172.21.15.6:0/208606193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f3950104dc0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 -- 172.21.15.6:0/208606193 >> 172.21.15.6:0/208606193 conn(0x7f3950079730 msgr2=0x7f3950079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 -- 172.21.15.6:0/208606193 shutdown_connections 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 -- 172.21.15.6:0/208606193 wait complete. 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.678+0000 7f395686b640 1 Processor -- start 2024-09-21T08:03:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 -- start start 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3950105300 0x7f395019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 0x7f395019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3950113940 con 0x7f39501049b0 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39501137c0 con 0x7f3950105300 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f395686b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3950113ac0 con 0x7f395010de10 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f394ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f394ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43990/0 (socket says 172.21.15.6:43990) 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f394ffff640 1 -- 172.21.15.6:0/252524886 learned_addr learned my addr 172.21.15.6:0/252524886 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 0x7f395019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.679+0000 7f394f7fe640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3950105300 0x7f395019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 -- 172.21.15.6:0/252524886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3950105300 msgr2=0x7f395019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3950105300 0x7f395019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 -- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 msgr2=0x7f395019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 -- 172.21.15.6:0/252524886 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39501a03c0 con 0x7f395010de10 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f394ffff640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 0x7f395019fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f394800e940 tx=0x7f394800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f394d7fa640 1 -- 172.21.15.6:0/252524886 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948004d20 con 0x7f395010de10 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39501a06b0 con 0x7f395010de10 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f394d7fa640 1 -- 172.21.15.6:0/252524886 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3948005020 con 0x7f395010de10 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f394d7fa640 1 -- 172.21.15.6:0/252524886 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480116d0 con 0x7f395010de10 2024-09-21T08:03:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.680+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501a6e10 con 0x7f395010de10 2024-09-21T08:03:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f394d7fa640 1 -- 172.21.15.6:0/252524886 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3948011870 con 0x7f395010de10 2024-09-21T08:03:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 Processor -- start 2024-09-21T08:03:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 -- start start 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da90840 0x561c7de57f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c7dd42dc0 con 0x561c7da90840 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561c7ddcf1f0 con 0x561c7dab1520 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.683+0000 7f395cddf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561c7ddbe620 con 0x561c7da88660 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:49638/0 (socket says 172.21.15.6:49638) 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da90840 0x561c7de57f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 -- 172.21.15.6:0/525711601 learned_addr learned my addr 172.21.15.6:0/525711601 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394f7fe640 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394d7fa640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 0x7f39380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 -- 172.21.15.6:0/525711601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 msgr2=0x561c7de57510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de57510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 0x7f39380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 -- 172.21.15.6:0/525711601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da90840 msgr2=0x561c7de57f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da90840 0x561c7de57f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394ffff640 1 -- 172.21.15.6:0/525711601 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c7dd86fd0 con 0x561c7da88660 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.684+0000 7f394d7fa640 1 -- 172.21.15.6:0/252524886 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f39480e7de0 con 0x7f395010de10 2024-09-21T08:03:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.685+0000 7f394ffff640 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3940006010 tx=0x7f3940032f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccafbe971957bf18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.685+0000 7f39367fc640 1 -- 172.21.15.6:0/525711601 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940035070 con 0x561c7da88660 2024-09-21T08:03:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.685+0000 7f39367fc640 1 -- 172.21.15.6:0/525711601 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39400044c0 con 0x561c7da88660 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.685+0000 7f39367fc640 1 -- 172.21.15.6:0/525711601 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940003db0 con 0x561c7da88660 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- 172.21.15.6:0/525711601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 msgr2=0x561c7de57a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f3954e08640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 0x7f39380b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39480e5260 tx=0x7f3948011000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3940006010 tx=0x7f3940032f60 comp rx=0 tx=0).stop 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- 172.21.15.6:0/525711601 shutdown_connections 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de57a50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da90840 0x561c7de57f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 --2- 172.21.15.6:0/525711601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- 172.21.15.6:0/525711601 >> 172.21.15.6:0/525711601 conn(0x561c7daa5910 msgr2=0x561c7de55400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- 172.21.15.6:0/525711601 shutdown_connections 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- 172.21.15.6:0/525711601 wait complete. 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.686+0000 7f395cddf740 1 -- start start 2024-09-21T08:03:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 Processor -- start 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da90840 0x561c7de63150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de73240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c7dd59300 con 0x561c7da88660 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561c7ddc2430 con 0x561c7dab1520 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561c7dc1fbb0 con 0x561c7da90840 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f395cddf740 10 client.0 _ll_register_callbacks cb 0x561c7dd73120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44022/0 (socket says 172.21.15.6:44022) 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f394f7fe640 1 -- 172.21.15.6:0/3459441364 learned_addr learned my addr 172.21.15.6:0/3459441364 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f394ffff640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da90840 0x561c7de63150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.687+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de73240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 -- 172.21.15.6:0/3459441364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da90840 msgr2=0x561c7de63150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da90840 0x561c7de63150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 -- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 msgr2=0x561c7de73240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de73240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 -- 172.21.15.6:0/3459441364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c7dd48780 con 0x561c7da88660 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f39440037d0 tx=0x7f3944009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ffb260f432f452 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f392f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944012b80 con 0x561c7da88660 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3944012d20 con 0x561c7da88660 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c7ddd1140 con 0x561c7da88660 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3944012030 con 0x561c7da88660 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f395cddf740 10 client.15945 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.688+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c7db1cb00 con 0x561c7da88660 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561c7ddd1140 con 0x561c7da88660 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f394401d030 con 0x561c7da88660 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 10 client.15945 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 10 client.15945 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 20 client.15945 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da6fea0 0x561c7de79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 4 client.15945 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c7ddccbf0 con 0x561c7da6fea0 2024-09-21T08:03:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.689+0000 7f394ffff640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da6fea0 0x561c7de79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.690+0000 7f392f7fe640 10 client.15945 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.690+0000 7f394ffff640 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da6fea0 0x561c7de79420 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b892f13a0bed3348 server_cookie=e356afe7131794b in_seq=0 out_seq=0 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.690+0000 7f392f7fe640 1 -- 172.21.15.6:0/3459441364 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c7ddccbf0 con 0x561c7da6fea0 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.690+0000 7f392f7fe640 10 client.15945 handle_command_reply: tid=0 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.690+0000 7f395cddf740 1 client.15945 shutdown 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 msgr2=0x561c7de62c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f39440037d0 tx=0x7f3944009ac0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 shutdown_connections 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da6fea0 0x561c7de79420 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da90840 0x561c7de63150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7dab1520 0x561c7de73240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 --2- 172.21.15.6:0/3459441364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de62c10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 >> 172.21.15.6:0/3459441364 conn(0x561c7daa5910 msgr2=0x561c7de5a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f392f7fe640 0 client.15945 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 shutdown_connections 2024-09-21T08:03:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 1 -- 172.21.15.6:0/3459441364 wait complete. 2024-09-21T08:03:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.691+0000 7f395cddf740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T08:03:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 Processor -- start 2024-09-21T08:03:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 -- start start 2024-09-21T08:03:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de73140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f39501acc40 con 0x561c7dab1520 2024-09-21T08:03:48.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39501af4c0 con 0x561c7da90840 2024-09-21T08:03:48.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f395cddf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f39501ad2b0 con 0x561c7da88660 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44036/0 (socket says 172.21.15.6:44036) 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f394f7fe640 1 -- 172.21.15.6:0/484319031 learned_addr learned my addr 172.21.15.6:0/484319031 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.709+0000 7f394ffff640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de73140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 -- 172.21.15.6:0/484319031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 msgr2=0x561c7de73140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de73140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 -- 172.21.15.6:0/484319031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 msgr2=0x561c7de697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 -- 172.21.15.6:0/484319031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c7db93960 con 0x561c7dab1520 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394ffff640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f394f7fe640 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3944003690 tx=0x7f3944005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5466f5f515c852e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f3935ffb640 1 -- 172.21.15.6:0/484319031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944012b80 con 0x561c7dab1520 2024-09-21T08:03:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f3935ffb640 1 -- 172.21.15.6:0/484319031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3944012d20 con 0x561c7dab1520 2024-09-21T08:03:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.710+0000 7f3935ffb640 1 -- 172.21.15.6:0/484319031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394400e6f0 con 0x561c7dab1520 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 -- 172.21.15.6:0/484319031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 msgr2=0x561c7de64af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3944003690 tx=0x7f3944005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 -- 172.21.15.6:0/484319031 shutdown_connections 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7dab1520 0x561c7de64af0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 --2- 172.21.15.6:0/484319031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7da88660 0x561c7de73140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 -- 172.21.15.6:0/484319031 >> 172.21.15.6:0/484319031 conn(0x561c7daa5910 msgr2=0x561c7de58540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 -- 172.21.15.6:0/484319031 shutdown_connections 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.711+0000 7f395cddf740 1 -- 172.21.15.6:0/484319031 wait complete. 2024-09-21T08:03:48.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 -- start start 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 Processor -- start 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de6f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7dab1520 0x561c7de6f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f39501ad980 con 0x561c7da88660 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39501aedf0 con 0x561c7da90840 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f39501ae050 con 0x561c7dab1520 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.712+0000 7f395cddf740 10 client.0 _ll_register_callbacks cb 0x7f3944009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44046/0 (socket says 172.21.15.6:44046) 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 -- 172.21.15.6:0/3572324847 learned_addr learned my addr 172.21.15.6:0/3572324847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394ffff640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de6f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7dab1520 0x561c7de6f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 -- 172.21.15.6:0/3572324847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7dab1520 msgr2=0x561c7de6f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7dab1520 0x561c7de6f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 -- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 msgr2=0x561c7de6f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de6f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 -- 172.21.15.6:0/3572324847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c7de66c90 con 0x561c7da88660 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f394f7fe640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3944003660 tx=0x7f39440035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d90e8e01319ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.713+0000 7f392f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:48.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440123e0 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3944009ac0 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3944012d20 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3944046050 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 10 client.15951 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c7dee8880 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3944012d20 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f394401d040 con 0x561c7da88660 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 10 client.15951 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 10 client.15951 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 20 client.15951 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da45250 0x561c7deeaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 4 client.15951 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e70b316d", "release": true, "await": true}] 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.714+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e70b316d", "release": true, "await": true}) -- 0x561c7ddca020 con 0x561c7da45250 2024-09-21T08:03:48.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.715+0000 7f394ffff640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da45250 0x561c7deeaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.715+0000 7f392f7fe640 10 client.15951 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:48.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.715+0000 7f394ffff640 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da45250 0x561c7deeaef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7faea66547da329 server_cookie=963079f0386bb69f in_seq=0 out_seq=0 2024-09-21T08:03:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.773+0000 7f392f7fe640 1 -- 172.21.15.6:0/3572324847 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561c7ddca020 con 0x561c7da45250 2024-09-21T08:03:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.773+0000 7f392f7fe640 10 client.15951 handle_command_reply: tid=0 2024-09-21T08:03:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.773+0000 7f395cddf740 1 client.15951 shutdown 2024-09-21T08:03:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 msgr2=0x561c7de697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3944003660 tx=0x7f39440035f0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 shutdown_connections 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561c7da45250 0x561c7deeaef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561c7dab1520 0x561c7de6f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c7da90840 0x561c7de6f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 --2- 172.21.15.6:0/3572324847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c7da88660 0x561c7de697c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 >> 172.21.15.6:0/3572324847 conn(0x561c7daa5910 msgr2=0x561c7de64890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f392f7fe640 0 client.15951 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 shutdown_connections 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 1 -- 172.21.15.6:0/3572324847 wait complete. 2024-09-21T08:03:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.774+0000 7f395cddf740 20 client.15951 trim_cache size 0 max 16384 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 12, 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "e70b316d": { 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 12, 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 147.8, 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:48.779 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 msgr2=0x7f39380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 0x7f39380b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39480e5260 tx=0x7f3948011000 comp rx=0 tx=0).stop 2024-09-21T08:03:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 msgr2=0x7f395019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 0x7f395019fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f394800e940 tx=0x7f394800ee00 comp rx=0 tx=0).stop 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 shutdown_connections 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f39380b6680 0x7f39380b8b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f395010de10 0x7f395019fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3950105300 0x7f395019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 --2- 172.21.15.6:0/252524886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39501049b0 0x7f395019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 >> 172.21.15.6:0/252524886 conn(0x7f3950079730 msgr2=0x7f3950100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 shutdown_connections 2024-09-21T08:03:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:48.775+0000 7f395686b640 1 -- 172.21.15.6:0/252524886 wait complete. 2024-09-21T08:03:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:48 smithi006 ceph-mon[30970]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 338 KiB/s wr, 43 op/s 2024-09-21T08:03:48.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:48 smithi119 ceph-mon[33564]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 338 KiB/s wr, 43 op/s 2024-09-21T08:03:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:48 smithi145 ceph-mon[34049]: pgmap v426: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 338 KiB/s wr, 43 op/s 2024-09-21T08:03:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:49.585 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e70b316d', total seconds elapsed: 31.6 2024-09-21T08:03:49.585 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T08:03:49.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:49.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:49.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:49.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:03:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:03:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:03:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.644+0000 7f53d4441640 1 -- 172.21.15.6:0/2595867276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 msgr2=0x7f53cc06ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.644+0000 7f53d4441640 1 --2- 172.21.15.6:0/2595867276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc06ae60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009be0 tx=0x7f53c402a6d0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 -- 172.21.15.6:0/2595867276 shutdown_connections 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 --2- 172.21.15.6:0/2595867276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc06ae60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 --2- 172.21.15.6:0/2595867276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 --2- 172.21.15.6:0/2595867276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 -- 172.21.15.6:0/2595867276 >> 172.21.15.6:0/2595867276 conn(0x7f53cc079730 msgr2=0x7f53cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:50.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 -- 172.21.15.6:0/2595867276 shutdown_connections 2024-09-21T08:03:50.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.646+0000 7f53d4441640 1 -- 172.21.15.6:0/2595867276 wait complete. 2024-09-21T08:03:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.647+0000 7f53d4441640 1 Processor -- start 2024-09-21T08:03:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.648+0000 7f53d4441640 1 -- start start 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.648+0000 7f53d4441640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.648+0000 7f53d4441640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.648+0000 7f53d4441640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc1a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d4441640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc115b40 con 0x7f53cc1083a0 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d19dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d19dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44064/0 (socket says 172.21.15.6:44064) 2024-09-21T08:03:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d19dc640 1 -- 172.21.15.6:0/361391412 learned_addr learned my addr 172.21.15.6:0/361391412 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d29de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc1a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc10f570 con 0x7f53cc102a60 2024-09-21T08:03:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc115cc0 con 0x7f53cc108cf0 2024-09-21T08:03:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.649+0000 7f53d21dd640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 -- 172.21.15.6:0/361391412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 msgr2=0x7f53cc1a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc1a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 -- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 msgr2=0x7f53cc19ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc1a2450 con 0x7f53cc102a60 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d19dc640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53d21dd640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc19c4e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e790 tx=0x7f53c800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c800eea0 con 0x7f53cc102a60 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53c800ccc0 con 0x7f53cc102a60 2024-09-21T08:03:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.650+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8018680 con 0x7f53cc102a60 2024-09-21T08:03:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.651+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc1a2740 con 0x7f53cc102a60 2024-09-21T08:03:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.651+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc1a8ea0 con 0x7f53cc102a60 2024-09-21T08:03:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.652+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53cc1087b0 con 0x7f53cc102a60 2024-09-21T08:03:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.654+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f53c8010430 con 0x7f53cc102a60 2024-09-21T08:03:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.655+0000 7f53c37fe640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 0x7f53b80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.656+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f53c80e7bf0 con 0x7f53cc102a60 2024-09-21T08:03:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.656+0000 7f53d19dc640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 0x7f53b80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.657+0000 7f53d19dc640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 0x7f53b80b8c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53cc06af80 tx=0x7f53bc00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:50.661+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53c80b2140 con 0x7f53cc102a60 2024-09-21T08:03:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.112+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53cc1a9070 con 0x7f53cc102a60 2024-09-21T08:03:51.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:50 smithi006 ceph-mon[30970]: pgmap v427: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 310 KiB/s wr, 40 op/s 2024-09-21T08:03:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.113+0000 7f53c37fe640 1 -- 172.21.15.6:0/361391412 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f53c80b7080 con 0x7f53cc102a60 2024-09-21T08:03:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:03:51.115 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:03:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 msgr2=0x7f53b80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 0x7f53b80b8c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53cc06af80 tx=0x7f53bc00b410 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 msgr2=0x7f53cc19c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc19c4e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e790 tx=0x7f53c800ec50 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 shutdown_connections 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f53b80b6700 0x7f53b80b8c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53cc108cf0 0x7f53cc1a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53cc1083a0 0x7f53cc19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 --2- 172.21.15.6:0/361391412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc102a60 0x7f53cc19c4e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 >> 172.21.15.6:0/361391412 conn(0x7f53cc079730 msgr2=0x7f53cc110460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.117+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 shutdown_connections 2024-09-21T08:03:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:51.118+0000 7f53d4441640 1 -- 172.21.15.6:0/361391412 wait complete. 2024-09-21T08:03:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:50 smithi119 ceph-mon[33564]: pgmap v427: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 310 KiB/s wr, 40 op/s 2024-09-21T08:03:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:50 smithi145 ceph-mon[34049]: pgmap v427: 129 pgs: 129 active+clean; 1.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 310 KiB/s wr, 40 op/s 2024-09-21T08:03:51.906 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T08:03:51.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T08:03:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:51 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/361391412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:51 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/361391412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:52.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:51 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/361391412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 55.0 s, 765.6 tps, lat 778.384 ms stddev 4138.620 2024-09-21T08:03:52.845 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:52 smithi006 ceph-mon[30970]: pgmap v428: 129 pgs: 129 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 671 KiB/s wr, 83 op/s 2024-09-21T08:03:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.008+0000 7f1b88ac9640 1 -- 172.21.15.6:0/4274736294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8410a1b0 msgr2=0x7f1b8410a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.008+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/4274736294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8410a1b0 0x7f1b8410a5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009be0 tx=0x7f1b7402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.009+0000 7f1b88ac9640 1 -- 172.21.15.6:0/4274736294 shutdown_connections 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.009+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/4274736294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 0x7f1b8410ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.009+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/4274736294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b84116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.009+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/4274736294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8410a1b0 0x7f1b8410a5c0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009be0 tx=0x7f1b7402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.009+0000 7f1b88ac9640 1 -- 172.21.15.6:0/4274736294 >> 172.21.15.6:0/4274736294 conn(0x7f1b84078200 msgr2=0x7f1b841081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.010+0000 7f1b88ac9640 1 -- 172.21.15.6:0/4274736294 shutdown_connections 2024-09-21T08:03:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.010+0000 7f1b88ac9640 1 -- 172.21.15.6:0/4274736294 wait complete. 2024-09-21T08:03:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.011+0000 7f1b88ac9640 1 Processor -- start 2024-09-21T08:03:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 -- start start 2024-09-21T08:03:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 0x7f1b841a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b841a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 0x7f1b841a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84119f70 con 0x7f1b84110440 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84119df0 con 0x7f1b841a6360 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.012+0000 7f1b88ac9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8411a0f0 con 0x7f1b8410faf0 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.013+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b841a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.013+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b841a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44076/0 (socket says 172.21.15.6:44076) 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.013+0000 7f1b7bfff640 1 -- 172.21.15.6:0/3611701791 learned_addr learned my addr 172.21.15.6:0/3611701791 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.013+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 0x7f1b841a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.013+0000 7f1b8259c640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 0x7f1b841a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3611701791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 msgr2=0x7f1b841a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 0x7f1b841a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 msgr2=0x7f1b841a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b841a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3611701791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841a6f40 con 0x7f1b841a6360 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 0x7f1b841a6770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e970 tx=0x7f1b7c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b7b7fe640 1 -- 172.21.15.6:0/3611701791 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ccc0 con 0x7f1b841a6360 2024-09-21T08:03:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.014+0000 7f1b7b7fe640 1 -- 172.21.15.6:0/3611701791 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b7c005020 con 0x7f1b841a6360 2024-09-21T08:03:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.015+0000 7f1b7b7fe640 1 -- 172.21.15.6:0/3611701791 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ce60 con 0x7f1b841a6360 2024-09-21T08:03:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.015+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8406cde0 con 0x7f1b841a6360 2024-09-21T08:03:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.015+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8406d2d0 con 0x7f1b841a6360 2024-09-21T08:03:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.018+0000 7f1b8f03d740 1 Processor -- start 2024-09-21T08:03:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.020+0000 7f1b7b7fe640 1 -- 172.21.15.6:0/3611701791 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1b7c004a00 con 0x7f1b841a6360 2024-09-21T08:03:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.021+0000 7f1b7b7fe640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 0x7f1b700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 -- start start 2024-09-21T08:03:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b7b7fe640 1 -- 172.21.15.6:0/3611701791 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f1b7c0e7970 con 0x7f1b841a6360 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a9859600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a985a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5569a97cfb90 con 0x5569a9491b60 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5569a97befc0 con 0x5569a9489980 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.022+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5569a97c2dd0 con 0x5569a94b2840 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54822/0 (socket says 172.21.15.6:54822) 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 -- 172.21.15.6:0/627481487 learned_addr learned my addr 172.21.15.6:0/627481487 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b8259c640 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a9859600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 0x7f1b700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 -- 172.21.15.6:0/627481487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 msgr2=0x5569a9859600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a9859600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 -- 172.21.15.6:0/627481487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 msgr2=0x5569a985a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a985a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b7bfff640 1 -- 172.21.15.6:0/627481487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a9746060 con 0x5569a9489980 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.023+0000 7f1b8259c640 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a9859600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.024+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c011700 tx=0x7f1b6c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b8608582b0527f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.025+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 0x7f1b700b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c022000 tx=0x7f1b6c01d000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.025+0000 7f1b78ff9640 1 -- 172.21.15.6:0/627481487 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00fe30 con 0x5569a9489980 2024-09-21T08:03:53.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.025+0000 7f1b78ff9640 1 -- 172.21.15.6:0/627481487 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b6c023070 con 0x5569a9489980 2024-09-21T08:03:53.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.025+0000 7f1b78ff9640 1 -- 172.21.15.6:0/627481487 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00e700 con 0x5569a9489980 2024-09-21T08:03:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 -- 172.21.15.6:0/627481487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 msgr2=0x5569a9859b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c011700 tx=0x7f1b6c009f90 comp rx=0 tx=0).stop 2024-09-21T08:03:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 -- 172.21.15.6:0/627481487 shutdown_connections 2024-09-21T08:03:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a985a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9859b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/627481487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a9859600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 -- 172.21.15.6:0/627481487 >> 172.21.15.6:0/627481487 conn(0x5569a94a6990 msgr2=0x5569a98574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 -- 172.21.15.6:0/627481487 shutdown_connections 2024-09-21T08:03:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.027+0000 7f1b8f03d740 1 -- 172.21.15.6:0/627481487 wait complete. 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 -- start start 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 Processor -- start 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a98658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a986b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5569a96207a0 con 0x5569a9491b60 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5569a97640a0 con 0x5569a9489980 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5569a9867e30 con 0x5569a94b2840 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8f03d740 10 client.0 _ll_register_callbacks cb 0x5569a97413c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.028+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54832/0 (socket says 172.21.15.6:54832) 2024-09-21T08:03:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b8259c640 1 -- 172.21.15.6:0/3435974558 learned_addr learned my addr 172.21.15.6:0/3435974558 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a986b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a98658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 msgr2=0x5569a98652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3435974558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 msgr2=0x5569a98658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a98658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b82d9d640 1 -- 172.21.15.6:0/3435974558 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a9752880 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.029+0000 7f1b8259c640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a986b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0e4d40 tx=0x7f1b7c005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f62151fa32fb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c01c040 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f1b7c0a7b40 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6c023070 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c0b1f20 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b8f03d740 10 client.25735 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.030+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5569a952cb90 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b6c023070 con 0x5569a94b2840 2024-09-21T08:03:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b7c0ac110 con 0x5569a94b2840 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 10 client.25735 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 10 client.25735 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 20 client.25735 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a94711c0 0x5569a9877370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 4 client.25735 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.031+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569a97d1ae0 con 0x5569a94711c0 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.032+0000 7f1b8259c640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a94711c0 0x5569a9877370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.032+0000 7f1b8259c640 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a94711c0 0x5569a9877370 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91353696b4532b7e server_cookie=bfef2f646066f29e in_seq=0 out_seq=0 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.032+0000 7f1b69ffb640 10 client.25735 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b69ffb640 1 -- 172.21.15.6:0/3435974558 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569a97d1ae0 con 0x5569a94711c0 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b69ffb640 10 client.25735 handle_command_reply: tid=0 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 client.25735 shutdown 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 msgr2=0x5569a986b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a986b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0e4d40 tx=0x7f1b7c005720 comp rx=0 tx=0).stop 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 shutdown_connections 2024-09-21T08:03:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a94711c0 0x5569a9877370 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a94b2840 0x5569a986b0f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9491b60 0x5569a98658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3435974558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a98652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 >> 172.21.15.6:0/3435974558 conn(0x5569a94a6990 msgr2=0x5569a985c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.033+0000 7f1b69ffb640 0 client.25735 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.034+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 shutdown_connections 2024-09-21T08:03:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.035+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3435974558 wait complete. 2024-09-21T08:03:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.035+0000 7f1b8f03d740 20 client.25735 trim_cache size 0 max 16384 2024-09-21T08:03:53.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.068+0000 7f1b8f03d740 1 Processor -- start 2024-09-21T08:03:53.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.068+0000 7f1b8f03d740 1 -- start start 2024-09-21T08:03:53.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a9871ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a94b2840 0x5569a9856450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84075340 con 0x5569a94b2840 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841c0ad0 con 0x5569a9489980 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841be8c0 con 0x5569a9491b60 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b7bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a9871ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54834/0 (socket says 172.21.15.6:54834) 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b8259c640 1 -- 172.21.15.6:0/3521590443 learned_addr learned my addr 172.21.15.6:0/3521590443 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.069+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a94b2840 0x5569a9856450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 -- 172.21.15.6:0/3521590443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 msgr2=0x5569a9857350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 -- 172.21.15.6:0/3521590443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a94b2840 msgr2=0x5569a9856450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a94b2840 0x5569a9856450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 -- 172.21.15.6:0/3521590443 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a98776e0 con 0x5569a9491b60 2024-09-21T08:03:53.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b8259c640 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:53.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.070+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a9871ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00e400 tx=0x7f1b6c029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8ea2f1889e14df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.071+0000 7f1b6bfff640 1 -- 172.21.15.6:0/3521590443 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c034070 con 0x5569a9491b60 2024-09-21T08:03:53.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.071+0000 7f1b6bfff640 1 -- 172.21.15.6:0/3521590443 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b6c023070 con 0x5569a9491b60 2024-09-21T08:03:53.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.071+0000 7f1b6bfff640 1 -- 172.21.15.6:0/3521590443 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c01dc50 con 0x5569a9491b60 2024-09-21T08:03:53.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3521590443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 msgr2=0x5569a9871ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a9871ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00e400 tx=0x7f1b6c029000 comp rx=0 tx=0).stop 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3521590443 shutdown_connections 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a9871ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a94b2840 0x5569a9856450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/3521590443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a9489980 0x5569a9857350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.072+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3521590443 >> 172.21.15.6:0/3521590443 conn(0x5569a94a6990 msgr2=0x5569a9866610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.073+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3521590443 shutdown_connections 2024-09-21T08:03:53.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.073+0000 7f1b8f03d740 1 -- 172.21.15.6:0/3521590443 wait complete. 2024-09-21T08:03:53.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.074+0000 7f1b8f03d740 1 -- start start 2024-09-21T08:03:53.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.074+0000 7f1b8f03d740 1 Processor -- start 2024-09-21T08:03:53.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9489980 0x5569a986e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a986ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841bef90 con 0x5569a9489980 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841c0400 con 0x5569a94b2840 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841bf660 con 0x5569a9491b60 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b82d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b82d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54840/0 (socket says 172.21.15.6:54840) 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b82d9d640 1 -- 172.21.15.6:0/118431208 learned_addr learned my addr 172.21.15.6:0/118431208 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:53.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8f03d740 10 client.0 _ll_register_callbacks cb 0x7f1b7c0acd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b8259c640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9489980 0x5569a986e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.075+0000 7f1b7bfff640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a986ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 -- 172.21.15.6:0/118431208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 msgr2=0x5569a986ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a986ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 -- 172.21.15.6:0/118431208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9489980 msgr2=0x5569a986e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9489980 0x5569a986e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 -- 172.21.15.6:0/118431208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a986f4f0 con 0x5569a94b2840 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b82d9d640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ad140 tx=0x7f1b7c0a93f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd0e49d235f1ead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.076+0000 7f1b69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.077+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c01c070 con 0x5569a94b2840 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.077+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f1b7c094b80 con 0x5569a94b2840 2024-09-21T08:03:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.077+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6c023070 con 0x5569a94b2840 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c0b6e60 con 0x5569a94b2840 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 10 client.25661 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5569a98e3160 con 0x5569a94b2840 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b6c023070 con 0x5569a94b2840 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b7c0ac7c0 con 0x5569a94b2840 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 10 client.25661 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 10 client.25661 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 20 client.25661 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.078+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a9446570 0x5569a98e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.079+0000 7f1b8f03d740 4 client.25661 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T08:03:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.079+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x5569a97cd590 con 0x5569a9446570 2024-09-21T08:03:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.079+0000 7f1b8259c640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a9446570 0x5569a98e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.080+0000 7f1b8259c640 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a9446570 0x5569a98e57b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c53199d165f5d4 server_cookie=8a53b44451734116 in_seq=0 out_seq=0 2024-09-21T08:03:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.080+0000 7f1b69ffb640 10 client.25661 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:52 smithi119 ceph-mon[33564]: pgmap v428: 129 pgs: 129 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 671 KiB/s wr, 83 op/s 2024-09-21T08:03:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:52 smithi145 ceph-mon[34049]: pgmap v428: 129 pgs: 129 active+clean; 1.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 671 KiB/s wr, 83 op/s 2024-09-21T08:03:53.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.446+0000 7f1b69ffb640 1 -- 172.21.15.6:0/118431208 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5569a97cd590 con 0x5569a9446570 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.446+0000 7f1b69ffb640 10 client.25661 handle_command_reply: tid=0 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.446+0000 7f1b8f03d740 1 client.25661 shutdown 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 msgr2=0x5569a98e1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ad140 tx=0x7f1b7c0a93f0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 shutdown_connections 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5569a9446570 0x5569a98e57b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5569a9491b60 0x5569a986ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5569a94b2840 0x5569a98e1cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 --2- 172.21.15.6:0/118431208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5569a9489980 0x5569a986e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b69ffb640 0 client.25661 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 >> 172.21.15.6:0/118431208 conn(0x5569a94a6990 msgr2=0x5569a9856220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 shutdown_connections 2024-09-21T08:03:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 1 -- 172.21.15.6:0/118431208 wait complete. 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b8f03d740 20 client.25661 trim_cache size 0 max 16384 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 14, 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "2e9651dc": { 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 14, 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:03:53.450 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 147.8, 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:53.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 msgr2=0x7f1b700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.447+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 0x7f1b700b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c022000 tx=0x7f1b6c01d000 comp rx=0 tx=0).stop 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 msgr2=0x7f1b841a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 0x7f1b841a6770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e970 tx=0x7f1b7c00ee30 comp rx=0 tx=0).stop 2024-09-21T08:03:53.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 shutdown_connections 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b700b6680 0x7f1b700b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b841a6360 0x7f1b841a6770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b84110440 0x7f1b841a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 --2- 172.21.15.6:0/3611701791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b8410faf0 0x7f1b841a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 >> 172.21.15.6:0/3611701791 conn(0x7f1b84078200 msgr2=0x7f1b840796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 shutdown_connections 2024-09-21T08:03:53.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:53.448+0000 7f1b88ac9640 1 -- 172.21.15.6:0/3611701791 wait complete. 2024-09-21T08:03:54.229 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2e9651dc', quiesce took 4.6 seconds. Will release after: 23.200000000000003 2024-09-21T08:03:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:54 smithi119 ceph-mon[33564]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 296 op/s 2024-09-21T08:03:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:54 smithi145 ceph-mon[34049]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 296 op/s 2024-09-21T08:03:55.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:54 smithi006 ceph-mon[30970]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 296 op/s 2024-09-21T08:03:57.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:03:57.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:56 smithi006 ceph-mon[30970]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.2 MiB/s wr, 371 op/s 2024-09-21T08:03:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:56 smithi119 ceph-mon[33564]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.2 MiB/s wr, 371 op/s 2024-09-21T08:03:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:56 smithi145 ceph-mon[34049]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.2 MiB/s wr, 371 op/s 2024-09-21T08:03:57.295 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:03:57.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 60.0 s, 151.1 tps, lat 94.756 ms stddev 26.735 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 -- 172.21.15.6:0/2349540381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 msgr2=0x7fb48c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 --2- 172.21.15.6:0/2349540381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c10f520 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb484009ca0 tx=0x7fb48402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 -- 172.21.15.6:0/2349540381 shutdown_connections 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 --2- 172.21.15.6:0/2349540381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c10f520 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 --2- 172.21.15.6:0/2349540381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c1083a0 0x7fb48c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 --2- 172.21.15.6:0/2349540381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c102a60 0x7fb48c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 -- 172.21.15.6:0/2349540381 >> 172.21.15.6:0/2349540381 conn(0x7fb48c079730 msgr2=0x7fb48c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 -- 172.21.15.6:0/2349540381 shutdown_connections 2024-09-21T08:03:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.221+0000 7fb491bea640 1 -- 172.21.15.6:0/2349540381 wait complete. 2024-09-21T08:03:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 Processor -- start 2024-09-21T08:03:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 -- start start 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c102a60 0x7fb48c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c113960 con 0x7fb48c108cf0 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1137e0 con 0x7fb48c102a60 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.222+0000 7fb491bea640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c113ae0 con 0x7fb48c1083a0 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:33798/0 (socket says 172.21.15.6:33798) 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 -- 172.21.15.6:0/2329022212 learned_addr learned my addr 172.21.15.6:0/2329022212 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48bfff640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47722/0 (socket says 172.21.15.6:47722) 2024-09-21T08:03:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c102a60 0x7fb48c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 -- 172.21.15.6:0/2329022212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c102a60 msgr2=0x7fb48c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c102a60 0x7fb48c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 -- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 msgr2=0x7fb48c19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 -- 172.21.15.6:0/2329022212 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c1a0280 con 0x7fb48c1083a0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48bfff640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.223+0000 7fb48affd640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb480005fd0 tx=0x7fb48000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.224+0000 7fb488ff9640 1 -- 172.21.15.6:0/2329022212 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480017070 con 0x7fb48c1083a0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.224+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48c1a0570 con 0x7fb48c1083a0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.224+0000 7fb488ff9640 1 -- 172.21.15.6:0/2329022212 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb480009c30 con 0x7fb48c1083a0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.224+0000 7fb488ff9640 1 -- 172.21.15.6:0/2329022212 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480003c70 con 0x7fb48c1083a0 2024-09-21T08:03:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.224+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb48c1a6cd0 con 0x7fb48c1083a0 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.226+0000 7fb49815e740 1 Processor -- start 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 -- start start 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x5571063fb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 0x5571063fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557106371e50 con 0x55710602b1b0 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557106361280 con 0x557106033390 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb49815e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557106365090 con 0x557106054070 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb488ff9640 1 -- 172.21.15.6:0/2329022212 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb480003e10 con 0x7fb48c1083a0 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47728/0 (socket says 172.21.15.6:47728) 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 -- 172.21.15.6:0/2162580031 learned_addr learned my addr 172.21.15.6:0/2162580031 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48bfff640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x5571063fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48affd640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 0x5571063fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 -- 172.21.15.6:0/2162580031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 msgr2=0x5571063fb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x5571063fb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 -- 172.21.15.6:0/2162580031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 msgr2=0x5571063fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 0x5571063fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.227+0000 7fb48b7fe640 1 -- 172.21.15.6:0/2162580031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571060bf650 con 0x55710602b1b0 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb48affd640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 0x5571063fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bd10 tx=0x7fb47c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dc95d3d27140f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb488ff9640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 0x7fb4740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb471ffb640 1 -- 172.21.15.6:0/2162580031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c004030 con 0x55710602b1b0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb471ffb640 1 -- 172.21.15.6:0/2162580031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb47c0035f0 con 0x55710602b1b0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb471ffb640 1 -- 172.21.15.6:0/2162580031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c011660 con 0x55710602b1b0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb48bfff640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 0x7fb4740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.228+0000 7fb488ff9640 1 -- 172.21.15.6:0/2329022212 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb4800e7660 con 0x7fb48c1083a0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 -- 172.21.15.6:0/2162580031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 msgr2=0x5571063fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb48bfff640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 0x7fb4740b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb484006010 tx=0x7fb484009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bd10 tx=0x7fb47c0107a0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 -- 172.21.15.6:0/2162580031 shutdown_connections 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106033390 0x5571063fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55710602b1b0 0x5571063fbb90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 --2- 172.21.15.6:0/2162580031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x5571063fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 -- 172.21.15.6:0/2162580031 >> 172.21.15.6:0/2162580031 conn(0x557106048460 msgr2=0x5571063f9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 -- 172.21.15.6:0/2162580031 shutdown_connections 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.229+0000 7fb49815e740 1 -- 172.21.15.6:0/2162580031 wait complete. 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 -- start start 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 Processor -- start 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 0x557106406cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 0x557106413120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5571061c2700 con 0x557106033390 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5571062fc110 con 0x557106054070 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557106409e30 con 0x55710602b1b0 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb49815e740 10 client.0 _ll_register_callbacks cb 0x557106315990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb48affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb48affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47732/0 (socket says 172.21.15.6:47732) 2024-09-21T08:03:58.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.230+0000 7fb48affd640 1 -- 172.21.15.6:0/1160171012 learned_addr learned my addr 172.21.15.6:0/1160171012 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 0x557106406cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 0x557106413120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 -- 172.21.15.6:0/1160171012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 msgr2=0x557106406cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 0x557106406cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 -- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 msgr2=0x557106413120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 0x557106413120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 -- 172.21.15.6:0/1160171012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557106329c40 con 0x557106033390 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 0x557106413120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 0x557106406cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb48affd640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ad0c0 tx=0x7fb4800a9100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3822025da10b860d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb46affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4800ac8a0 con 0x557106033390 2024-09-21T08:03:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb4800e7270 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb47c0035f0 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.231+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb4800035f0 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 10 client.15981 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557106415b00 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb47c0035f0 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb4800a8a80 con 0x557106033390 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 10 client.15981 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 20 client.15981 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5571060129f0 0x557106418f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 4 client.15981 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557106373da0 con 0x5571060129f0 2024-09-21T08:03:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.232+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5571060129f0 0x557106418f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.233+0000 7fb46affd640 10 client.15981 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.233+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5571060129f0 0x557106418f40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f707bf5e5f2e7c58 server_cookie=d5b5a041b78584c8 in_seq=0 out_seq=0 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb46affd640 1 -- 172.21.15.6:0/1160171012 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557106373da0 con 0x5571060129f0 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb46affd640 10 client.15981 handle_command_reply: tid=0 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 client.15981 shutdown 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 msgr2=0x557106407200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ad0c0 tx=0x7fb4800a9100 comp rx=0 tx=0).stop 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 shutdown_connections 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5571060129f0 0x557106418f40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557106054070 0x557106413120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x557106407200 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 --2- 172.21.15.6:0/1160171012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55710602b1b0 0x557106406cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 >> 172.21.15.6:0/1160171012 conn(0x557106048460 msgr2=0x5571063fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb46affd640 0 client.15981 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 shutdown_connections 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.234+0000 7fb49815e740 1 -- 172.21.15.6:0/1160171012 wait complete. 2024-09-21T08:03:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.235+0000 7fb49815e740 20 client.15981 trim_cache size 0 max 16384 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.252+0000 7fb49815e740 1 Processor -- start 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.252+0000 7fb49815e740 1 -- start start 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.252+0000 7fb49815e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x5571064088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.252+0000 7fb49815e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106033390 0x5571063f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.252+0000 7fb49815e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb49815e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1aee10 con 0x557106054070 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb49815e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1b1690 con 0x55710602b1b0 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb49815e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1af480 con 0x557106033390 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47746/0 (socket says 172.21.15.6:47746) 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 -- 172.21.15.6:0/1648289351 learned_addr learned my addr 172.21.15.6:0/1648289351 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48affd640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106033390 0x5571063f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x5571064088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 -- 172.21.15.6:0/1648289351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106033390 msgr2=0x5571063f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106033390 0x5571063f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 -- 172.21.15.6:0/1648289351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 msgr2=0x5571064088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x5571064088f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 -- 172.21.15.6:0/1648289351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557106012c20 con 0x557106054070 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x5571064088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb484009ca0 tx=0x7fb484041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6041b51f72e47b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb4717fa640 1 -- 172.21.15.6:0/1648289351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484031ab0 con 0x557106054070 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.253+0000 7fb4717fa640 1 -- 172.21.15.6:0/1648289351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb484036050 con 0x557106054070 2024-09-21T08:03:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb4717fa640 1 -- 172.21.15.6:0/1648289351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484032050 con 0x557106054070 2024-09-21T08:03:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 -- 172.21.15.6:0/1648289351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 msgr2=0x5571063f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb484009ca0 tx=0x7fb484041000 comp rx=0 tx=0).stop 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 -- 172.21.15.6:0/1648289351 shutdown_connections 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106033390 0x5571063f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106054070 0x5571063f90b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 --2- 172.21.15.6:0/1648289351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x5571064088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 -- 172.21.15.6:0/1648289351 >> 172.21.15.6:0/1648289351 conn(0x557106048460 msgr2=0x5571064081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 -- 172.21.15.6:0/1648289351 shutdown_connections 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.254+0000 7fb49815e740 1 -- 172.21.15.6:0/1648289351 wait complete. 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 -- start start 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 Processor -- start 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x55710640f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x55710640b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1afb50 con 0x557106033390 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1b0fc0 con 0x55710602b1b0 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c1b0220 con 0x557106054070 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb49815e740 10 client.0 _ll_register_callbacks cb 0x7fb480005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb48affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb48affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47748/0 (socket says 172.21.15.6:47748) 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.255+0000 7fb48affd640 1 -- 172.21.15.6:0/1287127144 learned_addr learned my addr 172.21.15.6:0/1287127144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48bfff640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x55710640b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x55710640f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 -- 172.21.15.6:0/1287127144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 msgr2=0x55710640b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x55710640b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 -- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 msgr2=0x55710640f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:03:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x55710640f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 -- 172.21.15.6:0/1287127144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55710640b940 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x55710640f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb48affd640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb4800a8d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4abe1240df2c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb46affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480014020 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb480004310 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb484036050 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb4800ac8a0 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb49815e740 10 client.15987 fetch_fsmap learned FSMap version 21 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.256+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557106483800 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb484036050 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb4800abe00 con 0x557106033390 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 10 client.15987 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:03:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 20 client.15987 populate_metadata read hostname 'smithi006' 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557105fe7da0 0x557106485fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 4 client.15987 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55710636f850 con 0x557105fe7da0 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.257+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557105fe7da0 0x557106485fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb46affd640 10 client.15987 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb48b7fe640 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557105fe7da0 0x557106485fa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54cb5f2094b2b4b server_cookie=82e072a2af8c9c43 in_seq=0 out_seq=0 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb46affd640 1 -- 172.21.15.6:0/1287127144 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55710636f850 con 0x557105fe7da0 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb46affd640 10 client.15987 handle_command_reply: tid=0 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 client.15987 shutdown 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 msgr2=0x55710640acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb4800a8d90 comp rx=0 tx=0).stop 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 shutdown_connections 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557105fe7da0 0x557106485fa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557106054070 0x55710640b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557106033390 0x55710640acc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 --2- 172.21.15.6:0/1287127144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55710602b1b0 0x55710640f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 >> 172.21.15.6:0/1287127144 conn(0x557106048460 msgr2=0x5571063fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb46affd640 0 client.15987 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 shutdown_connections 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 1 -- 172.21.15.6:0/1287127144 wait complete. 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.258+0000 7fb49815e740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:03:58.264 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:58.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:03:58.266 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:03:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 msgr2=0x7fb4740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 0x7fb4740b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb484006010 tx=0x7fb484009360 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 msgr2=0x7fb48c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb480005fd0 tx=0x7fb48000dde0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 shutdown_connections 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb4740b6680 0x7fb4740b8b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb48c1083a0 0x7fb48c19a8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c108cf0 0x7fb48c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 --2- 172.21.15.6:0/2329022212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb48c102a60 0x7fb48c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 >> 172.21.15.6:0/2329022212 conn(0x7fb48c079730 msgr2=0x7fb48c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 shutdown_connections 2024-09-21T08:03:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:03:58.259+0000 7fb491bea640 1 -- 172.21.15.6:0/2329022212 wait complete. 2024-09-21T08:03:58.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:03:58 smithi006 ceph-mon[30970]: pgmap v431: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 436 op/s 2024-09-21T08:03:59.037 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:03:59.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:03:58 smithi119 ceph-mon[33564]: pgmap v431: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 436 op/s 2024-09-21T08:03:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:03:58 smithi145 ceph-mon[34049]: pgmap v431: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 436 op/s 2024-09-21T08:03:59.338 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 -- 172.21.15.6:0/3909008785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4103b60 msgr2=0x7fcfa4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 --2- 172.21.15.6:0/3909008785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4103b60 0x7fcfa4103f70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009900 tx=0x7fcfa002a410 comp rx=0 tx=0).stop 2024-09-21T08:04:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 -- 172.21.15.6:0/3909008785 shutdown_connections 2024-09-21T08:04:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 --2- 172.21.15.6:0/3909008785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 --2- 172.21.15.6:0/3909008785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa41094a0 0x7fcfa41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 --2- 172.21.15.6:0/3909008785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4103b60 0x7fcfa4103f70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 -- 172.21.15.6:0/3909008785 >> 172.21.15.6:0/3909008785 conn(0x7fcfa407b850 msgr2=0x7fcfa407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 -- 172.21.15.6:0/3909008785 shutdown_connections 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.007+0000 7fcfac383640 1 -- 172.21.15.6:0/3909008785 wait complete. 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 Processor -- start 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 -- start start 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 0x7fcfa419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4113960 con 0x7fcfa41094a0 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa41137e0 con 0x7fcfa4103b60 2024-09-21T08:04:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfac383640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4113ae0 con 0x7fcfa4109df0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47758/0 (socket says 172.21.15.6:47758) 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 -- 172.21.15.6:0/4122112977 learned_addr learned my addr 172.21.15.6:0/4122112977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfaa920640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfaa11f640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 0x7fcfa419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 -- 172.21.15.6:0/4122112977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 msgr2=0x7fcfa419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 -- 172.21.15.6:0/4122112977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 msgr2=0x7fcfa419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 0x7fcfa419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfa991e640 1 -- 172.21.15.6:0/4122112977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41a0320 con 0x7fcfa41094a0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfaa920640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.008+0000 7fcfaa11f640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 0x7fcfa419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcfa991e640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400d950 tx=0x7fcf9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94017070 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf94009c30 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41a0610 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940047a0 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.009+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41a6d70 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.010+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa4103f70 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.012+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcf94004020 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.013+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 0x7fcf900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.013+0000 7fcfaa11f640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 0x7fcf900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.013+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fcf940e7d00 con 0x7fcfa41094a0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.013+0000 7fcfaa11f640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 0x7fcf900b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0006010 tx=0x7fcfa0000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.015+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf94020020 con 0x7fcfa41094a0 2024-09-21T08:04:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.241+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfa419b4e0 con 0x7fcfa41094a0 2024-09-21T08:04:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.241+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/4122112977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fcfa419b4e0 con 0x7fcfa41094a0 2024-09-21T08:04:00.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:04:00.244 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:04:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:04:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.243+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 msgr2=0x7fcf900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.243+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 0x7fcf900b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0006010 tx=0x7fcfa0000bc0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.243+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 msgr2=0x7fcfa419a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.243+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400d950 tx=0x7fcf9400de10 comp rx=0 tx=0).stop 2024-09-21T08:04:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 shutdown_connections 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcf900b6700 0x7fcf900b8c10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcfa4109df0 0x7fcfa419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41094a0 0x7fcfa419a950 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 --2- 172.21.15.6:0/4122112977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfa4103b60 0x7fcfa419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 >> 172.21.15.6:0/4122112977 conn(0x7fcfa407b850 msgr2=0x7fcfa41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 shutdown_connections 2024-09-21T08:04:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:00.244+0000 7fcfac383640 1 -- 172.21.15.6:0/4122112977 wait complete. 2024-09-21T08:04:00.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:00 smithi006 ceph-mon[30970]: pgmap v432: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 446 op/s 2024-09-21T08:04:00.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:00 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4122112977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:01.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:04:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:00 smithi119 ceph-mon[33564]: pgmap v432: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 446 op/s 2024-09-21T08:04:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:00 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4122112977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:00 smithi145 ceph-mon[34049]: pgmap v432: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.7 MiB/s wr, 446 op/s 2024-09-21T08:04:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:00 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4122112977' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2226503466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f0105380 msgr2=0x7f55f010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2226503466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f0105380 0x7f55f010d8d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009900 tx=0x7f55e002a410 comp rx=0 tx=0).stop 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2226503466 shutdown_connections 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2226503466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f010de60 0x7f55f0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2226503466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f0105380 0x7f55f010d8d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2226503466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0104a30 0x7f55f0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2226503466 >> 172.21.15.6:0/2226503466 conn(0x7f55f0079760 msgr2=0x7f55f0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2226503466 shutdown_connections 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.798+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2226503466 wait complete. 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 Processor -- start 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 -- start start 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 0x7f55f0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 0x7f55f0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0113950 con 0x7f55f010de60 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01137d0 con 0x7f55f0104a30 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f7dd1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0113ad0 con 0x7f55f0105380 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47768/0 (socket says 172.21.15.6:47768) 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 -- 172.21.15.6:0/2709386234 learned_addr learned my addr 172.21.15.6:0/2709386234 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f536c640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 0x7f55f0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 0x7f55f0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 -- 172.21.15.6:0/2709386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 msgr2=0x7f55f0102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 0x7f55f0102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 -- 172.21.15.6:0/2709386234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 msgr2=0x7f55f0102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 0x7f55f0102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f636e640 1 -- 172.21.15.6:0/2709386234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f01a8740 con 0x7f55f010de60 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 0x7f55f0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.799+0000 7f55f536c640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 0x7f55f0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55f636e640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009fd0 tx=0x7f55e800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55e6ffd640 1 -- 172.21.15.6:0/2709386234 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8017070 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55e6ffd640 1 -- 172.21.15.6:0/2709386234 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e8003e00 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f01a8a30 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55e6ffd640 1 -- 172.21.15.6:0/2709386234 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8010460 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.800+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f01a8ef0 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55e6ffd640 1 -- 172.21.15.6:0/2709386234 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f55e8003970 con 0x7f55f010de60 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 Processor -- start 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 -- start start 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d69d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ac25cdfea0 con 0x55ac259991b0 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac25ccf2d0 con 0x55ac259c2070 2024-09-21T08:04:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55fe345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ac25cd30e0 con 0x55ac259a1390 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55f5b6d640 1 -- 172.21.15.6:0/4148398860 learned_addr learned my addr 172.21.15.6:0/4148398860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55f536c640 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.803+0000 7f55f536c640 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55e6ffd640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 -- 172.21.15.6:0/4148398860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 msgr2=0x55ac25d69d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d69d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 -- 172.21.15.6:0/4148398860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 msgr2=0x55ac25d692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 -- 172.21.15.6:0/4148398860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac25a2d650 con 0x55ac259991b0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f636e640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00bd00 tx=0x7f55ec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c839b3836793725 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55e6ffd640 1 -- 172.21.15.6:0/2709386234 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f55e80e7c60 con 0x7f55f010de60 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55dbfff640 1 -- 172.21.15.6:0/4148398860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec015070 con 0x55ac259991b0 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55dbfff640 1 -- 172.21.15.6:0/4148398860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55ec01a8f0 con 0x55ac259991b0 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.804+0000 7f55dbfff640 1 -- 172.21.15.6:0/4148398860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0117e0 con 0x55ac259991b0 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 -- 172.21.15.6:0/4148398860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 msgr2=0x55ac25d69800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55f636e640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 0x7f55dc0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55e80e50e0 tx=0x7f55e80a95d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00bd00 tx=0x7f55ec00f730 comp rx=0 tx=0).stop 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 -- 172.21.15.6:0/4148398860 shutdown_connections 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259991b0 0x55ac25d69800 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 --2- 172.21.15.6:0/4148398860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 -- 172.21.15.6:0/4148398860 >> 172.21.15.6:0/4148398860 conn(0x55ac259b6460 msgr2=0x55ac25d671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 -- 172.21.15.6:0/4148398860 shutdown_connections 2024-09-21T08:04:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.805+0000 7f55fe345740 1 -- 172.21.15.6:0/4148398860 wait complete. 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 -- start start 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 Processor -- start 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d74940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259c2070 0x55ac25d80dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ac25b30700 con 0x55ac259a1390 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac25c6a160 con 0x55ac259991b0 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ac25d77aa0 con 0x55ac259c2070 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.806+0000 7f55fe345740 10 client.0 _ll_register_callbacks cb 0x55ac25c839e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47794/0 (socket says 172.21.15.6:47794) 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1964026887 learned_addr learned my addr 172.21.15.6:0/1964026887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f536c640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d74940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1964026887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259c2070 msgr2=0x55ac25d80dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259c2070 0x55ac25d80dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 msgr2=0x55ac25d74940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d74940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1964026887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac25c97c90 con 0x55ac259a1390 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f536c640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d74940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f55ec01a690 tx=0x7f55ec01a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8214fab9565f7573 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec028060 con 0x55ac259a1390 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f55ec01acb0 con 0x55ac259a1390 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55ec01a8f0 con 0x55ac259a1390 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f55ec02f050 con 0x55ac259a1390 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55fe345740 10 client.16005 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.807+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ac25d83780 con 0x55ac259a1390 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55ec01a8f0 con 0x55ac259a1390 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f55ec004990 con 0x55ac259a1390 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 10 client.16005 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 20 client.16005 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac259809f0 0x55ac25d86b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 4 client.16005 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac25ce1df0 con 0x55ac259809f0 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.808+0000 7f55f536c640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac259809f0 0x55ac25d86b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.809+0000 7f55f536c640 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac259809f0 0x55ac25d86b90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bcc721e877fecaa server_cookie=54d6da4ff7d368bf in_seq=0 out_seq=0 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.809+0000 7f55d97fa640 10 client.16005 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.809+0000 7f55d97fa640 1 -- 172.21.15.6:0/1964026887 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac25ce1df0 con 0x55ac259809f0 2024-09-21T08:04:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55d97fa640 10 client.16005 handle_command_reply: tid=0 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 client.16005 shutdown 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 msgr2=0x55ac25d74e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f55ec01a690 tx=0x7f55ec01a6c0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 shutdown_connections 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac259809f0 0x55ac25d86b90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259c2070 0x55ac25d80dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d74e80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 --2- 172.21.15.6:0/1964026887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d74940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55d97fa640 0 client.16005 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 >> 172.21.15.6:0/1964026887 conn(0x55ac259b6460 msgr2=0x55ac25d6c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 shutdown_connections 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 1 -- 172.21.15.6:0/1964026887 wait complete. 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.810+0000 7f55fe345740 20 client.16005 trim_cache size 0 max 16384 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.823+0000 7f55fe345740 1 Processor -- start 2024-09-21T08:04:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.823+0000 7f55fe345740 1 -- start start 2024-09-21T08:04:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.823+0000 7f55fe345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d76570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.823+0000 7f55fe345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d66760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.857 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:04:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55fe345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55fe345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b1000 con 0x55ac259c2070 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55fe345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b3880 con 0x55ac259991b0 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55fe345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b1670 con 0x55ac259a1390 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47802/0 (socket says 172.21.15.6:47802) 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 -- 172.21.15.6:0/3043549735 learned_addr learned my addr 172.21.15.6:0/3043549735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d76570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d66760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 -- 172.21.15.6:0/3043549735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 msgr2=0x55ac25d66760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d66760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 -- 172.21.15.6:0/3043549735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 msgr2=0x55ac25d76570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d76570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 -- 172.21.15.6:0/3043549735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac25d67aa0 con 0x55ac259c2070 2024-09-21T08:04:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55f536c640 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006010 tx=0x7f55e0032a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c449e7e48f0eab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55db7fe640 1 -- 172.21.15.6:0/3043549735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e004d030 con 0x55ac259c2070 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55db7fe640 1 -- 172.21.15.6:0/3043549735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e0004020 con 0x55ac259c2070 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.824+0000 7f55db7fe640 1 -- 172.21.15.6:0/3043549735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0035040 con 0x55ac259c2070 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 -- 172.21.15.6:0/3043549735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 msgr2=0x55ac25d66ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006010 tx=0x7f55e0032a80 comp rx=0 tx=0).stop 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 -- 172.21.15.6:0/3043549735 shutdown_connections 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259a1390 0x55ac25d66760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259c2070 0x55ac25d66ca0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 --2- 172.21.15.6:0/3043549735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259991b0 0x55ac25d76570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 -- 172.21.15.6:0/3043549735 >> 172.21.15.6:0/3043549735 conn(0x55ac259b6460 msgr2=0x55ac25d75e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 -- 172.21.15.6:0/3043549735 shutdown_connections 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.825+0000 7f55fe345740 1 -- 172.21.15.6:0/3043549735 wait complete. 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 -- start start 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 Processor -- start 2024-09-21T08:04:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259991b0 0x55ac25d8a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d87c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b1d40 con 0x55ac259a1390 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b31b0 con 0x55ac259c2070 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b2410 con 0x55ac259991b0 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55fe345740 10 client.0 _ll_register_callbacks cb 0x7f55e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55f5b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47806/0 (socket says 172.21.15.6:47806) 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1760130123 learned_addr learned my addr 172.21.15.6:0/1760130123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.826+0000 7f55f536c640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259991b0 0x55ac25d8a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f536c640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d87c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1760130123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259991b0 msgr2=0x55ac25d8a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259991b0 0x55ac25d8a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 msgr2=0x55ac25d87c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d87c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 -- 172.21.15.6:0/1760130123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac25d88200 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f536c640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d87c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55f5b6d640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0058c0 tx=0x7f55ec00fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cef66b93eea5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec028070 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f55ec011440 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e0004020 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f55ec015070 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55fe345740 10 client.16011 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ac25df10b0 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.827+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e0004020 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f55ec004f50 con 0x55ac259a1390 2024-09-21T08:04:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 10 client.16011 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 20 client.16011 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac25955da0 0x55ac25df38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 4 client.16011 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac25cdd8a0 con 0x55ac25955da0 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55f536c640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac25955da0 0x55ac25df38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55d97fa640 10 client.16011 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55f536c640 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac25955da0 0x55ac25df38b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25be7f6b64453ff1 server_cookie=6a10937da4458fd1 in_seq=0 out_seq=0 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55d97fa640 1 -- 172.21.15.6:0/1760130123 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac25cdd8a0 con 0x55ac25955da0 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.828+0000 7f55d97fa640 10 client.16011 handle_command_reply: tid=0 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 client.16011 shutdown 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 msgr2=0x55ac25d876d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0058c0 tx=0x7f55ec00fe90 comp rx=0 tx=0).stop 2024-09-21T08:04:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 shutdown_connections 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac25955da0 0x55ac25df38b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac259c2070 0x55ac25d87c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac259a1390 0x55ac25d876d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55d97fa640 0 client.16011 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 --2- 172.21.15.6:0/1760130123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac259991b0 0x55ac25d8a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 >> 172.21.15.6:0/1760130123 conn(0x55ac259b6460 msgr2=0x55ac25d75c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 shutdown_connections 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 1 -- 172.21.15.6:0/1760130123 wait complete. 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55fe345740 20 client.16011 trim_cache size 0 max 16384 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 msgr2=0x7f55dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 0x7f55dc0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55e80e50e0 tx=0x7f55e80a95d0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 msgr2=0x7f55f01031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009fd0 tx=0x7f55e800b260 comp rx=0 tx=0).stop 2024-09-21T08:04:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 shutdown_connections 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55f0105380 0x7f55f0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.829+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55f010de60 0x7f55f01031f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.830+0000 7f55f7dd1640 1 --2- 172.21.15.6:0/2709386234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f0104a30 0x7f55f0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.830+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 >> 172.21.15.6:0/2709386234 conn(0x7f55f0079760 msgr2=0x7f55f01009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.830+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 shutdown_connections 2024-09-21T08:04:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:01.830+0000 7f55f7dd1640 1 -- 172.21.15.6:0/2709386234 wait complete. 2024-09-21T08:04:02.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:04:02.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:02 smithi006 ceph-mon[30970]: pgmap v433: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.8 MiB/s wr, 448 op/s 2024-09-21T08:04:03.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:02 smithi119 ceph-mon[33564]: pgmap v433: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.8 MiB/s wr, 448 op/s 2024-09-21T08:04:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:02 smithi145 ceph-mon[34049]: pgmap v433: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.8 MiB/s wr, 448 op/s 2024-09-21T08:04:03.592 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:04:03.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:04:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 -- 172.21.15.6:0/1169924582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8681049b0 msgr2=0x7fc868104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 --2- 172.21.15.6:0/1169924582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8681049b0 0x7fc868104dc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc864009900 tx=0x7fc86402a410 comp rx=0 tx=0).stop 2024-09-21T08:04:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 -- 172.21.15.6:0/1169924582 shutdown_connections 2024-09-21T08:04:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 --2- 172.21.15.6:0/1169924582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc86810de10 0x7fc868110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 --2- 172.21.15.6:0/1169924582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc868105300 0x7fc86810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 --2- 172.21.15.6:0/1169924582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8681049b0 0x7fc868104dc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 -- 172.21.15.6:0/1169924582 >> 172.21.15.6:0/1169924582 conn(0x7fc868079700 msgr2=0x7fc868079b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 -- 172.21.15.6:0/1169924582 shutdown_connections 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.310+0000 7fc8704d2640 1 -- 172.21.15.6:0/1169924582 wait complete. 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.311+0000 7fc8704d2640 1 Processor -- start 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.311+0000 7fc8704d2640 1 -- start start 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.311+0000 7fc8704d2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8681049b0 0x7fc86819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.311+0000 7fc8704d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.311+0000 7fc8704d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc86810de10 0x7fc86819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc8704d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc868113940 con 0x7fc868105300 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc8704d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681137c0 con 0x7fc86810de10 2024-09-21T08:04:04.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc8704d2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc868113ac0 con 0x7fc8681049b0 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86e26e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8681049b0 0x7fc86819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86ea6f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc86810de10 0x7fc86819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47822/0 (socket says 172.21.15.6:47822) 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 -- 172.21.15.6:0/3502053606 learned_addr learned my addr 172.21.15.6:0/3502053606 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 -- 172.21.15.6:0/3502053606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8681049b0 msgr2=0x7fc86819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8681049b0 0x7fc86819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 -- 172.21.15.6:0/3502053606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc86810de10 msgr2=0x7fc86819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc86810de10 0x7fc86819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 -- 172.21.15.6:0/3502053606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681a02e0 con 0x7fc868105300 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc86da6d640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.312+0000 7fc85f7fe640 1 -- 172.21.15.6:0/3502053606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858017070 con 0x7fc868105300 2024-09-21T08:04:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.313+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681a05d0 con 0x7fc868105300 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.313+0000 7fc85f7fe640 1 -- 172.21.15.6:0/3502053606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc858009c30 con 0x7fc868105300 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.313+0000 7fc85f7fe640 1 -- 172.21.15.6:0/3502053606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580047a0 con 0x7fc868105300 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.313+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681a6d30 con 0x7fc868105300 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.315+0000 7fc85f7fe640 1 -- 172.21.15.6:0/3502053606 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc858004020 con 0x7fc868105300 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.316+0000 7fc876a46740 1 Processor -- start 2024-09-21T08:04:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.316+0000 7fc876a46740 1 -- start start 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.316+0000 7fc85f7fe640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 0x7fc8540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.316+0000 7fc876a46740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc876a46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc876a46740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc876a46740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560a2168e60 con 0x5560a1e2a670 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc876a46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5560a2158290 con 0x5560a1e22490 2024-09-21T08:04:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc876a46740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5560a215c0a0 con 0x5560a1e4b350 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 0x7fc8540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47824/0 (socket says 172.21.15.6:47824) 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 -- 172.21.15.6:0/3230794424 learned_addr learned my addr 172.21.15.6:0/3230794424 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86e26e640 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86da6d640 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc85f7fe640 1 -- 172.21.15.6:0/3502053606 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc8580e77b0 con 0x7fc868105300 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 -- 172.21.15.6:0/3230794424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 msgr2=0x5560a21f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 -- 172.21.15.6:0/3230794424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 msgr2=0x5560a21f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 -- 172.21.15.6:0/3230794424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a1eb6930 con 0x5560a1e2a670 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 0x7fc8540b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc860012c00 tx=0x7fc860009e00 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.317+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc86001da00 tx=0x7fc860020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7591ca0d968b113e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.318+0000 7fc85cff9640 1 -- 172.21.15.6:0/3230794424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860010c70 con 0x5560a1e2a670 2024-09-21T08:04:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.318+0000 7fc85cff9640 1 -- 172.21.15.6:0/3230794424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc860010e10 con 0x5560a1e2a670 2024-09-21T08:04:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.318+0000 7fc85cff9640 1 -- 172.21.15.6:0/3230794424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8600057c0 con 0x5560a1e2a670 2024-09-21T08:04:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- 172.21.15.6:0/3230794424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 msgr2=0x5560a21f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc86001da00 tx=0x7fc860020000 comp rx=0 tx=0).stop 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- 172.21.15.6:0/3230794424 shutdown_connections 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21f2eb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 --2- 172.21.15.6:0/3230794424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- 172.21.15.6:0/3230794424 >> 172.21.15.6:0/3230794424 conn(0x5560a1e3f740 msgr2=0x5560a21f0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- 172.21.15.6:0/3230794424 shutdown_connections 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- 172.21.15.6:0/3230794424 wait complete. 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 -- start start 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.319+0000 7fc876a46740 1 Processor -- start 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21fe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a2209ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560a1fb9890 con 0x5560a1e2a670 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5560a20f2d40 con 0x5560a1e22490 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5560a2200bb0 con 0x5560a1e4b350 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 10 client.0 _ll_register_callbacks cb 0x5560a2156c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47838/0 (socket says 172.21.15.6:47838) 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 -- 172.21.15.6:0/341030849 learned_addr learned my addr 172.21.15.6:0/341030849 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a2209ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86e26e640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 -- 172.21.15.6:0/341030849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 msgr2=0x5560a2209ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a2209ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 -- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 msgr2=0x5560a21fe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21fe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 -- 172.21.15.6:0/341030849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a220a530 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86e26e640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc86da6d640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc85800bfd0 tx=0x7fc8580acc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aae2c3bd6fe294 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580acd90 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc8580e73f0 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.320+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc860010e10 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc8580e75f0 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 10 client.16023 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560a220ce60 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc860010e10 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc858076040 con 0x5560a1e2a670 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 10 client.16023 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 20 client.16023 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1e09cd0 0x5560a2210330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 4 client.16023 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560a216adb0 con 0x5560a1e09cd0 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.321+0000 7fc86e26e640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1e09cd0 0x5560a2210330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.322+0000 7fc86e26e640 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1e09cd0 0x5560a2210330 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a4c391d1b80c4f server_cookie=e9dd67bce61975a8 in_seq=0 out_seq=0 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.322+0000 7fc851ffb640 10 client.16023 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc851ffb640 1 -- 172.21.15.6:0/341030849 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560a216adb0 con 0x5560a1e09cd0 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc851ffb640 10 client.16023 handle_command_reply: tid=0 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 client.16023 shutdown 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 msgr2=0x5560a21fe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc85800bfd0 tx=0x7fc8580acc40 comp rx=0 tx=0).stop 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 shutdown_connections 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1e09cd0 0x5560a2210330 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a2209ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc851ffb640 0 client.16023 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fe600 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 --2- 172.21.15.6:0/341030849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 >> 172.21.15.6:0/341030849 conn(0x5560a1e3f740 msgr2=0x5560a21f55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 shutdown_connections 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 1 -- 172.21.15.6:0/341030849 wait complete. 2024-09-21T08:04:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.323+0000 7fc876a46740 20 client.16023 trim_cache size 0 max 16384 2024-09-21T08:04:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 Processor -- start 2024-09-21T08:04:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 -- start start 2024-09-21T08:04:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681acc10 con 0x5560a1e2a670 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681af490 con 0x5560a1e22490 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc876a46740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681ad280 con 0x5560a1e4b350 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47844/0 (socket says 172.21.15.6:47844) 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 -- 172.21.15.6:0/4206096295 learned_addr learned my addr 172.21.15.6:0/4206096295 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86e26e640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 -- 172.21.15.6:0/4206096295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 msgr2=0x5560a21ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 -- 172.21.15.6:0/4206096295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 msgr2=0x5560a21f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86da6d640 1 -- 172.21.15.6:0/4206096295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a21f4720 con 0x5560a1e2a670 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.341+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.342+0000 7fc86da6d640 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ad210 tx=0x7fc85800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5551f7411b3919e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.342+0000 7fc853fff640 1 -- 172.21.15.6:0/4206096295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580ac9f0 con 0x5560a1e2a670 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.342+0000 7fc853fff640 1 -- 172.21.15.6:0/4206096295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8580ad980 con 0x5560a1e2a670 2024-09-21T08:04:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.342+0000 7fc853fff640 1 -- 172.21.15.6:0/4206096295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580a8e30 con 0x5560a1e2a670 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- 172.21.15.6:0/4206096295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 msgr2=0x5560a21fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc8580ad210 tx=0x7fc85800b690 comp rx=0 tx=0).stop 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- 172.21.15.6:0/4206096295 shutdown_connections 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e4b350 0x5560a21ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e2a670 0x5560a21fd6f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 --2- 172.21.15.6:0/4206096295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a21f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- 172.21.15.6:0/4206096295 >> 172.21.15.6:0/4206096295 conn(0x5560a1e3f740 msgr2=0x5560a21ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- 172.21.15.6:0/4206096295 shutdown_connections 2024-09-21T08:04:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- 172.21.15.6:0/4206096295 wait complete. 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 -- start start 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.343+0000 7fc876a46740 1 Processor -- start 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a22066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 0x5560a2200e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681ad950 con 0x5560a1e4b350 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681aedc0 con 0x5560a1e22490 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681ae020 con 0x5560a1e2a670 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc876a46740 10 client.0 _ll_register_callbacks cb 0x7fc8580a9120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47860/0 (socket says 172.21.15.6:47860) 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 -- 172.21.15.6:0/310073532 learned_addr learned my addr 172.21.15.6:0/310073532 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86e26e640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a22066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86da6d640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 0x5560a2200e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 -- 172.21.15.6:0/310073532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 msgr2=0x5560a2200e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 0x5560a2200e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 -- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 msgr2=0x5560a22066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a22066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 -- 172.21.15.6:0/310073532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a2201b40 con 0x5560a1e4b350 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86da6d640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 0x5560a2200e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc86ea6f640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc86001da00 tx=0x7fc860005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f571d90434f9d6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.344+0000 7fc851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860009b00 con 0x5560a1e4b350 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8580ad980 con 0x5560a1e4b350 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc860003970 con 0x5560a1e4b350 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc860040050 con 0x5560a1e4b350 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 10 client.16029 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560a227bc50 con 0x5560a1e4b350 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8580ad980 con 0x5560a1e4b350 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc86000f040 con 0x5560a1e4b350 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 10 client.16029 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 20 client.16029 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1ddf080 0x5560a227e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 4 client.16029 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.345+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560a2166860 con 0x5560a1ddf080 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.346+0000 7fc86e26e640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1ddf080 0x5560a227e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.346+0000 7fc86e26e640 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1ddf080 0x5560a227e2b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a2232ce2df3f69 server_cookie=4b22c60783646856 in_seq=0 out_seq=0 2024-09-21T08:04:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.346+0000 7fc851ffb640 10 client.16029 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc851ffb640 1 -- 172.21.15.6:0/310073532 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560a2166860 con 0x5560a1ddf080 2024-09-21T08:04:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc851ffb640 10 client.16029 handle_command_reply: tid=0 2024-09-21T08:04:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 client.16029 shutdown 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 msgr2=0x5560a22013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc86001da00 tx=0x7fc860005360 comp rx=0 tx=0).stop 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 shutdown_connections 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560a1ddf080 0x5560a227e2b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560a1e2a670 0x5560a2200e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560a1e4b350 0x5560a22013b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 --2- 172.21.15.6:0/310073532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560a1e22490 0x5560a22066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 >> 172.21.15.6:0/310073532 conn(0x5560a1e3f740 msgr2=0x5560a21ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc851ffb640 0 client.16029 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 shutdown_connections 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 1 -- 172.21.15.6:0/310073532 wait complete. 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.348+0000 7fc876a46740 20 client.16029 trim_cache size 0 max 16384 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7", 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:04:04.355 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 msgr2=0x7fc8540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 0x7fc8540b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc860012c00 tx=0x7fc860009e00 comp rx=0 tx=0).stop 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 msgr2=0x7fc86819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).stop 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 shutdown_connections 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc8540b6680 0x7fc8540b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc86810de10 0x7fc86819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc868105300 0x7fc86819a910 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 --2- 172.21.15.6:0/3502053606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8681049b0 0x7fc86819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 >> 172.21.15.6:0/3502053606 conn(0x7fc868079700 msgr2=0x7fc8681007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 shutdown_connections 2024-09-21T08:04:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:04.349+0000 7fc8704d2640 1 -- 172.21.15.6:0/3502053606 wait complete. 2024-09-21T08:04:05.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:04 smithi006 ceph-mon[30970]: pgmap v434: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.3 MiB/s wr, 409 op/s 2024-09-21T08:04:05.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:04:05.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:04 smithi119 ceph-mon[33564]: pgmap v434: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.3 MiB/s wr, 409 op/s 2024-09-21T08:04:05.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:04 smithi145 ceph-mon[34049]: pgmap v434: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.3 MiB/s wr, 409 op/s 2024-09-21T08:04:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 -- 172.21.15.6:0/4223956701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 msgr2=0x7ff18c102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 --2- 172.21.15.6:0/4223956701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c102650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009900 tx=0x7ff17c02a410 comp rx=0 tx=0).stop 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 -- 172.21.15.6:0/4223956701 shutdown_connections 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 --2- 172.21.15.6:0/4223956701 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 0x7ff18c10ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 --2- 172.21.15.6:0/4223956701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 --2- 172.21.15.6:0/4223956701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c102650 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 -- 172.21.15.6:0/4223956701 >> 172.21.15.6:0/4223956701 conn(0x7ff18c079f90 msgr2=0x7ff18c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 -- 172.21.15.6:0/4223956701 shutdown_connections 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.893+0000 7ff1921e4640 1 -- 172.21.15.6:0/4223956701 wait complete. 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 Processor -- start 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 -- start start 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 0x7ff18c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1139d0 con 0x7ff18c102240 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c113850 con 0x7ff18c107b80 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff1921e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c113b50 con 0x7ff18c1084d0 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47880/0 (socket says 172.21.15.6:47880) 2024-09-21T08:04:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.894+0000 7ff18b7fe640 1 -- 172.21.15.6:0/1423555747 learned_addr learned my addr 172.21.15.6:0/1423555747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 0x7ff18c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18affd640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 -- 172.21.15.6:0/1423555747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 msgr2=0x7ff18c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 0x7ff18c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 -- 172.21.15.6:0/1423555747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 msgr2=0x7ff18c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 -- 172.21.15.6:0/1423555747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c1a0370 con 0x7ff18c102240 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18affd640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009230 tx=0x7ff17c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff188ff9640 1 -- 172.21.15.6:0/1423555747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c03f030 con 0x7ff18c102240 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c1a0600 con 0x7ff18c102240 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff188ff9640 1 -- 172.21.15.6:0/1423555747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff17c003a80 con 0x7ff18c102240 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff188ff9640 1 -- 172.21.15.6:0/1423555747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c035070 con 0x7ff18c102240 2024-09-21T08:04:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.895+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c1a6dc0 con 0x7ff18c102240 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 Processor -- start 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 -- start start 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff188ff9640 1 -- 172.21.15.6:0/1423555747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff17c042030 con 0x7ff18c102240 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70930ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70930b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c709280e50 con 0x55c708f63070 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c709270280 con 0x55c708f42390 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.898+0000 7ff198758740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c709274090 con 0x55c708f3a1b0 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47896/0 (socket says 172.21.15.6:47896) 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 -- 172.21.15.6:0/1647100736 learned_addr learned my addr 172.21.15.6:0/1647100736 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18affd640 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70930b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70930ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 -- 172.21.15.6:0/1647100736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 msgr2=0x55c70930ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70930ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 -- 172.21.15.6:0/1647100736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 msgr2=0x55c70930b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70930b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 -- 172.21.15.6:0/1647100736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c708fce650 con 0x55c708f63070 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff184010370 tx=0x7ff184010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaa6ba08a5a00bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff188ff9640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 0x7ff1740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff171ffb640 1 -- 172.21.15.6:0/1647100736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184016070 con 0x55c708f63070 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.899+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 0x7ff1740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff171ffb640 1 -- 172.21.15.6:0/1647100736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff184004d20 con 0x55c708f63070 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff171ffb640 1 -- 172.21.15.6:0/1647100736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184012780 con 0x55c708f63070 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff188ff9640 1 -- 172.21.15.6:0/1423555747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff17c1081f0 con 0x7ff18c102240 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff198758740 1 -- 172.21.15.6:0/1647100736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 msgr2=0x55c70930a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff18b7fe640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 0x7ff1740b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff17c105670 tx=0x7ff17c02a410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff198758740 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff184010370 tx=0x7ff184010830 comp rx=0 tx=0).stop 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.900+0000 7ff198758740 1 -- 172.21.15.6:0/1647100736 shutdown_connections 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70930ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70930b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 --2- 172.21.15.6:0/1647100736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c70930a650 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 -- 172.21.15.6:0/1647100736 >> 172.21.15.6:0/1647100736 conn(0x55c708f57460 msgr2=0x55c709308540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 -- 172.21.15.6:0/1647100736 shutdown_connections 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 -- 172.21.15.6:0/1647100736 wait complete. 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 -- start start 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.901+0000 7ff198758740 1 Processor -- start 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70931a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70931a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c7090d1700 con 0x55c708f63070 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c70920b110 con 0x55c708f42390 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c70931d190 con 0x55c708f3a1b0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 10 client.0 _ll_register_callbacks cb 0x55c709224990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47900/0 (socket says 172.21.15.6:47900) 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 -- 172.21.15.6:0/1721735825 learned_addr learned my addr 172.21.15.6:0/1721735825 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70931a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18affd640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70931a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 -- 172.21.15.6:0/1721735825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 msgr2=0x55c70931a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70931a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 -- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 msgr2=0x55c70931a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70931a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 -- 172.21.15.6:0/1721735825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c709238c40 con 0x55c708f63070 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff18bfff640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff184009db0 tx=0x7ff184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6154e4bc93cf20e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff16affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184016070 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff184004d20 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.902+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff184012bb0 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff184030050 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 10 client.16041 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c709328ee0 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff184004d20 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff18400f040 con 0x55c708f63070 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 10 client.16041 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 20 client.16041 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f219f0 0x55c70932c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 4 client.16041 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c709282da0 con 0x55c708f219f0 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.903+0000 7ff18affd640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f219f0 0x55c70932c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.904+0000 7ff16affd640 10 client.16041 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.904+0000 7ff18affd640 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f219f0 0x55c70932c2a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f099d6edc577b3bb server_cookie=2718a5c0e9f25831 in_seq=0 out_seq=0 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff16affd640 1 -- 172.21.15.6:0/1721735825 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c709282da0 con 0x55c708f219f0 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff16affd640 10 client.16041 handle_command_reply: tid=0 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 client.16041 shutdown 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 msgr2=0x55c7093264f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff184009db0 tx=0x7ff184009bb0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 shutdown_connections 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f219f0 0x55c70932c2a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff16affd640 0 client.16041 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f63070 0x55c7093264f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c70931a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 --2- 172.21.15.6:0/1721735825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c70931a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 >> 172.21.15.6:0/1721735825 conn(0x55c708f57460 msgr2=0x55c70930c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 shutdown_connections 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 1 -- 172.21.15.6:0/1721735825 wait complete. 2024-09-21T08:04:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.905+0000 7ff198758740 20 client.16041 trim_cache size 0 max 16384 2024-09-21T08:04:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 Processor -- start 2024-09-21T08:04:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 -- start start 2024-09-21T08:04:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f219f0 0x55c70931bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f3a1b0 0x55c709317310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1acae0 con 0x55c708f42390 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1af360 con 0x55c708f3a1b0 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff198758740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1ad150 con 0x55c708f219f0 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47904/0 (socket says 172.21.15.6:47904) 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff18bfff640 1 -- 172.21.15.6:0/3617962471 learned_addr learned my addr 172.21.15.6:0/3617962471 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.923+0000 7ff18bfff640 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f219f0 0x55c70931bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18affd640 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f3a1b0 0x55c709317310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 -- 172.21.15.6:0/3617962471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f219f0 msgr2=0x55c70931bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f219f0 0x55c70931bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 -- 172.21.15.6:0/3617962471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f3a1b0 msgr2=0x55c709317310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f3a1b0 0x55c709317310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 -- 172.21.15.6:0/3617962471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70930cda0 con 0x55c708f42390 2024-09-21T08:04:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff18bfff640 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff184005f40 tx=0x7ff184010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861c49503db3763b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff1717fa640 1 -- 172.21.15.6:0/3617962471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184039070 con 0x55c708f42390 2024-09-21T08:04:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff1717fa640 1 -- 172.21.15.6:0/3617962471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff184010d30 con 0x55c708f42390 2024-09-21T08:04:05.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.924+0000 7ff1717fa640 1 -- 172.21.15.6:0/3617962471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184012e60 con 0x55c708f42390 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- 172.21.15.6:0/3617962471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 msgr2=0x55c709317850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff184005f40 tx=0x7ff184010830 comp rx=0 tx=0).stop 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- 172.21.15.6:0/3617962471 shutdown_connections 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f42390 0x55c709317850 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f3a1b0 0x55c709317310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 --2- 172.21.15.6:0/3617962471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f219f0 0x55c70931bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- 172.21.15.6:0/3617962471 >> 172.21.15.6:0/3617962471 conn(0x55c708f57460 msgr2=0x55c70931b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- 172.21.15.6:0/3617962471 shutdown_connections 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- 172.21.15.6:0/3617962471 wait complete. 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 -- start start 2024-09-21T08:04:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.925+0000 7ff198758740 1 Processor -- start 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c709320250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c7093208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1ad820 con 0x55c708f219f0 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1aec90 con 0x55c708f42390 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1adef0 con 0x55c708f3a1b0 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff198758740 10 client.0 _ll_register_callbacks cb 0x7ff18000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47914/0 (socket says 172.21.15.6:47914) 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 -- 172.21.15.6:0/692944857 learned_addr learned my addr 172.21.15.6:0/692944857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18affd640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c709320250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 -- 172.21.15.6:0/692944857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 msgr2=0x55c709320250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c709320250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 -- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 msgr2=0x55c7093208d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c7093208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.926+0000 7ff18bfff640 1 -- 172.21.15.6:0/692944857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70930cb70 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff18bfff640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff184003f80 tx=0x7ff184013e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e612ab060eef8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184039070 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff1840124e0 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff184010d30 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff184016070 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 10 client.16047 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7093969d0 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff184010d30 con 0x55c708f219f0 2024-09-21T08:04:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff184034830 con 0x55c708f219f0 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 10 client.16047 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 20 client.16047 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f63070 0x55c709399040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 4 client.16047 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.927+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c70927e850 con 0x55c708f63070 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff18affd640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f63070 0x55c709399040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff16affd640 10 client.16047 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff18affd640 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f63070 0x55c709399040 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcaff07192e8a5b1 server_cookie=4e7b6fc959e3c3d9 in_seq=0 out_seq=0 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff16affd640 1 -- 172.21.15.6:0/692944857 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55c70927e850 con 0x55c708f63070 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff16affd640 10 client.16047 handle_command_reply: tid=0 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.928+0000 7ff198758740 1 client.16047 shutdown 2024-09-21T08:04:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 msgr2=0x55c709322d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff184003f80 tx=0x7ff184013e70 comp rx=0 tx=0).stop 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 shutdown_connections 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c708f63070 0x55c709399040 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c708f3a1b0 0x55c709320250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c708f42390 0x55c7093208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 --2- 172.21.15.6:0/692944857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c708f219f0 0x55c709322d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 >> 172.21.15.6:0/692944857 conn(0x55c708f57460 msgr2=0x55c70930bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff16affd640 0 client.16047 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 shutdown_connections 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 1 -- 172.21.15.6:0/692944857 wait complete. 2024-09-21T08:04:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff198758740 20 client.16047 trim_cache size 0 max 16384 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7", 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:04:05.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:05.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:05.940 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 msgr2=0x7ff1740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 0x7ff1740b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff17c105670 tx=0x7ff17c02a410 comp rx=0 tx=0).stop 2024-09-21T08:04:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 msgr2=0x7ff18c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.929+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009230 tx=0x7ff17c004270 comp rx=0 tx=0).stop 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 shutdown_connections 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1740b6680 0x7ff1740b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff18c1084d0 0x7ff18c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff18c107b80 0x7ff18c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 --2- 172.21.15.6:0/1423555747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c102240 0x7ff18c19a400 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 >> 172.21.15.6:0/1423555747 conn(0x7ff18c079f90 msgr2=0x7ff18c105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 shutdown_connections 2024-09-21T08:04:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:05.930+0000 7ff1921e4640 1 -- 172.21.15.6:0/1423555747 wait complete. 2024-09-21T08:04:06.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:05 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:04:06.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:05 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:05 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:04:06.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:05 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:05 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:04:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:05 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:05 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:04:06.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:05 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:05 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:04:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:05 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:05 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:04:06.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:05 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:06.781 INFO:tasks.cephfs.filesystem:scrub status for tag:ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7 - {'path': '/', 'tag': 'ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7', 'options': 'recursive,force'} 2024-09-21T08:04:07.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:06 smithi119 ceph-mon[33564]: pgmap v435: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 193 op/s 2024-09-21T08:04:07.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:06 smithi145 ceph-mon[34049]: pgmap v435: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 193 op/s 2024-09-21T08:04:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:06 smithi006 ceph-mon[30970]: pgmap v435: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 193 op/s 2024-09-21T08:04:07.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 70.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:04:09.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:08 smithi119 ceph-mon[33564]: pgmap v436: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 813 KiB/s wr, 116 op/s 2024-09-21T08:04:09.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:08 smithi145 ceph-mon[34049]: pgmap v436: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 813 KiB/s wr, 116 op/s 2024-09-21T08:04:09.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:08 smithi006 ceph-mon[30970]: pgmap v436: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 813 KiB/s wr, 116 op/s 2024-09-21T08:04:11.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:10 smithi119 ceph-mon[33564]: pgmap v437: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 303 KiB/s wr, 52 op/s 2024-09-21T08:04:11.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:10 smithi145 ceph-mon[34049]: pgmap v437: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 303 KiB/s wr, 52 op/s 2024-09-21T08:04:11.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:10 smithi006 ceph-mon[30970]: pgmap v437: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 303 KiB/s wr, 52 op/s 2024-09-21T08:04:12.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:04:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:12 smithi119 ceph-mon[33564]: pgmap v438: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 213 KiB/s wr, 41 op/s 2024-09-21T08:04:13.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:12 smithi145 ceph-mon[34049]: pgmap v438: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 213 KiB/s wr, 41 op/s 2024-09-21T08:04:13.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:12 smithi006 ceph-mon[30970]: pgmap v438: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 213 KiB/s wr, 41 op/s 2024-09-21T08:04:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:14 smithi119 ceph-mon[33564]: pgmap v439: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 222 KiB/s wr, 42 op/s 2024-09-21T08:04:15.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:14 smithi145 ceph-mon[34049]: pgmap v439: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 222 KiB/s wr, 42 op/s 2024-09-21T08:04:15.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:14 smithi006 ceph-mon[30970]: pgmap v439: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 222 KiB/s wr, 42 op/s 2024-09-21T08:04:17.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:16 smithi119 ceph-mon[33564]: pgmap v440: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 183 KiB/s wr, 24 op/s 2024-09-21T08:04:17.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:16 smithi145 ceph-mon[34049]: pgmap v440: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 183 KiB/s wr, 24 op/s 2024-09-21T08:04:17.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:16 smithi006 ceph-mon[30970]: pgmap v440: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 183 KiB/s wr, 24 op/s 2024-09-21T08:04:17.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:04:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:04:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 -- 172.21.15.6:0/3352187951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 msgr2=0x7f5cf010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 --2- 172.21.15.6:0/3352187951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf010f560 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009ca0 tx=0x7f5ce802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 -- 172.21.15.6:0/3352187951 shutdown_connections 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 --2- 172.21.15.6:0/3352187951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf010f560 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 --2- 172.21.15.6:0/3352187951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 0x7f5cf01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 --2- 172.21.15.6:0/3352187951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 0x7f5cf0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.188+0000 7f5cf6535640 1 -- 172.21.15.6:0/3352187951 >> 172.21.15.6:0/3352187951 conn(0x7f5cf00797e0 msgr2=0x7f5cf0079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.189+0000 7f5cf6535640 1 -- 172.21.15.6:0/3352187951 shutdown_connections 2024-09-21T08:04:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.189+0000 7f5cf6535640 1 -- 172.21.15.6:0/3352187951 wait complete. 2024-09-21T08:04:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.189+0000 7f5cf6535640 1 Processor -- start 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.189+0000 7f5cf6535640 1 -- start start 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 0x7f5cf019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 0x7f5cf019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01128a0 con 0x7f5cf0108d30 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0112720 con 0x7f5cf01083e0 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf6535640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0112a20 con 0x7f5cf0102aa0 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf4ad2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf4ad2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43614/0 (socket says 172.21.15.6:43614) 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf4ad2640 1 -- 172.21.15.6:0/2038222952 learned_addr learned my addr 172.21.15.6:0/2038222952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5ceffff640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 0x7f5cf019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5ce7fff640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 0x7f5cf019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf4ad2640 1 -- 172.21.15.6:0/2038222952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 msgr2=0x7f5cf019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.190+0000 7f5cf4ad2640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 0x7f5cf019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf4ad2640 1 -- 172.21.15.6:0/2038222952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 msgr2=0x7f5cf019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf4ad2640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 0x7f5cf019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf4ad2640 1 -- 172.21.15.6:0/2038222952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf01a0290 con 0x7f5cf0108d30 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf4ad2640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8005cc0 tx=0x7f5ce8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8032e00 con 0x7f5cf0108d30 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01a0520 con 0x7f5cf0108d30 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ce80044d0 con 0x7f5cf0108d30 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8030b70 con 0x7f5cf0108d30 2024-09-21T08:04:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.191+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01a6ce0 con 0x7f5cf0108d30 2024-09-21T08:04:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.192+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf0102eb0 con 0x7f5cf0108d30 2024-09-21T08:04:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.194+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5ce8030d10 con 0x7f5cf0108d30 2024-09-21T08:04:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.195+0000 7f5cedffb640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 0x7f5cdc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.195+0000 7f5ceffff640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 0x7f5cdc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.195+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5ce8108ea0 con 0x7f5cf0108d30 2024-09-21T08:04:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.195+0000 7f5ceffff640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 0x7f5cdc0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00058c0 tx=0x7f5ce000a250 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:18.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.198+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ce80cf0a0 con 0x7f5cf0108d30 2024-09-21T08:04:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.427+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf019b450 con 0x7f5cf0108d30 2024-09-21T08:04:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.428+0000 7f5cedffb640 1 -- 172.21.15.6:0/2038222952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f5cf019b450 con 0x7f5cf0108d30 2024-09-21T08:04:18.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:04:18.431 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:04:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 msgr2=0x7f5cdc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 0x7f5cdc0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00058c0 tx=0x7f5ce000a250 comp rx=0 tx=0).stop 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 msgr2=0x7f5cf019fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8005cc0 tx=0x7f5ce8032a10 comp rx=0 tx=0).stop 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 shutdown_connections 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5cdc0b6680 0x7f5cdc0b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf0108d30 0x7f5cf019fb60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf01083e0 0x7f5cf019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 --2- 172.21.15.6:0/2038222952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0102aa0 0x7f5cf019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:18.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.430+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 >> 172.21.15.6:0/2038222952 conn(0x7f5cf00797e0 msgr2=0x7f5cf006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:18.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.431+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 shutdown_connections 2024-09-21T08:04:18.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:18.431+0000 7f5cf6535640 1 -- 172.21.15.6:0/2038222952 wait complete. 2024-09-21T08:04:19.151 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:18 smithi006 ceph-mon[30970]: pgmap v441: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 175 KiB/s wr, 24 op/s 2024-09-21T08:04:19.151 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:18 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2038222952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:19.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:18 smithi119 ceph-mon[33564]: pgmap v441: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 175 KiB/s wr, 24 op/s 2024-09-21T08:04:19.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:18 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2038222952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:19.181 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 2e9651dc --release --await' 2024-09-21T08:04:19.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 2e9651dc --release --await 2024-09-21T08:04:19.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:18 smithi145 ceph-mon[34049]: pgmap v441: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 175 KiB/s wr, 24 op/s 2024-09-21T08:04:19.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:18 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2038222952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 -- 172.21.15.6:0/2663521964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134103b60 msgr2=0x7f3134103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 --2- 172.21.15.6:0/2663521964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134103b60 0x7f3134103f70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3124009900 tx=0x7f312402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 -- 172.21.15.6:0/2663521964 shutdown_connections 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 --2- 172.21.15.6:0/2663521964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3134109df0 0x7f3134110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 --2- 172.21.15.6:0/2663521964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31341094a0 0x7f31341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 --2- 172.21.15.6:0/2663521964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134103b60 0x7f3134103f70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 -- 172.21.15.6:0/2663521964 >> 172.21.15.6:0/2663521964 conn(0x7f313407b850 msgr2=0x7f313407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 -- 172.21.15.6:0/2663521964 shutdown_connections 2024-09-21T08:04:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.920+0000 7f3139754640 1 -- 172.21.15.6:0/2663521964 wait complete. 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.921+0000 7f3139754640 1 Processor -- start 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.921+0000 7f3139754640 1 -- start start 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.921+0000 7f3139754640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3134103b60 0x7f313419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.921+0000 7f3139754640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 0x7f313419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.921+0000 7f3139754640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f3139754640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3134113960 con 0x7f3134109df0 2024-09-21T08:04:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f3139754640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31341137e0 con 0x7f3134103b60 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f3139754640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3134113ae0 con 0x7f31341094a0 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43624/0 (socket says 172.21.15.6:43624) 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 -- 172.21.15.6:0/484718136 learned_addr learned my addr 172.21.15.6:0/484718136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f3132ffd640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3134103b60 0x7f313419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31327fc640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 0x7f313419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 -- 172.21.15.6:0/484718136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 msgr2=0x7f313419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 0x7f313419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 -- 172.21.15.6:0/484718136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3134103b60 msgr2=0x7f313419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3134103b60 0x7f313419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 -- 172.21.15.6:0/484718136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31341a01c0 con 0x7f3134109df0 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31327fc640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 0x7f313419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f31337fe640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f312c00cce0 tx=0x7f312c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f311bfff640 1 -- 172.21.15.6:0/484718136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c00f450 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f311bfff640 1 -- 172.21.15.6:0/484718136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f312c00fa80 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31341a04b0 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.922+0000 7f311bfff640 1 -- 172.21.15.6:0/484718136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c018ad0 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.923+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341a6cd0 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.925+0000 7f311bfff640 1 -- 172.21.15.6:0/484718136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f312c00f5f0 con 0x7f3134109df0 2024-09-21T08:04:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.925+0000 7f313fcc8740 1 Processor -- start 2024-09-21T08:04:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.925+0000 7f313fcc8740 1 -- start start 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d0593a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d0593f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c3d047edc0 con 0x55c3d01ed520 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c3d050b1f0 con 0x55c3d01c4660 2024-09-21T08:04:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f313fcc8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c3d04fa620 con 0x55c3d01cc840 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43626/0 (socket says 172.21.15.6:43626) 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 -- 172.21.15.6:0/1915559056 learned_addr learned my addr 172.21.15.6:0/1915559056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f3132ffd640 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d0593a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d0593f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 -- 172.21.15.6:0/1915559056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 msgr2=0x55c3d0593f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d0593f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 -- 172.21.15.6:0/1915559056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 msgr2=0x55c3d0593a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d0593a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 -- 172.21.15.6:0/1915559056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d04c2fd0 con 0x55c3d01ed520 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f311bfff640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 0x7f311c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.926+0000 7f31327fc640 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3128012460 tx=0x7f31280085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06255606e202393 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.927+0000 7f3132ffd640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 0x7f311c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.927+0000 7f311bfff640 1 -- 172.21.15.6:0/484718136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f312c0e81d0 con 0x7f3134109df0 2024-09-21T08:04:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.927+0000 7f31197fa640 1 -- 172.21.15.6:0/1915559056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128018030 con 0x55c3d01ed520 2024-09-21T08:04:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.927+0000 7f31197fa640 1 -- 172.21.15.6:0/1915559056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31280054b0 con 0x55c3d01ed520 2024-09-21T08:04:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.927+0000 7f31197fa640 1 -- 172.21.15.6:0/1915559056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128010640 con 0x55c3d01ed520 2024-09-21T08:04:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- 172.21.15.6:0/1915559056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 msgr2=0x55c3d0593510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3128012460 tx=0x7f31280085e0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f3132ffd640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 0x7f311c0b8c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31240057c0 tx=0x7f31240058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- 172.21.15.6:0/1915559056 shutdown_connections 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d0593f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d0593a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 --2- 172.21.15.6:0/1915559056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d0593510 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- 172.21.15.6:0/1915559056 >> 172.21.15.6:0/1915559056 conn(0x55c3d01e1910 msgr2=0x55c3d0591400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- 172.21.15.6:0/1915559056 shutdown_connections 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- 172.21.15.6:0/1915559056 wait complete. 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 -- start start 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.928+0000 7f313fcc8740 1 Processor -- start 2024-09-21T08:04:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d059f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01ed520 0x55c3d059f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c3d0495300 con 0x55c3d01c4660 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c3d04fe430 con 0x55c3d01cc840 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c3d035bbb0 con 0x55c3d01ed520 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f313fcc8740 10 client.0 _ll_register_callbacks cb 0x55c3d04af120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43640/0 (socket says 172.21.15.6:43640) 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 -- 172.21.15.6:0/2965320913 learned_addr learned my addr 172.21.15.6:0/2965320913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f31327fc640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d059f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f31337fe640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01ed520 0x55c3d059f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 -- 172.21.15.6:0/2965320913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01ed520 msgr2=0x55c3d059f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01ed520 0x55c3d059f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 -- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 msgr2=0x55c3d059f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d059f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 -- 172.21.15.6:0/2965320913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d0484780 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3132ffd640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3124033000 tx=0x7f3124009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f348c24c8e9d022 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.929+0000 7f3116ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124035040 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f312404cce0 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31280054b0 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f31240035f0 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 10 client.16065 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3d0258b00 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31280054b0 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3124044030 con 0x55c3d01c4660 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 10 client.16065 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 10 client.16065 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 20 client.16065 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d01abea0 0x55c3d05b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 4 client.16065 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.930+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3d050d140 con 0x55c3d01abea0 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.931+0000 7f31327fc640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d01abea0 0x55c3d05b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.931+0000 7f3116ff5640 10 client.16065 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.931+0000 7f31327fc640 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d01abea0 0x55c3d05b0ef0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14b0f0308649919 server_cookie=6b842fca38abe4eb in_seq=0 out_seq=0 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f3116ff5640 1 -- 172.21.15.6:0/2965320913 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3d050d140 con 0x55c3d01abea0 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f3116ff5640 10 client.16065 handle_command_reply: tid=0 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 client.16065 shutdown 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 msgr2=0x55c3d059eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3124033000 tx=0x7f3124009260 comp rx=0 tx=0).stop 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 shutdown_connections 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d01abea0 0x55c3d05b0ef0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01ed520 0x55c3d059f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d059f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 --2- 172.21.15.6:0/2965320913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01c4660 0x55c3d059eb20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 >> 172.21.15.6:0/2965320913 conn(0x55c3d01e1910 msgr2=0x55c3d05966f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f3116ff5640 0 client.16065 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 shutdown_connections 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 1 -- 172.21.15.6:0/2965320913 wait complete. 2024-09-21T08:04:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.932+0000 7f313fcc8740 20 client.16065 trim_cache size 0 max 16384 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 Processor -- start 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 -- start start 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d059bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d059c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31341ac930 con 0x55c3d01ed520 2024-09-21T08:04:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31341af1b0 con 0x55c3d01c4660 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f313fcc8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31341acfa0 con 0x55c3d01cc840 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43648/0 (socket says 172.21.15.6:43648) 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 -- 172.21.15.6:0/3711866312 learned_addr learned my addr 172.21.15.6:0/3711866312 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31327fc640 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d059c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f3132ffd640 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d059bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 -- 172.21.15.6:0/3711866312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 msgr2=0x55c3d059c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d059c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 -- 172.21.15.6:0/3711866312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 msgr2=0x55c3d059bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.950+0000 7f31337fe640 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d059bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.951+0000 7f31337fe640 1 -- 172.21.15.6:0/3711866312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d02cf960 con 0x55c3d01ed520 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.951+0000 7f31337fe640 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f312c0adc30 tx=0x7f312c0ad540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf53e9a5bed44d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.951+0000 7f3118ff9640 1 -- 172.21.15.6:0/3711866312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0ae3a0 con 0x55c3d01ed520 2024-09-21T08:04:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.951+0000 7f3118ff9640 1 -- 172.21.15.6:0/3711866312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f312c0b2780 con 0x55c3d01ed520 2024-09-21T08:04:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.951+0000 7f3118ff9640 1 -- 172.21.15.6:0/3711866312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0d1310 con 0x55c3d01ed520 2024-09-21T08:04:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- 172.21.15.6:0/3711866312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 msgr2=0x55c3d05b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f312c0adc30 tx=0x7f312c0ad540 comp rx=0 tx=0).stop 2024-09-21T08:04:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- 172.21.15.6:0/3711866312 shutdown_connections 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01cc840 0x55c3d059c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05b66b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3711866312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01c4660 0x55c3d059bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- 172.21.15.6:0/3711866312 >> 172.21.15.6:0/3711866312 conn(0x55c3d01e1910 msgr2=0x55c3d05a0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- 172.21.15.6:0/3711866312 shutdown_connections 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- 172.21.15.6:0/3711866312 wait complete. 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 -- start start 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 Processor -- start 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.952+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01c4660 0x55c3d05a7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d05a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31341ad670 con 0x55c3d01ed520 2024-09-21T08:04:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31341aeae0 con 0x55c3d01cc840 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31341add40 con 0x55c3d01c4660 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 10 client.0 _ll_register_callbacks cb 0x7f3124009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43652/0 (socket says 172.21.15.6:43652) 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 -- 172.21.15.6:0/3923661746 learned_addr learned my addr 172.21.15.6:0/3923661746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f3132ffd640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01c4660 0x55c3d05a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31327fc640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d05a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 -- 172.21.15.6:0/3923661746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01c4660 msgr2=0x55c3d05a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01c4660 0x55c3d05a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 -- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 msgr2=0x55c3d05a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d05a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 -- 172.21.15.6:0/3923661746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d05a66a0 con 0x55c3d01ed520 2024-09-21T08:04:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f31337fe640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f312c0aaf10 tx=0x7f312c00fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea69eadaf5cfb6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f3116ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0950d0 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f312c0d12c0 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.953+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f312c0b2780 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f312c05d100 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 10 client.16071 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3d061c7e0 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f312c0c3e50 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f312c0ca050 con 0x55c3d01ed520 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 10 client.16071 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 10 client.16071 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 20 client.16071 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d0181250 0x55c3d061eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 4 client.16071 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e9651dc", "release": true, "await": true}] 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e9651dc", "release": true, "await": true}) -- 0x55c3d0508bf0 con 0x55c3d0181250 2024-09-21T08:04:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.954+0000 7f3132ffd640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d0181250 0x55c3d061eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.955+0000 7f3132ffd640 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d0181250 0x55c3d061eec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83e504f051e5d9a server_cookie=c8b7f17625be8c7c in_seq=0 out_seq=0 2024-09-21T08:04:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:19.955+0000 7f3116ff5640 10 client.16071 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.348+0000 7f3116ff5640 1 -- 172.21.15.6:0/3923661746 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c3d0508bf0 con 0x55c3d0181250 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.348+0000 7f3116ff5640 10 client.16071 handle_command_reply: tid=0 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.348+0000 7f313fcc8740 1 client.16071 shutdown 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.348+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 msgr2=0x55c3d05a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.348+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f312c0aaf10 tx=0x7f312c00fe40 comp rx=0 tx=0).stop 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 shutdown_connections 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c3d0181250 0x55c3d061eec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c3d01ed520 0x55c3d05a5f60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3d01cc840 0x55c3d05a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 --2- 172.21.15.6:0/3923661746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3d01c4660 0x55c3d05a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3116ff5640 0 client.16071 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 >> 172.21.15.6:0/3923661746 conn(0x55c3d01e1910 msgr2=0x55c3d059d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 shutdown_connections 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 1 -- 172.21.15.6:0/3923661746 wait complete. 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f313fcc8740 20 client.16071 trim_cache size 0 max 16384 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:04:20.353 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 16, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "2e9651dc": { 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 16, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 147.8, 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:04:20.354 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 msgr2=0x7f311c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 0x7f311c0b8c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31240057c0 tx=0x7f31240058d0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 msgr2=0x7f313419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f312c00cce0 tx=0x7f312c00a620 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 shutdown_connections 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f311c0b6730 0x7f311c0b8c40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31341094a0 0x7f313419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3134109df0 0x7f313419fb50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.349+0000 7f3139754640 1 --2- 172.21.15.6:0/484718136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3134103b60 0x7f313419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.350+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 >> 172.21.15.6:0/484718136 conn(0x7f313407b850 msgr2=0x7f3134107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.350+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 shutdown_connections 2024-09-21T08:04:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:20.350+0000 7f3139754640 1 -- 172.21.15.6:0/484718136 wait complete. 2024-09-21T08:04:20.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:20 smithi006 ceph-mon[30970]: pgmap v442: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 204 KiB/s wr, 27 op/s 2024-09-21T08:04:21.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:20 smithi119 ceph-mon[33564]: pgmap v442: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 204 KiB/s wr, 27 op/s 2024-09-21T08:04:21.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:20 smithi145 ceph-mon[34049]: pgmap v442: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 204 KiB/s wr, 27 op/s 2024-09-21T08:04:21.196 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2e9651dc', total seconds elapsed: 31.6 2024-09-21T08:04:22.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:21 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:04:22.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:21 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:04:22.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:21 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:04:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 85.0 s, 433.2 tps, lat 1353.221 ms stddev 5688.664 2024-09-21T08:04:23.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:22 smithi119 ceph-mon[33564]: pgmap v443: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 349 KiB/s wr, 43 op/s 2024-09-21T08:04:23.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:22 smithi145 ceph-mon[34049]: pgmap v443: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 349 KiB/s wr, 43 op/s 2024-09-21T08:04:23.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:22 smithi006 ceph-mon[30970]: pgmap v443: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 349 KiB/s wr, 43 op/s 2024-09-21T08:04:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:24 smithi119 ceph-mon[33564]: pgmap v444: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 147 op/s 2024-09-21T08:04:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:24 smithi145 ceph-mon[34049]: pgmap v444: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 147 op/s 2024-09-21T08:04:25.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:24 smithi006 ceph-mon[30970]: pgmap v444: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 147 op/s 2024-09-21T08:04:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:26 smithi119 ceph-mon[33564]: pgmap v445: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 227 op/s 2024-09-21T08:04:27.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:26 smithi145 ceph-mon[34049]: pgmap v445: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 227 op/s 2024-09-21T08:04:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:26 smithi006 ceph-mon[30970]: pgmap v445: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 227 op/s 2024-09-21T08:04:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 90.0 s, 1197.4 tps, lat 83.538 ms stddev 22.896 2024-09-21T08:04:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:28 smithi119 ceph-mon[33564]: pgmap v446: 129 pgs: 129 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 381 op/s 2024-09-21T08:04:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:28 smithi145 ceph-mon[34049]: pgmap v446: 129 pgs: 129 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 381 op/s 2024-09-21T08:04:29.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:28 smithi006 ceph-mon[30970]: pgmap v446: 129 pgs: 129 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.5 MiB/s wr, 381 op/s 2024-09-21T08:04:31.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:30 smithi119 ceph-mon[33564]: pgmap v447: 129 pgs: 129 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-09-21T08:04:31.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:30 smithi145 ceph-mon[34049]: pgmap v447: 129 pgs: 129 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-09-21T08:04:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:30 smithi006 ceph-mon[30970]: pgmap v447: 129 pgs: 129 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 677 op/s 2024-09-21T08:04:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 95.0 s, 1020.0 tps, lat 97.792 ms stddev 25.819 2024-09-21T08:04:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:32 smithi119 ceph-mon[33564]: pgmap v448: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.8 MiB/s wr, 876 op/s 2024-09-21T08:04:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:32 smithi145 ceph-mon[34049]: pgmap v448: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.8 MiB/s wr, 876 op/s 2024-09-21T08:04:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:32 smithi006 ceph-mon[30970]: pgmap v448: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.8 MiB/s wr, 876 op/s 2024-09-21T08:04:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:34 smithi119 ceph-mon[33564]: pgmap v449: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-21T08:04:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:34 smithi145 ceph-mon[34049]: pgmap v449: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-21T08:04:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:34 smithi006 ceph-mon[30970]: pgmap v449: 129 pgs: 129 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-21T08:04:36.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:04:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:36 smithi119 ceph-mon[33564]: pgmap v450: 129 pgs: 129 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 1.10k op/s 2024-09-21T08:04:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:36 smithi145 ceph-mon[34049]: pgmap v450: 129 pgs: 129 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 1.10k op/s 2024-09-21T08:04:37.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:36 smithi006 ceph-mon[30970]: pgmap v450: 129 pgs: 129 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.8 MiB/s wr, 1.10k op/s 2024-09-21T08:04:37.253 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 100.0 s, 958.8 tps, lat 81.413 ms stddev 30.766 2024-09-21T08:04:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.076+0000 7fa303367640 1 -- 172.21.15.6:0/1351546769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc103020 msgr2=0x7fa2fc103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.076+0000 7fa303367640 1 --2- 172.21.15.6:0/1351546769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc103020 0x7fa2fc103430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009900 tx=0x7fa2f802a440 comp rx=0 tx=0).stop 2024-09-21T08:04:38.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 -- 172.21.15.6:0/1351546769 shutdown_connections 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 --2- 172.21.15.6:0/1351546769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc105940 0x7fa2fc10f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 --2- 172.21.15.6:0/1351546769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 --2- 172.21.15.6:0/1351546769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc103020 0x7fa2fc103430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 -- 172.21.15.6:0/1351546769 >> 172.21.15.6:0/1351546769 conn(0x7fa2fc077ae0 msgr2=0x7fa2fc077f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 -- 172.21.15.6:0/1351546769 shutdown_connections 2024-09-21T08:04:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.077+0000 7fa303367640 1 -- 172.21.15.6:0/1351546769 wait complete. 2024-09-21T08:04:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.079+0000 7fa303367640 1 Processor -- start 2024-09-21T08:04:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.079+0000 7fa303367640 1 -- start start 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 0x7fa2fc19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc105940 0x7fa2fc1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1115d0 con 0x7fa2fc105940 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc111450 con 0x7fa2fc103020 2024-09-21T08:04:38.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa303367640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc111750 con 0x7fa2fc104ff0 2024-09-21T08:04:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa301103640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 0x7fa2fc19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa300902640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa300902640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47008/0 (socket says 172.21.15.6:47008) 2024-09-21T08:04:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.080+0000 7fa300902640 1 -- 172.21.15.6:0/2734662878 learned_addr learned my addr 172.21.15.6:0/2734662878 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:38.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301904640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc105940 0x7fa2fc1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301103640 1 -- 172.21.15.6:0/2734662878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 msgr2=0x7fa2fc19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301103640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301103640 1 -- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc105940 msgr2=0x7fa2fc1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301103640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc105940 0x7fa2fc1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.081+0000 7fa301103640 1 -- 172.21.15.6:0/2734662878 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc1a2320 con 0x7fa2fc103020 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa300902640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:04:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa301103640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 0x7fa2fc19c470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009230 tx=0x7fa2f8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa2f27fc640 1 -- 172.21.15.6:0/2734662878 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8040030 con 0x7fa2fc103020 2024-09-21T08:04:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa2f27fc640 1 -- 172.21.15.6:0/2734662878 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f803c8d0 con 0x7fa2fc103020 2024-09-21T08:04:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa2f27fc640 1 -- 172.21.15.6:0/2734662878 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8031790 con 0x7fa2fc103020 2024-09-21T08:04:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc1a25b0 con 0x7fa2fc103020 2024-09-21T08:04:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.082+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc1a2950 con 0x7fa2fc103020 2024-09-21T08:04:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.086+0000 7fa3098db740 1 Processor -- start 2024-09-21T08:04:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.086+0000 7fa3098db740 1 -- start start 2024-09-21T08:04:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9febe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9febeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564b9fe2be50 con 0x564b9fb0e070 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564b9fe1b280 con 0x564b9fae51b0 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa3098db740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564b9fe1f090 con 0x564b9faed390 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa301904640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa301904640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52868/0 (socket says 172.21.15.6:52868) 2024-09-21T08:04:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa301904640 1 -- 172.21.15.6:0/1400186068 learned_addr learned my addr 172.21.15.6:0/1400186068 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.087+0000 7fa300902640 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9febeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 -- 172.21.15.6:0/1400186068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 msgr2=0x564b9febeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9febeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 -- 172.21.15.6:0/1400186068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 msgr2=0x564b9febe560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9febe560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 -- 172.21.15.6:0/1400186068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9fb79650 con 0x564b9fb0e070 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa301904640 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009fd0 tx=0x7fa2f40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b093770a80a4e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa2f27fc640 1 -- 172.21.15.6:0/2734662878 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa2f8043030 con 0x7fa2fc103020 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa2e77fe640 1 -- 172.21.15.6:0/1400186068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4004d20 con 0x564b9fb0e070 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa2e77fe640 1 -- 172.21.15.6:0/1400186068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f4004050 con 0x564b9fb0e070 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.088+0000 7fa2e77fe640 1 -- 172.21.15.6:0/1400186068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4005280 con 0x564b9fb0e070 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.089+0000 7fa2f27fc640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 0x7fa2e80b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 -- 172.21.15.6:0/1400186068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 msgr2=0x564b9febe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009fd0 tx=0x7fa2f40118d0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 -- 172.21.15.6:0/1400186068 shutdown_connections 2024-09-21T08:04:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9febeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9febe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 --2- 172.21.15.6:0/1400186068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9febe020 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 -- 172.21.15.6:0/1400186068 >> 172.21.15.6:0/1400186068 conn(0x564b9fb02460 msgr2=0x564b9febbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa301103640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 0x7fa2e80b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa2f27fc640 1 -- 172.21.15.6:0/2734662878 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa2f81080e0 con 0x7fa2fc103020 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.090+0000 7fa3098db740 1 -- 172.21.15.6:0/1400186068 shutdown_connections 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.091+0000 7fa3098db740 1 -- 172.21.15.6:0/1400186068 wait complete. 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.091+0000 7fa301103640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 0x7fa2e80b8cc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x564b9febcca0 tx=0x7fa2f80d1040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.091+0000 7fa3098db740 1 -- start start 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.091+0000 7fa3098db740 1 Processor -- start 2024-09-21T08:04:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.092+0000 7fa3098db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fae51b0 0x564b9feb81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.092+0000 7fa3098db740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa3098db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa300902640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa301904640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa301904640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58050/0 (socket says 172.21.15.6:58050) 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa301904640 1 -- 172.21.15.6:0/1096300652 learned_addr learned my addr 172.21.15.6:0/1096300652 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa3098db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564b9fc7c700 con 0x564b9fae51b0 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564b9fdb6110 con 0x564b9fb0e070 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564b9febb350 con 0x564b9faed390 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.093+0000 7fa3098db740 10 client.0 _ll_register_callbacks cb 0x564b9fdcf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fae51b0 0x564b9feb81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 -- 172.21.15.6:0/1096300652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 msgr2=0x564b9feb8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 -- 172.21.15.6:0/1096300652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fae51b0 msgr2=0x564b9feb81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fae51b0 0x564b9feb81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.094+0000 7fa301904640 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9fde3c40 con 0x564b9fb0e070 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.095+0000 7fa301904640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004930 tx=0x7fa2f4005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708cff57af6d517c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.095+0000 7fa2e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.095+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f402c060 con 0x564b9fb0e070 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.095+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa2f4003d70 con 0x564b9fb0e070 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.095+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f4004050 con 0x564b9fb0e070 2024-09-21T08:04:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.096+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2f400f480 con 0x564b9fb0e070 2024-09-21T08:04:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.096+0000 7fa3098db740 10 client.25751 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.096+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b9fee0cb0 con 0x564b9fb0e070 2024-09-21T08:04:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.097+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f4004050 con 0x564b9fb0e070 2024-09-21T08:04:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.097+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2f4027560 con 0x564b9fb0e070 2024-09-21T08:04:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 10 client.25751 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 10 client.25751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 20 client.25751 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9facc9f0 0x564b9fee4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 4 client.25751 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b9fe2dda0 con 0x564b9facc9f0 2024-09-21T08:04:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.098+0000 7fa300902640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9facc9f0 0x564b9fee4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.100+0000 7fa300902640 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9facc9f0 0x564b9fee4120 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a959d793ed4bc7af server_cookie=10c15066440603f8 in_seq=0 out_seq=0 2024-09-21T08:04:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.100+0000 7fa2e4ff9640 10 client.25751 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/1096300652 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b9fe2dda0 con 0x564b9facc9f0 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa2e4ff9640 10 client.25751 handle_command_reply: tid=0 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 client.25751 shutdown 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 msgr2=0x564b9feb8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004930 tx=0x7fa2f4005bd0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 shutdown_connections 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9facc9f0 0x564b9fee4120 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9feb8c60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 --2- 172.21.15.6:0/1096300652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fae51b0 0x564b9feb81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 >> 172.21.15.6:0/1096300652 conn(0x564b9fb02460 msgr2=0x564b9febfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.101+0000 7fa2e4ff9640 0 client.25751 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.102+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 shutdown_connections 2024-09-21T08:04:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.103+0000 7fa3098db740 1 -- 172.21.15.6:0/1096300652 wait complete. 2024-09-21T08:04:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.103+0000 7fa3098db740 20 client.25751 trim_cache size 0 max 16384 2024-09-21T08:04:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.137+0000 7fa3098db740 1 Processor -- start 2024-09-21T08:04:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.137+0000 7fa3098db740 1 -- start start 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.137+0000 7fa3098db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9feba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.137+0000 7fa3098db740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa3098db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9feb5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa3098db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1acaa0 con 0x564b9fb0e070 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa3098db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1af320 con 0x564b9fae51b0 2024-09-21T08:04:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa3098db740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1ad110 con 0x564b9faed390 2024-09-21T08:04:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa300902640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa300902640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47026/0 (socket says 172.21.15.6:47026) 2024-09-21T08:04:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa300902640 1 -- 172.21.15.6:0/1811301666 learned_addr learned my addr 172.21.15.6:0/1811301666 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:38.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9feba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9feb5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 -- 172.21.15.6:0/1811301666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 msgr2=0x564b9feb53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 -- 172.21.15.6:0/1811301666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 msgr2=0x564b9feb5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9feb5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.138+0000 7fa301904640 1 -- 172.21.15.6:0/1811301666 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9febc800 con 0x564b9fae51b0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.139+0000 7fa301904640 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9feba1d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4006010 tx=0x7fa2f40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c9a5e6322f3f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.139+0000 7fa2e6ffd640 1 -- 172.21.15.6:0/1811301666 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f402c070 con 0x564b9fae51b0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.139+0000 7fa2e6ffd640 1 -- 172.21.15.6:0/1811301666 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f4011dd0 con 0x564b9fae51b0 2024-09-21T08:04:38.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.139+0000 7fa2e6ffd640 1 -- 172.21.15.6:0/1811301666 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400f620 con 0x564b9fae51b0 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.140+0000 7fa3098db740 1 -- 172.21.15.6:0/1811301666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 msgr2=0x564b9feba1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.140+0000 7fa3098db740 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9feba1d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4006010 tx=0x7fa2f40118d0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 -- 172.21.15.6:0/1811301666 shutdown_connections 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9faed390 0x564b9feb53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9fb0e070 0x564b9feb5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 --2- 172.21.15.6:0/1811301666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fae51b0 0x564b9feba1d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 -- 172.21.15.6:0/1811301666 >> 172.21.15.6:0/1811301666 conn(0x564b9fb02460 msgr2=0x564b9feddcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 -- 172.21.15.6:0/1811301666 shutdown_connections 2024-09-21T08:04:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 -- 172.21.15.6:0/1811301666 wait complete. 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.141+0000 7fa3098db740 1 -- start start 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 Processor -- start 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9faed390 0x564b9fedad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9fed5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1ad7e0 con 0x564b9faed390 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1aec50 con 0x564b9fb0e070 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1adeb0 con 0x564b9fae51b0 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.142+0000 7fa3098db740 10 client.0 _ll_register_callbacks cb 0x7fa2f4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47038/0 (socket says 172.21.15.6:47038) 2024-09-21T08:04:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 -- 172.21.15.6:0/3047536611 learned_addr learned my addr 172.21.15.6:0/3047536611 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9fed5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa300902640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9faed390 0x564b9fedad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 -- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 msgr2=0x564b9fed5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9fed5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 -- 172.21.15.6:0/3047536611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9faed390 msgr2=0x564b9fedad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9faed390 0x564b9fedad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.143+0000 7fa301904640 1 -- 172.21.15.6:0/3047536611 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9fed6560 con 0x564b9fae51b0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa301904640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009560 tx=0x7fa2f40059a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=189fce6964d201e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa2e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f402c040 con 0x564b9fae51b0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa2f40041b0 con 0x564b9fae51b0 2024-09-21T08:04:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f4011dd0 con 0x564b9fae51b0 2024-09-21T08:04:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2f404d050 con 0x564b9fae51b0 2024-09-21T08:04:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa3098db740 10 client.25849 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.144+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b9ff4e410 con 0x564b9fae51b0 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f403d030 con 0x564b9fae51b0 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2f4019430 con 0x564b9fae51b0 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 10 client.25849 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 20 client.25849 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9faa1da0 0x564b9ff50a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 4 client.25849 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.145+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa2f4011dd0 con 0x564b9faa1da0 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa300902640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9faa1da0 0x564b9ff50a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:38.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa2e4ff9640 10 client.25849 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa300902640 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9faa1da0 0x564b9ff50a30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7a59ebc364af9 server_cookie=3b48aa095204c35b in_seq=0 out_seq=0 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa2e4ff9640 1 -- 172.21.15.6:0/3047536611 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x7fa2f4011dd0 con 0x564b9faa1da0 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa2e4ff9640 10 client.25849 handle_command_reply: tid=0 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.146+0000 7fa3098db740 1 client.25849 shutdown 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 msgr2=0x564b9feda790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009560 tx=0x7fa2f40059a0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 shutdown_connections 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564b9faa1da0 0x564b9ff50a30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa2e4ff9640 0 client.25849 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564b9fb0e070 0x564b9fed5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b9faed390 0x564b9fedad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 --2- 172.21.15.6:0/3047536611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564b9fae51b0 0x564b9feda790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.147+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 >> 172.21.15.6:0/3047536611 conn(0x564b9fb02460 msgr2=0x564b9fec3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.148+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 shutdown_connections 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.148+0000 7fa3098db740 1 -- 172.21.15.6:0/3047536611 wait complete. 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:04:38.151 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:38.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:38.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:38.154 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.148+0000 7fa3098db740 20 client.25849 trim_cache size 0 max 16384 2024-09-21T08:04:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 msgr2=0x7fa2e80b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 0x7fa2e80b8cc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x564b9febcca0 tx=0x7fa2f80d1040 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 msgr2=0x7fa2fc19c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 0x7fa2fc19c470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009230 tx=0x7fa2f8003f10 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 shutdown_connections 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b67b0 0x7fa2e80b8cc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc104ff0 0x7fa2fc19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc105940 0x7fa2fc1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 --2- 172.21.15.6:0/2734662878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc103020 0x7fa2fc19c470 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.149+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 >> 172.21.15.6:0/2734662878 conn(0x7fa2fc077ae0 msgr2=0x7fa2fc106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.150+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 shutdown_connections 2024-09-21T08:04:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:38.150+0000 7fa303367640 1 -- 172.21.15.6:0/2734662878 wait complete. 2024-09-21T08:04:39.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:38 smithi119 ceph-mon[33564]: pgmap v451: 129 pgs: 129 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:04:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:38 smithi145 ceph-mon[34049]: pgmap v451: 129 pgs: 129 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:04:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:38 smithi006 ceph-mon[30970]: pgmap v451: 129 pgs: 129 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:04:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:40 smithi119 ceph-mon[33564]: pgmap v452: 129 pgs: 129 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T08:04:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:40 smithi145 ceph-mon[34049]: pgmap v452: 129 pgs: 129 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T08:04:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:40 smithi006 ceph-mon[30970]: pgmap v452: 129 pgs: 129 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T08:04:41.500 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:04:41.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:04:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 -- 172.21.15.6:0/852289832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a41082a0 msgr2=0x7f01a410ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 --2- 172.21.15.6:0/852289832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a41082a0 0x7f01a410ead0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f019c00bd70 tx=0x7f019c02c450 comp rx=0 tx=0).stop 2024-09-21T08:04:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 -- 172.21.15.6:0/852289832 shutdown_connections 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 --2- 172.21.15.6:0/852289832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a41082a0 0x7f01a410ead0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 --2- 172.21.15.6:0/852289832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a4107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.566+0000 7f01aa8af640 1 --2- 172.21.15.6:0/852289832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01a4102010 0x7f01a4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.567+0000 7f01aa8af640 1 -- 172.21.15.6:0/852289832 >> 172.21.15.6:0/852289832 conn(0x7f01a4077aa0 msgr2=0x7f01a4077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.567+0000 7f01aa8af640 1 -- 172.21.15.6:0/852289832 shutdown_connections 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.567+0000 7f01aa8af640 1 -- 172.21.15.6:0/852289832 wait complete. 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 Processor -- start 2024-09-21T08:04:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 -- start start 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01a41082a0 0x7f01a41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01a41159e0 con 0x7f01a4107950 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01a4115860 con 0x7f01a41082a0 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.568+0000 7f01aa8af640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f01a4115b60 con 0x7f01a4102010 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47058/0 (socket says 172.21.15.6:47058) 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 -- 172.21.15.6:0/2768195657 learned_addr learned my addr 172.21.15.6:0/2768195657 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 -- 172.21.15.6:0/2768195657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01a41082a0 msgr2=0x7f01a41a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01a41082a0 0x7f01a41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 -- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 msgr2=0x7f01a419ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a90ac640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a419ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.569+0000 7f01a98ad640 1 -- 172.21.15.6:0/2768195657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a41a2400 con 0x7f01a4102010 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.570+0000 7f01a90ac640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.570+0000 7f01a98ad640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01a000fdc0 tx=0x7f01a000d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.570+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0004220 con 0x7f01a4102010 2024-09-21T08:04:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.570+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01a00043c0 con 0x7f01a4102010 2024-09-21T08:04:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.571+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a000b930 con 0x7f01a4102010 2024-09-21T08:04:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.571+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a41a26f0 con 0x7f01a4102010 2024-09-21T08:04:42.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.571+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a41a8e50 con 0x7f01a4102010 2024-09-21T08:04:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.573+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a4102420 con 0x7f01a4102010 2024-09-21T08:04:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.575+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f01a000bad0 con 0x7f01a4102010 2024-09-21T08:04:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.576+0000 7f019affd640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 0x7f01900b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.577+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f01a00e7eb0 con 0x7f01a4102010 2024-09-21T08:04:42.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.577+0000 7f01a90ac640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 0x7f01900b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.578+0000 7f01a90ac640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 0x7f01900b8d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 105.0 s, 828.4 tps, lat 147.095 ms stddev 612.872 2024-09-21T08:04:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:42.582+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01a0014070 con 0x7f01a4102010 2024-09-21T08:04:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.026+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01a419d5c0 con 0x7f01a4102010 2024-09-21T08:04:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.028+0000 7f019affd640 1 -- 172.21.15.6:0/2768195657 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f01a00ae020 con 0x7f01a4102010 2024-09-21T08:04:43.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:04:43.029 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:04:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.031+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 msgr2=0x7f01900b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.031+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 0x7f01900b8d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194008040 comp rx=0 tx=0).stop 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.031+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 msgr2=0x7f01a419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.031+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01a000fdc0 tx=0x7f01a000d7b0 comp rx=0 tx=0).stop 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 shutdown_connections 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f01900b6850 0x7f01900b8d60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01a41082a0 0x7f01a41a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a4107950 0x7f01a419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 --2- 172.21.15.6:0/2768195657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f01a4102010 0x7f01a419c490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.032+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 >> 172.21.15.6:0/2768195657 conn(0x7f01a4077aa0 msgr2=0x7f01a4105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.033+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 shutdown_connections 2024-09-21T08:04:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:43.033+0000 7f01aa8af640 1 -- 172.21.15.6:0/2768195657 wait complete. 2024-09-21T08:04:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:42 smithi119 ceph-mon[33564]: pgmap v453: 129 pgs: 129 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-21T08:04:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:42 smithi145 ceph-mon[34049]: pgmap v453: 129 pgs: 129 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-21T08:04:43.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:42 smithi006 ceph-mon[30970]: pgmap v453: 129 pgs: 129 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-21T08:04:44.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:43 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2768195657' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:44.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2768195657' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:44.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2768195657' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:04:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:44 smithi119 ceph-mon[33564]: pgmap v454: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 1.17k op/s 2024-09-21T08:04:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:44 smithi145 ceph-mon[34049]: pgmap v454: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 1.17k op/s 2024-09-21T08:04:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:44 smithi006 ceph-mon[30970]: pgmap v454: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 1.17k op/s 2024-09-21T08:04:45.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:04:46.236 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:46 smithi119 ceph-mon[33564]: pgmap v455: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2024-09-21T08:04:47.192 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:46 smithi145 ceph-mon[34049]: pgmap v455: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2024-09-21T08:04:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:46 smithi006 ceph-mon[30970]: pgmap v455: 129 pgs: 129 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2024-09-21T08:04:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 110.0 s, 952.0 tps, lat 104.988 ms stddev 38.865 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.496+0000 7f7c92830640 1 -- 172.21.15.6:0/1264194585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c11cc30 msgr2=0x7f7c8c11f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.496+0000 7f7c92830640 1 --2- 172.21.15.6:0/1264194585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c11f140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009be0 tx=0x7f7c8402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.496+0000 7f7c92830640 1 -- 172.21.15.6:0/1264194585 shutdown_connections 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.496+0000 7f7c92830640 1 --2- 172.21.15.6:0/1264194585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c11f140 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.497+0000 7f7c92830640 1 --2- 172.21.15.6:0/1264194585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.497+0000 7f7c92830640 1 --2- 172.21.15.6:0/1264194585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c111f40 0x7f7c8c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.497+0000 7f7c92830640 1 -- 172.21.15.6:0/1264194585 >> 172.21.15.6:0/1264194585 conn(0x7f7c8c070ec0 msgr2=0x7f7c8c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.497+0000 7f7c92830640 1 -- 172.21.15.6:0/1264194585 shutdown_connections 2024-09-21T08:04:48.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.497+0000 7f7c92830640 1 -- 172.21.15.6:0/1264194585 wait complete. 2024-09-21T08:04:48.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.498+0000 7f7c92830640 1 Processor -- start 2024-09-21T08:04:48.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.498+0000 7f7c92830640 1 -- start start 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c92830640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c1a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c92830640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 0x7f7c8c1a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c92830640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c1aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c92830640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c122760 con 0x7f7c8c11cc30 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c92830640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c1225e0 con 0x7f7c8c10a9e0 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c1a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 0x7f7c8c1a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c1a9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47172/0 (socket says 172.21.15.6:47172) 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.499+0000 7f7c8bfff640 1 -- 172.21.15.6:0/440085283 learned_addr learned my addr 172.21.15.6:0/440085283 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c1228e0 con 0x7f7c8c111f40 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/440085283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 msgr2=0x7f7c8c1a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c1a9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 msgr2=0x7f7c8c1aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c1aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c1aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/440085283 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c1af1c0 con 0x7f7c8c111f40 2024-09-21T08:04:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.500+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c1aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.501+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 0x7f7c8c1a97f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c06c6e0 tx=0x7f7c7c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.501+0000 7f7c897fa640 1 -- 172.21.15.6:0/440085283 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00cc90 con 0x7f7c8c111f40 2024-09-21T08:04:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.502+0000 7f7c897fa640 1 -- 172.21.15.6:0/440085283 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c7c0044c0 con 0x7f7c8c111f40 2024-09-21T08:04:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.502+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c1af4b0 con 0x7f7c8c111f40 2024-09-21T08:04:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.502+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c1b5c10 con 0x7f7c8c111f40 2024-09-21T08:04:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.502+0000 7f7c897fa640 1 -- 172.21.15.6:0/440085283 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c003e20 con 0x7f7c8c111f40 2024-09-21T08:04:48.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.506+0000 7f7c98da4740 1 Processor -- start 2024-09-21T08:04:48.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.506+0000 7f7c98da4740 1 -- start start 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b63d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5624f4ad9ea0 con 0x5624f47931b0 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5624f4ac92d0 con 0x5624f47bc070 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c98da4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5624f4acd0e0 con 0x5624f479b390 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c897fa640 1 -- 172.21.15.6:0/440085283 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7c7c021440 con 0x7f7c8c111f40 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c90dcd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c90dcd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47178/0 (socket says 172.21.15.6:47178) 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c90dcd640 1 -- 172.21.15.6:0/2738539127 learned_addr learned my addr 172.21.15.6:0/2738539127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.507+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b63d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 -- 172.21.15.6:0/2738539127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 msgr2=0x5624f4b63d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b63d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 -- 172.21.15.6:0/2738539127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 msgr2=0x5624f4b63800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b63800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 -- 172.21.15.6:0/2738539127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f4827650 con 0x5624f47bc070 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c897fa640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 0x7f7c740b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c897fa640 1 -- 172.21.15.6:0/440085283 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7c7c0e7c30 con 0x7f7c8c111f40 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 0x7f7c740b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.509+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034040 tx=0x7f7c840093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216e66db288c71e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.510+0000 7f7c727fc640 1 -- 172.21.15.6:0/2738539127 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84041020 con 0x5624f47bc070 2024-09-21T08:04:48.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.510+0000 7f7c727fc640 1 -- 172.21.15.6:0/2738539127 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c84037040 con 0x5624f47bc070 2024-09-21T08:04:48.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.511+0000 7f7c98da4740 1 -- 172.21.15.6:0/2738539127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 msgr2=0x5624f4b632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.511+0000 7f7c727fc640 1 -- 172.21.15.6:0/2738539127 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84041020 con 0x5624f47bc070 2024-09-21T08:04:48.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.511+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034040 tx=0x7f7c840093e0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.512+0000 7f7c98da4740 1 -- 172.21.15.6:0/2738539127 shutdown_connections 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b63800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2738539127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b632c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 -- 172.21.15.6:0/2738539127 >> 172.21.15.6:0/2738539127 conn(0x5624f47b0460 msgr2=0x5624f4b611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 0x7f7c740b8d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5624f4b61f40 tx=0x7f7c80005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 -- 172.21.15.6:0/2738539127 shutdown_connections 2024-09-21T08:04:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.513+0000 7f7c98da4740 1 -- 172.21.15.6:0/2738539127 wait complete. 2024-09-21T08:04:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.514+0000 7f7c98da4740 1 -- start start 2024-09-21T08:04:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.515+0000 7f7c98da4740 1 Processor -- start 2024-09-21T08:04:48.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b6ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b6f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5624f492a700 con 0x5624f47931b0 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5624f4a64160 con 0x5624f47bc070 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.516+0000 7f7c98da4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5624f4b71a90 con 0x5624f479b390 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c98da4740 10 client.0 _ll_register_callbacks cb 0x5624f4a7d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b6ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57976/0 (socket says 172.21.15.6:57976) 2024-09-21T08:04:48.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 -- 172.21.15.6:0/2338355160 learned_addr learned my addr 172.21.15.6:0/2338355160 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 -- 172.21.15.6:0/2338355160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 msgr2=0x5624f4b6ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b6ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 -- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 msgr2=0x5624f4b6f380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:04:48.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b6f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.517+0000 7f7c8bfff640 1 -- 172.21.15.6:0/2338355160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f4a91c90 con 0x5624f47931b0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.518+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009710 tx=0x7f7c80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d685cf53fbc956d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.518+0000 7f7c6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8002e060 con 0x5624f47931b0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7c80018030 con 0x5624f47931b0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c84037040 con 0x5624f47931b0 2024-09-21T08:04:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c80035050 con 0x5624f47931b0 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c98da4740 10 client.16095 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.519+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5624f4b7d830 con 0x5624f47931b0 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c84037040 con 0x5624f47931b0 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c8001c530 con 0x5624f47931b0 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 10 client.16095 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 20 client.16095 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f477a9f0 0x5624f4b812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 4 client.16095 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f4adbdf0 con 0x5624f477a9f0 2024-09-21T08:04:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.520+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f477a9f0 0x5624f4b812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.521+0000 7f7c6b7fe640 10 client.16095 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.521+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f477a9f0 0x5624f4b812a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c828d41d405b852f server_cookie=bd24425a3a724cdd in_seq=0 out_seq=0 2024-09-21T08:04:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.522+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/2338355160 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624f4adbdf0 con 0x5624f477a9f0 2024-09-21T08:04:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.522+0000 7f7c6b7fe640 10 client.16095 handle_command_reply: tid=0 2024-09-21T08:04:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.522+0000 7f7c98da4740 1 client.16095 shutdown 2024-09-21T08:04:48.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.523+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 msgr2=0x5624f4b6e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.523+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009710 tx=0x7f7c80004730 comp rx=0 tx=0).stop 2024-09-21T08:04:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 shutdown_connections 2024-09-21T08:04:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f477a9f0 0x5624f4b812a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b6ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b6f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 --2- 172.21.15.6:0/2338355160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b6e900 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 >> 172.21.15.6:0/2338355160 conn(0x5624f47b0460 msgr2=0x5624f4b66450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.524+0000 7f7c6b7fe640 0 client.16095 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.525+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 shutdown_connections 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.525+0000 7f7c98da4740 1 -- 172.21.15.6:0/2338355160 wait complete. 2024-09-21T08:04:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.525+0000 7f7c98da4740 20 client.16095 trim_cache size 0 max 16384 2024-09-21T08:04:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.552+0000 7f7c98da4740 1 Processor -- start 2024-09-21T08:04:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.552+0000 7f7c98da4740 1 -- start start 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b64a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b64a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b64a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58368/0 (socket says 172.21.15.6:58368) 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/1217640047 learned_addr learned my addr 172.21.15.6:0/1217640047 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7800e040 con 0x5624f47931b0 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c90dcd640 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.553+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780108c0 con 0x5624f47bc070 2024-09-21T08:04:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.554+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7800e6b0 con 0x5624f479b390 2024-09-21T08:04:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.555+0000 7f7c8bfff640 1 -- 172.21.15.6:0/1217640047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 msgr2=0x5624f4b64a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.555+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b64a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.555+0000 7f7c8bfff640 1 -- 172.21.15.6:0/1217640047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 msgr2=0x5624f4b60760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.555+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b60760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.555+0000 7f7c8bfff640 1 -- 172.21.15.6:0/1217640047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f4b7ad60 con 0x5624f47931b0 2024-09-21T08:04:48.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.556+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b707e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c800096e0 tx=0x7f7c800092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a89d004d3a799 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.556+0000 7f7c71ffb640 1 -- 172.21.15.6:0/1217640047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8001cc00 con 0x5624f47931b0 2024-09-21T08:04:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.556+0000 7f7c71ffb640 1 -- 172.21.15.6:0/1217640047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c8003e070 con 0x5624f47931b0 2024-09-21T08:04:48.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.556+0000 7f7c71ffb640 1 -- 172.21.15.6:0/1217640047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80039c30 con 0x5624f47931b0 2024-09-21T08:04:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 msgr2=0x5624f4b707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b707e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c800096e0 tx=0x7f7c800092a0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 shutdown_connections 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f479b390 0x5624f4b64a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f47bc070 0x5624f4b60760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 --2- 172.21.15.6:0/1217640047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47931b0 0x5624f4b707e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 >> 172.21.15.6:0/1217640047 conn(0x5624f47b0460 msgr2=0x5624f4b642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.558+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 shutdown_connections 2024-09-21T08:04:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.559+0000 7f7c98da4740 1 -- 172.21.15.6:0/1217640047 wait complete. 2024-09-21T08:04:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.559+0000 7f7c98da4740 1 -- start start 2024-09-21T08:04:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.559+0000 7f7c98da4740 1 Processor -- start 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 0x5624f4be4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47bc070 0x5624f4b725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 0x5624f4be4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 0x5624f4be4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58374/0 (socket says 172.21.15.6:58374) 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7800ed80 con 0x5624f47bc070 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780101f0 con 0x5624f479b390 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7800f450 con 0x5624f47931b0 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47200/0 (socket says 172.21.15.6:47200) 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/3740429365 learned_addr learned my addr 172.21.15.6:0/3740429365 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.560+0000 7f7c98da4740 10 client.0 _ll_register_callbacks cb 0x7f7c800097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.561+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/3740429365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 msgr2=0x5624f4be4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.561+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 0x5624f4be4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.561+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/3740429365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47bc070 msgr2=0x5624f4b725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.561+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47bc070 0x5624f4b725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.561+0000 7f7c8b7fe640 1 -- 172.21.15.6:0/3740429365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f4b72d30 con 0x5624f479b390 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.562+0000 7f7c8b7fe640 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0ad630 tx=0x7f7c7c0a95b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4342edeab1e5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.562+0000 7f7c6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:04:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.562+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c0ace10 con 0x5624f479b390 2024-09-21T08:04:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.562+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7c7c0ac900 con 0x5624f479b390 2024-09-21T08:04:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.562+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8003e070 con 0x5624f479b390 2024-09-21T08:04:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.563+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c7c0ad1b0 con 0x5624f479b390 2024-09-21T08:04:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.563+0000 7f7c98da4740 10 client.25775 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.563+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5624f4beb800 con 0x5624f479b390 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.563+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c8003e070 con 0x5624f479b390 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c7c0a8ff0 con 0x5624f479b390 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 10 client.25775 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 10 client.25775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 20 client.25775 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f474fda0 0x5624f4bedfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 4 client.25775 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.564+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624f4ad78a0 con 0x5624f474fda0 2024-09-21T08:04:48.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.565+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f474fda0 0x5624f4bedfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:48.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.566+0000 7f7c8bfff640 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f474fda0 0x5624f4bedfa0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f78cf73ab161e88 server_cookie=20cbdb21cc10211f in_seq=0 out_seq=0 2024-09-21T08:04:48.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.566+0000 7f7c6b7fe640 10 client.25775 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:48.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.566+0000 7f7c6b7fe640 1 -- 172.21.15.6:0/3740429365 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624f4ad78a0 con 0x5624f474fda0 2024-09-21T08:04:48.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c6b7fe640 10 client.25775 handle_command_reply: tid=0 2024-09-21T08:04:48.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 client.25775 shutdown 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 msgr2=0x5624f4be45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0ad630 tx=0x7f7c7c0a95b0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 shutdown_connections 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624f474fda0 0x5624f4bedfa0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624f47bc070 0x5624f4b725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5624f479b390 0x5624f4be45d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 --2- 172.21.15.6:0/3740429365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5624f47931b0 0x5624f4be4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 >> 172.21.15.6:0/3740429365 conn(0x5624f47b0460 msgr2=0x5624f4b64a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.567+0000 7f7c6b7fe640 0 client.25775 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:04:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.568+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 shutdown_connections 2024-09-21T08:04:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.568+0000 7f7c98da4740 1 -- 172.21.15.6:0/3740429365 wait complete. 2024-09-21T08:04:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.568+0000 7f7c98da4740 20 client.25775 trim_cache size 0 max 16384 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 msgr2=0x7f7c740b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 0x7f7c740b8d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5624f4b61f40 tx=0x7f7c80005f90 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 msgr2=0x7f7c8c1a97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 0x7f7c8c1a97f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c06c6e0 tx=0x7f7c7c00ec20 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 shutdown_connections 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7c740b6880 0x7f7c740b8d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c8c111f40 0x7f7c8c1a97f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c8c11cc30 0x7f7c8c1aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 --2- 172.21.15.6:0/440085283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c8c10a9e0 0x7f7c8c1a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.569+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 >> 172.21.15.6:0/440085283 conn(0x7f7c8c070ec0 msgr2=0x7f7c8c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.570+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 shutdown_connections 2024-09-21T08:04:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:48.570+0000 7f7c92830640 1 -- 172.21.15.6:0/440085283 wait complete. 2024-09-21T08:04:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:48 smithi119 ceph-mon[33564]: pgmap v456: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 1.09k op/s 2024-09-21T08:04:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:48 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:04:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:48 smithi145 ceph-mon[34049]: pgmap v456: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 1.09k op/s 2024-09-21T08:04:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:48 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:04:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:48 smithi006 ceph-mon[30970]: pgmap v456: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 1.09k op/s 2024-09-21T08:04:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:48 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:04:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:04:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:04:50.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:49 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:04:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:04:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:04:50.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:49 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:04:50.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:04:50.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:04:50.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:49 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:04:50.446 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:04:50.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:04:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:50.902 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:50 smithi006 ceph-mon[30970]: pgmap v457: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2024-09-21T08:04:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:50 smithi119 ceph-mon[33564]: pgmap v457: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2024-09-21T08:04:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:50 smithi145 ceph-mon[34049]: pgmap v457: 129 pgs: 129 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2024-09-21T08:04:51.801 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:04:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "9274b668-698a-41d0-8c88-fff10bd2f605", 2024-09-21T08:04:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:04:51.802 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:51.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.541+0000 7f5d4c281640 1 -- 172.21.15.6:0/2901848766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44103b90 msgr2=0x7f5d44103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.541+0000 7f5d4c281640 1 --2- 172.21.15.6:0/2901848766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44103b90 0x7f5d44103fa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009900 tx=0x7f5d3402a410 comp rx=0 tx=0).stop 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.541+0000 7f5d4c281640 1 -- 172.21.15.6:0/2901848766 shutdown_connections 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 --2- 172.21.15.6:0/2901848766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44109e20 0x7f5d44110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 --2- 172.21.15.6:0/2901848766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d441094d0 0x7f5d441098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 --2- 172.21.15.6:0/2901848766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44103b90 0x7f5d44103fa0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 -- 172.21.15.6:0/2901848766 >> 172.21.15.6:0/2901848766 conn(0x7f5d440ff5e0 msgr2=0x7f5d44101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 -- 172.21.15.6:0/2901848766 shutdown_connections 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.542+0000 7f5d4c281640 1 -- 172.21.15.6:0/2901848766 wait complete. 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.543+0000 7f5d4c281640 1 Processor -- start 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.543+0000 7f5d4c281640 1 -- start start 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44103b90 0x7f5d44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d44109e20 0x7f5d44076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44113a20 con 0x7f5d441094d0 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441138a0 con 0x7f5d44109e20 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4c281640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44113ba0 con 0x7f5d44103b90 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58008/0 (socket says 172.21.15.6:58008) 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 -- 172.21.15.6:0/512467681 learned_addr learned my addr 172.21.15.6:0/512467681 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d44109e20 0x7f5d44076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44103b90 0x7f5d44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 -- 172.21.15.6:0/512467681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44103b90 msgr2=0x7f5d44075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44103b90 0x7f5d44075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 -- 172.21.15.6:0/512467681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d44109e20 msgr2=0x7f5d44076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d44109e20 0x7f5d44076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.544+0000 7f5d4981c640 1 -- 172.21.15.6:0/512467681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d441a8730 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.545+0000 7f5d4981c640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000b450 tx=0x7f5d4000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.546+0000 7f5d3b7fe640 1 -- 172.21.15.6:0/512467681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40015020 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.546+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d441a8a20 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.546+0000 7f5d3b7fe640 1 -- 172.21.15.6:0/512467681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d40011d20 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.546+0000 7f5d3b7fe640 1 -- 172.21.15.6:0/512467681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40010df0 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.546+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d441a8f80 con 0x7f5d441094d0 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.551+0000 7f5d527f5740 1 Processor -- start 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.552+0000 7f5d527f5740 1 -- start start 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.552+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d527f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e6b0842e60 con 0x55e6b0504670 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d527f5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6b0832290 con 0x55e6b0525350 2024-09-21T08:04:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d527f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e6b08360a0 con 0x55e6b04fc490 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47212/0 (socket says 172.21.15.6:47212) 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 -- 172.21.15.6:0/185777021 learned_addr learned my addr 172.21.15.6:0/185777021 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 -- 172.21.15.6:0/185777021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 msgr2=0x55e6b08cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 -- 172.21.15.6:0/185777021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 msgr2=0x55e6b08cceb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08cceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.553+0000 7f5d4a81e640 1 -- 172.21.15.6:0/185777021 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b0590930 con 0x55e6b0525350 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.554+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.554+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c010370 tx=0x7f5d3c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb114b966cdab87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.555+0000 7f5d38d9a640 1 -- 172.21.15.6:0/185777021 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c016070 con 0x55e6b0525350 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.555+0000 7f5d38d9a640 1 -- 172.21.15.6:0/185777021 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d3c004d20 con 0x55e6b0525350 2024-09-21T08:04:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.556+0000 7f5d3b7fe640 1 -- 172.21.15.6:0/512467681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5d40018020 con 0x7f5d441094d0 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.556+0000 7f5d527f5740 1 -- 172.21.15.6:0/185777021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 msgr2=0x55e6b08cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.556+0000 7f5d527f5740 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c010370 tx=0x7f5d3c010830 comp rx=0 tx=0).stop 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.556+0000 7f5d527f5740 1 -- 172.21.15.6:0/185777021 shutdown_connections 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.556+0000 7f5d527f5740 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d527f5740 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d527f5740 1 --2- 172.21.15.6:0/185777021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08cc430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d527f5740 1 -- 172.21.15.6:0/185777021 >> 172.21.15.6:0/185777021 conn(0x55e6b0519740 msgr2=0x55e6b08ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d527f5740 1 -- 172.21.15.6:0/185777021 shutdown_connections 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d527f5740 1 -- 172.21.15.6:0/185777021 wait complete. 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.557+0000 7f5d3b7fe640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 0x7f5d300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.558+0000 7f5d527f5740 1 -- start start 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.558+0000 7f5d3b7fe640 1 -- 172.21.15.6:0/512467681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5d400e7360 con 0x7f5d441094d0 2024-09-21T08:04:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.558+0000 7f5d527f5740 1 Processor -- start 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.558+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 0x7f5d300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0525350 0x55e6b08ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e6b0693890 con 0x55e6b0504670 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6b07ccd40 con 0x55e6b04fc490 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e6b08e33e0 con 0x55e6b0525350 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d527f5740 10 client.0 _ll_register_callbacks cb 0x55e6b0830c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.559+0000 7f5d4a01d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58010/0 (socket says 172.21.15.6:58010) 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 -- 172.21.15.6:0/4265480773 learned_addr learned my addr 172.21.15.6:0/4265480773 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 -- 172.21.15.6:0/4265480773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0525350 msgr2=0x55e6b08ec760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:04:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0525350 0x55e6b08ec760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 -- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 msgr2=0x55e6b08e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.560+0000 7f5d4981c640 1 -- 172.21.15.6:0/4265480773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b08eccf0 con 0x55e6b0504670 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.561+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 0x7f5d300b8b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d3402a980 tx=0x7f5d3402a910 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.561+0000 7f5d4981c640 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5d400a93a0 tx=0x7f5d400acc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cb0753457032b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.561+0000 7f5d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.562+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40092da0 con 0x55e6b0504670 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.562+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5d400ac030 con 0x55e6b0504670 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.562+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d3c004d20 con 0x55e6b0504670 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.563+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5d400ac8e0 con 0x55e6b0504670 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.563+0000 7f5d527f5740 10 client.16107 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:51.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.563+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e6b08ef5c0 con 0x55e6b0504670 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.563+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d3c004d20 con 0x55e6b0504670 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5d400d41b0 con 0x55e6b0504670 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 10 client.16107 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 20 client.16107 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04e3cd0 0x55e6b08f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 4 client.16107 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b0844db0 con 0x55e6b04e3cd0 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.564+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04e3cd0 0x55e6b08f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.565+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04e3cd0 0x55e6b08f2ff0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3db4437914dda67 server_cookie=f279624e34681f66 in_seq=0 out_seq=0 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.565+0000 7f5d2dffb640 10 client.16107 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d2dffb640 1 -- 172.21.15.6:0/4265480773 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6b0844db0 con 0x55e6b04e3cd0 2024-09-21T08:04:51.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d2dffb640 10 client.16107 handle_command_reply: tid=0 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 client.16107 shutdown 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 msgr2=0x55e6b08e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5d400a93a0 tx=0x7f5d400acc70 comp rx=0 tx=0).stop 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 shutdown_connections 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04e3cd0 0x55e6b08f2ff0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0525350 0x55e6b08ec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e0cf0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 --2- 172.21.15.6:0/4265480773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 >> 172.21.15.6:0/4265480773 conn(0x55e6b0519740 msgr2=0x55e6b08c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.566+0000 7f5d2dffb640 0 client.16107 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.567+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 shutdown_connections 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.567+0000 7f5d527f5740 1 -- 172.21.15.6:0/4265480773 wait complete. 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.567+0000 7f5d527f5740 20 client.16107 trim_cache size 0 max 16384 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.599+0000 7f5d527f5740 1 Processor -- start 2024-09-21T08:04:51.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.599+0000 7f5d527f5740 1 -- start start 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 0x55e6b08c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0525350 0x55e6b08dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4a01d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 0x55e6b08c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4a01d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47236/0 (socket says 172.21.15.6:47236) 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 0x55e6b08c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58408/0 (socket says 172.21.15.6:58408) 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1095532632 learned_addr learned my addr 172.21.15.6:0/1095532632 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0525350 0x55e6b08dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441acd70 con 0x55e6b0525350 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441af5f0 con 0x55e6b04fc490 2024-09-21T08:04:51.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.600+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441ad3e0 con 0x55e6b0504670 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1095532632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 msgr2=0x55e6b08c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 0x55e6b08c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1095532632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0525350 msgr2=0x55e6b08dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0525350 0x55e6b08dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1095532632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b08ce950 con 0x55e6b04fc490 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.601+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d34006010 tx=0x7f5d34043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2bb6c4b129b79cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.602+0000 7f5d2ffff640 1 -- 172.21.15.6:0/1095532632 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34055070 con 0x55e6b04fc490 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.602+0000 7f5d2ffff640 1 -- 172.21.15.6:0/1095532632 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d34005500 con 0x55e6b04fc490 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.602+0000 7f5d2ffff640 1 -- 172.21.15.6:0/1095532632 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34035050 con 0x55e6b04fc490 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 msgr2=0x55e6b08c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d34006010 tx=0x7f5d34043000 comp rx=0 tx=0).stop 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 shutdown_connections 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b0504670 0x55e6b08c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0525350 0x55e6b08dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1095532632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b04fc490 0x55e6b08c8850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 >> 172.21.15.6:0/1095532632 conn(0x55e6b0519740 msgr2=0x55e6b08dee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 shutdown_connections 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.603+0000 7f5d527f5740 1 -- 172.21.15.6:0/1095532632 wait complete. 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.604+0000 7f5d527f5740 1 -- start start 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.604+0000 7f5d527f5740 1 Processor -- start 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441adab0 con 0x55e6b0504670 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441aef20 con 0x55e6b0525350 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441ae180 con 0x55e6b04fc490 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d527f5740 10 client.0 _ll_register_callbacks cb 0x7f5d40010f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d4a01d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.605+0000 7f5d4981c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58022/0 (socket says 172.21.15.6:58022) 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4981c640 1 -- 172.21.15.6:0/1112074930 learned_addr learned my addr 172.21.15.6:0/1112074930 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a81e640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 msgr2=0x55e6b08e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1112074930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 msgr2=0x55e6b08e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 -- 172.21.15.6:0/1112074930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b08e3d70 con 0x55e6b04fc490 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d4a01d640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08e88d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009850 tx=0x7f5d34004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b22b3cf9a30f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.606+0000 7f5d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34055030 con 0x55e6b04fc490 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f5d3404d070 con 0x55e6b04fc490 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d34005500 con 0x55e6b04fc490 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5d3405f050 con 0x55e6b04fc490 2024-09-21T08:04:51.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d527f5740 10 client.25882 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e6b095e380 con 0x55e6b04fc490 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.607+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d34005500 con 0x55e6b04fc490 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5d3403c440 con 0x55e6b04fc490 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 10 client.25882 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 20 client.25882 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04b9080 0x55e6b0960b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 4 client.25882 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.608+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6b0840860 con 0x55e6b04b9080 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.609+0000 7f5d4981c640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04b9080 0x55e6b0960b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.609+0000 7f5d2dffb640 10 client.25882 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.609+0000 7f5d4981c640 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04b9080 0x55e6b0960b20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54fe3558a6c912dc server_cookie=67dbed7d101b4fe9 in_seq=0 out_seq=0 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.611+0000 7f5d2dffb640 1 -- 172.21.15.6:0/1112074930 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6b0840860 con 0x55e6b04b9080 2024-09-21T08:04:51.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.611+0000 7f5d2dffb640 10 client.25882 handle_command_reply: tid=0 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.611+0000 7f5d527f5740 1 client.25882 shutdown 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.611+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 msgr2=0x55e6b08e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.611+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08e88d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009850 tx=0x7f5d34004740 comp rx=0 tx=0).stop 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 shutdown_connections 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e6b04b9080 0x55e6b0960b20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6b0525350 0x55e6b08e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6b0504670 0x55e6b08e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d2dffb640 0 client.25882 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 --2- 172.21.15.6:0/1112074930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6b04fc490 0x55e6b08e88d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 >> 172.21.15.6:0/1112074930 conn(0x55e6b0519740 msgr2=0x55e6b08d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 shutdown_connections 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 1 -- 172.21.15.6:0/1112074930 wait complete. 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.612+0000 7f5d527f5740 20 client.25882 trim_cache size 0 max 16384 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 msgr2=0x7f5d300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 0x7f5d300b8b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d3402a980 tx=0x7f5d3402a910 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 msgr2=0x7f5d44075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000b450 tx=0x7f5d4000b910 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 shutdown_connections 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f5d300b6670 0x7f5d300b8b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d44109e20 0x7f5d44076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d441094d0 0x7f5d44075c50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 --2- 172.21.15.6:0/512467681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5d44103b90 0x7f5d44075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 >> 172.21.15.6:0/512467681 conn(0x7f5d440ff5e0 msgr2=0x7f5d44101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 shutdown_connections 2024-09-21T08:04:51.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:51.613+0000 7f5d4c281640 1 -- 172.21.15.6:0/512467681 wait complete. 2024-09-21T08:04:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 115.0 s, 1075.4 tps, lat 93.287 ms stddev 30.109 2024-09-21T08:04:52.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:04:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:52 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:04:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:52 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:52 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:04:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:52 smithi119 ceph-mon[33564]: pgmap v458: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:04:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:52 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:04:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:52 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:52 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:04:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:52 smithi145 ceph-mon[34049]: pgmap v458: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:04:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:52 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:04:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:52 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:52 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:04:53.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:52 smithi006 ceph-mon[30970]: pgmap v458: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:04:53.444 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:04:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.037+0000 7f6ef1375640 1 -- 172.21.15.6:0/2672649530 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0035020 con 0x7f6eec06af90 2024-09-21T08:04:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.038+0000 7f6ef45db640 1 -- 172.21.15.6:0/2672649530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec06af90 msgr2=0x7f6eec10f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.038+0000 7f6ef45db640 1 --2- 172.21.15.6:0/2672649530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec06af90 0x7f6eec10f150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009930 tx=0x7f6ee002a420 comp rx=0 tx=0).stop 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.038+0000 7f6ef45db640 1 -- 172.21.15.6:0/2672649530 shutdown_connections 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.038+0000 7f6ef45db640 1 --2- 172.21.15.6:0/2672649530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec10a900 0x7f6eec10ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.038+0000 7f6ef45db640 1 --2- 172.21.15.6:0/2672649530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 0x7f6eec10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.039+0000 7f6ef45db640 1 --2- 172.21.15.6:0/2672649530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec06af90 0x7f6eec10f150 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.039+0000 7f6ef45db640 1 -- 172.21.15.6:0/2672649530 >> 172.21.15.6:0/2672649530 conn(0x7f6eec0712f0 msgr2=0x7f6eec073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.039+0000 7f6ef45db640 1 -- 172.21.15.6:0/2672649530 shutdown_connections 2024-09-21T08:04:54.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.039+0000 7f6ef45db640 1 -- 172.21.15.6:0/2672649530 wait complete. 2024-09-21T08:04:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.040+0000 7f6ef45db640 1 Processor -- start 2024-09-21T08:04:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.040+0000 7f6ef45db640 1 -- start start 2024-09-21T08:04:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.040+0000 7f6ef45db640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec06af90 0x7f6eec114fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.040+0000 7f6ef45db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.040+0000 7f6ef45db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 0x7f6eec115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec06af90 0x7f6eec114fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47248/0 (socket says 172.21.15.6:47248) 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef45db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec11a000 con 0x7f6eec10f770 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef45db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec119e80 con 0x7f6eec10a900 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef45db640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec11a180 con 0x7f6eec06af90 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 -- 172.21.15.6:0/4119723137 learned_addr learned my addr 172.21.15.6:0/4119723137 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 0x7f6eec115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 -- 172.21.15.6:0/4119723137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec06af90 msgr2=0x7f6eec114fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec06af90 0x7f6eec114fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 -- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 msgr2=0x7f6eec115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 0x7f6eec115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.041+0000 7f6ef1b76640 1 -- 172.21.15.6:0/4119723137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec1b53b0 con 0x7f6eec10a900 2024-09-21T08:04:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800b450 tx=0x7f6ee800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6edf7fe640 1 -- 172.21.15.6:0/4119723137 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8015020 con 0x7f6eec10a900 2024-09-21T08:04:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6edf7fe640 1 -- 172.21.15.6:0/4119723137 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ee8011d20 con 0x7f6eec10a900 2024-09-21T08:04:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec1b56a0 con 0x7f6eec10a900 2024-09-21T08:04:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec1b5c30 con 0x7f6eec10a900 2024-09-21T08:04:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.042+0000 7f6edf7fe640 1 -- 172.21.15.6:0/4119723137 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8010e10 con 0x7f6eec10a900 2024-09-21T08:04:54.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.047+0000 7f6efab4f740 1 Processor -- start 2024-09-21T08:04:54.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.048+0000 7f6efab4f740 1 -- start start 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.048+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.048+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df279b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.048+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deeb1390 0x5600df27a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6efab4f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600df1efe50 con 0x5600deeb1390 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6efab4f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600df1df280 con 0x5600deed2070 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6efab4f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600df1e3090 con 0x5600deea91b0 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6edf7fe640 1 -- 172.21.15.6:0/4119723137 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6ee8018020 con 0x7f6eec10a900 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6ef2b78640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6ef2b78640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47254/0 (socket says 172.21.15.6:47254) 2024-09-21T08:04:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.049+0000 7f6ef2b78640 1 -- 172.21.15.6:0/2932983028 learned_addr learned my addr 172.21.15.6:0/2932983028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.050+0000 7f6ef2b78640 1 -- 172.21.15.6:0/2932983028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 msgr2=0x5600df279b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:04:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.050+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df279b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.050+0000 7f6ef2b78640 1 -- 172.21.15.6:0/2932983028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deeb1390 msgr2=0x5600df27a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.050+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deeb1390 0x5600df27a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.050+0000 7f6ef2b78640 1 -- 172.21.15.6:0/2932983028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600def3d650 con 0x5600deed2070 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.051+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009fc0 tx=0x7f6ee4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1435af4153715b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.051+0000 7f6edf7fe640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 0x7f6ed80b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.051+0000 7f6edf7fe640 1 -- 172.21.15.6:0/4119723137 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6ee80e7280 con 0x7f6eec10a900 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.051+0000 7f6edcff9640 1 -- 172.21.15.6:0/2932983028 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4003b70 con 0x5600deed2070 2024-09-21T08:04:54.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.051+0000 7f6edcff9640 1 -- 172.21.15.6:0/2932983028 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ee4003d10 con 0x5600deed2070 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6edcff9640 1 -- 172.21.15.6:0/2932983028 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4011980 con 0x5600deed2070 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6ef2377640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 0x7f6ed80b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 -- 172.21.15.6:0/2932983028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 msgr2=0x5600df279650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009fc0 tx=0x7f6ee4010860 comp rx=0 tx=0).stop 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 -- 172.21.15.6:0/2932983028 shutdown_connections 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df279b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deeb1390 0x5600df27a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 --2- 172.21.15.6:0/2932983028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df279650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.053+0000 7f6efab4f740 1 -- 172.21.15.6:0/2932983028 >> 172.21.15.6:0/2932983028 conn(0x5600deec6460 msgr2=0x5600df277540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.055+0000 7f6efab4f740 1 -- 172.21.15.6:0/2932983028 shutdown_connections 2024-09-21T08:04:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.055+0000 7f6efab4f740 1 -- 172.21.15.6:0/2932983028 wait complete. 2024-09-21T08:04:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.055+0000 7f6efab4f740 1 -- start start 2024-09-21T08:04:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 Processor -- start 2024-09-21T08:04:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6ef2377640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 0x7f6ed80b8cc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006010 tx=0x7f6ee0000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df2852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df291220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5600df040700 con 0x5600deea91b0 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600df17a110 con 0x5600deed2070 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5600df287e80 con 0x5600deeb1390 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.056+0000 7f6efab4f740 10 client.0 _ll_register_callbacks cb 0x5600df193990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58056/0 (socket says 172.21.15.6:58056) 2024-09-21T08:04:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 -- 172.21.15.6:0/855494429 learned_addr learned my addr 172.21.15.6:0/855494429 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:54.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df291220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df2852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 -- 172.21.15.6:0/855494429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 msgr2=0x5600df2852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df2852e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 -- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 msgr2=0x5600df291220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df291220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.057+0000 7f6ef2377640 1 -- 172.21.15.6:0/855494429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600df1a7c40 con 0x5600deea91b0 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.058+0000 7f6ef2377640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0033000 tx=0x7f6ee0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f04a3bfb751d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.058+0000 7f6ed5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee004e020 con 0x5600deea91b0 2024-09-21T08:04:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6ee00046c0 con 0x5600deea91b0 2024-09-21T08:04:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee4003d10 con 0x5600deea91b0 2024-09-21T08:04:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6ee0035020 con 0x5600deea91b0 2024-09-21T08:04:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6efab4f740 10 client.16119 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.059+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5600df293c50 con 0x5600deea91b0 2024-09-21T08:04:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.060+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ee4003d10 con 0x5600deea91b0 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6ee003a040 con 0x5600deea91b0 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 10 client.16119 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 20 client.16119 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee909f0 0x5600df297580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 4 client.16119 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.061+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600df1f1da0 con 0x5600dee909f0 2024-09-21T08:04:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.062+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee909f0 0x5600df297580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.062+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee909f0 0x5600df297580 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae070a29e83f2dd7 server_cookie=f19c75d9678c2757 in_seq=0 out_seq=0 2024-09-21T08:04:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.062+0000 7f6ed5ffb640 10 client.16119 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.063+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/855494429 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600df1f1da0 con 0x5600dee909f0 2024-09-21T08:04:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.063+0000 7f6ed5ffb640 10 client.16119 handle_command_reply: tid=0 2024-09-21T08:04:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.063+0000 7f6efab4f740 1 client.16119 shutdown 2024-09-21T08:04:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 msgr2=0x5600df284da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0033000 tx=0x7f6ee0009260 comp rx=0 tx=0).stop 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 shutdown_connections 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee909f0 0x5600df297580 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df2852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df291220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 --2- 172.21.15.6:0/855494429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df284da0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 >> 172.21.15.6:0/855494429 conn(0x5600deec6460 msgr2=0x5600df27c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6ed5ffb640 0 client.16119 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 shutdown_connections 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 1 -- 172.21.15.6:0/855494429 wait complete. 2024-09-21T08:04:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.064+0000 7f6efab4f740 20 client.16119 trim_cache size 0 max 16384 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.102+0000 7f6efab4f740 1 Processor -- start 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.102+0000 7f6efab4f740 1 -- start start 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.102+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df2773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.102+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 0x5600df279bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.102+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deed2070 0x5600df27a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6efab4f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000dee0 con 0x5600deed2070 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6efab4f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00106b0 con 0x5600deeb1390 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df2773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df2773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58442/0 (socket says 172.21.15.6:58442) 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef2377640 1 -- 172.21.15.6:0/1943463377 learned_addr learned my addr 172.21.15.6:0/1943463377 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000e4a0 con 0x5600deea91b0 2024-09-21T08:04:54.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 0x5600df279bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deed2070 0x5600df27a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 -- 172.21.15.6:0/1943463377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 msgr2=0x5600df2773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df2773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 -- 172.21.15.6:0/1943463377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deed2070 msgr2=0x5600df27a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deed2070 0x5600df27a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.103+0000 7f6ef1b76640 1 -- 172.21.15.6:0/1943463377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600df286010 con 0x5600deeb1390 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.104+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 0x5600df279bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80e45f0 tx=0x7f6ee8010970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df59fbeb9bf00bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.104+0000 7f6ed7fff640 1 -- 172.21.15.6:0/1943463377 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80ad3f0 con 0x5600deeb1390 2024-09-21T08:04:54.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.104+0000 7f6ed7fff640 1 -- 172.21.15.6:0/1943463377 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ee80b17d0 con 0x5600deeb1390 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.104+0000 7f6ed7fff640 1 -- 172.21.15.6:0/1943463377 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80d00d0 con 0x5600deeb1390 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.105+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 msgr2=0x5600df279bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.105+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 0x5600df279bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80e45f0 tx=0x7f6ee8010970 comp rx=0 tx=0).stop 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 shutdown_connections 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deed2070 0x5600df27a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deeb1390 0x5600df279bc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1943463377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deea91b0 0x5600df2773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 >> 172.21.15.6:0/1943463377 conn(0x5600deec6460 msgr2=0x5600df276cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 shutdown_connections 2024-09-21T08:04:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 -- 172.21.15.6:0/1943463377 wait complete. 2024-09-21T08:04:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.106+0000 7f6efab4f740 1 -- start start 2024-09-21T08:04:54.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 Processor -- start 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df28d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000eb70 con 0x5600deea91b0 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000ffe0 con 0x5600deed2070 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000f240 con 0x5600deeb1390 2024-09-21T08:04:54.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.107+0000 7f6efab4f740 10 client.0 _ll_register_callbacks cb 0x7f6ee0041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:04:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47278/0 (socket says 172.21.15.6:47278) 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58064/0 (socket says 172.21.15.6:58064) 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 -- 172.21.15.6:0/1853482562 learned_addr learned my addr 172.21.15.6:0/1853482562 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef1b76640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df28d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 -- 172.21.15.6:0/1853482562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 msgr2=0x5600df28d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df28d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 -- 172.21.15.6:0/1853482562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 msgr2=0x5600df28d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 -- 172.21.15.6:0/1853482562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600df28dee0 con 0x5600deed2070 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2377640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.108+0000 7f6ef2b78640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4011730 tx=0x7f6ee4011760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73fc7ab4b9c7d68a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:04:54.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6ed5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4029070 con 0x5600deed2070 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee80b17d0 con 0x5600deed2070 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6ee4003b70 con 0x5600deed2070 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6ee4034050 con 0x5600deed2070 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6efab4f740 10 client.25808 fetch_fsmap learned FSMap version 21 2024-09-21T08:04:54.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.109+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5600df313540 con 0x5600deed2070 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ee80b17d0 con 0x5600deed2070 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6ee4005680 con 0x5600deed2070 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 10 client.25808 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 10 client.25808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 20 client.25808 populate_metadata read hostname 'smithi006' 2024-09-21T08:04:54.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee65da0 0x5600df315890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 4 client.25808 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5600df1ed850 con 0x5600dee65da0 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.110+0000 7f6ef2377640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee65da0 0x5600df315890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.111+0000 7f6ef2377640 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee65da0 0x5600df315890 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db48ef2fb580b5d server_cookie=161e3b24dd016009 in_seq=0 out_seq=0 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.111+0000 7f6ed5ffb640 10 client.25808 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.111+0000 7f6ed5ffb640 1 -- 172.21.15.6:0/1853482562 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5600df1ed850 con 0x5600dee65da0 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.111+0000 7f6ed5ffb640 10 client.25808 handle_command_reply: tid=0 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 client.25808 shutdown 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 msgr2=0x5600df28a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4011730 tx=0x7f6ee4011760 comp rx=0 tx=0).stop 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 shutdown_connections 2024-09-21T08:04:54.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5600dee65da0 0x5600df315890 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5600deeb1390 0x5600df28d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600deed2070 0x5600df28a150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 --2- 172.21.15.6:0/1853482562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600deea91b0 0x5600df28d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 >> 172.21.15.6:0/1853482562 conn(0x5600deec6460 msgr2=0x5600df2861e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6ed5ffb640 0 client.25808 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 shutdown_connections 2024-09-21T08:04:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 1 -- 172.21.15.6:0/1853482562 wait complete. 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.112+0000 7f6efab4f740 20 client.25808 trim_cache size 0 max 16384 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "9274b668-698a-41d0-8c88-fff10bd2f605", 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:04:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:04:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:04:54.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.113+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 msgr2=0x7f6ed80b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.113+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 0x7f6ed80b8cc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006010 tx=0x7f6ee0000bc0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.113+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 msgr2=0x7f6eec115520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.113+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800b450 tx=0x7f6ee800b910 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 shutdown_connections 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6ed80b67b0 0x7f6ed80b8cc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec10f770 0x7f6eec115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eec10a900 0x7f6eec115520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 --2- 172.21.15.6:0/4119723137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6eec06af90 0x7f6eec114fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 >> 172.21.15.6:0/4119723137 conn(0x7f6eec0712f0 msgr2=0x7f6eec10bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 shutdown_connections 2024-09-21T08:04:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:04:54.114+0000 7f6ef45db640 1 -- 172.21.15.6:0/4119723137 wait complete. 2024-09-21T08:04:54.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:53 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:53 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:54.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:53 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:04:54.936 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:54 smithi006 ceph-mon[30970]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.7 MiB/s wr, 1.13k op/s 2024-09-21T08:04:54.993 INFO:tasks.cephfs.filesystem:scrub status for tag:9274b668-698a-41d0-8c88-fff10bd2f605 - {'path': '/', 'tag': '9274b668-698a-41d0-8c88-fff10bd2f605', 'options': 'recursive,force'} 2024-09-21T08:04:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:54 smithi145 ceph-mon[34049]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.7 MiB/s wr, 1.13k op/s 2024-09-21T08:04:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:54 smithi119 ceph-mon[33564]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.7 MiB/s wr, 1.13k op/s 2024-09-21T08:04:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:56 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:04:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:56 smithi145 ceph-mon[34049]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2024-09-21T08:04:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:56 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:04:57.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:56 smithi006 ceph-mon[30970]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2024-09-21T08:04:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:56 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:04:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:56 smithi119 ceph-mon[33564]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2024-09-21T08:04:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 120.0 s, 1030.0 tps, lat 97.067 ms stddev 106.999 2024-09-21T08:04:59.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:04:58 smithi006 ceph-mon[30970]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T08:04:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:04:58 smithi119 ceph-mon[33564]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T08:04:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:04:58 smithi145 ceph-mon[34049]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T08:05:01.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:00 smithi006 ceph-mon[30970]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:00 smithi119 ceph-mon[33564]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:00 smithi145 ceph-mon[34049]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 125.0 s, 1128.8 tps, lat 88.301 ms stddev 42.479 2024-09-21T08:05:03.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:02 smithi006 ceph-mon[30970]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 1.36k op/s 2024-09-21T08:05:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:02 smithi119 ceph-mon[33564]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 1.36k op/s 2024-09-21T08:05:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:02 smithi145 ceph-mon[34049]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 1.36k op/s 2024-09-21T08:05:05.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:04 smithi006 ceph-mon[30970]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-21T08:05:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:04 smithi119 ceph-mon[33564]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-21T08:05:05.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:04 smithi145 ceph-mon[34049]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-21T08:05:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:06 smithi119 ceph-mon[33564]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:06 smithi145 ceph-mon[34049]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:06 smithi006 ceph-mon[30970]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 130.0 s, 908.8 tps, lat 110.100 ms stddev 35.486 2024-09-21T08:05:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:08 smithi119 ceph-mon[33564]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-21T08:05:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:08 smithi145 ceph-mon[34049]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-21T08:05:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:08 smithi006 ceph-mon[30970]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-21T08:05:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:10 smithi119 ceph-mon[33564]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:10 smithi145 ceph-mon[34049]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:11.462 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:10 smithi006 ceph-mon[30970]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-21T08:05:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 135.0 s, 914.8 tps, lat 110.004 ms stddev 37.615 2024-09-21T08:05:13.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:12 smithi006 ceph-mon[30970]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 1.20k op/s 2024-09-21T08:05:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:12 smithi119 ceph-mon[33564]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 1.20k op/s 2024-09-21T08:05:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:12 smithi145 ceph-mon[34049]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 1.20k op/s 2024-09-21T08:05:15.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:14 smithi006 ceph-mon[30970]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:14 smithi119 ceph-mon[33564]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:14 smithi145 ceph-mon[34049]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:16 smithi119 ceph-mon[33564]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 940 op/s 2024-09-21T08:05:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:16 smithi145 ceph-mon[34049]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 940 op/s 2024-09-21T08:05:17.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:16 smithi006 ceph-mon[30970]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 940 op/s 2024-09-21T08:05:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 140.0 s, 961.4 tps, lat 99.117 ms stddev 48.574 2024-09-21T08:05:19.244 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:18 smithi145 ceph-mon[34049]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2024-09-21T08:05:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:18 smithi119 ceph-mon[33564]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2024-09-21T08:05:19.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:18 smithi006 ceph-mon[30970]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2024-09-21T08:05:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:20 smithi119 ceph-mon[33564]: pgmap v472: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T08:05:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:20 smithi145 ceph-mon[34049]: pgmap v472: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T08:05:21.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:20 smithi006 ceph-mon[30970]: pgmap v472: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T08:05:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 145.0 s, 1152.0 tps, lat 90.700 ms stddev 50.429 2024-09-21T08:05:23.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:22 smithi119 ceph-mon[33564]: pgmap v473: 129 pgs: 129 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T08:05:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:22 smithi145 ceph-mon[34049]: pgmap v473: 129 pgs: 129 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T08:05:23.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:22 smithi006 ceph-mon[30970]: pgmap v473: 129 pgs: 129 active+clean; 1.7 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T08:05:24.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:05:25.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:25 smithi119 ceph-mon[33564]: pgmap v474: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.9 MiB/s wr, 1.15k op/s 2024-09-21T08:05:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:25 smithi145 ceph-mon[34049]: pgmap v474: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.9 MiB/s wr, 1.15k op/s 2024-09-21T08:05:25.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:25 smithi006 ceph-mon[30970]: pgmap v474: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.9 MiB/s wr, 1.15k op/s 2024-09-21T08:05:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:05:27.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:27 smithi006 ceph-mon[30970]: pgmap v475: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:05:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:27 smithi119 ceph-mon[33564]: pgmap v475: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:05:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:27 smithi145 ceph-mon[34049]: pgmap v475: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T08:05:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 150.0 s, 1016.0 tps, lat 98.145 ms stddev 34.486 2024-09-21T08:05:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.938+0000 7f6f77a60640 1 -- 172.21.15.6:0/3432818091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 msgr2=0x7f6f700757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.938+0000 7f6f77a60640 1 --2- 172.21.15.6:0/3432818091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f700757b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009900 tx=0x7f6f6002a410 comp rx=0 tx=0).stop 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.939+0000 7f6f77a60640 1 -- 172.21.15.6:0/3432818091 shutdown_connections 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 --2- 172.21.15.6:0/3432818091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 0x7f6f700761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 --2- 172.21.15.6:0/3432818091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 0x7f6f70116930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 --2- 172.21.15.6:0/3432818091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f700757b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 -- 172.21.15.6:0/3432818091 >> 172.21.15.6:0/3432818091 conn(0x7f6f700ff600 msgr2=0x7f6f70101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:28.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 -- 172.21.15.6:0/3432818091 shutdown_connections 2024-09-21T08:05:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.940+0000 7f6f77a60640 1 -- 172.21.15.6:0/3432818091 wait complete. 2024-09-21T08:05:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.941+0000 7f6f77a60640 1 Processor -- start 2024-09-21T08:05:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.941+0000 7f6f77a60640 1 -- start start 2024-09-21T08:05:28.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 0x7f6f701a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 0x7f6f701a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7011a000 con 0x7f6f70114460 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57340/0 (socket says 172.21.15.6:57340) 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 -- 172.21.15.6:0/854175877 learned_addr learned my addr 172.21.15.6:0/854175877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70119e80 con 0x7f6f70077380 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7011a180 con 0x7f6f70075dd0 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 0x7f6f701a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f757fc640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 0x7f6f701a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 -- 172.21.15.6:0/854175877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 msgr2=0x7f6f701a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 0x7f6f701a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 -- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 msgr2=0x7f6f701a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 0x7f6f701a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.942+0000 7f6f74ffb640 1 -- 172.21.15.6:0/854175877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f701a6940 con 0x7f6f70077380 2024-09-21T08:05:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d770 tx=0x7f6f6c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f667fc640 1 -- 172.21.15.6:0/854175877 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c017070 con 0x7f6f70077380 2024-09-21T08:05:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f667fc640 1 -- 172.21.15.6:0/854175877 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f6c009c30 con 0x7f6f70077380 2024-09-21T08:05:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f667fc640 1 -- 172.21.15.6:0/854175877 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00f620 con 0x7f6f70077380 2024-09-21T08:05:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f701a6c30 con 0x7f6f70077380 2024-09-21T08:05:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.943+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f701ad390 con 0x7f6f70077380 2024-09-21T08:05:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.947+0000 7f6f7dfd4740 1 Processor -- start 2024-09-21T08:05:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.947+0000 7f6f7dfd4740 1 -- start start 2024-09-21T08:05:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.947+0000 7f6f667fc640 1 -- 172.21.15.6:0/854175877 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6f6c01a070 con 0x7f6f70077380 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.947+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee107270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.947+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd371b0 0x563dee1077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563dee07de50 con 0x563dedd3f390 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563dee06d280 con 0x563dedd371b0 2024-09-21T08:05:28.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563dee071090 con 0x563dedd60070 2024-09-21T08:05:28.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f74ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f74ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38246/0 (socket says 172.21.15.6:38246) 2024-09-21T08:05:28.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f74ffb640 1 -- 172.21.15.6:0/2253844008 learned_addr learned my addr 172.21.15.6:0/2253844008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:28.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f757fc640 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd371b0 0x563dee1077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.948+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f74ffb640 1 -- 172.21.15.6:0/2253844008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 msgr2=0x563dee107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f74ffb640 1 -- 172.21.15.6:0/2253844008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd371b0 msgr2=0x563dee1077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd371b0 0x563dee1077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f74ffb640 1 -- 172.21.15.6:0/2253844008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563deddcb650 con 0x563dedd3f390 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.949+0000 7f6f667fc640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 0x7f6f5c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.950+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0e4950 tx=0x7f6f6c0ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20b998a46efb9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.950+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 0x7f6f5c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.950+0000 7f6f667fc640 1 -- 172.21.15.6:0/854175877 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6f6c0e7610 con 0x7f6f70077380 2024-09-21T08:05:28.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.951+0000 7f6f5b7fe640 1 -- 172.21.15.6:0/2253844008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c021070 con 0x563dedd3f390 2024-09-21T08:05:28.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.951+0000 7f6f5b7fe640 1 -- 172.21.15.6:0/2253844008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f6c010e40 con 0x563dedd3f390 2024-09-21T08:05:28.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.951+0000 7f6f5b7fe640 1 -- 172.21.15.6:0/2253844008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0a9730 con 0x563dedd3f390 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2253844008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 msgr2=0x563dee107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0e4950 tx=0x7f6f6c0ef690 comp rx=0 tx=0).stop 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 0x7f6f5c0b8bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800a400 tx=0x7f6f6800d040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2253844008 shutdown_connections 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd3f390 0x563dee107cf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd371b0 0x563dee1077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2253844008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.952+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2253844008 >> 172.21.15.6:0/2253844008 conn(0x563dedd54460 msgr2=0x563dee105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:28.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.953+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2253844008 shutdown_connections 2024-09-21T08:05:28.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.953+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2253844008 wait complete. 2024-09-21T08:05:28.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.953+0000 7f6f7dfd4740 1 -- start start 2024-09-21T08:05:28.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.954+0000 7f6f7dfd4740 1 Processor -- start 2024-09-21T08:05:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.954+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.954+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 0x563dee112f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 0x563dee11ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563dedece700 con 0x563dedd371b0 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563dee008110 con 0x563dedd60070 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563dee115a50 con 0x563dedd3f390 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f757fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f7dfd4740 10 client.0 _ll_register_callbacks cb 0x563dee021990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f757fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38248/0 (socket says 172.21.15.6:38248) 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f757fc640 1 -- 172.21.15.6:0/1187446349 learned_addr learned my addr 172.21.15.6:0/1187446349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 0x563dee112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.955+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 0x563dee11ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 -- 172.21.15.6:0/1187446349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 msgr2=0x563dee112f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 0x563dee112f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 -- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 msgr2=0x563dee11ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 0x563dee11ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 -- 172.21.15.6:0/1187446349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dee035c40 con 0x563dedd371b0 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 0x563dee112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f757fc640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009230 tx=0x7f6f600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c49b3f66467949c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.956+0000 7f6f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:05:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.957+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 0x563dee11ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.957+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60005610 con 0x563dedd371b0 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.957+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563dee07fda0 con 0x563dedd371b0 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.957+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6f600049e0 con 0x563dedd371b0 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.958+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f60004be0 con 0x563dedd371b0 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.958+0000 7f6f7dfd4740 10 client.16134 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.958+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563dee121870 con 0x563dedd371b0 2024-09-21T08:05:28.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.959+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563dee07fda0 con 0x563dedd371b0 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.960+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6f60047430 con 0x563dedd371b0 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 10 client.16134 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 20 client.16134 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedd1e9f0 0x563dee124d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 4 client.16134 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:05:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dee07b850 con 0x563dedd1e9f0 2024-09-21T08:05:28.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.961+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedd1e9f0 0x563dee124d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.963+0000 7f6f74ffb640 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedd1e9f0 0x563dee124d70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a763259f9eec377e server_cookie=ab97fe39e109e7f8 in_seq=0 out_seq=0 2024-09-21T08:05:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.963+0000 7f6f58ff9640 10 client.16134 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.964+0000 7f6f58ff9640 1 -- 172.21.15.6:0/1187446349 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563dee07b850 con 0x563dedd1e9f0 2024-09-21T08:05:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.964+0000 7f6f58ff9640 10 client.16134 handle_command_reply: tid=0 2024-09-21T08:05:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.964+0000 7f6f7dfd4740 1 client.16134 shutdown 2024-09-21T08:05:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 msgr2=0x563dee1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009230 tx=0x7f6f600048f0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 shutdown_connections 2024-09-21T08:05:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedd1e9f0 0x563dee124d70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd3f390 0x563dee112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.965+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd60070 0x563dee11ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1187446349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee1129e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 >> 172.21.15.6:0/1187446349 conn(0x563dedd54460 msgr2=0x563dee10a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f58ff9640 0 client.16134 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 shutdown_connections 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1187446349 wait complete. 2024-09-21T08:05:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:28.966+0000 7f6f7dfd4740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T08:05:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.001+0000 7f6f7dfd4740 1 Processor -- start 2024-09-21T08:05:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.001+0000 7f6f7dfd4740 1 -- start start 2024-09-21T08:05:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee10aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b5480 con 0x563dedd371b0 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b7d00 con 0x563dedd3f390 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b5af0 con 0x563dedd60070 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52244/0 (socket says 172.21.15.6:52244) 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 -- 172.21.15.6:0/1222793622 learned_addr learned my addr 172.21.15.6:0/1222793622 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f757fc640 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee10aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 -- 172.21.15.6:0/1222793622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 msgr2=0x563dee10fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 -- 172.21.15.6:0/1222793622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 msgr2=0x563dee10aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee10aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.002+0000 7f6f75ffd640 1 -- 172.21.15.6:0/1222793622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dee125120 con 0x563dedd60070 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.003+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f68018a20 tx=0x7f6f68014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f514ab8e6d0861 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:29.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.003+0000 7f6f5affd640 1 -- 172.21.15.6:0/1222793622 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68016d40 con 0x563dedd60070 2024-09-21T08:05:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.005+0000 7f6f5affd640 1 -- 172.21.15.6:0/1222793622 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f68029070 con 0x563dedd60070 2024-09-21T08:05:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.005+0000 7f6f5affd640 1 -- 172.21.15.6:0/1222793622 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68017620 con 0x563dedd60070 2024-09-21T08:05:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1222793622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 msgr2=0x563dee110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f68018a20 tx=0x7f6f68014000 comp rx=0 tx=0).stop 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1222793622 shutdown_connections 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee110110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/1222793622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.006+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1222793622 >> 172.21.15.6:0/1222793622 conn(0x563dedd54460 msgr2=0x563dee10a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.007+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1222793622 shutdown_connections 2024-09-21T08:05:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.007+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/1222793622 wait complete. 2024-09-21T08:05:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.008+0000 7f6f7dfd4740 1 -- start start 2024-09-21T08:05:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.008+0000 7f6f7dfd4740 1 Processor -- start 2024-09-21T08:05:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee118d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee119280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b61c0 con 0x563dedd371b0 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b7630 con 0x563dedd3f390 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f701b6890 con 0x563dedd60070 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f7dfd4740 10 client.0 _ll_register_callbacks cb 0x7f6f600035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f75ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f74ffb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f75ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52250/0 (socket says 172.21.15.6:52250) 2024-09-21T08:05:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.009+0000 7f6f75ffd640 1 -- 172.21.15.6:0/2567767113 learned_addr learned my addr 172.21.15.6:0/2567767113 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f757fc640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee118d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f75ffd640 1 -- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 msgr2=0x563dee119280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee119280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f75ffd640 1 -- 172.21.15.6:0/2567767113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 msgr2=0x563dee118d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:29.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee118d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.010+0000 7f6f75ffd640 1 -- 172.21.15.6:0/2567767113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dee18e7f0 con 0x563dedd60070 2024-09-21T08:05:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.011+0000 7f6f75ffd640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f68024cd0 tx=0x7f6f68016df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900626b1c796a4bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.012+0000 7f6f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:05:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.012+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68024860 con 0x563dedd60070 2024-09-21T08:05:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.012+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f6f68039480 con 0x563dedd60070 2024-09-21T08:05:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.012+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f68029070 con 0x563dedd60070 2024-09-21T08:05:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.019+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f68042050 con 0x563dedd60070 2024-09-21T08:05:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.019+0000 7f6f7dfd4740 10 client.25909 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.019+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563dee18fa80 con 0x563dedd60070 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f68029070 con 0x563dedd60070 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6f6802d730 con 0x563dedd60070 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 10 client.25909 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 20 client.25909 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedcf3da0 0x563dee1921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 4 client.25909 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.021+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563dee10e590 con 0x563dedcf3da0 2024-09-21T08:05:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.022+0000 7f6f757fc640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedcf3da0 0x563dee1921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.024+0000 7f6f757fc640 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedcf3da0 0x563dee1921a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b32f6d6b10c1f2c server_cookie=8736d2ba23b06e01 in_seq=0 out_seq=0 2024-09-21T08:05:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.024+0000 7f6f58ff9640 10 client.25909 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.024+0000 7f6f58ff9640 1 -- 172.21.15.6:0/2567767113 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x563dee10e590 con 0x563dedcf3da0 2024-09-21T08:05:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.024+0000 7f6f58ff9640 10 client.25909 handle_command_reply: tid=0 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.025+0000 7f6f7dfd4740 1 client.25909 shutdown 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 msgr2=0x563dee1197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f68024cd0 tx=0x7f6f68016df0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 shutdown_connections 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563dedcf3da0 0x563dee1921a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563dedd60070 0x563dee1197c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f58ff9640 0 client.25909 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dedd3f390 0x563dee119280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 --2- 172.21.15.6:0/2567767113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563dedd371b0 0x563dee118d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 >> 172.21.15.6:0/2567767113 conn(0x563dedd54460 msgr2=0x563dee1082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.026+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 shutdown_connections 2024-09-21T08:05:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.027+0000 7f6f7dfd4740 1 -- 172.21.15.6:0/2567767113 wait complete. 2024-09-21T08:05:29.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.027+0000 7f6f7dfd4740 20 client.25909 trim_cache size 0 max 16384 2024-09-21T08:05:29.029 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:05:29.029 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:05:29.029 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:05:29.031 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:05:29.033 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 msgr2=0x7f6f5c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 0x7f6f5c0b8bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800a400 tx=0x7f6f6800d040 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 msgr2=0x7f6f701a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d770 tx=0x7f6f6c00dc30 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 shutdown_connections 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6f5c0b66b0 0x7f6f5c0b8bc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f70114460 0x7f6f701a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70077380 0x7f6f701a0f70 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d770 tx=0x7f6f6c00dc30 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 --2- 172.21.15.6:0/854175877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f70075dd0 0x7f6f701a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.028+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 >> 172.21.15.6:0/854175877 conn(0x7f6f700ff600 msgr2=0x7f6f70110360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.029+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 shutdown_connections 2024-09-21T08:05:29.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:29.029+0000 7f6f77a60640 1 -- 172.21.15.6:0/854175877 wait complete. 2024-09-21T08:05:29.035 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:29 smithi006 ceph-mon[30970]: pgmap v476: 129 pgs: 129 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:29 smithi119 ceph-mon[33564]: pgmap v476: 129 pgs: 129 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:29 smithi145 ceph-mon[34049]: pgmap v476: 129 pgs: 129 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:30.017 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:05:30.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:05:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 -- 172.21.15.6:0/1092101837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 msgr2=0x7f09ec102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1092101837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec102e70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009ca0 tx=0x7f09e402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 -- 172.21.15.6:0/1092101837 shutdown_connections 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1092101837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec1083a0 0x7f09ec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1092101837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec108cf0 0x7f09ec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1092101837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec102e70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 -- 172.21.15.6:0/1092101837 >> 172.21.15.6:0/1092101837 conn(0x7f09ec079730 msgr2=0x7f09ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.003+0000 7f09f27e5640 1 -- 172.21.15.6:0/1092101837 shutdown_connections 2024-09-21T08:05:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.004+0000 7f09f27e5640 1 -- 172.21.15.6:0/1092101837 wait complete. 2024-09-21T08:05:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.005+0000 7f09f27e5640 1 Processor -- start 2024-09-21T08:05:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.005+0000 7f09f27e5640 1 -- start start 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 0x7f09ec199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec112860 con 0x7f09ec102a60 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec1126e0 con 0x7f09ec1083a0 2024-09-21T08:05:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f27e5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec1129e0 con 0x7f09ec108cf0 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f0d82640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38286/0 (socket says 172.21.15.6:38286) 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f0d82640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52264/0 (socket says 172.21.15.6:52264) 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09ebfff640 1 -- 172.21.15.6:0/1418557561 learned_addr learned my addr 172.21.15.6:0/1418557561 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09eb7fe640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 0x7f09ec199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.006+0000 7f09f0d82640 1 -- 172.21.15.6:0/1418557561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 msgr2=0x7f09ec199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f0d82640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 0x7f09ec199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f0d82640 1 -- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 msgr2=0x7f09ec198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f0d82640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f0d82640 1 -- 172.21.15.6:0/1418557561 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec19e220 con 0x7f09ec108cf0 2024-09-21T08:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09ebfff640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09eb7fe640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 0x7f09ec199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f0d82640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00d6b0 tx=0x7f09dc00db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc017070 con 0x7f09ec108cf0 2024-09-21T08:05:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec19e510 con 0x7f09ec108cf0 2024-09-21T08:05:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.007+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec19ea50 con 0x7f09ec108cf0 2024-09-21T08:05:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.008+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09dc009cb0 con 0x7f09ec108cf0 2024-09-21T08:05:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.009+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc003bb0 con 0x7f09ec108cf0 2024-09-21T08:05:31.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.010+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc0052c0 con 0x7f09ec108cf0 2024-09-21T08:05:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.013+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f09dc004220 con 0x7f09ec108cf0 2024-09-21T08:05:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.014+0000 7f09e97fa640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 0x7f09d80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.014+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f09dc0e7540 con 0x7f09ec108cf0 2024-09-21T08:05:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.014+0000 7f09ebfff640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 0x7f09d80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.015+0000 7f09ebfff640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 0x7f09d80b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f80 tx=0x7f09e4004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.019+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09dc0b1af0 con 0x7f09ec108cf0 2024-09-21T08:05:31.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:31 smithi006 ceph-mon[30970]: pgmap v477: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:31 smithi119 ceph-mon[33564]: pgmap v477: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:31.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.438+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09cc0055b0 con 0x7f09ec108cf0 2024-09-21T08:05:31.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.441+0000 7f09e97fa640 1 -- 172.21.15.6:0/1418557561 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f09dc0b6a30 con 0x7f09ec108cf0 2024-09-21T08:05:31.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:05:31.443 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:05:31.443 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:05:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:31 smithi145 ceph-mon[34049]: pgmap v477: 129 pgs: 129 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 1.19k op/s 2024-09-21T08:05:31.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.444+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 msgr2=0x7f09d80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:31.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.444+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 0x7f09d80b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f80 tx=0x7f09e4004a40 comp rx=0 tx=0).stop 2024-09-21T08:05:31.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.444+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 msgr2=0x7f09ec1999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:31.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.444+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00d6b0 tx=0x7f09dc00db70 comp rx=0 tx=0).stop 2024-09-21T08:05:31.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 shutdown_connections 2024-09-21T08:05:31.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f09d80b66b0 0x7f09d80b8bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09ec108cf0 0x7f09ec1999c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09ec1083a0 0x7f09ec199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 --2- 172.21.15.6:0/1418557561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09ec102a60 0x7f09ec198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 >> 172.21.15.6:0/1418557561 conn(0x7f09ec079730 msgr2=0x7f09ec101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 shutdown_connections 2024-09-21T08:05:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:31.447+0000 7f09f27e5640 1 -- 172.21.15.6:0/1418557561 wait complete. 2024-09-21T08:05:32.306 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:32 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1418557561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:05:32.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:05:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:32 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1418557561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:05:32.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:32 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1418557561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:05:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 155.0 s, 906.6 tps, lat 110.451 ms stddev 125.070 2024-09-21T08:05:32.780 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:05:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:33 smithi006 ceph-mon[30970]: pgmap v478: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-21T08:05:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:33 smithi119 ceph-mon[33564]: pgmap v478: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-21T08:05:33.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:33 smithi145 ceph-mon[34049]: pgmap v478: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 -- 172.21.15.6:0/58391469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe368110420 msgr2=0x7fe368116c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 --2- 172.21.15.6:0/58391469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe368110420 0x7fe368116c50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe358009900 tx=0x7fe35802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 -- 172.21.15.6:0/58391469 shutdown_connections 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 --2- 172.21.15.6:0/58391469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe368110420 0x7fe368116c50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 --2- 172.21.15.6:0/58391469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe36810fad0 0x7fe36810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 --2- 172.21.15.6:0/58391469 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810a190 0x7fe36810a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 -- 172.21.15.6:0/58391469 >> 172.21.15.6:0/58391469 conn(0x7fe3680780f0 msgr2=0x7fe3681081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 -- 172.21.15.6:0/58391469 shutdown_connections 2024-09-21T08:05:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.216+0000 7fe36cc99640 1 -- 172.21.15.6:0/58391469 wait complete. 2024-09-21T08:05:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.218+0000 7fe36cc99640 1 Processor -- start 2024-09-21T08:05:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.218+0000 7fe36cc99640 1 -- start start 2024-09-21T08:05:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.218+0000 7fe36cc99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.218+0000 7fe36cc99640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 0x7fe3681a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36cc99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe368110420 0x7fe3681a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38314/0 (socket says 172.21.15.6:38314) 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 -- 172.21.15.6:0/2129403934 learned_addr learned my addr 172.21.15.6:0/2129403934 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe36811a040 con 0x7fe36810a190 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe368119ec0 con 0x7fe368110420 2024-09-21T08:05:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe36811a1c0 con 0x7fe36810fad0 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe365d9b640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 0x7fe3681a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe366d9d640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe368110420 0x7fe3681a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 -- 172.21.15.6:0/2129403934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 msgr2=0x7fe3681a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 0x7fe3681a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 -- 172.21.15.6:0/2129403934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe368110420 msgr2=0x7fe3681a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe368110420 0x7fe3681a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.219+0000 7fe36659c640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3681a6920 con 0x7fe36810a190 2024-09-21T08:05:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.220+0000 7fe365d9b640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 0x7fe3681a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:05:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.220+0000 7fe36659c640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b4a0 tx=0x7fe35c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.220+0000 7fe3577fe640 1 -- 172.21.15.6:0/2129403934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c014070 con 0x7fe36810a190 2024-09-21T08:05:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.220+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3681a6c10 con 0x7fe36810a190 2024-09-21T08:05:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.221+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3681ad370 con 0x7fe36810a190 2024-09-21T08:05:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.221+0000 7fe3577fe640 1 -- 172.21.15.6:0/2129403934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe35c010aa0 con 0x7fe36810a190 2024-09-21T08:05:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.221+0000 7fe3577fe640 1 -- 172.21.15.6:0/2129403934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c01e060 con 0x7fe36810a190 2024-09-21T08:05:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.225+0000 7fe37320d740 1 Processor -- start 2024-09-21T08:05:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.225+0000 7fe37320d740 1 -- start start 2024-09-21T08:05:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.226+0000 7fe3577fe640 1 -- 172.21.15.6:0/2129403934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe35c017070 con 0x7fe36810a190 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245d31b0 0x55b9249a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b924919ea0 con 0x55b9245db390 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b9249092d0 con 0x55b9245d31b0 2024-09-21T08:05:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe37320d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b92490d0e0 con 0x55b9245fc070 2024-09-21T08:05:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe366d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe366d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52286/0 (socket says 172.21.15.6:52286) 2024-09-21T08:05:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe36659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245d31b0 0x55b9249a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.227+0000 7fe366d9d640 1 -- 172.21.15.6:0/4115745991 learned_addr learned my addr 172.21.15.6:0/4115745991 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe3577fe640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 0x7fe3500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe365d9b640 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe3577fe640 1 -- 172.21.15.6:0/2129403934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe35c0e6c90 con 0x7fe36810a190 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe366d9d640 1 -- 172.21.15.6:0/4115745991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245d31b0 msgr2=0x55b9249a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe366d9d640 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245d31b0 0x55b9249a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe366d9d640 1 -- 172.21.15.6:0/4115745991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 msgr2=0x55b9249a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe366d9d640 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249a4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.228+0000 7fe366d9d640 1 -- 172.21.15.6:0/4115745991 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b924667650 con 0x55b9245fc070 2024-09-21T08:05:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.229+0000 7fe366d9d640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 0x7fe3500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.229+0000 7fe366d9d640 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe35802a9e0 tx=0x7fe3580041a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d4233b275b015d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.229+0000 7fe354ff9640 1 -- 172.21.15.6:0/4115745991 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe358041040 con 0x55b9245fc070 2024-09-21T08:05:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.229+0000 7fe354ff9640 1 -- 172.21.15.6:0/4115745991 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe358005380 con 0x55b9245fc070 2024-09-21T08:05:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.230+0000 7fe37320d740 1 -- 172.21.15.6:0/4115745991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 msgr2=0x55b9249a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.230+0000 7fe37320d740 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe35802a9e0 tx=0x7fe3580041a0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.230+0000 7fe366d9d640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 0x7fe3500b8c10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe358047000 tx=0x7fe358003b50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 -- 172.21.15.6:0/4115745991 shutdown_connections 2024-09-21T08:05:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245d31b0 0x55b9249a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 --2- 172.21.15.6:0/4115745991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245fc070 0x55b9249a36a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 -- 172.21.15.6:0/4115745991 >> 172.21.15.6:0/4115745991 conn(0x55b9245f0460 msgr2=0x55b9249a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 -- 172.21.15.6:0/4115745991 shutdown_connections 2024-09-21T08:05:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 -- 172.21.15.6:0/4115745991 wait complete. 2024-09-21T08:05:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 -- start start 2024-09-21T08:05:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.231+0000 7fe37320d740 1 Processor -- start 2024-09-21T08:05:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249af160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245fc070 0x55b9249af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b92476a700 con 0x55b9245db390 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b9248a4160 con 0x55b9245fc070 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b9249b1ed0 con 0x55b9245d31b0 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe37320d740 10 client.0 _ll_register_callbacks cb 0x55b9248bd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe36659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe36659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52302/0 (socket says 172.21.15.6:52302) 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe36659c640 1 -- 172.21.15.6:0/3344982265 learned_addr learned my addr 172.21.15.6:0/3344982265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.232+0000 7fe365d9b640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe366d9d640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245fc070 0x55b9249af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 -- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245fc070 msgr2=0x55b9249af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245fc070 0x55b9249af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 -- 172.21.15.6:0/3344982265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 msgr2=0x55b9249af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 -- 172.21.15.6:0/3344982265 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9248d1c90 con 0x55b9245d31b0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe36659c640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0a9970 tx=0x7fe35c0abfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e33a43aa7fa17e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe34dffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.233+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b11e0 con 0x55b9245d31b0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe35c010c50 con 0x55b9245d31b0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe358005380 con 0x55b9245d31b0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe35c0b6120 con 0x55b9245d31b0 2024-09-21T08:05:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe37320d740 10 client.25924 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b9249bdbb0 con 0x55b9245d31b0 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.234+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe358005380 con 0x55b9245d31b0 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe35c0ab3d0 con 0x55b9245d31b0 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 10 client.25924 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 10 client.25924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 20 client.25924 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b9245ba9f0 0x55b9249c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 4 client.25924 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:05:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b92491bdf0 con 0x55b9245ba9f0 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.235+0000 7fe365d9b640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b9245ba9f0 0x55b9249c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.237+0000 7fe365d9b640 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b9245ba9f0 0x55b9249c10a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa7289f4e1b6fbd9 server_cookie=eb199a820f7b349 in_seq=0 out_seq=0 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.237+0000 7fe34dffb640 10 client.25924 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe34dffb640 1 -- 172.21.15.6:0/3344982265 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b92491bdf0 con 0x55b9245ba9f0 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe34dffb640 10 client.25924 handle_command_reply: tid=0 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 client.25924 shutdown 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 msgr2=0x55b9249aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0a9970 tx=0x7fe35c0abfa0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 shutdown_connections 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b9245ba9f0 0x55b9249c10a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245fc070 0x55b9249af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245db390 0x55b9249af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 --2- 172.21.15.6:0/3344982265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249aec20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 >> 172.21.15.6:0/3344982265 conn(0x55b9245f0460 msgr2=0x55b9249a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe34dffb640 0 client.25924 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.238+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 shutdown_connections 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.239+0000 7fe37320d740 1 -- 172.21.15.6:0/3344982265 wait complete. 2024-09-21T08:05:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.239+0000 7fe37320d740 20 client.25924 trim_cache size 0 max 16384 2024-09-21T08:05:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.264+0000 7fe37320d740 1 Processor -- start 2024-09-21T08:05:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.264+0000 7fe37320d740 1 -- start start 2024-09-21T08:05:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b9249ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe34800e030 con 0x55b9245fc070 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe366d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b9249ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe366d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b9249ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38342/0 (socket says 172.21.15.6:38342) 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe366d9d640 1 -- 172.21.15.6:0/3116462766 learned_addr learned my addr 172.21.15.6:0/3116462766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe36659c640 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480108b0 con 0x55b9245db390 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe365d9b640 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.265+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe34800e6a0 con 0x55b9245d31b0 2024-09-21T08:05:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.266+0000 7fe36659c640 1 -- 172.21.15.6:0/3116462766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 msgr2=0x55b9249abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.266+0000 7fe36659c640 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.267+0000 7fe36659c640 1 -- 172.21.15.6:0/3116462766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 msgr2=0x55b9249ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.267+0000 7fe36659c640 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b9249ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.267+0000 7fe36659c640 1 -- 172.21.15.6:0/3116462766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9249afee0 con 0x55b9245d31b0 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.268+0000 7fe36659c640 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249a4de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0ab870 tx=0x7fe35c0abe70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4504e8f976cd9b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.269+0000 7fe34ffff640 1 -- 172.21.15.6:0/3116462766 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b11e0 con 0x55b9245d31b0 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.269+0000 7fe34ffff640 1 -- 172.21.15.6:0/3116462766 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe35c0b2370 con 0x55b9245d31b0 2024-09-21T08:05:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.270+0000 7fe34ffff640 1 -- 172.21.15.6:0/3116462766 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b11e0 con 0x55b9245d31b0 2024-09-21T08:05:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 msgr2=0x55b9249a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249a4de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0ab870 tx=0x7fe35c0abe70 comp rx=0 tx=0).stop 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 shutdown_connections 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b9249ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 --2- 172.21.15.6:0/3116462766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249a4de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.271+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 >> 172.21.15.6:0/3116462766 conn(0x55b9245f0460 msgr2=0x55b9249a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.272+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 shutdown_connections 2024-09-21T08:05:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.272+0000 7fe37320d740 1 -- 172.21.15.6:0/3116462766 wait complete. 2024-09-21T08:05:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.272+0000 7fe37320d740 1 -- start start 2024-09-21T08:05:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.272+0000 7fe37320d740 1 Processor -- start 2024-09-21T08:05:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe36659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe36659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52310/0 (socket says 172.21.15.6:52310) 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe36659c640 1 -- 172.21.15.6:0/1934976833 learned_addr learned my addr 172.21.15.6:0/1934976833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b924a2aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe365d9b640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe34800ed70 con 0x55b9245fc070 2024-09-21T08:05:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480101e0 con 0x55b9245db390 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.273+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe34800f440 con 0x55b9245d31b0 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe37320d740 10 client.0 _ll_register_callbacks cb 0x7fe35c0ac4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe366d9d640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b924a2aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe36659c640 1 -- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 msgr2=0x55b9249b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe36659c640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe36659c640 1 -- 172.21.15.6:0/1934976833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 msgr2=0x55b924a2aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe36659c640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b924a2aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.274+0000 7fe36659c640 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9249b42a0 con 0x55b9245d31b0 2024-09-21T08:05:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.275+0000 7fe36659c640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b13a0 tx=0x7fe35c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df165c02ed8f9730 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.275+0000 7fe34dffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:05:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.275+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b11e0 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.275+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe35c0b2370 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.275+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe35c0abb70 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe35c08b050 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 10 client.25930 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b9249b42a0 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe35c0ce340 con 0x55b9245d31b0 2024-09-21T08:05:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe35c0b5130 con 0x55b9245d31b0 2024-09-21T08:05:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 10 client.25930 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 10 client.25930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 20 client.25930 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b92458fda0 0x55b924a2e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 4 client.25930 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.276+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe35c0b2370 con 0x55b92458fda0 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.277+0000 7fe365d9b640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b92458fda0 0x55b924a2e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.277+0000 7fe34dffb640 10 client.25930 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.278+0000 7fe365d9b640 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b92458fda0 0x55b924a2e2f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5022036811948cdb server_cookie=5a563ed13f14c052 in_seq=0 out_seq=0 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.278+0000 7fe34dffb640 1 -- 172.21.15.6:0/1934976833 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe35c0b2370 con 0x55b92458fda0 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.278+0000 7fe34dffb640 10 client.25930 handle_command_reply: tid=0 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.278+0000 7fe37320d740 1 client.25930 shutdown 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.279+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 msgr2=0x55b9249b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.279+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b13a0 tx=0x7fe35c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.279+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 shutdown_connections 2024-09-21T08:05:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b92458fda0 0x55b924a2e2f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9245fc070 0x55b924a2aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe34dffb640 0 client.25930 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9245db390 0x55b9249b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 --2- 172.21.15.6:0/1934976833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9245d31b0 0x55b9249b34c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 >> 172.21.15.6:0/1934976833 conn(0x55b9245f0460 msgr2=0x55b9249b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 shutdown_connections 2024-09-21T08:05:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.280+0000 7fe37320d740 1 -- 172.21.15.6:0/1934976833 wait complete. 2024-09-21T08:05:34.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.281+0000 7fe37320d740 20 client.25930 trim_cache size 0 max 16384 2024-09-21T08:05:34.285 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 msgr2=0x7fe3500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 0x7fe3500b8c10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe358047000 tx=0x7fe358003b50 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 msgr2=0x7fe3681a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b4a0 tx=0x7fe35c00b960 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 shutdown_connections 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6700 0x7fe3500b8c10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe36810fad0 0x7fe3681a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe368110420 0x7fe3681a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 --2- 172.21.15.6:0/2129403934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36810a190 0x7fe3681a09b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.284+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 >> 172.21.15.6:0/2129403934 conn(0x7fe3680780f0 msgr2=0x7fe36810db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.285+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 shutdown_connections 2024-09-21T08:05:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:34.285+0000 7fe36cc99640 1 -- 172.21.15.6:0/2129403934 wait complete. 2024-09-21T08:05:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:35 smithi119 ceph-mon[33564]: pgmap v479: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.09k op/s 2024-09-21T08:05:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:35 smithi145 ceph-mon[34049]: pgmap v479: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.09k op/s 2024-09-21T08:05:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:35 smithi006 ceph-mon[30970]: pgmap v479: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.09k op/s 2024-09-21T08:05:36.230 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:05:36.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:05:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:05:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:37 smithi006 ceph-mon[30970]: pgmap v480: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-21T08:05:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:37 smithi119 ceph-mon[33564]: pgmap v480: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-21T08:05:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:37 smithi145 ceph-mon[34049]: pgmap v480: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 -- 172.21.15.6:0/3652236254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc81094d0 msgr2=0x7f7cc81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/3652236254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc81094d0 0x7f7cc81098e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009860 tx=0x7f7cb802a340 comp rx=0 tx=0).stop 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 -- 172.21.15.6:0/3652236254 shutdown_connections 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/3652236254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc81094d0 0x7f7cc81098e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/3652236254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/3652236254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc8103b90 0x7f7cc8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 -- 172.21.15.6:0/3652236254 >> 172.21.15.6:0/3652236254 conn(0x7f7cc80ff600 msgr2=0x7f7cc8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 -- 172.21.15.6:0/3652236254 shutdown_connections 2024-09-21T08:05:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.484+0000 7f7cd04e2640 1 -- 172.21.15.6:0/3652236254 wait complete. 2024-09-21T08:05:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.485+0000 7f7cd04e2640 1 Processor -- start 2024-09-21T08:05:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.485+0000 7f7cd04e2640 1 -- start start 2024-09-21T08:05:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81094d0 0x7f7cc81102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc81a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8113990 con 0x7f7cc81094d0 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8113810 con 0x7f7cc8109e20 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cd04e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8113b10 con 0x7f7cc8103b90 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37264/0 (socket says 172.21.15.6:37264) 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7cce27e640 1 -- 172.21.15.6:0/1889781298 learned_addr learned my addr 172.21.15.6:0/1889781298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81094d0 0x7f7cc81102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.486+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc81a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 -- 172.21.15.6:0/1889781298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 msgr2=0x7f7cc810fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 -- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81094d0 msgr2=0x7f7cc81102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81094d0 0x7f7cc81102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 -- 172.21.15.6:0/1889781298 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81a6740 con 0x7f7cc8109e20 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7cce27e640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc81a6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ec50 tx=0x7f7cc000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7cbf7fe640 1 -- 172.21.15.6:0/1889781298 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0003b70 con 0x7f7cc8109e20 2024-09-21T08:05:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7cbf7fe640 1 -- 172.21.15.6:0/1889781298 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cc0003d10 con 0x7f7cc8109e20 2024-09-21T08:05:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.487+0000 7f7cbf7fe640 1 -- 172.21.15.6:0/1889781298 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00107a0 con 0x7f7cc8109e20 2024-09-21T08:05:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.488+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc81a6a30 con 0x7f7cc8109e20 2024-09-21T08:05:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.488+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc81ad190 con 0x7f7cc8109e20 2024-09-21T08:05:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.491+0000 7f7cbf7fe640 1 -- 172.21.15.6:0/1889781298 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7cc0003fc0 con 0x7f7cc8109e20 2024-09-21T08:05:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.493+0000 7f7cd6a56740 1 Processor -- start 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.493+0000 7f7cd6a56740 1 -- start start 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a0585fb490 0x55a0589cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a058941e60 con 0x55a058603670 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a058931290 con 0x55a0585fb490 2024-09-21T08:05:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a0589350a0 con 0x55a058624350 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7cbf7fe640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 0x7f7cb40b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7ccda7d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7ccda7d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37268/0 (socket says 172.21.15.6:37268) 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3127813915 learned_addr learned my addr 172.21.15.6:0/3127813915 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.494+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a0585fb490 0x55a0589cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7cce27e640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 0x7f7cb40b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3127813915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a0585fb490 msgr2=0x55a0589cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a0585fb490 0x55a0589cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3127813915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 msgr2=0x55a0589cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3127813915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a05868f930 con 0x55a058624350 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7cbf7fe640 1 -- 172.21.15.6:0/1889781298 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7cc00e7fe0 con 0x7f7cc8109e20 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.495+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7cb802a930 tx=0x7f7cb8005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d88e3ef764044e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.496+0000 7f7cbcff9640 1 -- 172.21.15.6:0/3127813915 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8049070 con 0x55a058624350 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.496+0000 7f7cbcff9640 1 -- 172.21.15.6:0/3127813915 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cb8004450 con 0x55a058624350 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.496+0000 7f7cbcff9640 1 -- 172.21.15.6:0/3127813915 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8037040 con 0x55a058624350 2024-09-21T08:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3127813915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 msgr2=0x55a0589cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cce27e640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 0x7f7cb40b8c90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40058c0 tx=0x7f7cc4009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7cb802a930 tx=0x7f7cb8005c90 comp rx=0 tx=0).stop 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3127813915 shutdown_connections 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a0585fb490 0x55a0589cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3127813915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a058624350 0x55a0589cb430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.497+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3127813915 >> 172.21.15.6:0/3127813915 conn(0x55a058618740 msgr2=0x55a0589c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.498+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3127813915 shutdown_connections 2024-09-21T08:05:37.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.498+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3127813915 wait complete. 2024-09-21T08:05:37.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.498+0000 7f7cd6a56740 1 -- start start 2024-09-21T08:05:37.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.499+0000 7f7cd6a56740 1 Processor -- start 2024-09-21T08:05:37.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.499+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589dcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37274/0 (socket says 172.21.15.6:37274) 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7ccda7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7ccda7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:48024/0 (socket says 172.21.15.6:48024) 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7cce27e640 1 -- 172.21.15.6:0/3217945467 learned_addr learned my addr 172.21.15.6:0/3217945467 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.500+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a058792890 con 0x55a058624350 2024-09-21T08:05:37.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a0588cbd40 con 0x55a058603670 2024-09-21T08:05:37.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a0589d9bb0 con 0x55a0585fb490 2024-09-21T08:05:37.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7cd6a56740 10 client.0 _ll_register_callbacks cb 0x55a05892fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3217945467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 msgr2=0x55a0589d7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3217945467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 msgr2=0x55a0589dcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589dcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0589dd550 con 0x55a058603670 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.501+0000 7f7cce27e640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009780 tx=0x7f7cb8030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe2fa3cbdaaa387 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3217945467 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8049070 con 0x55a058603670 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3217945467 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7cb8003800 con 0x55a058603670 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cb8004450 con 0x55a058603670 2024-09-21T08:05:37.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.502+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3217945467 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7cb8059050 con 0x55a058603670 2024-09-21T08:05:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.503+0000 7f7cd6a56740 10 client.25856 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.503+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55a0589e5d60 con 0x55a058603670 2024-09-21T08:05:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.503+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3217945467 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7cb8003a00 con 0x55a058603670 2024-09-21T08:05:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 10 client.25856 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 20 client.25856 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585e2cd0 0x55a0589e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 4 client.25856 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7cb8004450 con 0x55a0585e2cd0 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.504+0000 7f7cce27e640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585e2cd0 0x55a0589e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.505+0000 7f7cce27e640 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585e2cd0 0x55a0589e92b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c18712c88fab5e75 server_cookie=82c42bad2f1078af in_seq=0 out_seq=0 2024-09-21T08:05:37.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.505+0000 7f7cb1ffb640 10 client.25856 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3217945467 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7cb8004450 con 0x55a0585e2cd0 2024-09-21T08:05:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cb1ffb640 10 client.25856 handle_command_reply: tid=0 2024-09-21T08:05:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cd6a56740 1 client.25856 shutdown 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 msgr2=0x55a0589d7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009780 tx=0x7f7cb8030ce0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.506+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 shutdown_connections 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585e2cd0 0x55a0589e92b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589dcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589d7730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3217945467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 >> 172.21.15.6:0/3217945467 conn(0x55a058618740 msgr2=0x55a0589ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cb1ffb640 0 client.25856 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 shutdown_connections 2024-09-21T08:05:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3217945467 wait complete. 2024-09-21T08:05:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.507+0000 7f7cd6a56740 20 client.25856 trim_cache size 0 max 16384 2024-09-21T08:05:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.540+0000 7f7cd6a56740 1 Processor -- start 2024-09-21T08:05:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 -- start start 2024-09-21T08:05:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b51f0 con 0x55a058624350 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b7a70 con 0x55a058603670 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b5860 con 0x55a0585fb490 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7ccea7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7ccea7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44878/0 (socket says 172.21.15.6:44878) 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.541+0000 7f7ccea7f640 1 -- 172.21.15.6:0/2955281906 learned_addr learned my addr 172.21.15.6:0/2955281906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7cce27e640 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 -- 172.21.15.6:0/2955281906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 msgr2=0x55a0589cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 -- 172.21.15.6:0/2955281906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 msgr2=0x55a0589dcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 -- 172.21.15.6:0/2955281906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0589d8230 con 0x55a058624350 2024-09-21T08:05:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.542+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ad750 tx=0x7f7cc00046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ea9f4f4d587a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.543+0000 7f7cb3fff640 1 -- 172.21.15.6:0/2955281906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00ad820 con 0x55a058624350 2024-09-21T08:05:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.543+0000 7f7cb3fff640 1 -- 172.21.15.6:0/2955281906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cc0009820 con 0x55a058624350 2024-09-21T08:05:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.543+0000 7f7cb3fff640 1 -- 172.21.15.6:0/2955281906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00a91c0 con 0x55a058624350 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 -- 172.21.15.6:0/2955281906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 msgr2=0x55a0589d66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ad750 tx=0x7f7cc00046f0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 -- 172.21.15.6:0/2955281906 shutdown_connections 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058624350 0x55a0589d66d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058603670 0x55a0589dcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/2955281906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.544+0000 7f7cd6a56740 1 -- 172.21.15.6:0/2955281906 >> 172.21.15.6:0/2955281906 conn(0x55a058618740 msgr2=0x55a0589ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.545+0000 7f7cd6a56740 1 -- 172.21.15.6:0/2955281906 shutdown_connections 2024-09-21T08:05:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.545+0000 7f7cd6a56740 1 -- 172.21.15.6:0/2955281906 wait complete. 2024-09-21T08:05:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.546+0000 7f7cd6a56740 1 -- start start 2024-09-21T08:05:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.546+0000 7f7cd6a56740 1 Processor -- start 2024-09-21T08:05:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058624350 0x55a0589de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b5f30 con 0x55a058603670 2024-09-21T08:05:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b73a0 con 0x55a058624350 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81b6600 con 0x55a0585fb490 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cd6a56740 10 client.0 _ll_register_callbacks cb 0x7f7cb8047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7ccda7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cce27e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589ddc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37296/0 (socket says 172.21.15.6:37296) 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7cce27e640 1 -- 172.21.15.6:0/3515831326 learned_addr learned my addr 172.21.15.6:0/3515831326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.547+0000 7f7ccea7f640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058624350 0x55a0589de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.548+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3515831326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 msgr2=0x55a0589ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.548+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.548+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058624350 msgr2=0x55a0589de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.548+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058624350 0x55a0589de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.548+0000 7f7ccda7d640 1 -- 172.21.15.6:0/3515831326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0589e2d50 con 0x55a058603670 2024-09-21T08:05:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7ccda7d640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589de1c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8005d00 tx=0x7f7cb8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd246eeef14fc100 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8037040 con 0x55a058603670 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7cb8032440 con 0x55a058603670 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cc0009820 con 0x55a058603670 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.549+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7cb8030ab0 con 0x55a058603670 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.550+0000 7f7cd6a56740 10 client.16179 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.550+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a058a53fa0 con 0x55a058603670 2024-09-21T08:05:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cb804b070 con 0x55a058603670 2024-09-21T08:05:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7cb8032af0 con 0x55a058603670 2024-09-21T08:05:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 10 client.16179 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 20 client.16179 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585b8080 0x55a058a56510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 4 client.16179 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:05:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f7cc0009820 con 0x55a0585b8080 2024-09-21T08:05:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.551+0000 7f7cce27e640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585b8080 0x55a058a56510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.552+0000 7f7cb1ffb640 10 client.16179 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.552+0000 7f7cce27e640 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585b8080 0x55a058a56510 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58be0d21e7a99374 server_cookie=f39de465b7880383 in_seq=0 out_seq=0 2024-09-21T08:05:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.554+0000 7f7cb1ffb640 1 -- 172.21.15.6:0/3515831326 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f7cc0009820 con 0x55a0585b8080 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.554+0000 7f7cb1ffb640 10 client.16179 handle_command_reply: tid=0 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.554+0000 7f7cd6a56740 1 client.16179 shutdown 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.554+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 msgr2=0x55a0589de1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.554+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589de1c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8005d00 tx=0x7f7cb8005e70 comp rx=0 tx=0).stop 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 shutdown_connections 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a0585b8080 0x55a058a56510 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a058624350 0x55a0589de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a058603670 0x55a0589de1c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 --2- 172.21.15.6:0/3515831326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a0585fb490 0x55a0589ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 >> 172.21.15.6:0/3515831326 conn(0x55a058618740 msgr2=0x55a0589d8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.555+0000 7f7cb1ffb640 0 client.16179 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.556+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 shutdown_connections 2024-09-21T08:05:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.556+0000 7f7cd6a56740 1 -- 172.21.15.6:0/3515831326 wait complete. 2024-09-21T08:05:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.556+0000 7f7cd6a56740 20 client.16179 trim_cache size 0 max 16384 2024-09-21T08:05:37.559 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:05:37.559 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:05:37.559 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "487ed3a7-1faa-4b71-b846-b5d47fdc1652", 2024-09-21T08:05:37.559 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:05:37.559 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 msgr2=0x7f7cb40b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 0x7f7cb40b8c90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40058c0 tx=0x7f7cc4009260 comp rx=0 tx=0).stop 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 msgr2=0x7f7cc81a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc81a6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ec50 tx=0x7f7cc000c6a0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 shutdown_connections 2024-09-21T08:05:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7cb40b6780 0x7f7cb40b8c90 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40058c0 tx=0x7f7cc4009260 comp rx=0 tx=0).stop 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc8109e20 0x7f7cc81a6010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cc81094d0 0x7f7cc81102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 --2- 172.21.15.6:0/1889781298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc8103b90 0x7f7cc810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 >> 172.21.15.6:0/1889781298 conn(0x7f7cc80ff600 msgr2=0x7f7cc8102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 shutdown_connections 2024-09-21T08:05:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:37.559+0000 7f7cd04e2640 1 -- 172.21.15.6:0/1889781298 wait complete. 2024-09-21T08:05:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 160.0 s, 1019.4 tps, lat 97.843 ms stddev 31.249 2024-09-21T08:05:38.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:05:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:05:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:39 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:05:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:39 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:39 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:05:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:39 smithi119 ceph-mon[33564]: pgmap v481: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T08:05:39.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:39 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:05:39.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:39 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:39.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:39 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:05:39.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:39 smithi006 ceph-mon[30970]: pgmap v481: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T08:05:39.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:39 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:05:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:39 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:39 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:05:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:39 smithi145 ceph-mon[34049]: pgmap v481: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 -- 172.21.15.6:0/1345717921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d0105270 msgr2=0x7f96d010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1345717921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d0105270 0x7f96d010d8b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009860 tx=0x7f96c402a340 comp rx=0 tx=0).stop 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 -- 172.21.15.6:0/1345717921 shutdown_connections 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1345717921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d0105270 0x7f96d010d8b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1345717921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d010ddf0 0x7f96d0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1345717921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0104840 0x7f96d0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 -- 172.21.15.6:0/1345717921 >> 172.21.15.6:0/1345717921 conn(0x7f96d0079730 msgr2=0x7f96d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 -- 172.21.15.6:0/1345717921 shutdown_connections 2024-09-21T08:05:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.928+0000 7f96d60ff640 1 -- 172.21.15.6:0/1345717921 wait complete. 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.930+0000 7f96d60ff640 1 Processor -- start 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.930+0000 7f96d60ff640 1 -- start start 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 0x7f96d0102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 0x7f96d0102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d010ddf0 0x7f96d01031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96d0113970 con 0x7f96d0104840 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01137f0 con 0x7f96d0105270 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96d60ff640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96d0113af0 con 0x7f96d010ddf0 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 0x7f96d0102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 0x7f96d0102750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44902/0 (socket says 172.21.15.6:44902) 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96cf7fe640 1 -- 172.21.15.6:0/1031624027 learned_addr learned my addr 172.21.15.6:0/1031624027 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.931+0000 7f96ceffd640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 0x7f96d0102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96cffff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d010ddf0 0x7f96d01031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 -- 172.21.15.6:0/1031624027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d010ddf0 msgr2=0x7f96d01031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d010ddf0 0x7f96d01031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 -- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 msgr2=0x7f96d0102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 0x7f96d0102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 -- 172.21.15.6:0/1031624027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d01a86c0 con 0x7f96d0105270 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.932+0000 7f96ceffd640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 0x7f96d0102c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f96d006aaa0 tx=0x7f96c4030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.933+0000 7f96ccff9640 1 -- 172.21.15.6:0/1031624027 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037040 con 0x7f96d0105270 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.933+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d01a8950 con 0x7f96d0105270 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.933+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d01a8df0 con 0x7f96d0105270 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.933+0000 7f96ccff9640 1 -- 172.21.15.6:0/1031624027 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96c4032df0 con 0x7f96d0105270 2024-09-21T08:05:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.933+0000 7f96ccff9640 1 -- 172.21.15.6:0/1031624027 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40035f0 con 0x7f96d0105270 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.937+0000 7f96ccff9640 1 -- 172.21.15.6:0/1031624027 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f96c4043020 con 0x7f96d0105270 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.939+0000 7f96ccff9640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 0x7f96b80c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.939+0000 7f96ccff9640 1 -- 172.21.15.6:0/1031624027 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f96c4106e10 con 0x7f96d0105270 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 0x7f96b80c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 Processor -- start 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 -- start start 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fccccff1b0 0x55fccd0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.940+0000 7f96dc673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fccd045e50 con 0x55fcccd07390 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96dc673740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fccd035280 con 0x55fcccd28070 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96dc673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fccd039090 con 0x55fccccff1b0 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 0x7f96b80c14d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96d01041a0 tx=0x7f96c0005f30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44910/0 (socket says 172.21.15.6:44910) 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cffff640 1 -- 172.21.15.6:0/2939387019 learned_addr learned my addr 172.21.15.6:0/2939387019 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96ceffd640 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fccccff1b0 0x55fccd0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 -- 172.21.15.6:0/2939387019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fccccff1b0 msgr2=0x55fccd0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fccccff1b0 0x55fccd0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 -- 172.21.15.6:0/2939387019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 msgr2=0x55fccd0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.941+0000 7f96cf7fe640 1 -- 172.21.15.6:0/2939387019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcccd93650 con 0x55fcccd28070 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.942+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0cf270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96c000bf60 tx=0x7f96c0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ffaacd26510d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.942+0000 7f96b5ffb640 1 -- 172.21.15.6:0/2939387019 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0022070 con 0x55fcccd28070 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.942+0000 7f96b5ffb640 1 -- 172.21.15.6:0/2939387019 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96c00047a0 con 0x55fcccd28070 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.942+0000 7f96b5ffb640 1 -- 172.21.15.6:0/2939387019 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c001e690 con 0x55fcccd28070 2024-09-21T08:05:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 -- 172.21.15.6:0/2939387019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 msgr2=0x55fccd0cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0cf270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96c000bf60 tx=0x7f96c0012000 comp rx=0 tx=0).stop 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 -- 172.21.15.6:0/2939387019 shutdown_connections 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fccccff1b0 0x55fccd0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 --2- 172.21.15.6:0/2939387019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0cf270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 -- 172.21.15.6:0/2939387019 >> 172.21.15.6:0/2939387019 conn(0x55fcccd1c460 msgr2=0x55fccd0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 -- 172.21.15.6:0/2939387019 shutdown_connections 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.944+0000 7f96dc673740 1 -- 172.21.15.6:0/2939387019 wait complete. 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.945+0000 7f96dc673740 1 -- start start 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.946+0000 7f96dc673740 1 Processor -- start 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccff1b0 0x55fccd0da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fccce96700 con 0x55fcccd07390 2024-09-21T08:05:39.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fcccfd0110 con 0x55fccccff1b0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fccd0dda50 con 0x55fcccd28070 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96cffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96cffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37328/0 (socket says 172.21.15.6:37328) 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96cffff640 1 -- 172.21.15.6:0/458087098 learned_addr learned my addr 172.21.15.6:0/458087098 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccff1b0 0x55fccd0da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96ceffd640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.947+0000 7f96dc673740 10 client.0 _ll_register_callbacks cb 0x55fcccfe9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 -- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccff1b0 msgr2=0x55fccd0da9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccff1b0 0x55fccd0da9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 -- 172.21.15.6:0/458087098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 msgr2=0x55fccd0daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0daee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 -- 172.21.15.6:0/458087098 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcccffdc40 con 0x55fcccd28070 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96cffff640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96c8011d10 tx=0x7f96c800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d6dc1536ba9658a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:05:39.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.948+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c801f060 con 0x55fcccd28070 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.949+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f96c8017050 con 0x55fcccd28070 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.949+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c00047a0 con 0x55fcccd28070 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.949+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f96c8026050 con 0x55fcccd28070 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.949+0000 7f96dc673740 10 client.25960 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.949+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fccd0e9890 con 0x55fcccd28070 2024-09-21T08:05:39.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96c801a880 con 0x55fcccd28070 2024-09-21T08:05:39.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f96c8019030 con 0x55fcccd28070 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 10 client.25960 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 10 client.25960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 20 client.25960 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fcccce69f0 0x55fccd0ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 4 client.25960 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.951+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f96c00047a0 con 0x55fcccce69f0 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.952+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fcccce69f0 0x55fccd0ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.952+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fcccce69f0 0x55fccd0ecd60 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23bb0bff0b359ca9 server_cookie=e73b592035c6e292 in_seq=0 out_seq=0 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.952+0000 7f96aeffd640 10 client.25960 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.953+0000 7f96aeffd640 1 -- 172.21.15.6:0/458087098 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f96c00047a0 con 0x55fcccce69f0 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.953+0000 7f96aeffd640 10 client.25960 handle_command_reply: tid=0 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.953+0000 7f96dc673740 1 client.25960 shutdown 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 msgr2=0x55fccd0e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96c8011d10 tx=0x7f96c800f790 comp rx=0 tx=0).stop 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 shutdown_connections 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fcccce69f0 0x55fccd0ecd60 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0e6d40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 --2- 172.21.15.6:0/458087098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccff1b0 0x55fccd0da9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 >> 172.21.15.6:0/458087098 conn(0x55fcccd1c460 msgr2=0x55fccd0d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96aeffd640 0 client.25960 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 shutdown_connections 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 1 -- 172.21.15.6:0/458087098 wait complete. 2024-09-21T08:05:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.954+0000 7f96dc673740 20 client.25960 trim_cache size 0 max 16384 2024-09-21T08:05:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 Processor -- start 2024-09-21T08:05:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 -- start start 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd07390 0x55fccd0dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44926/0 (socket says 172.21.15.6:44926) 2024-09-21T08:05:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96cf7fe640 1 -- 172.21.15.6:0/1501527552 learned_addr learned my addr 172.21.15.6:0/1501527552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01acc40 con 0x55fccccff1b0 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01af4c0 con 0x55fcccd28070 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01ad2b0 con 0x55fcccd07390 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.991+0000 7f96cffff640 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.992+0000 7f96cf7fe640 1 -- 172.21.15.6:0/1501527552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd07390 msgr2=0x55fccd0dac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.992+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd07390 0x55fccd0dac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.992+0000 7f96cf7fe640 1 -- 172.21.15.6:0/1501527552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 msgr2=0x55fccd0d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.992+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0d7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.992+0000 7f96cf7fe640 1 -- 172.21.15.6:0/1501527552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fccd0d1560 con 0x55fccccff1b0 2024-09-21T08:05:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.993+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f96c000ba20 tx=0x7f96c0004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b438378edcd56c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.993+0000 7f96b57fa640 1 -- 172.21.15.6:0/1501527552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0015040 con 0x55fccccff1b0 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.993+0000 7f96b57fa640 1 -- 172.21.15.6:0/1501527552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96c001e8e0 con 0x55fccccff1b0 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.993+0000 7f96b57fa640 1 -- 172.21.15.6:0/1501527552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0022040 con 0x55fccccff1b0 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 msgr2=0x55fccd0da750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f96c000ba20 tx=0x7f96c0004680 comp rx=0 tx=0).stop 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 shutdown_connections 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd07390 0x55fccd0dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcccd28070 0x55fccd0d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 --2- 172.21.15.6:0/1501527552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccccff1b0 0x55fccd0da750 secure :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f96c000ba20 tx=0x7f96c0004680 comp rx=0 tx=0).stop 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 >> 172.21.15.6:0/1501527552 conn(0x55fcccd1c460 msgr2=0x55fccd0d9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.995+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 shutdown_connections 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.996+0000 7f96dc673740 1 -- 172.21.15.6:0/1501527552 wait complete. 2024-09-21T08:05:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.996+0000 7f96dc673740 1 -- start start 2024-09-21T08:05:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.997+0000 7f96dc673740 1 Processor -- start 2024-09-21T08:05:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0dee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0df340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01ad980 con 0x55fcccd07390 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01aedf0 con 0x55fccccbbda0 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96d01ae050 con 0x55fcccd28070 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96dc673740 10 client.0 _ll_register_callbacks cb 0x7f96c8009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96cffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96cffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:48092/0 (socket says 172.21.15.6:48092) 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96cffff640 1 -- 172.21.15.6:0/2534132872 learned_addr learned my addr 172.21.15.6:0/2534132872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:05:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.998+0000 7f96ceffd640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 -- 172.21.15.6:0/2534132872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 msgr2=0x55fccd0df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 -- 172.21.15.6:0/2534132872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 msgr2=0x55fccd0dee00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0dee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 -- 172.21.15.6:0/2534132872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fccd167860 con 0x55fccccbbda0 2024-09-21T08:05:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96ceffd640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:05:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96cffff640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c801d040 tx=0x7f96c800eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fdd01010d66d3be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:05:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:05:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:39.999+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c800e9a0 con 0x55fccccbbda0 2024-09-21T08:05:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.000+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f96c8017040 con 0x55fccccbbda0 2024-09-21T08:05:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.000+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c001e8e0 con 0x55fccccbbda0 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.000+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f96c801f020 con 0x55fccccbbda0 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.000+0000 7f96dc673740 10 client.25877 fetch_fsmap learned FSMap version 21 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.000+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fccd168af0 con 0x55fccccbbda0 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.001+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96c8003e00 con 0x55fccccbbda0 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f96c8019040 con 0x55fccccbbda0 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 10 client.25877 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 10 client.25877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 20 client.25877 populate_metadata read hostname 'smithi006' 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fccd1692a0 0x55fccd16b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:05:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 4 client.25877 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:05:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f96c001e8e0 con 0x55fccd1692a0 2024-09-21T08:05:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fccd1692a0 0x55fccd16b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96cf7fe640 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fccd1692a0 0x55fccd16b6c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad3710113f3e31c server_cookie=99ba94bb6a0d59ee in_seq=0 out_seq=0 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.002+0000 7f96aeffd640 10 client.25877 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96aeffd640 1 -- 172.21.15.6:0/2534132872 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x7f96c001e8e0 con 0x55fccd1692a0 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96aeffd640 10 client.25877 handle_command_reply: tid=0 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 client.25877 shutdown 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 msgr2=0x55fccd0df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c801d040 tx=0x7f96c800eed0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 shutdown_connections 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fccd1692a0 0x55fccd16b6c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fcccd28070 0x55fccd0df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96aeffd640 0 client.25877 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:05:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fccccbbda0 0x55fccd0df880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 --2- 172.21.15.6:0/2534132872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcccd07390 0x55fccd0dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.003+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 >> 172.21.15.6:0/2534132872 conn(0x55fcccd1c460 msgr2=0x55fccd0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.004+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 shutdown_connections 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.004+0000 7f96dc673740 1 -- 172.21.15.6:0/2534132872 wait complete. 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.004+0000 7f96dc673740 20 client.25877 trim_cache size 0 max 16384 2024-09-21T08:05:40.006 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "487ed3a7-1faa-4b71-b846-b5d47fdc1652", 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.007 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.010 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:05:40.011 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 msgr2=0x7f96b80c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 0x7f96b80c14d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96d01041a0 tx=0x7f96c0005f30 comp rx=0 tx=0).stop 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 msgr2=0x7f96d0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 0x7f96d0102c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f96d006aaa0 tx=0x7f96c4030ce0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 shutdown_connections 2024-09-21T08:05:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96b80befc0 0x7f96b80c14d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96d010ddf0 0x7f96d01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96d0105270 0x7f96d0102c90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 --2- 172.21.15.6:0/1031624027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d0104840 0x7f96d0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 >> 172.21.15.6:0/1031624027 conn(0x7f96d0079730 msgr2=0x7f96d0100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 shutdown_connections 2024-09-21T08:05:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:05:40.006+0000 7f96d60ff640 1 -- 172.21.15.6:0/1031624027 wait complete. 2024-09-21T08:05:40.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:40 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:40 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:40.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:40 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:05:40.949 INFO:tasks.cephfs.filesystem:scrub status for tag:487ed3a7-1faa-4b71-b846-b5d47fdc1652 - {'path': '/', 'tag': '487ed3a7-1faa-4b71-b846-b5d47fdc1652', 'options': 'recursive,force'} 2024-09-21T08:05:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:41 smithi006 ceph-mon[30970]: pgmap v482: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-21T08:05:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:41 smithi119 ceph-mon[33564]: pgmap v482: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-21T08:05:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:41 smithi145 ceph-mon[34049]: pgmap v482: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2024-09-21T08:05:42.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:42 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:05:42.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:42 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:05:42.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:42 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:05:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 165.0 s, 958.2 tps, lat 104.354 ms stddev 35.346 2024-09-21T08:05:43.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:43 smithi006 ceph-mon[30970]: pgmap v483: 129 pgs: 129 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T08:05:43.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:43 smithi119 ceph-mon[33564]: pgmap v483: 129 pgs: 129 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T08:05:43.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:43 smithi145 ceph-mon[34049]: pgmap v483: 129 pgs: 129 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T08:05:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:45 smithi119 ceph-mon[33564]: pgmap v484: 129 pgs: 129 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:45 smithi145 ceph-mon[34049]: pgmap v484: 129 pgs: 129 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:45.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:45 smithi006 ceph-mon[30970]: pgmap v484: 129 pgs: 129 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 1.04k op/s 2024-09-21T08:05:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:47 smithi119 ceph-mon[33564]: pgmap v485: 129 pgs: 129 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 994 op/s 2024-09-21T08:05:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:47 smithi145 ceph-mon[34049]: pgmap v485: 129 pgs: 129 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 994 op/s 2024-09-21T08:05:47.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:47 smithi006 ceph-mon[30970]: pgmap v485: 129 pgs: 129 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 994 op/s 2024-09-21T08:05:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 170.0 s, 880.4 tps, lat 114.104 ms stddev 40.357 2024-09-21T08:05:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:49 smithi119 ceph-mon[33564]: pgmap v486: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:49 smithi145 ceph-mon[34049]: pgmap v486: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:49.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:49 smithi006 ceph-mon[30970]: pgmap v486: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:50.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:50 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:05:50.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:50 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:05:50.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:50 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:05:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:51 smithi119 ceph-mon[33564]: pgmap v487: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:05:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:05:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:05:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:51 smithi145 ceph-mon[34049]: pgmap v487: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:05:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:05:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:05:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:51 smithi006 ceph-mon[30970]: pgmap v487: 129 pgs: 129 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.5 MiB/s wr, 1.01k op/s 2024-09-21T08:05:51.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:05:51.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:05:51.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:05:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 175.0 s, 865.2 tps, lat 114.798 ms stddev 42.907 2024-09-21T08:05:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:53 smithi119 ceph-mon[33564]: pgmap v488: 129 pgs: 129 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.8 MiB/s wr, 1.04k op/s 2024-09-21T08:05:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:53 smithi145 ceph-mon[34049]: pgmap v488: 129 pgs: 129 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.8 MiB/s wr, 1.04k op/s 2024-09-21T08:05:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:53 smithi006 ceph-mon[30970]: pgmap v488: 129 pgs: 129 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.8 MiB/s wr, 1.04k op/s 2024-09-21T08:05:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:55 smithi119 ceph-mon[33564]: pgmap v489: 129 pgs: 129 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 945 op/s 2024-09-21T08:05:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:55 smithi145 ceph-mon[34049]: pgmap v489: 129 pgs: 129 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 945 op/s 2024-09-21T08:05:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:55 smithi006 ceph-mon[30970]: pgmap v489: 129 pgs: 129 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.9 MiB/s wr, 945 op/s 2024-09-21T08:05:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:57 smithi119 ceph-mon[33564]: pgmap v490: 129 pgs: 129 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.9 MiB/s wr, 929 op/s 2024-09-21T08:05:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:57 smithi145 ceph-mon[34049]: pgmap v490: 129 pgs: 129 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.9 MiB/s wr, 929 op/s 2024-09-21T08:05:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:57 smithi006 ceph-mon[30970]: pgmap v490: 129 pgs: 129 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.9 MiB/s wr, 929 op/s 2024-09-21T08:05:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 180.0 s, 891.0 tps, lat 112.228 ms stddev 44.119 2024-09-21T08:05:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:05:59 smithi119 ceph-mon[33564]: pgmap v491: 129 pgs: 129 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.3 MiB/s wr, 973 op/s 2024-09-21T08:05:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:05:59 smithi145 ceph-mon[34049]: pgmap v491: 129 pgs: 129 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.3 MiB/s wr, 973 op/s 2024-09-21T08:05:59.463 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:05:59 smithi006 ceph-mon[30970]: pgmap v491: 129 pgs: 129 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.3 MiB/s wr, 973 op/s 2024-09-21T08:06:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:01 smithi119 ceph-mon[33564]: pgmap v492: 129 pgs: 129 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.6 MiB/s wr, 997 op/s 2024-09-21T08:06:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:01 smithi145 ceph-mon[34049]: pgmap v492: 129 pgs: 129 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.6 MiB/s wr, 997 op/s 2024-09-21T08:06:01.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:01 smithi006 ceph-mon[30970]: pgmap v492: 129 pgs: 129 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.6 MiB/s wr, 997 op/s 2024-09-21T08:06:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 185.0 s, 892.6 tps, lat 109.653 ms stddev 60.111 2024-09-21T08:06:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:03 smithi119 ceph-mon[33564]: pgmap v493: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.8 MiB/s wr, 1.02k op/s 2024-09-21T08:06:03.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:03 smithi145 ceph-mon[34049]: pgmap v493: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.8 MiB/s wr, 1.02k op/s 2024-09-21T08:06:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:03 smithi006 ceph-mon[30970]: pgmap v493: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.8 MiB/s wr, 1.02k op/s 2024-09-21T08:06:04.455 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T08:06:04.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:04.919 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:05 smithi119 ceph-mon[33564]: pgmap v494: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.3 MiB/s wr, 984 op/s 2024-09-21T08:06:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:05 smithi145 ceph-mon[34049]: pgmap v494: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.3 MiB/s wr, 984 op/s 2024-09-21T08:06:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:05 smithi006 ceph-mon[30970]: pgmap v494: 129 pgs: 129 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.3 MiB/s wr, 984 op/s 2024-09-21T08:06:07.353 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:06:07.353 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:06:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.869+0000 7fe48ce1f640 1 -- 172.21.15.6:0/2494862738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 msgr2=0x7fe488102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.869+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/2494862738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe488102c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe478009860 tx=0x7fe47802a340 comp rx=0 tx=0).stop 2024-09-21T08:06:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 -- 172.21.15.6:0/2494862738 shutdown_connections 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/2494862738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488107c30 0x7fe4881080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/2494862738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488103170 0x7fe4881076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/2494862738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe488102c30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 -- 172.21.15.6:0/2494862738 >> 172.21.15.6:0/2494862738 conn(0x7fe488079790 msgr2=0x7fe488079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 -- 172.21.15.6:0/2494862738 shutdown_connections 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.870+0000 7fe48ce1f640 1 -- 172.21.15.6:0/2494862738 wait complete. 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.871+0000 7fe48ce1f640 1 Processor -- start 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.872+0000 7fe48ce1f640 1 -- start start 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.872+0000 7fe48ce1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.872+0000 7fe48ce1f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48ce1f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488107c30 0x7fe4881a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe485d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe485d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48790/0 (socket says 172.21.15.6:48790) 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43766/0 (socket says 172.21.15.6:43766) 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe485d9b640 1 -- 172.21.15.6:0/3055481716 learned_addr learned my addr 172.21.15.6:0/3055481716 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe488119f60 con 0x7fe488107c30 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe488119de0 con 0x7fe488102820 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.873+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe48811a0e0 con 0x7fe488103170 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe486d9d640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488107c30 0x7fe4881a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 -- 172.21.15.6:0/3055481716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 msgr2=0x7fe4881a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 -- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488107c30 msgr2=0x7fe4881a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488107c30 0x7fe4881a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4881a6940 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe48659c640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe485d9b640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00d950 tx=0x7fe47c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.874+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c017070 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.875+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe47c009c30 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.875+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c003c50 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.875+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4881a6c30 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.876+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4881ad390 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.878+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48806bed0 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.881+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe47c003df0 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.883+0000 7fe4777fe640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 0x7fe4700b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.883+0000 7fe48659c640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 0x7fe4700b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.883+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe47c0e7530 con 0x7fe488103170 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.884+0000 7fe48659c640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 0x7fe4700b8c90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe478009830 tx=0x7fe478000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:06.888+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe47c020030 con 0x7fe488103170 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.326+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4881ad5c0 con 0x7fe488103170 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.327+0000 7fe4777fe640 1 -- 172.21.15.6:0/3055481716 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fe47c0ad6a0 con 0x7fe488103170 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 msgr2=0x7fe4700b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 0x7fe4700b8c90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe478009830 tx=0x7fe478000bc0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 msgr2=0x7fe4881a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00d950 tx=0x7fe47c00de10 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 shutdown_connections 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe4700b6780 0x7fe4700b8c90 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe478009830 tx=0x7fe478000bc0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488103170 0x7fe4881a0f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe488107c30 0x7fe4881a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 --2- 172.21.15.6:0/3055481716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488102820 0x7fe4881a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 >> 172.21.15.6:0/3055481716 conn(0x7fe488079790 msgr2=0x7fe488105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 shutdown_connections 2024-09-21T08:06:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:07.331+0000 7fe48ce1f640 1 -- 172.21.15.6:0/3055481716 wait complete. 2024-09-21T08:06:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:07 smithi119 ceph-mon[33564]: pgmap v495: 129 pgs: 129 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.3 MiB/s wr, 961 op/s 2024-09-21T08:06:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:07 smithi145 ceph-mon[34049]: pgmap v495: 129 pgs: 129 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.3 MiB/s wr, 961 op/s 2024-09-21T08:06:07.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:07 smithi006 ceph-mon[30970]: pgmap v495: 129 pgs: 129 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.3 MiB/s wr, 961 op/s 2024-09-21T08:06:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 190.0 s, 817.8 tps, lat 124.205 ms stddev 51.778 2024-09-21T08:06:08.171 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T08:06:08.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T08:06:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:08 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3055481716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:08 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3055481716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:08 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3055481716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.304+0000 7f8d60eea640 1 -- 172.21.15.6:0/1371565159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 msgr2=0x7f8d5c107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.304+0000 7f8d60eea640 1 --2- 172.21.15.6:0/1371565159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c107d90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005fd0 tx=0x7f8d4c02eac0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 -- 172.21.15.6:0/1371565159 shutdown_connections 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 --2- 172.21.15.6:0/1371565159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 0x7f8d5c10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 --2- 172.21.15.6:0/1371565159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c107d90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 --2- 172.21.15.6:0/1371565159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 0x7f8d5c102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 -- 172.21.15.6:0/1371565159 >> 172.21.15.6:0/1371565159 conn(0x7f8d5c079be0 msgr2=0x7f8d5c07a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 -- 172.21.15.6:0/1371565159 shutdown_connections 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.305+0000 7f8d60eea640 1 -- 172.21.15.6:0/1371565159 wait complete. 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.306+0000 7f8d60eea640 1 Processor -- start 2024-09-21T08:06:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.306+0000 7f8d60eea640 1 -- start start 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 0x7f8d5c118910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 0x7f8d5c1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c119e90 con 0x7f8d5c107980 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c119d10 con 0x7f8d5c102040 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d60eea640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c11a010 con 0x7f8d5c1082d0 2024-09-21T08:06:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40096/0 (socket says 172.21.15.6:40096) 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.307+0000 7f8d52ffd640 1 -- 172.21.15.6:0/165848187 learned_addr learned my addr 172.21.15.6:0/165848187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 0x7f8d5c118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d52ffd640 1 -- 172.21.15.6:0/165848187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 msgr2=0x7f8d5c1122e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 0x7f8d5c1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 0x7f8d5c1122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d52ffd640 1 -- 172.21.15.6:0/165848187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 msgr2=0x7f8d5c118910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 0x7f8d5c118910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.308+0000 7f8d52ffd640 1 -- 172.21.15.6:0/165848187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c117580 con 0x7f8d5c107980 2024-09-21T08:06:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.311+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c02efe0 tx=0x7f8d4c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.312+0000 7f8d597fa640 1 -- 172.21.15.6:0/165848187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c030820 con 0x7f8d5c107980 2024-09-21T08:06:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.313+0000 7f8d597fa640 1 -- 172.21.15.6:0/165848187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d4c012290 con 0x7f8d5c107980 2024-09-21T08:06:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.313+0000 7f8d597fa640 1 -- 172.21.15.6:0/165848187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c042660 con 0x7f8d5c107980 2024-09-21T08:06:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.314+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c117810 con 0x7f8d5c107980 2024-09-21T08:06:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.314+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c117cf0 con 0x7f8d5c107980 2024-09-21T08:06:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.319+0000 7f8d686c0740 1 Processor -- start 2024-09-21T08:06:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.319+0000 7f8d686c0740 1 -- start start 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4da7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5576e4d1db90 con 0x5576e49d7980 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5576e4d0cfc0 con 0x5576e49dfb60 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.320+0000 7f8d686c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5576e4d10dd0 con 0x5576e4a00840 2024-09-21T08:06:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.321+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.321+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48816/0 (socket says 172.21.15.6:48816) 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.321+0000 7f8d5bfff640 1 -- 172.21.15.6:0/3331651905 learned_addr learned my addr 172.21.15.6:0/3331651905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.322+0000 7f8d5bfff640 1 -- 172.21.15.6:0/3331651905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 msgr2=0x5576e4da8240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.322+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da8240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.322+0000 7f8d5bfff640 1 -- 172.21.15.6:0/3331651905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 msgr2=0x5576e4da7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.322+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4da7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.322+0000 7f8d5bfff640 1 -- 172.21.15.6:0/3331651905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e4c94060 con 0x5576e4a00840 2024-09-21T08:06:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.321+0000 7f8d597fa640 1 -- 172.21.15.6:0/165848187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8d4c004280 con 0x7f8d5c107980 2024-09-21T08:06:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.323+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a840 tx=0x7f8d5400ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5686bd4af5d17808 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.323+0000 7f8d51ffb640 1 -- 172.21.15.6:0/3331651905 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54015070 con 0x5576e4a00840 2024-09-21T08:06:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.323+0000 7f8d51ffb640 1 -- 172.21.15.6:0/3331651905 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d540113f0 con 0x5576e4a00840 2024-09-21T08:06:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.323+0000 7f8d51ffb640 1 -- 172.21.15.6:0/3331651905 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d540185c0 con 0x5576e4a00840 2024-09-21T08:06:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.324+0000 7f8d597fa640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 0x7f8d480b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.324+0000 7f8d597fa640 1 -- 172.21.15.6:0/165848187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8d4c108230 con 0x7f8d5c107980 2024-09-21T08:06:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.325+0000 7f8d686c0740 1 -- 172.21.15.6:0/3331651905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 msgr2=0x5576e4da77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.325+0000 7f8d686c0740 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a840 tx=0x7f8d5400ad00 comp rx=0 tx=0).stop 2024-09-21T08:06:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.325+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 0x7f8d480b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d686c0740 1 -- 172.21.15.6:0/3331651905 shutdown_connections 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d686c0740 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d686c0740 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4da7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d686c0740 1 --2- 172.21.15.6:0/3331651905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4da77c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d686c0740 1 -- 172.21.15.6:0/3331651905 >> 172.21.15.6:0/3331651905 conn(0x5576e49f4990 msgr2=0x5576e4da56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.326+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 0x7f8d480b8d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5576e4da6440 tx=0x7f8d44008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.327+0000 7f8d686c0740 1 -- 172.21.15.6:0/3331651905 shutdown_connections 2024-09-21T08:06:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.327+0000 7f8d686c0740 1 -- 172.21.15.6:0/3331651905 wait complete. 2024-09-21T08:06:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.328+0000 7f8d686c0740 1 -- start start 2024-09-21T08:06:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.328+0000 7f8d686c0740 1 Processor -- start 2024-09-21T08:06:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.329+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 0x5576e4db33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.329+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49dfb60 0x5576e4db3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.329+0000 7f8d5b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 0x5576e4db33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.329+0000 7f8d5b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 0x5576e4db33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43790/0 (socket says 172.21.15.6:43790) 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.329+0000 7f8d5b7fe640 1 -- 172.21.15.6:0/1782377026 learned_addr learned my addr 172.21.15.6:0/1782377026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4dbf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49dfb60 0x5576e4db3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5576e4b6e7a0 con 0x5576e49dfb60 2024-09-21T08:06:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5576e4cb20a0 con 0x5576e49d7980 2024-09-21T08:06:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5576e4db5fa0 con 0x5576e4a00840 2024-09-21T08:06:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d686c0740 10 client.0 _ll_register_callbacks cb 0x5576e4c8f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.330+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4dbf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 -- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 msgr2=0x5576e4db33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 0x5576e4db33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 -- 172.21.15.6:0/1782377026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49dfb60 msgr2=0x5576e4db3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49dfb60 0x5576e4db3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e4ca0880 con 0x5576e4a00840 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4dbf2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a1f0 tx=0x7f8d540117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=853791c1f1a8bc45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d3affd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54029060 con 0x5576e4a00840 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d540113f0 con 0x5576e4a00840 2024-09-21T08:06:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.331+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8d5401a450 con 0x5576e4a00840 2024-09-21T08:06:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.332+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8d54030050 con 0x5576e4a00840 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.332+0000 7f8d686c0740 10 client.25975 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.332+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5576e4a7ab90 con 0x5576e4a00840 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.332+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d5400a430 con 0x5576e4a00840 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.332+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8d54024420 con 0x5576e4a00840 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 10 client.25975 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 10 client.25975 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 20 client.25975 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e49bf1c0 0x5576e4dc54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 4 client.25975 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e49bf1c0 0x5576e4dc54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.333+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8d540113f0 con 0x5576e49bf1c0 2024-09-21T08:06:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.334+0000 7f8d3affd640 10 client.25975 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.334+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e49bf1c0 0x5576e4dc54f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40573ec53e84db6 server_cookie=93c9f1ca8f1ce72c in_seq=0 out_seq=0 2024-09-21T08:06:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d3affd640 1 -- 172.21.15.6:0/1782377026 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8d540113f0 con 0x5576e49bf1c0 2024-09-21T08:06:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d3affd640 10 client.25975 handle_command_reply: tid=0 2024-09-21T08:06:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 client.25975 shutdown 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 msgr2=0x5576e4dbf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4dbf2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a1f0 tx=0x7f8d540117d0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 shutdown_connections 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e49bf1c0 0x5576e4dc54f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e4a00840 0x5576e4dbf2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49dfb60 0x5576e4db3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1782377026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49d7980 0x5576e4db33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.335+0000 7f8d3affd640 0 client.25975 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.336+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 >> 172.21.15.6:0/1782377026 conn(0x5576e49f4990 msgr2=0x5576e4daa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.336+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 shutdown_connections 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.336+0000 7f8d686c0740 1 -- 172.21.15.6:0/1782377026 wait complete. 2024-09-21T08:06:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.337+0000 7f8d686c0740 20 client.25975 trim_cache size 0 max 16384 2024-09-21T08:06:09.377 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:09 smithi006 ceph-mon[30970]: pgmap v496: 129 pgs: 129 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.8 MiB/s wr, 922 op/s 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.374+0000 7f8d686c0740 1 Processor -- start 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.374+0000 7f8d686c0740 1 -- start start 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49bf1c0 0x5576e4daafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1bdb50 con 0x5576e49d7980 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1c03d0 con 0x5576e49dfb60 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d686c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1be1c0 con 0x5576e49bf1c0 2024-09-21T08:06:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40120/0 (socket says 172.21.15.6:40120) 2024-09-21T08:06:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.375+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1534415423 learned_addr learned my addr 172.21.15.6:0/1534415423 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d5bfff640 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49bf1c0 0x5576e4daafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1534415423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49bf1c0 msgr2=0x5576e4daafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49bf1c0 0x5576e4daafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1534415423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 msgr2=0x5576e4da7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.376+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1534415423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e4db4490 con 0x5576e49d7980 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.377+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0cdc30 tx=0x7f8d4c0f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2539510d170bbe3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.378+0000 7f8d517fa640 1 -- 172.21.15.6:0/1534415423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0cd410 con 0x5576e49d7980 2024-09-21T08:06:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.378+0000 7f8d517fa640 1 -- 172.21.15.6:0/1534415423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d4c0cd7b0 con 0x5576e49d7980 2024-09-21T08:06:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.378+0000 7f8d517fa640 1 -- 172.21.15.6:0/1534415423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0c9410 con 0x5576e49d7980 2024-09-21T08:06:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.379+0000 7f8d686c0740 1 -- 172.21.15.6:0/1534415423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 msgr2=0x5576e4dae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.379+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0cdc30 tx=0x7f8d4c0f1040 comp rx=0 tx=0).stop 2024-09-21T08:06:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.381+0000 7f8d686c0740 1 -- 172.21.15.6:0/1534415423 shutdown_connections 2024-09-21T08:06:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.381+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4da7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.381+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49d7980 0x5576e4dae8f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.381+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1534415423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49bf1c0 0x5576e4daafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.381+0000 7f8d686c0740 1 -- 172.21.15.6:0/1534415423 >> 172.21.15.6:0/1534415423 conn(0x5576e49f4990 msgr2=0x5576e4daa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.382+0000 7f8d686c0740 1 -- 172.21.15.6:0/1534415423 shutdown_connections 2024-09-21T08:06:09.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.382+0000 7f8d686c0740 1 -- 172.21.15.6:0/1534415423 wait complete. 2024-09-21T08:06:09.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.383+0000 7f8d686c0740 1 -- start start 2024-09-21T08:06:09.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.384+0000 7f8d686c0740 1 Processor -- start 2024-09-21T08:06:09.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.384+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49bf1c0 0x5576e4e2b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.384+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 0x5576e4e29e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.384+0000 7f8d686c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4e2a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d686c0740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1be890 con 0x5576e49bf1c0 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4e2a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d5bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4e2a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43804/0 (socket says 172.21.15.6:43804) 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d5bfff640 1 -- 172.21.15.6:0/1739734996 learned_addr learned my addr 172.21.15.6:0/1739734996 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 0x5576e4e29e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1bfd00 con 0x5576e49dfb60 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1bef60 con 0x5576e49d7980 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.385+0000 7f8d686c0740 10 client.0 _ll_register_callbacks cb 0x7f8d5400a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.386+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49bf1c0 0x5576e4e2b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.386+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 msgr2=0x5576e4e2a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.386+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4e2a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.386+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1739734996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49bf1c0 msgr2=0x5576e4e2b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.386+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49bf1c0 0x5576e4e2b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.387+0000 7f8d52ffd640 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e4e2aa40 con 0x5576e49d7980 2024-09-21T08:06:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.387+0000 7f8d52ffd640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 0x5576e4e29e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5576e4c935f0 tx=0x7f8d4c0f12e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da47c6f3d391ceec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.387+0000 7f8d3affd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.387+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c105a30 con 0x5576e49d7980 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.387+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f8d4c0f51c0 con 0x5576e49d7980 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.388+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d4c0cd7b0 con 0x5576e49d7980 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.388+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8d4c0cd410 con 0x5576e49d7980 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.388+0000 7f8d686c0740 10 client.25978 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.388+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5576e4dc83a0 con 0x5576e49d7980 2024-09-21T08:06:09.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d4c0e3e50 con 0x5576e49d7980 2024-09-21T08:06:09.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8d4c04a020 con 0x5576e49d7980 2024-09-21T08:06:09.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 10 client.25978 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:09.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 10 client.25978 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:09.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 20 client.25978 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e4a00840 0x5576e4dc8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 4 client.25978 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x7f8d4c0cd7b0 con 0x5576e4a00840 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.391+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e4a00840 0x5576e4dc8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.392+0000 7f8d5b7fe640 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e4a00840 0x5576e4dc8820 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b76c6b53804aeca server_cookie=b791bc3ba375e6d5 in_seq=0 out_seq=0 2024-09-21T08:06:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.392+0000 7f8d3affd640 10 client.25978 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:09 smithi119 ceph-mon[33564]: pgmap v496: 129 pgs: 129 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.8 MiB/s wr, 922 op/s 2024-09-21T08:06:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:09 smithi145 ceph-mon[34049]: pgmap v496: 129 pgs: 129 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.8 MiB/s wr, 922 op/s 2024-09-21T08:06:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.721+0000 7f8d3affd640 1 -- 172.21.15.6:0/1739734996 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f8d4c0cd7b0 con 0x5576e4a00840 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.721+0000 7f8d3affd640 10 client.25978 handle_command_reply: tid=0 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.721+0000 7f8d686c0740 1 client.25978 shutdown 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 msgr2=0x5576e4e29e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 0x5576e4e29e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5576e4c935f0 tx=0x7f8d4c0f12e0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 shutdown_connections 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5576e4a00840 0x5576e4dc8820 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5576e49d7980 0x5576e4e29e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d3affd640 0 client.25978 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5576e49dfb60 0x5576e4e2a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 --2- 172.21.15.6:0/1739734996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576e49bf1c0 0x5576e4e2b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 >> 172.21.15.6:0/1739734996 conn(0x5576e49f4990 msgr2=0x5576e4db1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 shutdown_connections 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 1 -- 172.21.15.6:0/1739734996 wait complete. 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.722+0000 7f8d686c0740 20 client.25978 trim_cache size 0 max 16384 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 18, 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "47e2cde7": { 2024-09-21T08:06:09.726 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 18, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 130.0, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:09.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 msgr2=0x7f8d480b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 0x7f8d480b8d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5576e4da6440 tx=0x7f8d44008040 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 msgr2=0x7f8d5c111be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c02efe0 tx=0x7f8d4c003f10 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 shutdown_connections 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8d480b6840 0x7f8d480b8d50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d5c1082d0 0x7f8d5c1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d5c107980 0x7f8d5c111be0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 --2- 172.21.15.6:0/165848187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d5c102040 0x7f8d5c118910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 >> 172.21.15.6:0/165848187 conn(0x7f8d5c079be0 msgr2=0x7f8d5c105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 shutdown_connections 2024-09-21T08:06:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:09.723+0000 7f8d60eea640 1 -- 172.21.15.6:0/165848187 wait complete. 2024-09-21T08:06:10.750 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '47e2cde7', quiesce took 6.3 seconds. Will release after: 3.7 2024-09-21T08:06:10.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:06:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:11.609 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:11 smithi006 ceph-mon[30970]: pgmap v497: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 951 op/s 2024-09-21T08:06:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:11 smithi119 ceph-mon[33564]: pgmap v497: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 951 op/s 2024-09-21T08:06:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:11 smithi145 ceph-mon[34049]: pgmap v497: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 951 op/s 2024-09-21T08:06:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 -- 172.21.15.6:0/2361440504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0241083b0 msgr2=0x7fe0241087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 --2- 172.21.15.6:0/2361440504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0241083b0 0x7fe0241087c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe018009900 tx=0x7fe01802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 -- 172.21.15.6:0/2361440504 shutdown_connections 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 --2- 172.21.15.6:0/2361440504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 --2- 172.21.15.6:0/2361440504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0241083b0 0x7fe0241087c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.701+0000 7fe0297d4640 1 --2- 172.21.15.6:0/2361440504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe024102a70 0x7fe024102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.702+0000 7fe0297d4640 1 -- 172.21.15.6:0/2361440504 >> 172.21.15.6:0/2361440504 conn(0x7fe024079710 msgr2=0x7fe024079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.702+0000 7fe0297d4640 1 -- 172.21.15.6:0/2361440504 shutdown_connections 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.702+0000 7fe0297d4640 1 -- 172.21.15.6:0/2361440504 wait complete. 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.702+0000 7fe0297d4640 1 Processor -- start 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.702+0000 7fe0297d4640 1 -- start start 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0241083b0 0x7fe02419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe024113960 con 0x7fe024102a70 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241137e0 con 0x7fe0241083b0 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0297d4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe024113ae0 con 0x7fe024108d00 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40138/0 (socket says 172.21.15.6:40138) 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 -- 172.21.15.6:0/3345056056 learned_addr learned my addr 172.21.15.6:0/3345056056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0227fc640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0241083b0 0x7fe02419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 -- 172.21.15.6:0/3345056056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 msgr2=0x7fe02419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 -- 172.21.15.6:0/3345056056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0241083b0 msgr2=0x7fe02419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0241083b0 0x7fe02419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe022ffd640 1 -- 172.21.15.6:0/3345056056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0241a0300 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.703+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d950 tx=0x7fe01400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe00bfff640 1 -- 172.21.15.6:0/3345056056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014017070 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe00bfff640 1 -- 172.21.15.6:0/3345056056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe014009c30 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0241a05f0 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe00bfff640 1 -- 172.21.15.6:0/3345056056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01400f620 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.704+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0241a6e10 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.706+0000 7fe00bfff640 1 -- 172.21.15.6:0/3345056056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe014010460 con 0x7fe024102a70 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 Processor -- start 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 -- start start 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091cdea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdeacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56091cd60e50 con 0x56091ca1a1b0 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56091cd50280 con 0x56091ca43070 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe02fd48740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56091cd54090 con 0x56091ca22390 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40154/0 (socket says 172.21.15.6:40154) 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe022ffd640 1 -- 172.21.15.6:0/567213986 learned_addr learned my addr 172.21.15.6:0/567213986 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe0227fc640 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdeacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.707+0000 7fe0237fe640 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091cdea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe00bfff640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 0x7fe00c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 -- 172.21.15.6:0/567213986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 msgr2=0x56091cdeacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdeacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 -- 172.21.15.6:0/567213986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 msgr2=0x56091cdea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091cdea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 -- 172.21.15.6:0/567213986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091caae650 con 0x56091ca1a1b0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 0x7fe00c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe00bfff640 1 -- 172.21.15.6:0/3345056056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe0140e7650 con 0x7fe024102a70 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe022ffd640 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e4990 tx=0x7fe01407a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305a31cda18f42cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe0097fa640 1 -- 172.21.15.6:0/567213986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014020070 con 0x56091ca1a1b0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 0x7fe00c0b8c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0113e0 tx=0x7fe01c004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe0097fa640 1 -- 172.21.15.6:0/567213986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0140acc30 con 0x56091ca1a1b0 2024-09-21T08:06:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.708+0000 7fe0097fa640 1 -- 172.21.15.6:0/567213986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01407a900 con 0x56091ca1a1b0 2024-09-21T08:06:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 -- 172.21.15.6:0/567213986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 msgr2=0x56091cdea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e4990 tx=0x7fe01407a400 comp rx=0 tx=0).stop 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 -- 172.21.15.6:0/567213986 shutdown_connections 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdeacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdea7b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 --2- 172.21.15.6:0/567213986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091cdea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 -- 172.21.15.6:0/567213986 >> 172.21.15.6:0/567213986 conn(0x56091ca37460 msgr2=0x56091cde8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 -- 172.21.15.6:0/567213986 shutdown_connections 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.709+0000 7fe02fd48740 1 -- 172.21.15.6:0/567213986 wait complete. 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 -- start start 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 Processor -- start 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdf5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56091cbb1700 con 0x56091ca1a1b0 2024-09-21T08:06:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56091cceb110 con 0x56091ca43070 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56091cdfcda0 con 0x56091ca22390 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe02fd48740 10 client.0 _ll_register_callbacks cb 0x56091cd04990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40164/0 (socket says 172.21.15.6:40164) 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe022ffd640 1 -- 172.21.15.6:0/239287951 learned_addr learned my addr 172.21.15.6:0/239287951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe0237fe640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.710+0000 7fe0227fc640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdf5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 -- 172.21.15.6:0/239287951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 msgr2=0x56091cdf5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdf5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 -- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 msgr2=0x56091ce060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 -- 172.21.15.6:0/239287951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091cd18c40 con 0x56091ca1a1b0 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe0237fe640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe022ffd640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e4ad0 tx=0x7fe0140e3d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204e1417cada79ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe006ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140e6030 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe0140a9390 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0140acc30 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe014020040 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe02fd48740 10 client.16227 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56091ce08ac0 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.711+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0140acc30 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe0140a8a70 con 0x56091ca1a1b0 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 10 client.16227 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 20 client.16227 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091ca019f0 0x56091ce0be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 4 client.16227 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56091cd62da0 con 0x56091ca019f0 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe0227fc640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091ca019f0 0x56091ce0be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe006ff5640 10 client.16227 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.712+0000 7fe0227fc640 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091ca019f0 0x56091ce0be20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b414c106ace2488 server_cookie=217849ae3a79fbed in_seq=0 out_seq=0 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe006ff5640 1 -- 172.21.15.6:0/239287951 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56091cd62da0 con 0x56091ca019f0 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe006ff5640 10 client.16227 handle_command_reply: tid=0 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 client.16227 shutdown 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 msgr2=0x56091cdf5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e4ad0 tx=0x7fe0140e3d90 comp rx=0 tx=0).stop 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 shutdown_connections 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091ca019f0 0x56091ce0be20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091cdf5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 --2- 172.21.15.6:0/239287951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cdf5940 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 >> 172.21.15.6:0/239287951 conn(0x56091ca37460 msgr2=0x56091cded400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.713+0000 7fe006ff5640 0 client.16227 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.714+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 shutdown_connections 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.714+0000 7fe02fd48740 1 -- 172.21.15.6:0/239287951 wait complete. 2024-09-21T08:06:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.714+0000 7fe02fd48740 20 client.16227 trim_cache size 0 max 16384 2024-09-21T08:06:11.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 Processor -- start 2024-09-21T08:06:11.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 -- start start 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 0x56091ce06030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 0x56091cdf2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241acb50 con 0x56091ca1a1b0 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241af3d0 con 0x56091ca22390 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe02fd48740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241ad1c0 con 0x56091ca43070 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40168/0 (socket says 172.21.15.6:40168) 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.731+0000 7fe022ffd640 1 -- 172.21.15.6:0/3295781193 learned_addr learned my addr 172.21.15.6:0/3295781193 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 0x56091cdf2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 -- 172.21.15.6:0/3295781193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 msgr2=0x56091cdf2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe0227fc640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 0x56091ce06030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 0x56091cdf2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 -- 172.21.15.6:0/3295781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 msgr2=0x56091ce06030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 0x56091ce06030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 -- 172.21.15.6:0/3295781193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091cde8ef0 con 0x56091ca1a1b0 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe0237fe640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 0x56091cdf2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe0227fc640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 0x56091ce06030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe022ffd640 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0140ace20 tx=0x7fe01400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c25f647502b9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe008ff9640 1 -- 172.21.15.6:0/3295781193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140e6070 con 0x56091ca1a1b0 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe008ff9640 1 -- 172.21.15.6:0/3295781193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0140b1c00 con 0x56091ca1a1b0 2024-09-21T08:06:11.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.732+0000 7fe008ff9640 1 -- 172.21.15.6:0/3295781193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140e7260 con 0x56091ca1a1b0 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- 172.21.15.6:0/3295781193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 msgr2=0x56091cde81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0140ace20 tx=0x7fe01400bf60 comp rx=0 tx=0).stop 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- 172.21.15.6:0/3295781193 shutdown_connections 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca43070 0x56091cdf2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca22390 0x56091ce06030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 --2- 172.21.15.6:0/3295781193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091cde81d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- 172.21.15.6:0/3295781193 >> 172.21.15.6:0/3295781193 conn(0x56091ca37460 msgr2=0x56091cde7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- 172.21.15.6:0/3295781193 shutdown_connections 2024-09-21T08:06:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- 172.21.15.6:0/3295781193 wait complete. 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 -- start start 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.733+0000 7fe02fd48740 1 Processor -- start 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091ce0c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce0cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241ad890 con 0x56091ca1a1b0 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241aed00 con 0x56091ca43070 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241adf60 con 0x56091ca22390 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe02fd48740 10 client.0 _ll_register_callbacks cb 0x7fe01c0075c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40170/0 (socket says 172.21.15.6:40170) 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 -- 172.21.15.6:0/2049300747 learned_addr learned my addr 172.21.15.6:0/2049300747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe0227fc640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091ce0c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe0237fe640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce0cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 -- 172.21.15.6:0/2049300747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 msgr2=0x56091ce0c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091ce0c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 -- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 msgr2=0x56091ce0cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce0cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 -- 172.21.15.6:0/2049300747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091ce0d300 con 0x56091ca1a1b0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe0237fe640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce0cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe022ffd640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0140a96a0 tx=0x7fe0140e7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448075bd8969b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.734+0000 7fe006ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140e6070 con 0x56091ca1a1b0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe0140c2fe0 con 0x56091ca1a1b0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56091cdf6230 con 0x56091ca1a1b0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0140aca70 con 0x56091ca1a1b0 2024-09-21T08:06:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 10 client.16233 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56091ce0d300 con 0x56091ca1a1b0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56091cdf6230 con 0x56091ca1a1b0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe014010750 con 0x56091ca1a1b0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 10 client.16233 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 20 client.16233 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091c9d6da0 0x56091ce78520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 4 client.16233 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.735+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56091cdf14f0 con 0x56091c9d6da0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe0227fc640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091c9d6da0 0x56091ce78520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe006ff5640 10 client.16233 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe0227fc640 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091c9d6da0 0x56091ce78520 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee44f021a6d254b9 server_cookie=55db47c3871d27ad in_seq=0 out_seq=0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe006ff5640 1 -- 172.21.15.6:0/2049300747 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56091cdf14f0 con 0x56091c9d6da0 2024-09-21T08:06:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe006ff5640 10 client.16233 handle_command_reply: tid=0 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 client.16233 shutdown 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 msgr2=0x56091ce0f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0140a96a0 tx=0x7fe0140e7490 comp rx=0 tx=0).stop 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 shutdown_connections 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56091c9d6da0 0x56091ce78520 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56091ca22390 0x56091ce0c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56091ca43070 0x56091ce0cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe006ff5640 0 client.16233 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 --2- 172.21.15.6:0/2049300747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56091ca1a1b0 0x56091ce0f3b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.736+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 >> 172.21.15.6:0/2049300747 conn(0x56091ca37460 msgr2=0x56091cdf7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 shutdown_connections 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe02fd48740 1 -- 172.21.15.6:0/2049300747 wait complete. 2024-09-21T08:06:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe02fd48740 20 client.16233 trim_cache size 0 max 16384 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:06:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 msgr2=0x7fe00c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 0x7fe00c0b8c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0113e0 tx=0x7fe01c004a40 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 msgr2=0x7fe02419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d950 tx=0x7fe01400de10 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 shutdown_connections 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe00c0b6730 0x7fe00c0b8c40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe024108d00 0x7fe02419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0241083b0 0x7fe02419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 --2- 172.21.15.6:0/3345056056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe024102a70 0x7fe02419a450 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 >> 172.21.15.6:0/3345056056 conn(0x7fe024079710 msgr2=0x7fe024104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 shutdown_connections 2024-09-21T08:06:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:11.737+0000 7fe0297d4640 1 -- 172.21.15.6:0/3345056056 wait complete. 2024-09-21T08:06:12.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 195.0 s, 287.4 tps, lat 142.477 ms stddev 48.935 2024-09-21T08:06:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:13 smithi119 ceph-mon[33564]: pgmap v498: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 850 op/s 2024-09-21T08:06:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:13 smithi145 ceph-mon[34049]: pgmap v498: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 850 op/s 2024-09-21T08:06:13.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:13 smithi006 ceph-mon[30970]: pgmap v498: 129 pgs: 129 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 850 op/s 2024-09-21T08:06:14.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:14.771 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:06:14.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:15.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/641234901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e681094a0 msgr2=0x7f4e681098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:15.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/641234901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e681094a0 0x7f4e681098b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009900 tx=0x7f4e5402a410 comp rx=0 tx=0).stop 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/641234901 shutdown_connections 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/641234901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68109df0 0x7f4e68110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/641234901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e681094a0 0x7f4e681098b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/641234901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e68103b60 0x7f4e68103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/641234901 >> 172.21.15.6:0/641234901 conn(0x7f4e6807b850 msgr2=0x7f4e6807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/641234901 shutdown_connections 2024-09-21T08:06:15.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.347+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/641234901 wait complete. 2024-09-21T08:06:15.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.348+0000 7f4e6ebbd640 1 Processor -- start 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.348+0000 7f4e6ebbd640 1 -- start start 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.348+0000 7f4e6ebbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.348+0000 7f4e6ebbd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e681094a0 0x7f4e6819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6ebbd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 0x7f4e6819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6ebbd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68113960 con 0x7f4e68109df0 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6ebbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4e681137e0 con 0x7f4e68103b60 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6ebbd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68113ae0 con 0x7f4e681094a0 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6d15a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 0x7f4e6819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:43874/0 (socket says 172.21.15.6:43874) 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 -- 172.21.15.6:0/3042451793 learned_addr learned my addr 172.21.15.6:0/3042451793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e67fff640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e681094a0 0x7f4e6819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 -- 172.21.15.6:0/3042451793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e681094a0 msgr2=0x7f4e6819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:15.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e681094a0 0x7f4e6819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 -- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 msgr2=0x7f4e6819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 0x7f4e6819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6c959640 1 -- 172.21.15.6:0/3042451793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e681a0280 con 0x7f4e68103b60 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.349+0000 7f4e6d15a640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 0x7f4e6819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e6c959640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c920 tx=0x7f4e5c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:15.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c007c70 con 0x7f4e68103b60 2024-09-21T08:06:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e5c007e10 con 0x7f4e68103b60 2024-09-21T08:06:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e681a0570 con 0x7f4e68103b60 2024-09-21T08:06:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c018710 con 0x7f4e68103b60 2024-09-21T08:06:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.350+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681a6d90 con 0x7f4e68103b60 2024-09-21T08:06:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.352+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68103f70 con 0x7f4e68103b60 2024-09-21T08:06:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.353+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4e5c00f450 con 0x7f4e68103b60 2024-09-21T08:06:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.354+0000 7f4e65ffb640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 0x7f4e580b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.354+0000 7f4e67fff640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 0x7f4e580b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.355+0000 7f4e67fff640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 0x7f4e580b8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e54005940 tx=0x7f4e540058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.357+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f4e5c00fa70 con 0x7f4e68103b60 2024-09-21T08:06:15.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.363+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e5c014030 con 0x7f4e68103b60 2024-09-21T08:06:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:15 smithi006 ceph-mon[30970]: pgmap v499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.9 MiB/s wr, 713 op/s 2024-09-21T08:06:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.598+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e6819b500 con 0x7f4e68103b60 2024-09-21T08:06:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.599+0000 7f4e65ffb640 1 -- 172.21.15.6:0/3042451793 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f4e5c0ae220 con 0x7f4e68103b60 2024-09-21T08:06:15.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:06:15.600 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:06:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 msgr2=0x7f4e580b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 0x7f4e580b8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e54005940 tx=0x7f4e540058d0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 msgr2=0x7f4e6819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c920 tx=0x7f4e5c00cde0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 shutdown_connections 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e580b66b0 0x7f4e580b8bc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e681094a0 0x7f4e6819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e68109df0 0x7f4e6819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 --2- 172.21.15.6:0/3042451793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e68103b60 0x7f4e6819a3d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:15.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.601+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 >> 172.21.15.6:0/3042451793 conn(0x7f4e6807b850 msgr2=0x7f4e681075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:15.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.602+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 shutdown_connections 2024-09-21T08:06:15.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:15.602+0000 7f4e6ebbd640 1 -- 172.21.15.6:0/3042451793 wait complete. 2024-09-21T08:06:15.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:15 smithi119 ceph-mon[33564]: pgmap v499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.9 MiB/s wr, 713 op/s 2024-09-21T08:06:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:15 smithi145 ceph-mon[34049]: pgmap v499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.9 MiB/s wr, 713 op/s 2024-09-21T08:06:16.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:16 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3042451793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:16.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:16 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3042451793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:16.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:16 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3042451793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:17.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 -- 172.21.15.6:0/3625022629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0109e20 msgr2=0x7f60e0110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/3625022629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0109e20 0x7f60e0110650 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009ca0 tx=0x7f60d802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 -- 172.21.15.6:0/3625022629 shutdown_connections 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/3625022629 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/3625022629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0109e20 0x7f60e0110650 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/3625022629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0103b90 0x7f60e0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 -- 172.21.15.6:0/3625022629 >> 172.21.15.6:0/3625022629 conn(0x7f60e00ff600 msgr2=0x7f60e0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 -- 172.21.15.6:0/3625022629 shutdown_connections 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.859+0000 7f60e5e5b640 1 -- 172.21.15.6:0/3625022629 wait complete. 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.860+0000 7f60e5e5b640 1 Processor -- start 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.860+0000 7f60e5e5b640 1 -- start start 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:17.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0109e20 0x7f60e019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01139e0 con 0x7f60e0103b90 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0113860 con 0x7f60e0109e20 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60e5e5b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0113b60 con 0x7f60e01094d0 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34884/0 (socket says 172.21.15.6:34884) 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 -- 172.21.15.6:0/511472324 learned_addr learned my addr 172.21.15.6:0/511472324 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60d6ffd640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60dffff640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0109e20 0x7f60e019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 -- 172.21.15.6:0/511472324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 msgr2=0x7f60e019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 -- 172.21.15.6:0/511472324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0109e20 msgr2=0x7f60e019fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0109e20 0x7f60e019fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 -- 172.21.15.6:0/511472324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e01a0300 con 0x7f60e0103b90 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60d6ffd640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60df7fe640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d950 tx=0x7f60d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.861+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0017070 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.862+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60d0009c30 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.862+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e01a05f0 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.862+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d000f620 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.862+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e01a6d50 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.863+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e0104e10 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.865+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f60d0005030 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.866+0000 7f60dd7fa640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 0x7f60cc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.866+0000 7f60d6ffd640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 0x7f60cc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.867+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f60d00e7700 con 0x7f60e0103b90 2024-09-21T08:06:17.300 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.867+0000 7f60d6ffd640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 0x7f60cc0b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f60e0102d00 tx=0x7f60c8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:16.870+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60d00ad8f0 con 0x7f60e0103b90 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.095+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60e0103fa0 con 0x7f60e0103b90 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.095+0000 7f60dd7fa640 1 -- 172.21.15.6:0/511472324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f60d0009de0 con 0x7f60e0103b90 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 msgr2=0x7f60cc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 0x7f60cc0b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f60e0102d00 tx=0x7f60c8005f90 comp rx=0 tx=0).stop 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 msgr2=0x7f60e019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d950 tx=0x7f60d000de10 comp rx=0 tx=0).stop 2024-09-21T08:06:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 shutdown_connections 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60cc0b6700 0x7f60cc0b8c10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60e01094d0 0x7f60e019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e0109e20 0x7f60e019fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 --2- 172.21.15.6:0/511472324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e0103b90 0x7f60e019a390 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 >> 172.21.15.6:0/511472324 conn(0x7f60e00ff600 msgr2=0x7f60e0108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 shutdown_connections 2024-09-21T08:06:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:17.098+0000 7f60e5e5b640 1 -- 172.21.15.6:0/511472324 wait complete. 2024-09-21T08:06:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 200.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:06:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:17 smithi119 ceph-mon[33564]: pgmap v500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-09-21T08:06:17.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:17 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/511472324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:17.659 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:17 smithi006 ceph-mon[30970]: pgmap v500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-09-21T08:06:17.659 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:17 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/511472324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:17 smithi145 ceph-mon[34049]: pgmap v500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-09-21T08:06:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:17 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/511472324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:18.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:06:18.543 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 47e2cde7 --release --await' 2024-09-21T08:06:18.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 47e2cde7 --release --await 2024-09-21T08:06:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.170+0000 7f36af13e640 1 -- 172.21.15.6:0/3461502259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a81083c0 msgr2=0x7f36a81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.170+0000 7f36af13e640 1 --2- 172.21.15.6:0/3461502259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a81083c0 0x7f36a81087d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3698009ca0 tx=0x7f369802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 -- 172.21.15.6:0/3461502259 shutdown_connections 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 --2- 172.21.15.6:0/3461502259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a8108d10 0x7f36a810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 --2- 172.21.15.6:0/3461502259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a81083c0 0x7f36a81087d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 --2- 172.21.15.6:0/3461502259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8102a80 0x7f36a8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 -- 172.21.15.6:0/3461502259 >> 172.21.15.6:0/3461502259 conn(0x7f36a8079740 msgr2=0x7f36a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 -- 172.21.15.6:0/3461502259 shutdown_connections 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 -- 172.21.15.6:0/3461502259 wait complete. 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.171+0000 7f36af13e640 1 Processor -- start 2024-09-21T08:06:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 -- start start 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a81083c0 0x7f36a8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 0x7f36a819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8112880 con 0x7f36a8102a80 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8112700 con 0x7f36a8108d10 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36af13e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8112a00 con 0x7f36a81083c0 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34912/0 (socket says 172.21.15.6:34912) 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 -- 172.21.15.6:0/2630906624 learned_addr learned my addr 172.21.15.6:0/2630906624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36a7fff640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a81083c0 0x7f36a8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 -- 172.21.15.6:0/2630906624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a81083c0 msgr2=0x7f36a8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a81083c0 0x7f36a8199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 0x7f36a819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 -- 172.21.15.6:0/2630906624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 msgr2=0x7f36a819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 0x7f36a819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36aceda640 1 -- 172.21.15.6:0/2630906624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a819f220 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.172+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 0x7f36a819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36aceda640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9f0 tx=0x7f369000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36a5ffb640 1 -- 172.21.15.6:0/2630906624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369000cd80 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a819f510 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36a5ffb640 1 -- 172.21.15.6:0/2630906624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36900108c0 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36a5ffb640 1 -- 172.21.15.6:0/2630906624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900187c0 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.173+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a81a5c70 con 0x7f36a8102a80 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 Processor -- start 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 -- start start 2024-09-21T08:06:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36a5ffb640 1 -- 172.21.15.6:0/2630906624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3690010430 con 0x7f36a8102a80 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c742524ea0 con 0x55c742207070 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c7425142d0 con 0x55c7421e6390 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36b56b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c7425180e0 con 0x55c7421de1b0 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36ad6db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36ad6db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34928/0 (socket says 172.21.15.6:34928) 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36ad6db640 1 -- 172.21.15.6:0/2457561453 learned_addr learned my addr 172.21.15.6:0/2457561453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36a7fff640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.176+0000 7f36aceda640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 -- 172.21.15.6:0/2457561453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 msgr2=0x55c7425ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 -- 172.21.15.6:0/2457561453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 msgr2=0x55c7425aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 -- 172.21.15.6:0/2457561453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c742272650 con 0x55c742207070 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36aceda640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009bb0 tx=0x7f36a0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d1e89e16b87ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36a5ffb640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 0x7f36940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f369effd640 1 -- 172.21.15.6:0/2457561453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004020 con 0x55c742207070 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36aceda640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 0x7f36940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f369effd640 1 -- 172.21.15.6:0/2457561453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36a00041c0 con 0x55c742207070 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f369effd640 1 -- 172.21.15.6:0/2457561453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0012470 con 0x55c742207070 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.177+0000 7f36a5ffb640 1 -- 172.21.15.6:0/2630906624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f36900e7f70 con 0x7f36a8102a80 2024-09-21T08:06:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 -- 172.21.15.6:0/2457561453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 msgr2=0x55c7425b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009bb0 tx=0x7f36a0010740 comp rx=0 tx=0).stop 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36aceda640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 0x7f36940b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f36900e53f0 tx=0x7f3690016c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 -- 172.21.15.6:0/2457561453 shutdown_connections 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2457561453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425b1100 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 -- 172.21.15.6:0/2457561453 >> 172.21.15.6:0/2457561453 conn(0x55c7421fb460 msgr2=0x55c7425ac590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 -- 172.21.15.6:0/2457561453 shutdown_connections 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.178+0000 7f36b56b2740 1 -- 172.21.15.6:0/2457561453 wait complete. 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 -- start start 2024-09-21T08:06:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 Processor -- start 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c742375700 con 0x55c7421e6390 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c7424af160 con 0x55c742207070 2024-09-21T08:06:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c7425c1200 con 0x55c7421de1b0 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36b56b2740 10 client.0 _ll_register_callbacks cb 0x55c7424c89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34944/0 (socket says 172.21.15.6:34944) 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36a7fff640 1 -- 172.21.15.6:0/373832186 learned_addr learned my addr 172.21.15.6:0/373832186 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36ad6db640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.179+0000 7f36ad6db640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 -- 172.21.15.6:0/373832186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 msgr2=0x55c7425be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 -- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 msgr2=0x55c7425ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 -- 172.21.15.6:0/373832186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7424dcc90 con 0x55c7421e6390 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36ad6db640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36a7fff640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f36a806b6c0 tx=0x7f36980093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aec2761a06ae599 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f3687fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698003970 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f3698003b10 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a00041c0 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3698003d10 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36b56b2740 10 client.16257 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.180+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7425cce60 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36a00041c0 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3698030750 con 0x55c7421e6390 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 10 client.16257 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 20 client.16257 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7421c59f0 0x55c7425d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 4 client.16257 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c742526df0 con 0x55c7421c59f0 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.181+0000 7f36ad6db640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7421c59f0 0x55c7425d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f36ad6db640 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7421c59f0 0x55c7425d03a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3565f15e9a23172 server_cookie=ba26b1a91c1be3a2 in_seq=0 out_seq=0 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f3687fff640 10 client.16257 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f3687fff640 1 -- 172.21.15.6:0/373832186 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c742526df0 con 0x55c7421c59f0 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f3687fff640 10 client.16257 handle_command_reply: tid=0 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f36b56b2740 1 client.16257 shutdown 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 msgr2=0x55c7425be890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.182+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f36a806b6c0 tx=0x7f36980093c0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 shutdown_connections 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c7421c59f0 0x55c7425d03a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be890 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f3687fff640 0 client.16257 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 --2- 172.21.15.6:0/373832186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 >> 172.21.15.6:0/373832186 conn(0x55c7421fb460 msgr2=0x55c7425b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 shutdown_connections 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 1 -- 172.21.15.6:0/373832186 wait complete. 2024-09-21T08:06:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.183+0000 7f36b56b2740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T08:06:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 Processor -- start 2024-09-21T08:06:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 -- start start 2024-09-21T08:06:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81acba0 con 0x55c7421e6390 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81af420 con 0x55c742207070 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36b56b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81ad210 con 0x55c7421de1b0 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34958/0 (socket says 172.21.15.6:34958) 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36a7fff640 1 -- 172.21.15.6:0/3899339951 learned_addr learned my addr 172.21.15.6:0/3899339951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.197+0000 7f36ad6db640 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36ad6db640 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 -- 172.21.15.6:0/3899339951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 msgr2=0x55c7425ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 -- 172.21.15.6:0/3899339951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 msgr2=0x55c7425be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 -- 172.21.15.6:0/3899339951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7425b0bc0 con 0x55c7421e6390 2024-09-21T08:06:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f36a7fff640 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f80 tx=0x7f369802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2814e148c551e4de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f369e7fc640 1 -- 172.21.15.6:0/3899339951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698052030 con 0x55c7421e6390 2024-09-21T08:06:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f369e7fc640 1 -- 172.21.15.6:0/3899339951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3698036050 con 0x55c7421e6390 2024-09-21T08:06:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.198+0000 7f369e7fc640 1 -- 172.21.15.6:0/3899339951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698003eb0 con 0x55c7421e6390 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 -- 172.21.15.6:0/3899339951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 msgr2=0x55c7425be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f80 tx=0x7f369802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 -- 172.21.15.6:0/3899339951 shutdown_connections 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c742207070 0x55c7425be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7421e6390 0x55c7425be100 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 --2- 172.21.15.6:0/3899339951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 -- 172.21.15.6:0/3899339951 >> 172.21.15.6:0/3899339951 conn(0x55c7421fb460 msgr2=0x55c7425bcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 -- 172.21.15.6:0/3899339951 shutdown_connections 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.199+0000 7f36b56b2740 1 -- 172.21.15.6:0/3899339951 wait complete. 2024-09-21T08:06:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 -- start start 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 Processor -- start 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81ad8e0 con 0x55c742207070 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81aed50 con 0x55c7421e6390 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81adfb0 con 0x55c7421de1b0 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.200+0000 7f36b56b2740 10 client.0 _ll_register_callbacks cb 0x7f36a0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34962/0 (socket says 172.21.15.6:34962) 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 -- 172.21.15.6:0/2216131071 learned_addr learned my addr 172.21.15.6:0/2216131071 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 -- 172.21.15.6:0/2216131071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 msgr2=0x55c7425d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425d6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 -- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 msgr2=0x55c7425c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 -- 172.21.15.6:0/2216131071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7425ae280 con 0x55c742207070 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36a7fff640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36ad6db640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009860 tx=0x7f3698031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72289f26c930b39e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f3687fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0024040 con 0x55c742207070 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3698036050 con 0x55c742207070 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.201+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f36a0005390 con 0x55c742207070 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f36a00035f0 con 0x55c742207070 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 10 client.16263 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c74263af80 con 0x55c742207070 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3698036050 con 0x55c742207070 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f36a002a040 con 0x55c742207070 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 10 client.16263 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 20 client.16263 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c74219ada0 0x55c74263d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 4 client.16263 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.202+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7425228a0 con 0x55c74219ada0 2024-09-21T08:06:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f36a7fff640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c74219ada0 0x55c74263d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f3687fff640 10 client.16263 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f36a7fff640 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c74219ada0 0x55c74263d470 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a84f2f452ce97e server_cookie=ac0b9cab2c898818 in_seq=0 out_seq=0 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f3687fff640 1 -- 172.21.15.6:0/2216131071 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7425228a0 con 0x55c74219ada0 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f3687fff640 10 client.16263 handle_command_reply: tid=0 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f36b56b2740 1 client.16263 shutdown 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 msgr2=0x55c7425c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.203+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009860 tx=0x7f3698031810 comp rx=0 tx=0).stop 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 shutdown_connections 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c74219ada0 0x55c74263d470 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f3687fff640 0 client.16263 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c742207070 0x55c7425c6c20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c7421e6390 0x55c7425c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 --2- 172.21.15.6:0/2216131071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7421de1b0 0x55c7425d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 >> 172.21.15.6:0/2216131071 conn(0x55c7421fb460 msgr2=0x55c7425b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 shutdown_connections 2024-09-21T08:06:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 1 -- 172.21.15.6:0/2216131071 wait complete. 2024-09-21T08:06:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36b56b2740 20 client.16263 trim_cache size 0 max 16384 2024-09-21T08:06:19.210 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 msgr2=0x7f36940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 0x7f36940b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f36900e53f0 tx=0x7f3690016c30 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 msgr2=0x7f36a81992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.204+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9f0 tx=0x7f369000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 shutdown_connections 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36940b6680 0x7f36940b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36a81083c0 0x7f36a8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36a8108d10 0x7f36a819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 --2- 172.21.15.6:0/2630906624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8102a80 0x7f36a81992b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 >> 172.21.15.6:0/2630906624 conn(0x7f36a8079740 msgr2=0x7f36a8104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 shutdown_connections 2024-09-21T08:06:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:19.205+0000 7f36af13e640 1 -- 172.21.15.6:0/2630906624 wait complete. 2024-09-21T08:06:19.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:19 smithi119 ceph-mon[33564]: pgmap v501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-09-21T08:06:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:19 smithi145 ceph-mon[34049]: pgmap v501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-09-21T08:06:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:19 smithi006 ceph-mon[30970]: pgmap v501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 431 op/s 2024-09-21T08:06:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.461+0000 7ff070de0640 1 -- 172.21.15.6:0/1574518289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c1083b0 msgr2=0x7ff06c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.461+0000 7ff070de0640 1 --2- 172.21.15.6:0/1574518289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c1083b0 0x7ff06c1087c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff060009900 tx=0x7ff06002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 -- 172.21.15.6:0/1574518289 shutdown_connections 2024-09-21T08:06:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 --2- 172.21.15.6:0/1574518289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c108d00 0x7ff06c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 --2- 172.21.15.6:0/1574518289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c1083b0 0x7ff06c1087c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 --2- 172.21.15.6:0/1574518289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c102a70 0x7ff06c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 -- 172.21.15.6:0/1574518289 >> 172.21.15.6:0/1574518289 conn(0x7ff06c079730 msgr2=0x7ff06c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 -- 172.21.15.6:0/1574518289 shutdown_connections 2024-09-21T08:06:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 -- 172.21.15.6:0/1574518289 wait complete. 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.462+0000 7ff070de0640 1 Processor -- start 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 -- start start 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c108d00 0x7ff06c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c112820 con 0x7ff06c102a70 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1126a0 con 0x7ff06c108d00 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff070de0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1129a0 con 0x7ff06c1083b0 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff06a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:42630/0 (socket says 172.21.15.6:42630) 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 -- 172.21.15.6:0/1046176214 learned_addr learned my addr 172.21.15.6:0/1046176214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff06a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34976/0 (socket says 172.21.15.6:34976) 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c108d00 0x7ff06c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 -- 172.21.15.6:0/1046176214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c108d00 msgr2=0x7ff06c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c108d00 0x7ff06c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 -- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 msgr2=0x7ff06c199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.463+0000 7ff069d9b640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff069d9b640 1 -- 172.21.15.6:0/1046176214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c1a86d0 con 0x7ff06c1083b0 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff06a59c640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff069d9b640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff060005940 tx=0x7ff0600042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff05b7fe640 1 -- 172.21.15.6:0/1046176214 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06003f030 con 0x7ff06c1083b0 2024-09-21T08:06:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c1a8960 con 0x7ff06c1083b0 2024-09-21T08:06:20.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff05b7fe640 1 -- 172.21.15.6:0/1046176214 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff060003c90 con 0x7ff06c1083b0 2024-09-21T08:06:20.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff05b7fe640 1 -- 172.21.15.6:0/1046176214 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060035070 con 0x7ff06c1083b0 2024-09-21T08:06:20.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.464+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c1a8e90 con 0x7ff06c1083b0 2024-09-21T08:06:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 Processor -- start 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 -- start start 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 0x56514dd14510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff05b7fe640 1 -- 172.21.15.6:0/1046176214 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff060042030 con 0x7ff06c1083b0 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd14f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56514dbffdc0 con 0x56514d945660 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56514dc8c1f0 con 0x56514d94d840 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff077354740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56514dc7b620 con 0x56514d96e520 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff06a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 0x56514dd14510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff06a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.467+0000 7ff06a59c640 1 -- 172.21.15.6:0/2636675224 learned_addr learned my addr 172.21.15.6:0/2636675224 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff069d9b640 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd14f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2636675224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 msgr2=0x56514dd14f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd14f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2636675224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 msgr2=0x56514dd14a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2636675224 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514dc43fd0 con 0x56514d96e520 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06a59c640 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 0x56514dd14510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff064009eb0 tx=0x7ff064010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f393281cb8b8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff05b7fe640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff058ff9640 1 -- 172.21.15.6:0/2636675224 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064016070 con 0x56514d96e520 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff06a59c640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff058ff9640 1 -- 172.21.15.6:0/2636675224 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff064004d20 con 0x56514d96e520 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff058ff9640 1 -- 172.21.15.6:0/2636675224 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0640126b0 con 0x56514d96e520 2024-09-21T08:06:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.468+0000 7ff05b7fe640 1 -- 172.21.15.6:0/1046176214 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff060107f80 con 0x7ff06c1083b0 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 -- 172.21.15.6:0/2636675224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 msgr2=0x56514dd14510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff06a59c640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 0x7ff0540b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x56514dd13190 tx=0x7ff05c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 0x56514dd14510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff064009eb0 tx=0x7ff064010740 comp rx=0 tx=0).stop 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 -- 172.21.15.6:0/2636675224 shutdown_connections 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd14f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d945660 0x56514dd14a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 --2- 172.21.15.6:0/2636675224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d96e520 0x56514dd14510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 -- 172.21.15.6:0/2636675224 >> 172.21.15.6:0/2636675224 conn(0x56514d962910 msgr2=0x56514dd12400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 -- 172.21.15.6:0/2636675224 shutdown_connections 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.469+0000 7ff077354740 1 -- 172.21.15.6:0/2636675224 wait complete. 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 -- start start 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 Processor -- start 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd1fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd20160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56514dc16300 con 0x56514d96e520 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56514dc7f430 con 0x56514d94d840 2024-09-21T08:06:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56514dadcbb0 con 0x56514d945660 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff077354740 10 client.0 _ll_register_callbacks cb 0x56514dc30120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35006/0 (socket says 172.21.15.6:35006) 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.470+0000 7ff06ad9d640 1 -- 172.21.15.6:0/4053086419 learned_addr learned my addr 172.21.15.6:0/4053086419 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06a59c640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd1fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff069d9b640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd20160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 -- 172.21.15.6:0/4053086419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 msgr2=0x56514dd1fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd1fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 -- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 msgr2=0x56514dd20160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd20160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 -- 172.21.15.6:0/4053086419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514dc05780 con 0x56514d96e520 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff064005960 tx=0x7ff064009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fc9d9f3daff2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064016070 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff064003d80 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff064004d20 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff064004ed0 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff077354740 10 client.16275 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.471+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56514d9d9b00 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff064004d20 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff06400f040 con 0x56514d96e520 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 10 client.16275 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 10 client.16275 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 20 client.16275 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d92cea0 0x56514dd31e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 4 client.16275 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514dc8e140 con 0x56514d92cea0 2024-09-21T08:06:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.472+0000 7ff06a59c640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d92cea0 0x56514dd31e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.473+0000 7ff06a59c640 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d92cea0 0x56514dd31e80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17456fecc258fb08 server_cookie=4635fac5eaef1dda in_seq=0 out_seq=0 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.473+0000 7ff051ffb640 10 client.16275 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.473+0000 7ff051ffb640 1 -- 172.21.15.6:0/4053086419 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56514dc8e140 con 0x56514d92cea0 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.473+0000 7ff051ffb640 10 client.16275 handle_command_reply: tid=0 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.473+0000 7ff077354740 1 client.16275 shutdown 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 msgr2=0x56514dd2be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff064005960 tx=0x7ff064009ab0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 shutdown_connections 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d92cea0 0x56514dd31e80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff051ffb640 0 client.16275 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd2be90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd20160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 --2- 172.21.15.6:0/4053086419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd1fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 >> 172.21.15.6:0/4053086419 conn(0x56514d962910 msgr2=0x56514dd176a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 shutdown_connections 2024-09-21T08:06:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 1 -- 172.21.15.6:0/4053086419 wait complete. 2024-09-21T08:06:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.474+0000 7ff077354740 20 client.16275 trim_cache size 0 max 16384 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 Processor -- start 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 -- start start 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd20040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd2bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b0fd0 con 0x56514d96e520 2024-09-21T08:06:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b3850 con 0x56514d94d840 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff077354740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b1640 con 0x56514d945660 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff069d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd2bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35010/0 (socket says 172.21.15.6:35010) 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff06ad9d640 1 -- 172.21.15.6:0/3431259 learned_addr learned my addr 172.21.15.6:0/3431259 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.492+0000 7ff06a59c640 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd20040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 -- 172.21.15.6:0/3431259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 msgr2=0x56514dd20040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd20040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 -- 172.21.15.6:0/3431259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 msgr2=0x56514dd17610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 -- 172.21.15.6:0/3431259 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514da50960 con 0x56514d94d840 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff069d9b640 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd2bd90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff060105350 tx=0x7ff060005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9cad62d803dfd6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff053fff640 1 -- 172.21.15.6:0/3431259 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060049070 con 0x56514d94d840 2024-09-21T08:06:20.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff053fff640 1 -- 172.21.15.6:0/3431259 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff060003e40 con 0x56514d94d840 2024-09-21T08:06:20.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.493+0000 7ff053fff640 1 -- 172.21.15.6:0/3431259 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600cd610 con 0x56514d94d840 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- 172.21.15.6:0/3431259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 msgr2=0x56514dd2bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd2bd90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff060105350 tx=0x7ff060005f10 comp rx=0 tx=0).stop 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- 172.21.15.6:0/3431259 shutdown_connections 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd17610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd2bd90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 --2- 172.21.15.6:0/3431259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd20040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- 172.21.15.6:0/3431259 >> 172.21.15.6:0/3431259 conn(0x56514d962910 msgr2=0x56514dd21140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- 172.21.15.6:0/3431259 shutdown_connections 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- 172.21.15.6:0/3431259 wait complete. 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 -- start start 2024-09-21T08:06:20.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.494+0000 7ff077354740 1 Processor -- start 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd23e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd24340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b1d10 con 0x56514d96e520 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b3180 con 0x56514d94d840 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c1b23e0 con 0x56514d945660 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff077354740 10 client.0 _ll_register_callbacks cb 0x7ff05c00bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35020/0 (socket says 172.21.15.6:35020) 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2112597993 learned_addr learned my addr 172.21.15.6:0/2112597993 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd23e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff069d9b640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd24340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2112597993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 msgr2=0x56514dd23e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd23e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 msgr2=0x56514dd24340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd24340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06ad9d640 1 -- 172.21.15.6:0/2112597993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514dd9b710 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.495+0000 7ff06a59c640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd23e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff06ad9d640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff064005cc0 tx=0x7ff064000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe7d82cbca49aec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064038020 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff064005070 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56514dc89bf0 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff064016040 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff077354740 10 client.16281 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56514dd9c9b0 con 0x56514d96e520 2024-09-21T08:06:20.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.496+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56514dc89bf0 con 0x56514d96e520 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff064003b80 con 0x56514d96e520 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 10 client.16281 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 10 client.16281 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 20 client.16281 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d902250 0x56514dd9f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 4 client.16281 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "47e2cde7", "release": true, "await": true}] 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "47e2cde7", "release": true, "await": true}) -- 0x56514dc87020 con 0x56514d902250 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff06a59c640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d902250 0x56514dd9f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff051ffb640 10 client.16281 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:20.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.497+0000 7ff06a59c640 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d902250 0x56514dd9f130 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df84344d4307366 server_cookie=2452f9a0f5bd47f in_seq=0 out_seq=0 2024-09-21T08:06:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.554+0000 7ff051ffb640 1 -- 172.21.15.6:0/2112597993 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56514dc87020 con 0x56514d902250 2024-09-21T08:06:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.554+0000 7ff051ffb640 10 client.16281 handle_command_reply: tid=0 2024-09-21T08:06:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.554+0000 7ff077354740 1 client.16281 shutdown 2024-09-21T08:06:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.554+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 msgr2=0x56514dd24880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.554+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff064005cc0 tx=0x7ff064000f40 comp rx=0 tx=0).stop 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 shutdown_connections 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56514d902250 0x56514dd9f130 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56514d96e520 0x56514dd24880 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56514d94d840 0x56514dd24340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff051ffb640 0 client.16281 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 --2- 172.21.15.6:0/2112597993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56514d945660 0x56514dd23e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 >> 172.21.15.6:0/2112597993 conn(0x56514d962910 msgr2=0x56514dd15c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 shutdown_connections 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 1 -- 172.21.15.6:0/2112597993 wait complete. 2024-09-21T08:06:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.555+0000 7ff077354740 20 client.16281 trim_cache size 0 max 16384 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 20, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "47e2cde7": { 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 20, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 130.0, 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:20.559 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 msgr2=0x7ff0540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 0x7ff0540b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x56514dd13190 tx=0x7ff05c00b390 comp rx=0 tx=0).stop 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 msgr2=0x7ff06c199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff060005940 tx=0x7ff0600042f0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 shutdown_connections 2024-09-21T08:06:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0540b6680 0x7ff0540b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff06c1083b0 0x7ff06c199560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff06c108d00 0x7ff06c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 --2- 172.21.15.6:0/1046176214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c102a70 0x7ff06c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 >> 172.21.15.6:0/1046176214 conn(0x7ff06c079730 msgr2=0x7ff06c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 shutdown_connections 2024-09-21T08:06:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:20.556+0000 7ff070de0640 1 -- 172.21.15.6:0/1046176214 wait complete. 2024-09-21T08:06:20.969 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:06:20.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:06:21.442 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '47e2cde7', total seconds elapsed: 17.0 2024-09-21T08:06:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:21.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:21 smithi119 ceph-mon[33564]: pgmap v502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-21T08:06:21.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:21 smithi006 ceph-mon[30970]: pgmap v502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-21T08:06:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:21 smithi145 ceph-mon[34049]: pgmap v502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-21T08:06:22.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 -- 172.21.15.6:0/2502458477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a81026b0 msgr2=0x7fa9a8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 --2- 172.21.15.6:0/2502458477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a81026b0 0x7fa9a8102ac0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa998009900 tx=0x7fa99802a480 comp rx=0 tx=0).stop 2024-09-21T08:06:22.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 -- 172.21.15.6:0/2502458477 shutdown_connections 2024-09-21T08:06:22.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 --2- 172.21.15.6:0/2502458477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8110260 0x7fa9a8112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 --2- 172.21.15.6:0/2502458477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a8103000 0x7fa9a810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 --2- 172.21.15.6:0/2502458477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a81026b0 0x7fa9a8102ac0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 -- 172.21.15.6:0/2502458477 >> 172.21.15.6:0/2502458477 conn(0x7fa9a80797b0 msgr2=0x7fa9a8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 -- 172.21.15.6:0/2502458477 shutdown_connections 2024-09-21T08:06:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.222+0000 7fa9acd05640 1 -- 172.21.15.6:0/2502458477 wait complete. 2024-09-21T08:06:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 Processor -- start 2024-09-21T08:06:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 -- start start 2024-09-21T08:06:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a81026b0 0x7fa9a819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8103000 0x7fa9a819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8115b50 con 0x7fa9a8110260 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81159d0 con 0x7fa9a81026b0 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9acd05640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8115cd0 con 0x7fa9a8103000 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9a659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a81026b0 0x7fa9a819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9a5d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8103000 0x7fa9a819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35042/0 (socket says 172.21.15.6:35042) 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.224+0000 7fa9a6d9d640 1 -- 172.21.15.6:0/3133602376 learned_addr learned my addr 172.21.15.6:0/3133602376 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 -- 172.21.15.6:0/3133602376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8103000 msgr2=0x7fa9a819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8103000 0x7fa9a819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 -- 172.21.15.6:0/3133602376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a81026b0 msgr2=0x7fa9a819c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a81026b0 0x7fa9a819c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 -- 172.21.15.6:0/3133602376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a81a2510 con 0x7fa9a8110260 2024-09-21T08:06:22.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9a6d9d640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000eb10 tx=0x7fa9a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9977fe640 1 -- 172.21.15.6:0/3133602376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0004b20 con 0x7fa9a8110260 2024-09-21T08:06:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a81a2800 con 0x7fa9a8110260 2024-09-21T08:06:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9977fe640 1 -- 172.21.15.6:0/3133602376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a0004cc0 con 0x7fa9a8110260 2024-09-21T08:06:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9977fe640 1 -- 172.21.15.6:0/3133602376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0010690 con 0x7fa9a8110260 2024-09-21T08:06:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.225+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81a8f60 con 0x7fa9a8110260 2024-09-21T08:06:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 Processor -- start 2024-09-21T08:06:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9977fe640 1 -- 172.21.15.6:0/3133602376 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa9a0005020 con 0x7fa9a8110260 2024-09-21T08:06:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 -- start start 2024-09-21T08:06:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b2ac350 0x557d4b653430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b653eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557d4b5c9e60 con 0x557d4b2ac350 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d4b5b9290 con 0x557d4b28b670 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.229+0000 7fa9b3279740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557d4b5bd0a0 con 0x557d4b283490 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:42696/0 (socket says 172.21.15.6:42696) 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 -- 172.21.15.6:0/1006962806 learned_addr learned my addr 172.21.15.6:0/1006962806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b653eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b2ac350 0x557d4b653430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 -- 172.21.15.6:0/1006962806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 msgr2=0x557d4b653eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b653eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9977fe640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 0x7fa9900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 -- 172.21.15.6:0/1006962806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b2ac350 msgr2=0x557d4b653430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b2ac350 0x557d4b653430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 -- 172.21.15.6:0/1006962806 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4b317930 con 0x557d4b283490 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9977fe640 1 -- 172.21.15.6:0/3133602376 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa9a00e7ff0 con 0x7fa9a8110260 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.230+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa998009900 tx=0x7fa998031480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489bf2eb4a63ca01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.231+0000 7fa9a6d9d640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 0x7fa9900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.231+0000 7fa994ff9640 1 -- 172.21.15.6:0/1006962806 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998040070 con 0x557d4b283490 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.231+0000 7fa994ff9640 1 -- 172.21.15.6:0/1006962806 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998004030 con 0x557d4b283490 2024-09-21T08:06:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.231+0000 7fa994ff9640 1 -- 172.21.15.6:0/1006962806 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998035040 con 0x557d4b283490 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 -- 172.21.15.6:0/1006962806 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 msgr2=0x557d4b653970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa998009900 tx=0x7fa998031480 comp rx=0 tx=0).stop 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9a6d9d640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 0x7fa9900b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00aad10 tx=0x7fa9a000cee0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 -- 172.21.15.6:0/1006962806 shutdown_connections 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b283490 0x557d4b653970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b653eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1006962806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b2ac350 0x557d4b653430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 -- 172.21.15.6:0/1006962806 >> 172.21.15.6:0/1006962806 conn(0x557d4b2a0740 msgr2=0x557d4b651320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 -- 172.21.15.6:0/1006962806 shutdown_connections 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.232+0000 7fa9b3279740 1 -- 172.21.15.6:0/1006962806 wait complete. 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.233+0000 7fa9b3279740 1 -- start start 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.233+0000 7fa9b3279740 1 Processor -- start 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b66aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557d4b41a890 con 0x557d4b283490 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d4b553d40 con 0x557d4b2ac350 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557d4b661bb0 con 0x557d4b28b670 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35068/0 (socket says 172.21.15.6:35068) 2024-09-21T08:06:22.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a5d9b640 1 -- 172.21.15.6:0/1954191909 learned_addr learned my addr 172.21.15.6:0/1954191909 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9b3279740 10 client.0 _ll_register_callbacks cb 0x557d4b5b7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b66aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 -- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 msgr2=0x557d4b66aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b66aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 -- 172.21.15.6:0/1954191909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 msgr2=0x557d4b65f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a659c640 1 -- 172.21.15.6:0/1954191909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4b66b4e0 con 0x557d4b28b670 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.234+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65f610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa998005940 tx=0x7fa99802ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639110060323621c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa98dffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998035040 con 0x557d4b28b670 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa998004030 con 0x557d4b28b670 2024-09-21T08:06:22.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa9980319e0 con 0x557d4b28b670 2024-09-21T08:06:22.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa998040040 con 0x557d4b28b670 2024-09-21T08:06:22.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa9b3279740 10 client.26044 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:22.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.235+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557d4b66ddd0 con 0x557d4b28b670 2024-09-21T08:06:22.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998004030 con 0x557d4b28b670 2024-09-21T08:06:22.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa998004900 con 0x557d4b28b670 2024-09-21T08:06:22.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 10 client.26044 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:22.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 10 client.26044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:22.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 20 client.26044 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b26acd0 0x557d4b671130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 4 client.26044 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.236+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d4b5cbdb0 con 0x557d4b26acd0 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.237+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b26acd0 0x557d4b671130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.237+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b26acd0 0x557d4b671130 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d253f865c47861c server_cookie=21c9cda40891035d in_seq=0 out_seq=0 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.237+0000 7fa98dffb640 10 client.26044 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa98dffb640 1 -- 172.21.15.6:0/1954191909 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d4b5cbdb0 con 0x557d4b26acd0 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa98dffb640 10 client.26044 handle_command_reply: tid=0 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 client.26044 shutdown 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 msgr2=0x557d4b65f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65f610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa998005940 tx=0x7fa99802ac00 comp rx=0 tx=0).stop 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 shutdown_connections 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b26acd0 0x557d4b671130 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa98dffb640 0 client.26044 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65f610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b66aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1954191909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b65f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 >> 172.21.15.6:0/1954191909 conn(0x557d4b2a0740 msgr2=0x557d4b656610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 shutdown_connections 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 1 -- 172.21.15.6:0/1954191909 wait complete. 2024-09-21T08:06:22.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.238+0000 7fa9b3279740 20 client.26044 trim_cache size 0 max 16384 2024-09-21T08:06:22.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.259+0000 7fa9b3279740 1 Processor -- start 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.259+0000 7fa9b3279740 1 -- start start 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b66ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b658510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b0fd0 con 0x557d4b283490 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b3850 con 0x557d4b2ac350 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9b3279740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b1640 con 0x557d4b28b670 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:42722/0 (socket says 172.21.15.6:42722) 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 -- 172.21.15.6:0/1019665685 learned_addr learned my addr 172.21.15.6:0/1019665685 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b66ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b658510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 -- 172.21.15.6:0/1019665685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 msgr2=0x557d4b658510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b658510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 -- 172.21.15.6:0/1019665685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 msgr2=0x557d4b66ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b66ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a659c640 1 -- 172.21.15.6:0/1019665685 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4b656290 con 0x557d4b28b670 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.260+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b658510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.261+0000 7fa9a659c640 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa998004d50 tx=0x7fa9980058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34fbd41fae586ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.261+0000 7fa98ffff640 1 -- 172.21.15.6:0/1019665685 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99805f070 con 0x557d4b28b670 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.261+0000 7fa98ffff640 1 -- 172.21.15.6:0/1019665685 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998009520 con 0x557d4b28b670 2024-09-21T08:06:22.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.261+0000 7fa98ffff640 1 -- 172.21.15.6:0/1019665685 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998035040 con 0x557d4b28b670 2024-09-21T08:06:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 -- 172.21.15.6:0/1019665685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 msgr2=0x557d4b65e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa998004d50 tx=0x7fa9980058d0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 -- 172.21.15.6:0/1019665685 shutdown_connections 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b28b670 0x557d4b65e720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b2ac350 0x557d4b658510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 --2- 172.21.15.6:0/1019665685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b66ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 -- 172.21.15.6:0/1019665685 >> 172.21.15.6:0/1019665685 conn(0x557d4b2a0740 msgr2=0x557d4b656ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 -- 172.21.15.6:0/1019665685 shutdown_connections 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.262+0000 7fa9b3279740 1 -- 172.21.15.6:0/1019665685 wait complete. 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.263+0000 7fa9b3279740 1 -- start start 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.263+0000 7fa9b3279740 1 Processor -- start 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.263+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.263+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b670690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9b3279740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b2ac350 0x557d4b670bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9b3279740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b1d10 con 0x557d4b283490 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9b3279740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b3180 con 0x557d4b28b670 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9b3279740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b23e0 con 0x557d4b2ac350 2024-09-21T08:06:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35096/0 (socket says 172.21.15.6:35096) 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 -- 172.21.15.6:0/645137001 learned_addr learned my addr 172.21.15.6:0/645137001 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9b3279740 10 client.0 _ll_register_callbacks cb 0x7fa99c00bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a659c640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b670690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b2ac350 0x557d4b670bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 -- 172.21.15.6:0/645137001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b2ac350 msgr2=0x557d4b670bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b2ac350 0x557d4b670bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 -- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 msgr2=0x557d4b670690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b670690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 -- 172.21.15.6:0/645137001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4b650a70 con 0x557d4b283490 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa9a5d9b640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x557d4b5bd190 tx=0x7fa99c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6bca275f9e1881 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa98dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.264+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c02f020 con 0x557d4b283490 2024-09-21T08:06:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fa99c012c20 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa998009520 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa99c03a050 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 10 client.16299 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557d4b6dba10 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998009520 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa99c026040 con 0x557d4b283490 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 10 client.16299 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 20 client.16299 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.265+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b240080 0x557d4b6de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.266+0000 7fa9b3279740 4 client.16299 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:06:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.266+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557d4b5c7860 con 0x557d4b240080 2024-09-21T08:06:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.266+0000 7fa9a659c640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b240080 0x557d4b6de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.266+0000 7fa9a659c640 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b240080 0x557d4b6de1d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7c1c0854389c75d server_cookie=34b5033bdcfb5cb5 in_seq=0 out_seq=0 2024-09-21T08:06:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.266+0000 7fa98dffb640 10 client.16299 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.267+0000 7fa98dffb640 1 -- 172.21.15.6:0/645137001 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557d4b5c7860 con 0x557d4b240080 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa98dffb640 10 client.16299 handle_command_reply: tid=0 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 client.16299 shutdown 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 msgr2=0x557d4b670150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x557d4b5bd190 tx=0x7fa99c00b810 comp rx=0 tx=0).stop 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 shutdown_connections 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557d4b240080 0x557d4b6de1d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d4b2ac350 0x557d4b670bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa98dffb640 0 client.16299 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d4b28b670 0x557d4b670690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 --2- 172.21.15.6:0/645137001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d4b283490 0x557d4b670150 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 >> 172.21.15.6:0/645137001 conn(0x557d4b2a0740 msgr2=0x557d4b656ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 shutdown_connections 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 1 -- 172.21.15.6:0/645137001 wait complete. 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.268+0000 7fa9b3279740 20 client.16299 trim_cache size 0 max 16384 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "ff72ecee-4198-4c31-afd5-530f37a041ca", 2024-09-21T08:06:22.273 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:06:22.274 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 msgr2=0x7fa9900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 0x7fa9900b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00aad10 tx=0x7fa9a000cee0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 msgr2=0x7fa9a81a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000eb10 tx=0x7fa9a000c2d0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 shutdown_connections 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa9900b6680 0x7fa9900b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9a8103000 0x7fa9a819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a8110260 0x7fa9a81a1de0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 --2- 172.21.15.6:0/3133602376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9a81026b0 0x7fa9a819c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 >> 172.21.15.6:0/3133602376 conn(0x7fa9a80797b0 msgr2=0x7fa9a8108cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 shutdown_connections 2024-09-21T08:06:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:22.269+0000 7fa9acd05640 1 -- 172.21.15.6:0/3133602376 wait complete. 2024-09-21T08:06:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 205.0 s, 250.6 tps, lat 1039.325 ms stddev 2965.675 2024-09-21T08:06:23.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:06:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:23 smithi006 ceph-mon[30970]: pgmap v503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.4 MiB/s wr, 178 op/s 2024-09-21T08:06:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:23 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:06:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:23 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:23 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:06:23.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:23 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:23 smithi119 ceph-mon[33564]: pgmap v503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.4 MiB/s wr, 178 op/s 2024-09-21T08:06:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:23 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:06:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:23 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:23 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:06:23.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:23 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:23 smithi145 ceph-mon[34049]: pgmap v503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.4 MiB/s wr, 178 op/s 2024-09-21T08:06:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:23 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:06:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:23 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:23 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:06:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:23 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:06:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 -- 172.21.15.6:0/1660573662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe61810a9e0 msgr2=0x7fe61810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/1660573662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe61810a9e0 0x7fe61810adf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe608009860 tx=0x7fe60802a340 comp rx=0 tx=0).stop 2024-09-21T08:06:24.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 -- 172.21.15.6:0/1660573662 shutdown_connections 2024-09-21T08:06:24.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/1660573662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe61811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/1660573662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe61810a9e0 0x7fe61810adf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/1660573662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe618111f40 0x7fe61810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.239+0000 7fe61cb4a640 1 -- 172.21.15.6:0/1660573662 >> 172.21.15.6:0/1660573662 conn(0x7fe618070ec0 msgr2=0x7fe6180712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.240+0000 7fe61cb4a640 1 -- 172.21.15.6:0/1660573662 shutdown_connections 2024-09-21T08:06:24.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.240+0000 7fe61cb4a640 1 -- 172.21.15.6:0/1660573662 wait complete. 2024-09-21T08:06:24.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.241+0000 7fe61cb4a640 1 Processor -- start 2024-09-21T08:06:24.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.241+0000 7fe61cb4a640 1 -- start start 2024-09-21T08:06:24.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe61810a9e0 0x7fe61811c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 0x7fe6181166d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe618112aa0 con 0x7fe61810a9e0 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe618112920 con 0x7fe618111f40 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61cb4a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe618112c20 con 0x7fe61811cc30 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe616d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe615d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 0x7fe6181166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe616d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:42758/0 (socket says 172.21.15.6:42758) 2024-09-21T08:06:24.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe616d9d640 1 -- 172.21.15.6:0/2894900266 learned_addr learned my addr 172.21.15.6:0/2894900266 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:24.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe615d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 0x7fe6181166d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44104/0 (socket says 172.21.15.6:44104) 2024-09-21T08:06:24.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.242+0000 7fe61659c640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe61810a9e0 0x7fe61811c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 -- 172.21.15.6:0/2894900266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 msgr2=0x7fe6181166d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 0x7fe6181166d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 -- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe61810a9e0 msgr2=0x7fe61811c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe61810a9e0 0x7fe61811c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 -- 172.21.15.6:0/2894900266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe618117450 con 0x7fe61811cc30 2024-09-21T08:06:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.243+0000 7fe616d9d640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe61000eda0 tx=0x7fe61000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.244+0000 7fe6077fe640 1 -- 172.21.15.6:0/2894900266 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610003b70 con 0x7fe61811cc30 2024-09-21T08:06:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.244+0000 7fe6077fe640 1 -- 172.21.15.6:0/2894900266 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe610003d10 con 0x7fe61811cc30 2024-09-21T08:06:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.244+0000 7fe6077fe640 1 -- 172.21.15.6:0/2894900266 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610017860 con 0x7fe61811cc30 2024-09-21T08:06:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.244+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6181bde40 con 0x7fe61811cc30 2024-09-21T08:06:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.244+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6181be2a0 con 0x7fe61811cc30 2024-09-21T08:06:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.250+0000 7fe6230be740 1 Processor -- start 2024-09-21T08:06:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.250+0000 7fe6230be740 1 -- start start 2024-09-21T08:06:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6077fe640 1 -- 172.21.15.6:0/2894900266 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe610004540 con 0x7fe61811cc30 2024-09-21T08:06:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a322270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a322cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a298e50 con 0x55dc99f5a390 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a288280 con 0x55dc99f521b0 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe61659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe61659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44114/0 (socket says 172.21.15.6:44114) 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe61659c640 1 -- 172.21.15.6:0/1811628186 learned_addr learned my addr 172.21.15.6:0/1811628186 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe615d9b640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a322270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.251+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a28c090 con 0x55dc99f7b070 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe6077fe640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 0x7fe6000b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe61659c640 1 -- 172.21.15.6:0/1811628186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 msgr2=0x55dc9a322270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe615d9b640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a322cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe61659c640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a322270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe61659c640 1 -- 172.21.15.6:0/1811628186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 msgr2=0x55dc9a322cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.252+0000 7fe61659c640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a322cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.253+0000 7fe61659c640 1 -- 172.21.15.6:0/1811628186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc99fe6650 con 0x55dc99f521b0 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.253+0000 7fe615d9b640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a322cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.253+0000 7fe6077fe640 1 -- 172.21.15.6:0/2894900266 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe6100e7a60 con 0x7fe61811cc30 2024-09-21T08:06:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.253+0000 7fe61659c640 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009c90 tx=0x7fe60c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9be89cad1c10fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.254+0000 7fe604ff9640 1 -- 172.21.15.6:0/1811628186 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c005220 con 0x55dc99f521b0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.254+0000 7fe604ff9640 1 -- 172.21.15.6:0/1811628186 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe60c004c30 con 0x55dc99f521b0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.254+0000 7fe616d9d640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 0x7fe6000b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.254+0000 7fe604ff9640 1 -- 172.21.15.6:0/1811628186 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c019670 con 0x55dc99f521b0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.256+0000 7fe616d9d640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 0x7fe6000b8cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ad510 tx=0x7fe610011040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.256+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 msgr2=0x55dc9a3227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.256+0000 7fe6230be740 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009c90 tx=0x7fe60c011810 comp rx=0 tx=0).stop 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 shutdown_connections 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a322cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a3227b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 --2- 172.21.15.6:0/1811628186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a322270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 >> 172.21.15.6:0/1811628186 conn(0x55dc99f6f460 msgr2=0x55dc9a320160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.257+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 shutdown_connections 2024-09-21T08:06:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.258+0000 7fe6230be740 1 -- 172.21.15.6:0/1811628186 wait complete. 2024-09-21T08:06:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.259+0000 7fe6230be740 1 -- start start 2024-09-21T08:06:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.259+0000 7fe6230be740 1 Processor -- start 2024-09-21T08:06:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a32d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f7b070 0x55dc9a339d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a0e9700 con 0x55dc99f521b0 2024-09-21T08:06:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a223110 con 0x55dc99f7b070 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55dc9a330a50 con 0x55dc99f5a390 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe6230be740 10 client.0 _ll_register_callbacks cb 0x55dc9a23c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe61659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe61659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:42772/0 (socket says 172.21.15.6:42772) 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.260+0000 7fe61659c640 1 -- 172.21.15.6:0/911667506 learned_addr learned my addr 172.21.15.6:0/911667506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.261+0000 7fe61659c640 1 -- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f7b070 msgr2=0x55dc9a339d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.261+0000 7fe61659c640 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f7b070 0x55dc9a339d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.261+0000 7fe61659c640 1 -- 172.21.15.6:0/911667506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 msgr2=0x55dc9a32d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.261+0000 7fe61659c640 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a32d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.261+0000 7fe61659c640 1 -- 172.21.15.6:0/911667506 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9a250c40 con 0x55dc99f5a390 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.262+0000 7fe61659c640 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009560 tx=0x7fe60c005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8574c39953da29a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.262+0000 7fe5fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.264+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c028070 con 0x55dc99f5a390 2024-09-21T08:06:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.264+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe60c004250 con 0x55dc99f5a390 2024-09-21T08:06:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.264+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe60c004c30 con 0x55dc99f5a390 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.265+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe60c034050 con 0x55dc99f5a390 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.265+0000 7fe6230be740 10 client.26062 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.265+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dc9a33c780 con 0x55dc99f5a390 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.265+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe60c0053d0 con 0x55dc99f5a390 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe60c003cb0 con 0x55dc99f5a390 2024-09-21T08:06:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 10 client.26062 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 10 client.26062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 20 client.26062 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f399f0 0x55dc9a33fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 4 client.26062 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.266+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe60c004c30 con 0x55dc99f399f0 2024-09-21T08:06:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.267+0000 7fe615d9b640 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f399f0 0x55dc9a33fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.268+0000 7fe615d9b640 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f399f0 0x55dc9a33fb40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5aea3064204945 server_cookie=e40b1f131c21708b in_seq=0 out_seq=0 2024-09-21T08:06:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.268+0000 7fe5fdffb640 10 client.26062 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe5fdffb640 1 -- 172.21.15.6:0/911667506 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe60c004c30 con 0x55dc99f399f0 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe5fdffb640 10 client.26062 handle_command_reply: tid=0 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 client.26062 shutdown 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 msgr2=0x55dc9a32def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009560 tx=0x7fe60c005230 comp rx=0 tx=0).stop 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 shutdown_connections 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f399f0 0x55dc9a33fb40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f5a390 0x55dc9a32def0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe5fdffb640 0 client.26062 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f7b070 0x55dc9a339d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 --2- 172.21.15.6:0/911667506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a32d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.269+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 >> 172.21.15.6:0/911667506 conn(0x55dc99f6f460 msgr2=0x55dc9a325400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.270+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 shutdown_connections 2024-09-21T08:06:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.270+0000 7fe6230be740 1 -- 172.21.15.6:0/911667506 wait complete. 2024-09-21T08:06:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.270+0000 7fe6230be740 20 client.26062 trim_cache size 0 max 16384 2024-09-21T08:06:24.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.304+0000 7fe6230be740 1 Processor -- start 2024-09-21T08:06:24.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.304+0000 7fe6230be740 1 -- start start 2024-09-21T08:06:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a32f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a32b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c6680 con 0x55dc99f5a390 2024-09-21T08:06:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c8f00 con 0x55dc99f521b0 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe6230be740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c6cf0 con 0x55dc99f7b070 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe61659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe61659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35136/0 (socket says 172.21.15.6:35136) 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe61659c640 1 -- 172.21.15.6:0/2827452419 learned_addr learned my addr 172.21.15.6:0/2827452419 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe615d9b640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a32f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.305+0000 7fe615d9b640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a32b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe615d9b640 1 -- 172.21.15.6:0/2827452419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 msgr2=0x55dc9a32b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe615d9b640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a32b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe615d9b640 1 -- 172.21.15.6:0/2827452419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 msgr2=0x55dc9a32aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe615d9b640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe615d9b640 1 -- 172.21.15.6:0/2827452419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9a32ec70 con 0x55dc99f521b0 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.306+0000 7fe61659c640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:06:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.307+0000 7fe615d9b640 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a32f890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe61806c970 tx=0x7fe608041040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a51337668d04977 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.307+0000 7fe5fffff640 1 -- 172.21.15.6:0/2827452419 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60804d070 con 0x55dc99f521b0 2024-09-21T08:06:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.307+0000 7fe5fffff640 1 -- 172.21.15.6:0/2827452419 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe60804e040 con 0x55dc99f521b0 2024-09-21T08:06:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.307+0000 7fe5fffff640 1 -- 172.21.15.6:0/2827452419 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608037040 con 0x55dc99f521b0 2024-09-21T08:06:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 -- 172.21.15.6:0/2827452419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 msgr2=0x55dc9a32f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a32f890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe61806c970 tx=0x7fe608041040 comp rx=0 tx=0).stop 2024-09-21T08:06:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 -- 172.21.15.6:0/2827452419 shutdown_connections 2024-09-21T08:06:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a32b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f5a390 0x55dc9a32aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 --2- 172.21.15.6:0/2827452419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f521b0 0x55dc9a32f890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.309+0000 7fe6230be740 1 -- 172.21.15.6:0/2827452419 >> 172.21.15.6:0/2827452419 conn(0x55dc99f6f460 msgr2=0x55dc9a3259e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.310+0000 7fe6230be740 1 -- 172.21.15.6:0/2827452419 shutdown_connections 2024-09-21T08:06:24.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.311+0000 7fe6230be740 1 -- 172.21.15.6:0/2827452419 wait complete. 2024-09-21T08:06:24.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.311+0000 7fe6230be740 1 -- start start 2024-09-21T08:06:24.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.312+0000 7fe6230be740 1 Processor -- start 2024-09-21T08:06:24.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.312+0000 7fe6230be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a3363f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 0x55dc9a333910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a333e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c73c0 con 0x55dc99f521b0 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c8830 con 0x55dc99f5a390 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181c7a90 con 0x55dc99f7b070 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe6230be740 10 client.0 _ll_register_callbacks cb 0x7fe60c009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe61659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 0x55dc9a333910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe61659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 0x55dc9a333910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44152/0 (socket says 172.21.15.6:44152) 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe61659c640 1 -- 172.21.15.6:0/3828544851 learned_addr learned my addr 172.21.15.6:0/3828544851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.313+0000 7fe615d9b640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a3363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a333e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 -- 172.21.15.6:0/3828544851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 msgr2=0x55dc9a333e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a333e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 -- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 msgr2=0x55dc9a333910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 0x55dc9a333910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 -- 172.21.15.6:0/3828544851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9a334510 con 0x55dc99f521b0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe615d9b640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a3363f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe608001eb0 tx=0x7fe608009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba6c07092b04157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe5fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.314+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608037070 con 0x55dc99f521b0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.315+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe608004030 con 0x55dc99f521b0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.315+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe60804e040 con 0x55dc99f521b0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.315+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe60804d040 con 0x55dc99f521b0 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.315+0000 7fe6230be740 10 client.16311 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.315+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dc9a3aa1d0 con 0x55dc99f521b0 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6080307d0 con 0x55dc99f521b0 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe608051020 con 0x55dc99f521b0 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 10 client.16311 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 20 client.16311 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f0eda0 0x55dc9a3ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 4 client.16311 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe60804e040 con 0x55dc99f0eda0 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.316+0000 7fe61659c640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f0eda0 0x55dc9a3ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.317+0000 7fe61659c640 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f0eda0 0x55dc9a3ac800 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89a52f875116fcf server_cookie=5d24e4ed4dd11b4b in_seq=0 out_seq=0 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.317+0000 7fe5fdffb640 10 client.16311 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.317+0000 7fe5fdffb640 1 -- 172.21.15.6:0/3828544851 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x7fe60804e040 con 0x55dc99f0eda0 2024-09-21T08:06:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.317+0000 7fe5fdffb640 10 client.16311 handle_command_reply: tid=0 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.317+0000 7fe6230be740 1 client.16311 shutdown 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.318+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 msgr2=0x55dc9a3363f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.318+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a3363f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe608001eb0 tx=0x7fe608009780 comp rx=0 tx=0).stop 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 shutdown_connections 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55dc99f0eda0 0x55dc9a3ac800 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55dc99f7b070 0x55dc9a333e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe5fdffb640 0 client.16311 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc99f5a390 0x55dc9a333910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 --2- 172.21.15.6:0/3828544851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc99f521b0 0x55dc9a3363f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.319+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 >> 172.21.15.6:0/3828544851 conn(0x55dc99f6f460 msgr2=0x55dc9a3259e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.320+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 shutdown_connections 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.320+0000 7fe6230be740 1 -- 172.21.15.6:0/3828544851 wait complete. 2024-09-21T08:06:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.320+0000 7fe6230be740 20 client.16311 trim_cache size 0 max 16384 2024-09-21T08:06:24.322 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "ff72ecee-4198-4c31-afd5-530f37a041ca", 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.323 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:06:24.324 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.325 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:06:24.327 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 msgr2=0x7fe6000b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 0x7fe6000b8cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ad510 tx=0x7fe610011040 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 msgr2=0x7fe618116c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe61000eda0 tx=0x7fe61000c6e0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 shutdown_connections 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe6000b67b0 0x7fe6000b8cc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe61811cc30 0x7fe618116c30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe618111f40 0x7fe6181166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 --2- 172.21.15.6:0/2894900266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe61810a9e0 0x7fe61811c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 >> 172.21.15.6:0/2894900266 conn(0x7fe618070ec0 msgr2=0x7fe618073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 shutdown_connections 2024-09-21T08:06:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:24.322+0000 7fe61cb4a640 1 -- 172.21.15.6:0/2894900266 wait complete. 2024-09-21T08:06:25.259 INFO:tasks.cephfs.filesystem:scrub status for tag:ff72ecee-4198-4c31-afd5-530f37a041ca - {'path': '/', 'tag': 'ff72ecee-4198-4c31-afd5-530f37a041ca', 'options': 'recursive,force'} 2024-09-21T08:06:25.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:25 smithi006 ceph-mon[30970]: pgmap v504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-21T08:06:25.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:25 smithi119 ceph-mon[33564]: pgmap v504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-21T08:06:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:25 smithi145 ceph-mon[34049]: pgmap v504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-21T08:06:26.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:26 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:06:26.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:26 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:06:26.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:26 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:06:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 210.0 s, 1081.6 tps, lat 92.050 ms stddev 31.378 2024-09-21T08:06:27.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:27 smithi119 ceph-mon[33564]: pgmap v505: 129 pgs: 129 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T08:06:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:27 smithi145 ceph-mon[34049]: pgmap v505: 129 pgs: 129 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T08:06:27.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:27 smithi006 ceph-mon[30970]: pgmap v505: 129 pgs: 129 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T08:06:29.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:29 smithi119 ceph-mon[33564]: pgmap v506: 129 pgs: 129 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 345 op/s 2024-09-21T08:06:29.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:29 smithi145 ceph-mon[34049]: pgmap v506: 129 pgs: 129 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 345 op/s 2024-09-21T08:06:29.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:29 smithi006 ceph-mon[30970]: pgmap v506: 129 pgs: 129 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 345 op/s 2024-09-21T08:06:31.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:31 smithi119 ceph-mon[33564]: pgmap v507: 129 pgs: 129 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.5 MiB/s wr, 497 op/s 2024-09-21T08:06:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:31 smithi145 ceph-mon[34049]: pgmap v507: 129 pgs: 129 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.5 MiB/s wr, 497 op/s 2024-09-21T08:06:31.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:31 smithi006 ceph-mon[30970]: pgmap v507: 129 pgs: 129 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.5 MiB/s wr, 497 op/s 2024-09-21T08:06:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 215.0 s, 1026.4 tps, lat 97.475 ms stddev 27.648 2024-09-21T08:06:33.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:33 smithi119 ceph-mon[33564]: pgmap v508: 129 pgs: 129 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-09-21T08:06:33.692 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:33 smithi145 ceph-mon[34049]: pgmap v508: 129 pgs: 129 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-09-21T08:06:33.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:33 smithi006 ceph-mon[30970]: pgmap v508: 129 pgs: 129 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-09-21T08:06:35.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:35 smithi119 ceph-mon[33564]: pgmap v509: 129 pgs: 129 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 9.1 MiB/s wr, 904 op/s 2024-09-21T08:06:35.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:35 smithi145 ceph-mon[34049]: pgmap v509: 129 pgs: 129 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 9.1 MiB/s wr, 904 op/s 2024-09-21T08:06:35.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:35 smithi006 ceph-mon[30970]: pgmap v509: 129 pgs: 129 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 9.1 MiB/s wr, 904 op/s 2024-09-21T08:06:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 220.0 s, 970.6 tps, lat 102.967 ms stddev 33.045 2024-09-21T08:06:37.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:37 smithi119 ceph-mon[33564]: pgmap v510: 129 pgs: 129 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 944 op/s 2024-09-21T08:06:37.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:37 smithi145 ceph-mon[34049]: pgmap v510: 129 pgs: 129 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 944 op/s 2024-09-21T08:06:37.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:37 smithi006 ceph-mon[30970]: pgmap v510: 129 pgs: 129 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 944 op/s 2024-09-21T08:06:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:39 smithi119 ceph-mon[33564]: pgmap v511: 129 pgs: 129 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 967 op/s 2024-09-21T08:06:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:39 smithi145 ceph-mon[34049]: pgmap v511: 129 pgs: 129 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 967 op/s 2024-09-21T08:06:39.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:39 smithi006 ceph-mon[30970]: pgmap v511: 129 pgs: 129 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 967 op/s 2024-09-21T08:06:40.015 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:06:40.015 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T08:06:40.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:40.435 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.060+0000 7f8443b97640 1 -- 172.21.15.6:0/1854412932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c10a9e0 msgr2=0x7f843c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.060+0000 7f8443b97640 1 --2- 172.21.15.6:0/1854412932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c10a9e0 0x7f843c10adf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f842c009860 tx=0x7f842c02a380 comp rx=0 tx=0).stop 2024-09-21T08:06:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.062+0000 7f8443b97640 1 -- 172.21.15.6:0/1854412932 shutdown_connections 2024-09-21T08:06:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.062+0000 7f8443b97640 1 --2- 172.21.15.6:0/1854412932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c11cc30 0x7f843c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.062+0000 7f8443b97640 1 --2- 172.21.15.6:0/1854412932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c10a9e0 0x7f843c10adf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.062+0000 7f8443b97640 1 --2- 172.21.15.6:0/1854412932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c111f40 0x7f843c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.062+0000 7f8443b97640 1 -- 172.21.15.6:0/1854412932 >> 172.21.15.6:0/1854412932 conn(0x7f843c070ec0 msgr2=0x7f843c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.063+0000 7f8443b97640 1 -- 172.21.15.6:0/1854412932 shutdown_connections 2024-09-21T08:06:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.063+0000 7f8443b97640 1 -- 172.21.15.6:0/1854412932 wait complete. 2024-09-21T08:06:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.064+0000 7f8443b97640 1 Processor -- start 2024-09-21T08:06:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.064+0000 7f8443b97640 1 -- start start 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c10a9e0 0x7f843c1a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 0x7f843c1a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f843c122810 con 0x7f843c111f40 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f843c122690 con 0x7f843c11cc30 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8443b97640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f843c122990 con 0x7f843c10a9e0 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8441132640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 0x7f843c1a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8442134640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8442134640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:48540/0 (socket says 172.21.15.6:48540) 2024-09-21T08:06:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8441132640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 0x7f843c1a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39384/0 (socket says 172.21.15.6:39384) 2024-09-21T08:06:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8442134640 1 -- 172.21.15.6:0/1454402610 learned_addr learned my addr 172.21.15.6:0/1454402610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.065+0000 7f8441933640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c10a9e0 0x7f843c1a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.066+0000 7f8442134640 1 -- 172.21.15.6:0/1454402610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c10a9e0 msgr2=0x7f843c1a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.066+0000 7f8442134640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c10a9e0 0x7f843c1a9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.066+0000 7f8442134640 1 -- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 msgr2=0x7f843c1a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.066+0000 7f8442134640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 0x7f843c1a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.066+0000 7f8442134640 1 -- 172.21.15.6:0/1454402610 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c1af290 con 0x7f843c11cc30 2024-09-21T08:06:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.070+0000 7f8442134640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8434009fd0 tx=0x7f843400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.070+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434004b20 con 0x7f843c11cc30 2024-09-21T08:06:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.070+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8434003e00 con 0x7f843c11cc30 2024-09-21T08:06:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.070+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84340047f0 con 0x7f843c11cc30 2024-09-21T08:06:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.071+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843c1af580 con 0x7f843c11cc30 2024-09-21T08:06:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.071+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843c1b5ce0 con 0x7f843c11cc30 2024-09-21T08:06:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.072+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843c10b5e0 con 0x7f843c11cc30 2024-09-21T08:06:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.080+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f843401d020 con 0x7f843c11cc30 2024-09-21T08:06:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.081+0000 7f8432ffd640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 0x7f84280b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.081+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f84340e8440 con 0x7f843c11cc30 2024-09-21T08:06:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.082+0000 7f8441933640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 0x7f84280b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.082+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8434024030 con 0x7f843c11cc30 2024-09-21T08:06:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.087+0000 7f8441933640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 0x7f84280b8d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8438006fd0 tx=0x7f84380090e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.476+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f843c10adf0 con 0x7f843c11cc30 2024-09-21T08:06:41.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.477+0000 7f8432ffd640 1 -- 172.21.15.6:0/1454402610 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f843c10adf0 con 0x7f843c11cc30 2024-09-21T08:06:41.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:06:41.478 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:06:41.479 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:06:41.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 msgr2=0x7f84280b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:41.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 0x7f84280b8d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8438006fd0 tx=0x7f84380090e0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 msgr2=0x7f843c1aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8434009fd0 tx=0x7f843400c800 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 shutdown_connections 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84280b6880 0x7f84280b8d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f843c11cc30 0x7f843c1aeb60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c111f40 0x7f843c1a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 --2- 172.21.15.6:0/1454402610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f843c10a9e0 0x7f843c1a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:41.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.481+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 >> 172.21.15.6:0/1454402610 conn(0x7f843c070ec0 msgr2=0x7f843c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:41.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.482+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 shutdown_connections 2024-09-21T08:06:41.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:41.482+0000 7f8443b97640 1 -- 172.21.15.6:0/1454402610 wait complete. 2024-09-21T08:06:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:41 smithi145 ceph-mon[34049]: pgmap v512: 129 pgs: 129 active+clean; 2.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.9 MiB/s wr, 1.05k op/s 2024-09-21T08:06:41.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:41 smithi006 ceph-mon[30970]: pgmap v512: 129 pgs: 129 active+clean; 2.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.9 MiB/s wr, 1.05k op/s 2024-09-21T08:06:41.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:41 smithi119 ceph-mon[33564]: pgmap v512: 129 pgs: 129 active+clean; 2.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.9 MiB/s wr, 1.05k op/s 2024-09-21T08:06:42.260 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T08:06:42.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T08:06:42.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:42 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1454402610' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 225.0 s, 817.4 tps, lat 120.132 ms stddev 165.141 2024-09-21T08:06:42.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:42 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1454402610' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:42.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:42 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1454402610' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:43.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.344+0000 7ff86acc9640 1 -- 172.21.15.6:0/355035993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864118900 msgr2=0x7ff86411ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.344+0000 7ff86acc9640 1 --2- 172.21.15.6:0/355035993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864118900 0x7ff86411ad20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff854009900 tx=0x7ff85402a4d0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.349+0000 7ff86acc9640 1 -- 172.21.15.6:0/355035993 shutdown_connections 2024-09-21T08:06:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.349+0000 7ff86acc9640 1 --2- 172.21.15.6:0/355035993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff86410ad10 0x7ff8641183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.349+0000 7ff86acc9640 1 --2- 172.21.15.6:0/355035993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff864118900 0x7ff86411ad20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.349+0000 7ff86acc9640 1 --2- 172.21.15.6:0/355035993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86410a3c0 0x7ff86410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.349+0000 7ff86acc9640 1 -- 172.21.15.6:0/355035993 >> 172.21.15.6:0/355035993 conn(0x7ff864070e80 msgr2=0x7ff864071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.352+0000 7ff86acc9640 1 -- 172.21.15.6:0/355035993 shutdown_connections 2024-09-21T08:06:43.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.353+0000 7ff86acc9640 1 -- 172.21.15.6:0/355035993 wait complete. 2024-09-21T08:06:43.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.354+0000 7ff86acc9640 1 Processor -- start 2024-09-21T08:06:43.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.354+0000 7ff86acc9640 1 -- start start 2024-09-21T08:06:43.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86410a3c0 0x7ff8641a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff86410ad10 0x7ff8641aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff86411e3f0 con 0x7ff86410ad10 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff86411e270 con 0x7ff86410a3c0 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff86acc9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff86411e570 con 0x7ff864118900 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff869266640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff869266640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38222/0 (socket says 172.21.15.6:38222) 2024-09-21T08:06:43.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.355+0000 7ff869266640 1 -- 172.21.15.6:0/3172655659 learned_addr learned my addr 172.21.15.6:0/3172655659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.356+0000 7ff869266640 1 -- 172.21.15.6:0/3172655659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86410a3c0 msgr2=0x7ff8641a9f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.356+0000 7ff869266640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86410a3c0 0x7ff8641a9f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.356+0000 7ff869266640 1 -- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff86410ad10 msgr2=0x7ff8641aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.356+0000 7ff869266640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff86410ad10 0x7ff8641aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.356+0000 7ff869266640 1 -- 172.21.15.6:0/3172655659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8641171e0 con 0x7ff864118900 2024-09-21T08:06:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.357+0000 7ff869266640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff854006010 tx=0x7ff8540054a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.357+0000 7ff861ffb640 1 -- 172.21.15.6:0/3172655659 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854040030 con 0x7ff864118900 2024-09-21T08:06:43.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.357+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff864117470 con 0x7ff864118900 2024-09-21T08:06:43.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.358+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641179a0 con 0x7ff864118900 2024-09-21T08:06:43.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.358+0000 7ff861ffb640 1 -- 172.21.15.6:0/3172655659 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff854003ef0 con 0x7ff864118900 2024-09-21T08:06:43.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.358+0000 7ff861ffb640 1 -- 172.21.15.6:0/3172655659 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85403cab0 con 0x7ff864118900 2024-09-21T08:06:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.362+0000 7ff87123d740 1 Processor -- start 2024-09-21T08:06:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.363+0000 7ff87123d740 1 -- start start 2024-09-21T08:06:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029566f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x56029566f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5602955e5bb0 con 0x56029529f990 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5602955d4fe0 con 0x5602952c8850 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff87123d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5602955d8df0 con 0x5602952a7b70 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff863fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff863fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:48542/0 (socket says 172.21.15.6:48542) 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff863fff640 1 -- 172.21.15.6:0/427101030 learned_addr learned my addr 172.21.15.6:0/427101030 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.364+0000 7ff863fff640 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x56029566f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 -- 172.21.15.6:0/427101030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 msgr2=0x56029566f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x56029566f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 -- 172.21.15.6:0/427101030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 msgr2=0x56029566f3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029566f3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 -- 172.21.15.6:0/427101030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560295342ba0 con 0x5602952c8850 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff863fff640 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8580137d0 tx=0x7ff8580096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e1c990136c5e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.365+0000 7ff861ffb640 1 -- 172.21.15.6:0/3172655659 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff854043030 con 0x7ff864118900 2024-09-21T08:06:43.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.367+0000 7ff861ffb640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 0x7ff84c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.367+0000 7ff84affd640 1 -- 172.21.15.6:0/427101030 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858005220 con 0x5602952c8850 2024-09-21T08:06:43.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.368+0000 7ff861ffb640 1 -- 172.21.15.6:0/3172655659 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff854109170 con 0x7ff864118900 2024-09-21T08:06:43.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.368+0000 7ff84affd640 1 -- 172.21.15.6:0/427101030 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff858013e10 con 0x5602952c8850 2024-09-21T08:06:43.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.368+0000 7ff84affd640 1 -- 172.21.15.6:0/427101030 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85800c6d0 con 0x5602952c8850 2024-09-21T08:06:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.368+0000 7ff868a65640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 0x7ff84c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 -- 172.21.15.6:0/427101030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 msgr2=0x56029566ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8580137d0 tx=0x7ff8580096e0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 -- 172.21.15.6:0/427101030 shutdown_connections 2024-09-21T08:06:43.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x56029566f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029566f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 --2- 172.21.15.6:0/427101030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952c8850 0x56029566ee70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.369+0000 7ff87123d740 1 -- 172.21.15.6:0/427101030 >> 172.21.15.6:0/427101030 conn(0x5602952bcc40 msgr2=0x56029566cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.370+0000 7ff87123d740 1 -- 172.21.15.6:0/427101030 shutdown_connections 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.371+0000 7ff87123d740 1 -- 172.21.15.6:0/427101030 wait complete. 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.372+0000 7ff87123d740 1 -- start start 2024-09-21T08:06:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.372+0000 7ff87123d740 1 Processor -- start 2024-09-21T08:06:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029567aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 0x5602956869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5602954367b0 con 0x56029529f990 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56029556fe90 con 0x5602952a7b70 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56029567d640 con 0x5602952c8850 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff87123d740 10 client.0 _ll_register_callbacks cb 0x5602955d2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff863fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff863fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:48546/0 (socket says 172.21.15.6:48546) 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff863fff640 1 -- 172.21.15.6:0/3494761706 learned_addr learned my addr 172.21.15.6:0/3494761706 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff869266640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 0x5602956869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.373+0000 7ff868a65640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 0x7ff84c0b8c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x56029566daf0 tx=0x7ff85c009210 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 -- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 msgr2=0x56029567af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 -- 172.21.15.6:0/3494761706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 msgr2=0x56029567aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029567aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 -- 172.21.15.6:0/3494761706 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560295686f00 con 0x5602952c8850 2024-09-21T08:06:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.374+0000 7ff869266640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 0x5602956869c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8541064e0 tx=0x7ff8540ce410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cccca57d6bda7157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.375+0000 7ff843fff640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.375+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85404a040 con 0x5602952c8850 2024-09-21T08:06:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.375+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff858013e10 con 0x5602952c8850 2024-09-21T08:06:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.375+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff85403c440 con 0x5602952c8850 2024-09-21T08:06:43.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.375+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff8540ce6f0 con 0x5602952c8850 2024-09-21T08:06:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.377+0000 7ff87123d740 10 client.26083 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.377+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560295689810 con 0x5602952c8850 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff858013e10 con 0x5602952c8850 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff85403cc50 con 0x5602952c8850 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 10 client.26083 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 10 client.26083 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 20 client.26083 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5602952871d0 0x56029568cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 4 client.26083 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.379+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602955e7b00 con 0x5602952871d0 2024-09-21T08:06:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.382+0000 7ff868a65640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5602952871d0 0x56029568cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.382+0000 7ff843fff640 10 client.26083 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.383+0000 7ff868a65640 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5602952871d0 0x56029568cf90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2b894c7fda4366 server_cookie=fbaccd36acfa4b31 in_seq=0 out_seq=0 2024-09-21T08:06:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.395+0000 7ff843fff640 1 -- 172.21.15.6:0/3494761706 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602955e7b00 con 0x5602952871d0 2024-09-21T08:06:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.395+0000 7ff843fff640 10 client.26083 handle_command_reply: tid=0 2024-09-21T08:06:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.395+0000 7ff87123d740 1 client.26083 shutdown 2024-09-21T08:06:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.395+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 msgr2=0x5602956869c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.395+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 0x5602956869c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8541064e0 tx=0x7ff8540ce410 comp rx=0 tx=0).stop 2024-09-21T08:06:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 shutdown_connections 2024-09-21T08:06:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5602952871d0 0x56029568cf90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952c8850 0x5602956869c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 --2- 172.21.15.6:0/3494761706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56029529f990 0x56029567aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 >> 172.21.15.6:0/3494761706 conn(0x5602952bcc40 msgr2=0x560295672000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.396+0000 7ff843fff640 0 client.26083 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.399+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 shutdown_connections 2024-09-21T08:06:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.401+0000 7ff87123d740 1 -- 172.21.15.6:0/3494761706 wait complete. 2024-09-21T08:06:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.403+0000 7ff87123d740 20 client.26083 trim_cache size 0 max 16384 2024-09-21T08:06:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.444+0000 7ff87123d740 1 Processor -- start 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.444+0000 7ff87123d740 1 -- start start 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.444+0000 7ff87123d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56029529f990 0x560295673f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.444+0000 7ff87123d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x560295674440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.444+0000 7ff87123d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x560295671f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff863fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x560295674440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff863fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x560295674440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38240/0 (socket says 172.21.15.6:38240) 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff863fff640 1 -- 172.21.15.6:0/1695932527 learned_addr learned my addr 172.21.15.6:0/1695932527 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff85000dfb0 con 0x5602952c8850 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff850010830 con 0x56029529f990 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff85000e620 con 0x5602952a7b70 2024-09-21T08:06:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.445+0000 7ff869266640 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x560295671f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.446+0000 7ff869266640 1 -- 172.21.15.6:0/1695932527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 msgr2=0x560295674440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.446+0000 7ff869266640 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x560295674440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.446+0000 7ff869266640 1 -- 172.21.15.6:0/1695932527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56029529f990 msgr2=0x560295673f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.446+0000 7ff869266640 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56029529f990 0x560295673f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.446+0000 7ff869266640 1 -- 172.21.15.6:0/1695932527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602956760d0 con 0x5602952c8850 2024-09-21T08:06:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.447+0000 7ff869266640 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x560295671f70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff854003b00 tx=0x7ff8540b6190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b92aca666d5fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.457+0000 7ff84a7fc640 1 -- 172.21.15.6:0/1695932527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85404a070 con 0x5602952c8850 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.457+0000 7ff84a7fc640 1 -- 172.21.15.6:0/1695932527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8540f61a0 con 0x5602952c8850 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 msgr2=0x560295671f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x560295671f70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff854003b00 tx=0x7ff8540b6190 comp rx=0 tx=0).stop 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 shutdown_connections 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5602952a7b70 0x560295674440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x560295671f70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 --2- 172.21.15.6:0/1695932527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56029529f990 0x560295673f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.458+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 >> 172.21.15.6:0/1695932527 conn(0x5602952bcc40 msgr2=0x5602956790c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.464+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 shutdown_connections 2024-09-21T08:06:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.468+0000 7ff87123d740 1 -- 172.21.15.6:0/1695932527 wait complete. 2024-09-21T08:06:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.468+0000 7ff87123d740 1 -- start start 2024-09-21T08:06:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.468+0000 7ff87123d740 1 Processor -- start 2024-09-21T08:06:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 0x56029567eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x5602956f6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff85000ecf0 con 0x5602952c8850 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff850010160 con 0x5602952a7b70 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.471+0000 7ff87123d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff85000f3c0 con 0x56029529f990 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.472+0000 7ff87123d740 10 client.0 _ll_register_callbacks cb 0x7ff854005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.472+0000 7ff869266640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x5602956f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.472+0000 7ff869266640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x5602956f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39424/0 (socket says 172.21.15.6:39424) 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.472+0000 7ff869266640 1 -- 172.21.15.6:0/1994622903 learned_addr learned my addr 172.21.15.6:0/1994622903 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 0x56029567eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff863fff640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 -- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 msgr2=0x56029567f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 -- 172.21.15.6:0/1994622903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 msgr2=0x5602956f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x5602956f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.473+0000 7ff868a65640 1 -- 172.21.15.6:0/1994622903 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56029567f8d0 con 0x56029529f990 2024-09-21T08:06:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.474+0000 7ff868a65640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 0x56029567eb80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56029568af10 tx=0x7ff85c004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7364e9e400b49e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:43.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.475+0000 7ff843fff640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:06:43.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.513+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c01b630 con 0x56029529f990 2024-09-21T08:06:43.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.513+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8540f61a0 con 0x56029529f990 2024-09-21T08:06:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.513+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff85c01b7d0 con 0x56029529f990 2024-09-21T08:06:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.514+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff85c032050 con 0x56029529f990 2024-09-21T08:06:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.514+0000 7ff87123d740 10 client.26089 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.514+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5602956f7ee0 con 0x56029529f990 2024-09-21T08:06:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.514+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8540f61a0 con 0x56029529f990 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff85c00b040 con 0x56029529f990 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 10 client.26089 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 10 client.26089 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 20 client.26089 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56029525c580 0x5602956fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 4 client.26089 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T08:06:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.515+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x5602955e35b0 con 0x56029525c580 2024-09-21T08:06:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.520+0000 7ff863fff640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56029525c580 0x5602956fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.521+0000 7ff843fff640 10 client.26089 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.521+0000 7ff863fff640 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56029525c580 0x5602956fa6c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e9ded560a30c04 server_cookie=53c8dd1d01371dec in_seq=0 out_seq=0 2024-09-21T08:06:43.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:43 smithi006 ceph-mon[30970]: pgmap v513: 129 pgs: 129 active+clean; 2.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff843fff640 1 -- 172.21.15.6:0/1994622903 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5602955e35b0 con 0x56029525c580 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff843fff640 10 client.26089 handle_command_reply: tid=0 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 client.26089 shutdown 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 msgr2=0x56029567eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 0x56029567eb80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56029568af10 tx=0x7ff85c004a80 comp rx=0 tx=0).stop 2024-09-21T08:06:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 shutdown_connections 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56029525c580 0x5602956fa6c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602952c8850 0x5602956f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5602952a7b70 0x56029567f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 --2- 172.21.15.6:0/1994622903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56029529f990 0x56029567eb80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff843fff640 0 client.26089 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 >> 172.21.15.6:0/1994622903 conn(0x5602952bcc40 msgr2=0x560295671f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 shutdown_connections 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.863+0000 7ff87123d740 1 -- 172.21.15.6:0/1994622903 wait complete. 2024-09-21T08:06:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff87123d740 20 client.26089 trim_cache size 0 max 16384 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 22, 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "6c9b2f0d": { 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 22, 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:43.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 139.2, 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:43.868 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 msgr2=0x7ff84c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 0x7ff84c0b8c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x56029566daf0 tx=0x7ff85c009210 comp rx=0 tx=0).stop 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 msgr2=0x7ff8641aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff854006010 tx=0x7ff8540054a0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 shutdown_connections 2024-09-21T08:06:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff84c0b6730 0x7ff84c0b8c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff864118900 0x7ff8641aa9a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff86410ad10 0x7ff8641aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 --2- 172.21.15.6:0/3172655659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff86410a3c0 0x7ff8641a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 >> 172.21.15.6:0/3172655659 conn(0x7ff864070e80 msgr2=0x7ff86410e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 shutdown_connections 2024-09-21T08:06:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:43.864+0000 7ff86acc9640 1 -- 172.21.15.6:0/3172655659 wait complete. 2024-09-21T08:06:43.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:43 smithi119 ceph-mon[33564]: pgmap v513: 129 pgs: 129 active+clean; 2.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:06:43.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:43 smithi145 ceph-mon[34049]: pgmap v513: 129 pgs: 129 active+clean; 2.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-21T08:06:44.695 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:44 smithi006 ceph-mon[30970]: pgmap v514: 129 pgs: 129 active+clean; 2.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T08:06:44.725 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6c9b2f0d', quiesce took 4.7 seconds. Will release after: 14.55 2024-09-21T08:06:44.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:44 smithi119 ceph-mon[33564]: pgmap v514: 129 pgs: 129 active+clean; 2.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T08:06:44.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:44 smithi145 ceph-mon[34049]: pgmap v514: 129 pgs: 129 active+clean; 2.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T08:06:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:46 smithi119 ceph-mon[33564]: pgmap v515: 129 pgs: 129 active+clean; 2.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-21T08:06:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:46 smithi145 ceph-mon[34049]: pgmap v515: 129 pgs: 129 active+clean; 2.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-21T08:06:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:46 smithi006 ceph-mon[30970]: pgmap v515: 129 pgs: 129 active+clean; 2.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 921 op/s 2024-09-21T08:06:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 230.0 s, 87.9 tps, lat 149.571 ms stddev 81.150 2024-09-21T08:06:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:48 smithi119 ceph-mon[33564]: pgmap v516: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-09-21T08:06:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:48 smithi145 ceph-mon[34049]: pgmap v516: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-09-21T08:06:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:48 smithi006 ceph-mon[30970]: pgmap v516: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 889 op/s 2024-09-21T08:06:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:50 smithi119 ceph-mon[33564]: pgmap v517: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-21T08:06:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:50 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:06:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:50 smithi145 ceph-mon[34049]: pgmap v517: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-21T08:06:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:50 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:06:51.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:50 smithi006 ceph-mon[30970]: pgmap v517: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-09-21T08:06:51.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:50 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:06:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:06:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:06:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:06:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:06:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:06:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:06:52.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:06:52.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:06:52.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:06:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:06:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:53 smithi119 ceph-mon[33564]: pgmap v518: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.4 MiB/s wr, 560 op/s 2024-09-21T08:06:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:53 smithi145 ceph-mon[34049]: pgmap v518: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.4 MiB/s wr, 560 op/s 2024-09-21T08:06:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:53 smithi006 ceph-mon[30970]: pgmap v518: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.4 MiB/s wr, 560 op/s 2024-09-21T08:06:55.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:06:55.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:55 smithi006 ceph-mon[30970]: pgmap v519: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.9 MiB/s wr, 378 op/s 2024-09-21T08:06:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:55 smithi119 ceph-mon[33564]: pgmap v519: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.9 MiB/s wr, 378 op/s 2024-09-21T08:06:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:55 smithi145 ceph-mon[34049]: pgmap v519: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.9 MiB/s wr, 378 op/s 2024-09-21T08:06:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 -- 172.21.15.6:0/3993233423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 msgr2=0x7fc1d010fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 --2- 172.21.15.6:0/3993233423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d010fcc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009900 tx=0x7fc1c002a480 comp rx=0 tx=0).stop 2024-09-21T08:06:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 -- 172.21.15.6:0/3993233423 shutdown_connections 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 --2- 172.21.15.6:0/3993233423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 0x7fc1d0112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 --2- 172.21.15.6:0/3993233423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d010fcc0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 --2- 172.21.15.6:0/3993233423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 0x7fc1d0102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 -- 172.21.15.6:0/3993233423 >> 172.21.15.6:0/3993233423 conn(0x7fc1d0079760 msgr2=0x7fc1d0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 -- 172.21.15.6:0/3993233423 shutdown_connections 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.363+0000 7fc1d777d640 1 -- 172.21.15.6:0/3993233423 wait complete. 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 Processor -- start 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 -- start start 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 0x7fc1d019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 0x7fc1d01a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d0115b20 con 0x7fc1d0102fa0 2024-09-21T08:06:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01159a0 con 0x7fc1d0102650 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d777d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d0115ca0 con 0x7fc1d0110200 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38356/0 (socket says 172.21.15.6:38356) 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1973697335 learned_addr learned my addr 172.21.15.6:0/1973697335 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 0x7fc1d01a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.364+0000 7fc1d5519640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 0x7fc1d019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1973697335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 msgr2=0x7fc1d01a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 0x7fc1d01a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1973697335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 msgr2=0x7fc1d019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 0x7fc1d019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1973697335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d01a2500 con 0x7fc1d0102fa0 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009230 tx=0x7fc1c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1c67fc640 1 -- 172.21.15.6:0/1973697335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c003f030 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1c67fc640 1 -- 172.21.15.6:0/1973697335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1c0003a80 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1c67fc640 1 -- 172.21.15.6:0/1973697335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0035070 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d01a2790 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.365+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d01a8f50 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.368+0000 7fc1ddcf1740 1 Processor -- start 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.368+0000 7fc1ddcf1740 1 -- start start 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.368+0000 7fc1c67fc640 1 -- 172.21.15.6:0/1973697335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc1c0042030 con 0x7fc1d0102fa0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54fc070 0x55a8e58a3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 0x55a8e58a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a8e5819e50 con 0x55a8e54d31b0 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a8e5809280 con 0x55a8e54db390 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a8e580d090 con 0x55a8e54fc070 2024-09-21T08:06:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38366/0 (socket says 172.21.15.6:38366) 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 -- 172.21.15.6:0/2076600688 learned_addr learned my addr 172.21.15.6:0/2076600688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 0x55a8e58a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54fc070 0x55a8e58a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 -- 172.21.15.6:0/2076600688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54fc070 msgr2=0x55a8e58a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54fc070 0x55a8e58a3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 -- 172.21.15.6:0/2076600688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 msgr2=0x55a8e58a40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 0x55a8e58a40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 -- 172.21.15.6:0/2076600688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e5567650 con 0x55a8e54d31b0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 0x55a8e58a40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1c67fc640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 0x7fc1bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00bd50 tx=0x7fc1cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab78478f9d65db0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.369+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 0x7fc1bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.370+0000 7fc1c67fc640 1 -- 172.21.15.6:0/1973697335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1c0108170 con 0x7fc1d0102fa0 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.370+0000 7fc1bb7fe640 1 -- 172.21.15.6:0/2076600688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc005220 con 0x55a8e54d31b0 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.370+0000 7fc1bb7fe640 1 -- 172.21.15.6:0/2076600688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1cc00be40 con 0x55a8e54d31b0 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.370+0000 7fc1bb7fe640 1 -- 172.21.15.6:0/2076600688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc011770 con 0x55a8e54d31b0 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2076600688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 msgr2=0x55a8e58a3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 0x7fc1bc0b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005fd0 tx=0x7fc1c8009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00bd50 tx=0x7fc1cc0107a0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2076600688 shutdown_connections 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54db390 0x55a8e58a40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a3b90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2076600688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54fc070 0x55a8e58a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2076600688 >> 172.21.15.6:0/2076600688 conn(0x55a8e54f0460 msgr2=0x55a8e58a1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2076600688 shutdown_connections 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2076600688 wait complete. 2024-09-21T08:06:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 -- start start 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.371+0000 7fc1ddcf1740 1 Processor -- start 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a8e566a700 con 0x55a8e54db390 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a8e57a4110 con 0x55a8e54fc070 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a8e58b1e30 con 0x55a8e54d31b0 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1ddcf1740 10 client.0 _ll_register_callbacks cb 0x55a8e57bd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38380/0 (socket says 172.21.15.6:38380) 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 -- 172.21.15.6:0/2895222768 learned_addr learned my addr 172.21.15.6:0/2895222768 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 -- 172.21.15.6:0/2895222768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 msgr2=0x55a8e58aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 -- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 msgr2=0x55a8e58af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 -- 172.21.15.6:0/2895222768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e57d1c40 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1c01055a0 tx=0x7fc1c0105a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69874d483da9e34d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.372+0000 7fc1b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0049030 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1c00f10b0 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8e581bda0 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1c00cdac0 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 10 client.16338 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a8e58bdab0 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a8e581bda0 con 0x55a8e54db390 2024-09-21T08:06:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1c00d71d0 con 0x55a8e54db390 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 10 client.16338 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 20 client.16338 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e54ba9f0 0x55a8e58c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 4 client.16338 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8e5817850 con 0x55a8e54ba9f0 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.373+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e54ba9f0 0x55a8e58c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.374+0000 7fc1d5519640 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e54ba9f0 0x55a8e58c0fa0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ec049bb0958349 server_cookie=dda3b332d6085994 in_seq=0 out_seq=0 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.374+0000 7fc1b8ff9640 10 client.16338 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/2895222768 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8e5817850 con 0x55a8e54ba9f0 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1b8ff9640 10 client.16338 handle_command_reply: tid=0 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 client.16338 shutdown 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 msgr2=0x55a8e58af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1c01055a0 tx=0x7fc1c0105a40 comp rx=0 tx=0).stop 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 shutdown_connections 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e54ba9f0 0x55a8e58c0fa0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58af1c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1b8ff9640 0 client.16338 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/2895222768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 >> 172.21.15.6:0/2895222768 conn(0x55a8e54f0460 msgr2=0x55a8e58a67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 shutdown_connections 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/2895222768 wait complete. 2024-09-21T08:06:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.375+0000 7fc1ddcf1740 20 client.16338 trim_cache size 0 max 16384 2024-09-21T08:06:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 Processor -- start 2024-09-21T08:06:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 -- start start 2024-09-21T08:06:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54db390 0x55a8e58abe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b0e80 con 0x55a8e54d31b0 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b3700 con 0x55a8e54fc070 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b14f0 con 0x55a8e54db390 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1d5519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1d5519640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38394/0 (socket says 172.21.15.6:38394) 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.393+0000 7fc1d5519640 1 -- 172.21.15.6:0/3637267169 learned_addr learned my addr 172.21.15.6:0/3637267169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54db390 0x55a8e58abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 -- 172.21.15.6:0/3637267169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54db390 msgr2=0x55a8e58abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54db390 0x55a8e58abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 -- 172.21.15.6:0/3637267169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 msgr2=0x55a8e58ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 -- 172.21.15.6:0/3637267169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e58afa40 con 0x55a8e54d31b0 2024-09-21T08:06:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1d5519640 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01a000 tx=0x7fc1cc005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab38c8348cdf797f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1baffd640 1 -- 172.21.15.6:0/3637267169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc02a020 con 0x55a8e54d31b0 2024-09-21T08:06:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1baffd640 1 -- 172.21.15.6:0/3637267169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1cc005050 con 0x55a8e54d31b0 2024-09-21T08:06:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.394+0000 7fc1baffd640 1 -- 172.21.15.6:0/3637267169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0048a0 con 0x55a8e54d31b0 2024-09-21T08:06:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/3637267169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 msgr2=0x55a8e58a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01a000 tx=0x7fc1cc005d00 comp rx=0 tx=0).stop 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/3637267169 shutdown_connections 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54db390 0x55a8e58abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/3637267169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54d31b0 0x55a8e58a4d90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/3637267169 >> 172.21.15.6:0/3637267169 conn(0x55a8e54f0460 msgr2=0x55a8e58a4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/3637267169 shutdown_connections 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/3637267169 wait complete. 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.395+0000 7fc1ddcf1740 1 -- start start 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 Processor -- start 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b1bc0 con 0x55a8e54db390 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b3030 con 0x55a8e54fc070 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d01b2290 con 0x55a8e54d31b0 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1ddcf1740 10 client.0 _ll_register_callbacks cb 0x7fc1c0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1d4d18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38408/0 (socket says 172.21.15.6:38408) 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1734268164 learned_addr learned my addr 172.21.15.6:0/1734268164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1d5519640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.396+0000 7fc1d5d1a640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1734268164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 msgr2=0x55a8e58b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 msgr2=0x55a8e58b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 -- 172.21.15.6:0/1734268164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e592a960 con 0x55a8e54db390 2024-09-21T08:06:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1d4d18640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00cd0c0 tx=0x7fc1c00f12e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66012cde167a1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0049070 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fc1c00f5170 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1cc005050 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1c00cd460 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1ddcf1740 10 client.16344 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.397+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a8e592bbf0 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1cc005050 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc1c00d2190 con 0x55a8e54db390 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 10 client.16344 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 20 client.16344 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e548fda0 0x55a8e592e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 4 client.16344 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:06:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8e5814c80 con 0x55a8e548fda0 2024-09-21T08:06:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1d5519640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e548fda0 0x55a8e592e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1d5519640 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e548fda0 0x55a8e592e130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce152fafe98a3cc1 server_cookie=e0ad5c32284df50d in_seq=0 out_seq=0 2024-09-21T08:06:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.398+0000 7fc1b8ff9640 10 client.16344 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1b8ff9640 1 -- 172.21.15.6:0/1734268164 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55a8e5814c80 con 0x55a8e548fda0 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1b8ff9640 10 client.16344 handle_command_reply: tid=0 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 client.16344 shutdown 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 msgr2=0x55a8e58b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00cd0c0 tx=0x7fc1c00f12e0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 shutdown_connections 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a8e548fda0 0x55a8e592e130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a8e54fc070 0x55a8e58b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8e54db390 0x55a8e58b35c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 --2- 172.21.15.6:0/1734268164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a8e54d31b0 0x55a8e58b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 >> 172.21.15.6:0/1734268164 conn(0x55a8e54f0460 msgr2=0x55a8e58a1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1b8ff9640 0 client.16344 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 shutdown_connections 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 1 -- 172.21.15.6:0/1734268164 wait complete. 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.399+0000 7fc1ddcf1740 20 client.16344 trim_cache size 0 max 16384 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:06:56.405 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.407 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:06:56.408 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:06:56.409 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:06:56.410 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 msgr2=0x7fc1bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 0x7fc1bc0b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005fd0 tx=0x7fc1c8009600 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 msgr2=0x7fc1d019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009230 tx=0x7fc1c0004270 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 shutdown_connections 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc1bc0b6680 0x7fc1bc0b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d0110200 0x7fc1d01a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1d0102fa0 0x7fc1d019cb30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 --2- 172.21.15.6:0/1973697335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d0102650 0x7fc1d019c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 >> 172.21.15.6:0/1973697335 conn(0x7fc1d0079760 msgr2=0x7fc1d01116b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 shutdown_connections 2024-09-21T08:06:56.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:56.400+0000 7fc1d777d640 1 -- 172.21.15.6:0/1973697335 wait complete. 2024-09-21T08:06:57.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:57 smithi006 ceph-mon[30970]: pgmap v520: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-21T08:06:57.285 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:06:57.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:57 smithi119 ceph-mon[33564]: pgmap v520: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-21T08:06:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:57 smithi145 ceph-mon[34049]: pgmap v520: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-21T08:06:57.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:06:57.588 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 -- 172.21.15.6:0/115930359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb141083a0 msgr2=0x7fdb141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 --2- 172.21.15.6:0/115930359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb141083a0 0x7fdb141087b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009900 tx=0x7fdafc02a410 comp rx=0 tx=0).stop 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 -- 172.21.15.6:0/115930359 shutdown_connections 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 --2- 172.21.15.6:0/115930359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14108cf0 0x7fdb1410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 --2- 172.21.15.6:0/115930359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb141083a0 0x7fdb141087b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 --2- 172.21.15.6:0/115930359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb14102a60 0x7fdb14102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 -- 172.21.15.6:0/115930359 >> 172.21.15.6:0/115930359 conn(0x7fdb14079730 msgr2=0x7fdb14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 -- 172.21.15.6:0/115930359 shutdown_connections 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.098+0000 7fdb19db8640 1 -- 172.21.15.6:0/115930359 wait complete. 2024-09-21T08:06:58.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 Processor -- start 2024-09-21T08:06:58.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 -- start start 2024-09-21T08:06:58.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14102a60 0x7fdb14199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:58.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb141083a0 0x7fdb141998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:58.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14112850 con 0x7fdb14108cf0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb141126d0 con 0x7fdb141083a0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb19db8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb141129d0 con 0x7fdb14102a60 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38418/0 (socket says 172.21.15.6:38418) 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb13fff640 1 -- 172.21.15.6:0/1617420746 learned_addr learned my addr 172.21.15.6:0/1617420746 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb137fe640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14102a60 0x7fdb14199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.099+0000 7fdb12ffd640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb141083a0 0x7fdb141998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 -- 172.21.15.6:0/1617420746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14102a60 msgr2=0x7fdb14199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14102a60 0x7fdb14199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 -- 172.21.15.6:0/1617420746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb141083a0 msgr2=0x7fdb141998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb141083a0 0x7fdb141998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 -- 172.21.15.6:0/1617420746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1419f1b0 con 0x7fdb14108cf0 2024-09-21T08:06:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb13fff640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b970 tx=0x7fdb0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c019070 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1419f4a0 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb0c014440 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0075d0 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.100+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141a5cc0 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.101+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb14103ce0 con 0x7fdb14108cf0 2024-09-21T08:06:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.103+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdb0c01c070 con 0x7fdb14108cf0 2024-09-21T08:06:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.104+0000 7fdb10ff9640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 0x7fdb000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.104+0000 7fdb137fe640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 0x7fdb000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.104+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fdb0c0e7320 con 0x7fdb14108cf0 2024-09-21T08:06:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.104+0000 7fdb137fe640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 0x7fdb000b8bc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400abe0 tx=0x7fdb0400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.107+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb0c0b1870 con 0x7fdb14108cf0 2024-09-21T08:06:58.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.336+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb1410ab40 con 0x7fdb14108cf0 2024-09-21T08:06:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.337+0000 7fdb10ff9640 1 -- 172.21.15.6:0/1617420746 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fdb0c0b67b0 con 0x7fdb14108cf0 2024-09-21T08:06:58.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:06:58.339 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:06:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:06:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 msgr2=0x7fdb000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 0x7fdb000b8bc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400abe0 tx=0x7fdb0400a2d0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 msgr2=0x7fdb1419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b970 tx=0x7fdb0c00bd70 comp rx=0 tx=0).stop 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 shutdown_connections 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb000b66b0 0x7fdb000b8bc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb14108cf0 0x7fdb1419eb40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb141083a0 0x7fdb141998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.339+0000 7fdb19db8640 1 --2- 172.21.15.6:0/1617420746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb14102a60 0x7fdb14199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.340+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 >> 172.21.15.6:0/1617420746 conn(0x7fdb14079730 msgr2=0x7fdb14105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.340+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 shutdown_connections 2024-09-21T08:06:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:58.340+0000 7fdb19db8640 1 -- 172.21.15.6:0/1617420746 wait complete. 2024-09-21T08:06:59.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:06:59.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:06:59.299 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:59 smithi006 ceph-mon[30970]: pgmap v521: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.0 MiB/s wr, 120 op/s 2024-09-21T08:06:59.299 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:06:59 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1617420746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:59 smithi119 ceph-mon[33564]: pgmap v521: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.0 MiB/s wr, 120 op/s 2024-09-21T08:06:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:06:59 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1617420746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:59.441 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:06:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:59 smithi145 ceph-mon[34049]: pgmap v521: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.0 MiB/s wr, 120 op/s 2024-09-21T08:06:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:06:59 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1617420746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:06:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.924+0000 7fe36722e640 1 -- 172.21.15.6:0/1497873966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe360108cf0 msgr2=0x7fe36010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.924+0000 7fe36722e640 1 --2- 172.21.15.6:0/1497873966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe360108cf0 0x7fe36010f520 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe358009ca0 tx=0x7fe35802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 -- 172.21.15.6:0/1497873966 shutdown_connections 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 --2- 172.21.15.6:0/1497873966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe360108cf0 0x7fe36010f520 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 --2- 172.21.15.6:0/1497873966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3601083a0 0x7fe3601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 --2- 172.21.15.6:0/1497873966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360102a60 0x7fe360102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 -- 172.21.15.6:0/1497873966 >> 172.21.15.6:0/1497873966 conn(0x7fe360079730 msgr2=0x7fe360079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 -- 172.21.15.6:0/1497873966 shutdown_connections 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 -- 172.21.15.6:0/1497873966 wait complete. 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 Processor -- start 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.925+0000 7fe36722e640 1 -- start start 2024-09-21T08:06:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe360102a60 0x7fe36019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360108cf0 0x7fe36019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112860 con 0x7fe3601083a0 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601126e0 con 0x7fe360102a60 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe36722e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601129e0 con 0x7fe360108cf0 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38436/0 (socket says 172.21.15.6:38436) 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe3657cb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360108cf0 0x7fe36019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 -- 172.21.15.6:0/3049783867 learned_addr learned my addr 172.21.15.6:0/3049783867 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe364fca640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe360102a60 0x7fe36019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 -- 172.21.15.6:0/3049783867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360108cf0 msgr2=0x7fe36019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360108cf0 0x7fe36019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 -- 172.21.15.6:0/3049783867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe360102a60 msgr2=0x7fe36019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe360102a60 0x7fe36019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.926+0000 7fe35ffff640 1 -- 172.21.15.6:0/3049783867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3601a01d0 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c970 tx=0x7fe34c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe35dffb640 1 -- 172.21.15.6:0/3049783867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c007bb0 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe35dffb640 1 -- 172.21.15.6:0/3049783867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe34c007d50 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe35dffb640 1 -- 172.21.15.6:0/3049783867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c004d00 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3601a04c0 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.927+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3601a6ce0 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 Processor -- start 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe35dffb640 1 -- 172.21.15.6:0/3049783867 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe34c004ea0 con 0x7fe3601083a0 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 -- start start 2024-09-21T08:06:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dc56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dc6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559266d3bea0 con 0x5592669f51b0 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559266d2b2d0 con 0x5592669fd390 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559266d2f0e0 con 0x559266a1e070 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe364fca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe364fca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38444/0 (socket says 172.21.15.6:38444) 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe364fca640 1 -- 172.21.15.6:0/3953069673 learned_addr learned my addr 172.21.15.6:0/3953069673 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dc56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.930+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dc6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 -- 172.21.15.6:0/3953069673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 msgr2=0x559266dc56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dc56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 -- 172.21.15.6:0/3953069673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 msgr2=0x559266dc6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dc6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 -- 172.21.15.6:0/3953069673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559266a89650 con 0x5592669f51b0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dc56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe35dffb640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 0x7fe3500b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 0x7fe3500b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe364fca640 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe35400ad30 tx=0x7fe35400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c449a351ebdf43e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe35dffb640 1 -- 172.21.15.6:0/3049783867 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe34c0e7620 con 0x7fe3601083a0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe34affd640 1 -- 172.21.15.6:0/3953069673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354010840 con 0x5592669f51b0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe34affd640 1 -- 172.21.15.6:0/3953069673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe354014070 con 0x5592669f51b0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.931+0000 7fe34affd640 1 -- 172.21.15.6:0/3953069673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354018a90 con 0x5592669f51b0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3953069673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 msgr2=0x559266dc5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 0x7fe3500b8c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe358006010 tx=0x7fe358005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe35400ad30 tx=0x7fe35400f790 comp rx=0 tx=0).stop 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3953069673 shutdown_connections 2024-09-21T08:06:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dc6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266dc5be0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3953069673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dc56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3953069673 >> 172.21.15.6:0/3953069673 conn(0x559266a12460 msgr2=0x559266dc3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3953069673 shutdown_connections 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.932+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3953069673 wait complete. 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 -- start start 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 Processor -- start 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266de14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559266b8c700 con 0x5592669fd390 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559266cc6160 con 0x559266a1e070 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559266dd81b0 con 0x5592669f51b0 2024-09-21T08:06:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe36d7a2740 10 client.0 _ll_register_callbacks cb 0x559266cdf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38454/0 (socket says 172.21.15.6:38454) 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe35ffff640 1 -- 172.21.15.6:0/3516166010 learned_addr learned my addr 172.21.15.6:0/3516166010 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266de14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.933+0000 7fe364fca640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 -- 172.21.15.6:0/3516166010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 msgr2=0x559266dd5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 -- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 msgr2=0x559266de14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266de14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 -- 172.21.15.6:0/3516166010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559266cf3c90 con 0x5592669fd390 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0e4a50 tx=0x7fe34c0ac720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f46d0f2076df9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe33ffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c01d040 con 0x5592669fd390 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe34c0e7230 con 0x5592669fd390 2024-09-21T08:06:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe354014070 con 0x5592669fd390 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe34c0acec0 con 0x5592669fd390 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe36d7a2740 10 client.16362 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.934+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559266de3f00 con 0x5592669fd390 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe354014070 con 0x5592669fd390 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe34c0b2d60 con 0x5592669fd390 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 10 client.16362 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 20 client.16362 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669dc9f0 0x559266de73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 4 client.16362 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559266d3ddf0 con 0x5592669dc9f0 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe364fca640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669dc9f0 0x559266de73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe33ffff640 10 client.16362 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.935+0000 7fe364fca640 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669dc9f0 0x559266de73f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11575d1cb7e85d2 server_cookie=e1475e1fa3cf0cd2 in_seq=0 out_seq=0 2024-09-21T08:06:59.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe33ffff640 1 -- 172.21.15.6:0/3516166010 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559266d3ddf0 con 0x5592669dc9f0 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe33ffff640 10 client.16362 handle_command_reply: tid=0 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 client.16362 shutdown 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 msgr2=0x559266dd5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0e4a50 tx=0x7fe34c0ac720 comp rx=0 tx=0).stop 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 shutdown_connections 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669dc9f0 0x559266de73f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.936+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266de14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dd5640 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3516166010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 >> 172.21.15.6:0/3516166010 conn(0x559266a12460 msgr2=0x559266dc87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe33ffff640 0 client.16362 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 shutdown_connections 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3516166010 wait complete. 2024-09-21T08:06:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.937+0000 7fe36d7a2740 20 client.16362 trim_cache size 0 max 16384 2024-09-21T08:06:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.950+0000 7fe36d7a2740 1 Processor -- start 2024-09-21T08:06:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.950+0000 7fe36d7a2740 1 -- start start 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266dc2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601aca40 con 0x5592669fd390 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601af2c0 con 0x559266a1e070 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601ad0b0 con 0x5592669f51b0 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38464/0 (socket says 172.21.15.6:38464) 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 -- 172.21.15.6:0/3362134507 learned_addr learned my addr 172.21.15.6:0/3362134507 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe364fca640 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe3657cb640 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266dc2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 -- 172.21.15.6:0/3362134507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 msgr2=0x559266dd6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 -- 172.21.15.6:0/3362134507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 msgr2=0x559266dc2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266dc2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 -- 172.21.15.6:0/3362134507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559266dd6050 con 0x5592669fd390 2024-09-21T08:06:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe35ffff640 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ad080 tx=0x7fe34c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c97d8e117f4441 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.951+0000 7fe34a7fc640 1 -- 172.21.15.6:0/3362134507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c01d030 con 0x5592669fd390 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe34a7fc640 1 -- 172.21.15.6:0/3362134507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe34c0ad7f0 con 0x5592669fd390 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe34a7fc640 1 -- 172.21.15.6:0/3362134507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0ac860 con 0x5592669fd390 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3362134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 msgr2=0x559266dc6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ad080 tx=0x7fe34c00cf80 comp rx=0 tx=0).stop 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3362134507 shutdown_connections 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559266a1e070 0x559266dc2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669fd390 0x559266dc6de0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/3362134507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592669f51b0 0x559266dd6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3362134507 >> 172.21.15.6:0/3362134507 conn(0x559266a12460 msgr2=0x559266dc66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3362134507 shutdown_connections 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.952+0000 7fe36d7a2740 1 -- 172.21.15.6:0/3362134507 wait complete. 2024-09-21T08:06:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 -- start start 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 Processor -- start 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dd93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dd9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601ad780 con 0x5592669f51b0 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601aebf0 con 0x5592669fd390 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.953+0000 7fe36d7a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601ade50 con 0x559266a1e070 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe36d7a2740 10 client.0 _ll_register_callbacks cb 0x7fe34c0b4f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dd93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dd93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46986/0 (socket says 172.21.15.6:46986) 2024-09-21T08:06:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38478/0 (socket says 172.21.15.6:38478) 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe35ffff640 1 -- 172.21.15.6:0/2438547016 learned_addr learned my addr 172.21.15.6:0/2438547016 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe3657cb640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dd9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 -- 172.21.15.6:0/2438547016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 msgr2=0x559266dd9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dd9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 -- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 msgr2=0x559266dd93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dd93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 -- 172.21.15.6:0/2438547016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559266dc9750 con 0x5592669f51b0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe364fca640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe35401a040 tx=0x7fe3540186d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35290cc3df66b67c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe33ffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35402e030 con 0x5592669f51b0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fe3540184d0 con 0x5592669f51b0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.954+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe34c0ad7f0 con 0x5592669f51b0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe35403b050 con 0x5592669f51b0 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 10 client.16368 fetch_fsmap learned FSMap version 21 2024-09-21T08:06:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559266e51d40 con 0x5592669f51b0 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe34c0ad7f0 con 0x5592669f51b0 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe354005550 con 0x5592669f51b0 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 10 client.16368 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 20 client.16368 populate_metadata read hostname 'smithi006' 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669b1da0 0x559266e54190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 4 client.16368 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559266d398a0 con 0x5592669b1da0 2024-09-21T08:06:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.955+0000 7fe35ffff640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669b1da0 0x559266e54190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:06:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe33ffff640 10 client.16368 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe35ffff640 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669b1da0 0x559266e54190 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33696601cbe52f3 server_cookie=bf6b7432d1888148 in_seq=0 out_seq=0 2024-09-21T08:06:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe33ffff640 1 -- 172.21.15.6:0/2438547016 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559266d398a0 con 0x5592669b1da0 2024-09-21T08:06:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe33ffff640 10 client.16368 handle_command_reply: tid=0 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 client.16368 shutdown 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 msgr2=0x559266ddde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe35401a040 tx=0x7fe3540186d0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 shutdown_connections 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592669b1da0 0x559266e54190 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe33ffff640 0 client.16368 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559266a1e070 0x559266dd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592669fd390 0x559266dd93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 --2- 172.21.15.6:0/2438547016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592669f51b0 0x559266ddde70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.956+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 >> 172.21.15.6:0/2438547016 conn(0x559266a12460 msgr2=0x559266dc7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 shutdown_connections 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36d7a2740 1 -- 172.21.15.6:0/2438547016 wait complete. 2024-09-21T08:06:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36d7a2740 20 client.16368 trim_cache size 0 max 16384 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 msgr2=0x7fe3500b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 0x7fe3500b8c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe358006010 tx=0x7fe358005c30 comp rx=0 tx=0).stop 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 msgr2=0x7fe36019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c970 tx=0x7fe34c00cd70 comp rx=0 tx=0).stop 2024-09-21T08:06:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 shutdown_connections 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe3500b6730 0x7fe3500b8c40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe360108cf0 0x7fe36019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3601083a0 0x7fe36019a8c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 --2- 172.21.15.6:0/3049783867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe360102a60 0x7fe36019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.957+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 >> 172.21.15.6:0/3049783867 conn(0x7fe360079730 msgr2=0x7fe36006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.958+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 shutdown_connections 2024-09-21T08:06:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:06:59.958+0000 7fe36722e640 1 -- 172.21.15.6:0/3049783867 wait complete. 2024-09-21T08:07:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 -- 172.21.15.6:0/2756963786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 msgr2=0x7f96e41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 --2- 172.21.15.6:0/2756963786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e41098c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009900 tx=0x7f96d402a410 comp rx=0 tx=0).stop 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 -- 172.21.15.6:0/2756963786 shutdown_connections 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 --2- 172.21.15.6:0/2756963786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 --2- 172.21.15.6:0/2756963786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e41098c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 --2- 172.21.15.6:0/2756963786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 -- 172.21.15.6:0/2756963786 >> 172.21.15.6:0/2756963786 conn(0x7f96e407b910 msgr2=0x7f96e407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 -- 172.21.15.6:0/2756963786 shutdown_connections 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.126+0000 7f96ec116640 1 -- 172.21.15.6:0/2756963786 wait complete. 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 Processor -- start 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 -- start start 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:01.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4113970 con 0x7f96e41094b0 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96e41137f0 con 0x7f96e4103bc0 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96ec116640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4113af0 con 0x7f96e4109e00 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.127+0000 7f96e96b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38494/0 (socket says 172.21.15.6:38494) 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 -- 172.21.15.6:0/3197410090 learned_addr learned my addr 172.21.15.6:0/3197410090 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e9eb2640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96ea6b3640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 -- 172.21.15.6:0/3197410090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 msgr2=0x7f96e4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 -- 172.21.15.6:0/3197410090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 msgr2=0x7f96e4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 -- 172.21.15.6:0/3197410090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e41a86e0 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96ea6b3640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e9eb2640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96e96b1640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96d4004770 tx=0x7f96d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d403f030 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e41a8970 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96d4004440 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4035070 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.128+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e41a8ea0 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.129+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e4103fd0 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.131+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f96d4042030 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.132+0000 7f96daffd640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.132+0000 7f96e9eb2640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.132+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f96d41082f0 con 0x7f96e41094b0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.132+0000 7f96e9eb2640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 0x7f96d00b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96e4077160 tx=0x7f96e0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.135+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96d40ce460 con 0x7f96e41094b0 2024-09-21T08:07:01.153 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:01 smithi006 ceph-mon[30970]: pgmap v522: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 775 KiB/s wr, 50 op/s 2024-09-21T08:07:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.370+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96e4076a10 con 0x7f96e41094b0 2024-09-21T08:07:01.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.371+0000 7f96daffd640 1 -- 172.21.15.6:0/3197410090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f96d40d2840 con 0x7f96e41094b0 2024-09-21T08:07:01.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:07:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:07:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 msgr2=0x7f96d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 0x7f96d00b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96e4077160 tx=0x7f96e0005f90 comp rx=0 tx=0).stop 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 msgr2=0x7f96e4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96d4004770 tx=0x7f96d4004040 comp rx=0 tx=0).stop 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 shutdown_connections 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96e4109e00 0x7f96e4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e41094b0 0x7f96e4075c50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 --2- 172.21.15.6:0/3197410090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e4103bc0 0x7f96e4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 >> 172.21.15.6:0/3197410090 conn(0x7f96e407b910 msgr2=0x7f96e4105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 shutdown_connections 2024-09-21T08:07:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:01.373+0000 7f96ec116640 1 -- 172.21.15.6:0/3197410090 wait complete. 2024-09-21T08:07:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:01 smithi119 ceph-mon[33564]: pgmap v522: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 775 KiB/s wr, 50 op/s 2024-09-21T08:07:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:01 smithi145 ceph-mon[34049]: pgmap v522: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 775 KiB/s wr, 50 op/s 2024-09-21T08:07:01.606 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:07:01.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:07:02.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3197410090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:02.091 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 6c9b2f0d --release --await' 2024-09-21T08:07:02.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 6c9b2f0d --release --await 2024-09-21T08:07:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3197410090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:02.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3197410090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:02.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:07:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 -- 172.21.15.6:0/562022138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff134108d10 msgr2=0x7ff13410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/562022138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff134108d10 0x7ff13410f540 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009ca0 tx=0x7ff12c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 -- 172.21.15.6:0/562022138 shutdown_connections 2024-09-21T08:07:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/562022138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff134108d10 0x7ff13410f540 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/562022138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1341083c0 0x7ff1341087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/562022138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134102a80 0x7ff134102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 -- 172.21.15.6:0/562022138 >> 172.21.15.6:0/562022138 conn(0x7ff134079740 msgr2=0x7ff134079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 -- 172.21.15.6:0/562022138 shutdown_connections 2024-09-21T08:07:03.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.290+0000 7ff13b2ed640 1 -- 172.21.15.6:0/562022138 wait complete. 2024-09-21T08:07:03.293 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:03 smithi006 ceph-mon[30970]: pgmap v523: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 470 KiB/s wr, 17 op/s 2024-09-21T08:07:03.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 Processor -- start 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 -- start start 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff134102a80 0x7ff134199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134108d10 0x7ff13419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff134112880 con 0x7ff1341083c0 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff134112700 con 0x7ff134102a80 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff13b2ed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff134112a00 con 0x7ff134108d10 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38502/0 (socket says 172.21.15.6:38502) 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.291+0000 7ff138888640 1 -- 172.21.15.6:0/2476093287 learned_addr learned my addr 172.21.15.6:0/2476093287 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff13988a640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134108d10 0x7ff13419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff139089640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff134102a80 0x7ff134199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 -- 172.21.15.6:0/2476093287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134108d10 msgr2=0x7ff13419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134108d10 0x7ff13419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 -- 172.21.15.6:0/2476093287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff134102a80 msgr2=0x7ff134199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff134102a80 0x7ff134199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 -- 172.21.15.6:0/2476093287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13419f180 con 0x7ff1341083c0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff138888640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff12400d770 tx=0x7ff12400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff12a7fc640 1 -- 172.21.15.6:0/2476093287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124017070 con 0x7ff1341083c0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13419f470 con 0x7ff1341083c0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1341a5bd0 con 0x7ff1341083c0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff12a7fc640 1 -- 172.21.15.6:0/2476093287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff124009c30 con 0x7ff1341083c0 2024-09-21T08:07:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.292+0000 7ff12a7fc640 1 -- 172.21.15.6:0/2476093287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400f620 con 0x7ff1341083c0 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.295+0000 7ff141861740 1 Processor -- start 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.295+0000 7ff141861740 1 -- start start 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.295+0000 7ff12a7fc640 1 -- 172.21.15.6:0/2476093287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff12401a070 con 0x7ff1341083c0 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65557d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e6554f3e60 con 0x55e6551b5670 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6554e3290 con 0x55e6551ad490 2024-09-21T08:07:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff141861740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e6554e70a0 con 0x55e6551d6350 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38518/0 (socket says 172.21.15.6:38518) 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff138888640 1 -- 172.21.15.6:0/3642887144 learned_addr learned my addr 172.21.15.6:0/3642887144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff139089640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65557d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 -- 172.21.15.6:0/3642887144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 msgr2=0x55e65557d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65557d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 -- 172.21.15.6:0/3642887144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 msgr2=0x55e65557dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff13988a640 1 -- 172.21.15.6:0/3642887144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e655241930 con 0x55e6551d6350 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff139089640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65557d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.296+0000 7ff138888640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff12a7fc640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 0x7ff1200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff139089640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 0x7ff1200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff13988a640 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557ff30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006010 tx=0x7ff12c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc834c4bae02c71f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff12a7fc640 1 -- 172.21.15.6:0/2476093287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff1240e7610 con 0x7ff1341083c0 2024-09-21T08:07:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff11f7fe640 1 -- 172.21.15.6:0/3642887144 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c031750 con 0x55e6551d6350 2024-09-21T08:07:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff11f7fe640 1 -- 172.21.15.6:0/3642887144 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff12c036040 con 0x55e6551d6350 2024-09-21T08:07:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.297+0000 7ff11f7fe640 1 -- 172.21.15.6:0/3642887144 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c004240 con 0x55e6551d6350 2024-09-21T08:07:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- 172.21.15.6:0/3642887144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 msgr2=0x55e65557ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff139089640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 0x7ff1200b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55e65557c0d0 tx=0x7ff130005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557ff30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006010 tx=0x7ff12c009a20 comp rx=0 tx=0).stop 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- 172.21.15.6:0/3642887144 shutdown_connections 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65557dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65557d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 --2- 172.21.15.6:0/3642887144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557ff30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- 172.21.15.6:0/3642887144 >> 172.21.15.6:0/3642887144 conn(0x55e6551ca740 msgr2=0x55e65557b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- 172.21.15.6:0/3642887144 shutdown_connections 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- 172.21.15.6:0/3642887144 wait complete. 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.298+0000 7ff141861740 1 -- start start 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 Processor -- start 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65558d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e6555992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e655344890 con 0x55e6551b5670 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e65547dd40 con 0x55e6551ad490 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e65558ff20 con 0x55e6551d6350 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff141861740 10 client.0 _ll_register_callbacks cb 0x55e6554e1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff138888640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38526/0 (socket says 172.21.15.6:38526) 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff138888640 1 -- 172.21.15.6:0/1874811531 learned_addr learned my addr 172.21.15.6:0/1874811531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff139089640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65558d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.299+0000 7ff13988a640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e6555992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 -- 172.21.15.6:0/1874811531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 msgr2=0x55e6555992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e6555992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 -- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 msgr2=0x55e65558d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65558d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 -- 172.21.15.6:0/1874811531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e655599870 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff13988a640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e6555992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff138888640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff1240e4a90 tx=0x7ff1240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad30dbcc10d2095 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff11cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124021030 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff1240a8c40 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff12c036040 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff1240a8f80 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff141861740 10 client.16386 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e65559c200 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.300+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff12c036040 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff1240e7220 con 0x55e6551b5670 2024-09-21T08:07:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 10 client.16386 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 20 client.16386 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e655194cd0 0x55e65559f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 4 client.16386 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6554f5db0 con 0x55e655194cd0 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff139089640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e655194cd0 0x55e65559f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff139089640 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e655194cd0 0x55e65559f6c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9475e8edc04982a0 server_cookie=c526c436539fb453 in_seq=0 out_seq=0 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.301+0000 7ff11cff9640 10 client.16386 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff11cff9640 1 -- 172.21.15.6:0/1874811531 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6554f5db0 con 0x55e655194cd0 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff11cff9640 10 client.16386 handle_command_reply: tid=0 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 client.16386 shutdown 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 msgr2=0x55e65558db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff1240e4a90 tx=0x7ff1240057f0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 shutdown_connections 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e655194cd0 0x55e65559f6c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e6555992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551b5670 0x55e65558db10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff11cff9640 0 client.16386 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 --2- 172.21.15.6:0/1874811531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551ad490 0x55e65558d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.302+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 >> 172.21.15.6:0/1874811531 conn(0x55e6551ca740 msgr2=0x55e65557ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.303+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 shutdown_connections 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.303+0000 7ff141861740 1 -- 172.21.15.6:0/1874811531 wait complete. 2024-09-21T08:07:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.303+0000 7ff141861740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T08:07:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.320+0000 7ff141861740 1 Processor -- start 2024-09-21T08:07:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 -- start start 2024-09-21T08:07:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e6555835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341acb60 con 0x55e6551ad490 2024-09-21T08:07:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341af3e0 con 0x55e6551b5670 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff141861740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341ad1d0 con 0x55e6551d6350 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38534/0 (socket says 172.21.15.6:38534) 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 -- 172.21.15.6:0/3012031772 learned_addr learned my addr 172.21.15.6:0/3012031772 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff13988a640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff138888640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e6555835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 -- 172.21.15.6:0/3012031772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 msgr2=0x55e65557b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 -- 172.21.15.6:0/3012031772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 msgr2=0x55e6555835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e6555835e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 -- 172.21.15.6:0/3012031772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65558b8d0 con 0x55e6551ad490 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff138888640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e6555835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.321+0000 7ff139089640 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55e65559fe40 tx=0x7ff130015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fdfc22e7743929 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff11effd640 1 -- 172.21.15.6:0/3012031772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13001e310 con 0x55e6551ad490 2024-09-21T08:07:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff11effd640 1 -- 172.21.15.6:0/3012031772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff13001e4b0 con 0x55e6551ad490 2024-09-21T08:07:03.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff11effd640 1 -- 172.21.15.6:0/3012031772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13001c710 con 0x55e6551ad490 2024-09-21T08:07:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 -- 172.21.15.6:0/3012031772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 msgr2=0x55e65557c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55e65559fe40 tx=0x7ff130015000 comp rx=0 tx=0).stop 2024-09-21T08:07:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 -- 172.21.15.6:0/3012031772 shutdown_connections 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551d6350 0x55e65557b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e6555835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 --2- 172.21.15.6:0/3012031772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551ad490 0x55e65557c920 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.322+0000 7ff141861740 1 -- 172.21.15.6:0/3012031772 >> 172.21.15.6:0/3012031772 conn(0x55e6551ca740 msgr2=0x55e65557ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.323+0000 7ff141861740 1 -- 172.21.15.6:0/3012031772 shutdown_connections 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.323+0000 7ff141861740 1 -- 172.21.15.6:0/3012031772 wait complete. 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.323+0000 7ff141861740 1 -- start start 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.323+0000 7ff141861740 1 Processor -- start 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 0x55e6555a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e655595260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341ad8a0 con 0x55e6551d6350 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341aed10 con 0x55e6551b5670 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1341adf70 con 0x55e6551ad490 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff141861740 10 client.0 _ll_register_callbacks cb 0x7ff1240e4e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38544/0 (socket says 172.21.15.6:38544) 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 -- 172.21.15.6:0/69849520 learned_addr learned my addr 172.21.15.6:0/69849520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff138888640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e655595260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff139089640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 0x55e6555a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 -- 172.21.15.6:0/69849520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 msgr2=0x55e6555a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 0x55e6555a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 -- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 msgr2=0x55e655595260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e655595260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 -- 172.21.15.6:0/69849520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65558a490 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff139089640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 0x55e6555a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff13988a640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0094e0 tx=0x7ff12c031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36adc278b8fa5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.324+0000 7ff11cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c053060 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7ff12c031b90 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff13001e4b0 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff12c05a050 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 10 client.16392 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e65560a2d0 con 0x55e6551d6350 2024-09-21T08:07:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff13001e4b0 con 0x55e6551d6350 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff12c004300 con 0x55e6551d6350 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 10 client.16392 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 20 client.16392 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e65516a080 0x55e65560c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 4 client.16392 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.325+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6554f1860 con 0x55e65516a080 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.326+0000 7ff139089640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e65516a080 0x55e65560c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.326+0000 7ff11cff9640 10 client.16392 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.326+0000 7ff139089640 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e65516a080 0x55e65560c660 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f820bd027a37dbe server_cookie=b849fead22b930e1 in_seq=0 out_seq=0 2024-09-21T08:07:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff11cff9640 1 -- 172.21.15.6:0/69849520 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6554f1860 con 0x55e65516a080 2024-09-21T08:07:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff11cff9640 10 client.16392 handle_command_reply: tid=0 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 client.16392 shutdown 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 msgr2=0x55e655595970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0094e0 tx=0x7ff12c031640 comp rx=0 tx=0).stop 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 shutdown_connections 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e65516a080 0x55e65560c660 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6551d6350 0x55e655595970 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6551b5670 0x55e655595260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 --2- 172.21.15.6:0/69849520 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e6551ad490 0x55e6555a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 >> 172.21.15.6:0/69849520 conn(0x55e6551ca740 msgr2=0x55e6555799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.328+0000 7ff11cff9640 0 client.16392 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.329+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 shutdown_connections 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.329+0000 7ff141861740 1 -- 172.21.15.6:0/69849520 wait complete. 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.329+0000 7ff141861740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "848e85ef-6ec6-4bad-bce6-4f1367fd842c", 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:07:03.334 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 msgr2=0x7ff1200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 0x7ff1200b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55e65557c0d0 tx=0x7ff130005f90 comp rx=0 tx=0).stop 2024-09-21T08:07:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 msgr2=0x7ff1341997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff12400d770 tx=0x7ff12400dc30 comp rx=0 tx=0).stop 2024-09-21T08:07:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 shutdown_connections 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff1200b6700 0x7ff1200b8c10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff134108d10 0x7ff13419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1341083c0 0x7ff1341997b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 --2- 172.21.15.6:0/2476093287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff134102a80 0x7ff134199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 >> 172.21.15.6:0/2476093287 conn(0x7ff134079740 msgr2=0x7ff1341043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 shutdown_connections 2024-09-21T08:07:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:03.330+0000 7ff13b2ed640 1 -- 172.21.15.6:0/2476093287 wait complete. 2024-09-21T08:07:03.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:03 smithi119 ceph-mon[33564]: pgmap v523: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 470 KiB/s wr, 17 op/s 2024-09-21T08:07:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:03 smithi145 ceph-mon[34049]: pgmap v523: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 470 KiB/s wr, 17 op/s 2024-09-21T08:07:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:04.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:07:04.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 -- 172.21.15.6:0/4016554635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb710102a60 msgr2=0x7fb710102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 --2- 172.21.15.6:0/4016554635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb710102a60 0x7fb710102e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb700009900 tx=0x7fb70002a410 comp rx=0 tx=0).stop 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 -- 172.21.15.6:0/4016554635 shutdown_connections 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 --2- 172.21.15.6:0/4016554635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 0x7fb71010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 --2- 172.21.15.6:0/4016554635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7101083a0 0x7fb7101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 --2- 172.21.15.6:0/4016554635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb710102a60 0x7fb710102e70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 -- 172.21.15.6:0/4016554635 >> 172.21.15.6:0/4016554635 conn(0x7fb710079730 msgr2=0x7fb710079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 -- 172.21.15.6:0/4016554635 shutdown_connections 2024-09-21T08:07:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.506+0000 7fb715e16640 1 -- 172.21.15.6:0/4016554635 wait complete. 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 Processor -- start 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 -- start start 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb710102a60 0x7fb71019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 0x7fb71019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb710112810 con 0x7fb7101083a0 2024-09-21T08:07:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb710112690 con 0x7fb710102a60 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb715e16640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb710112990 con 0x7fb710108cf0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38558/0 (socket says 172.21.15.6:38558) 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.507+0000 7fb70effd640 1 -- 172.21.15.6:0/882158026 learned_addr learned my addr 172.21.15.6:0/882158026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70ffff640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 0x7fb71019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb710102a60 0x7fb71019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 -- 172.21.15.6:0/882158026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 msgr2=0x7fb71019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 0x7fb71019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 -- 172.21.15.6:0/882158026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb710102a60 msgr2=0x7fb71019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb710102a60 0x7fb71019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 -- 172.21.15.6:0/882158026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7101a02c0 con 0x7fb7101083a0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70effd640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d770 tx=0x7fb70400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70cff9640 1 -- 172.21.15.6:0/882158026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704017070 con 0x7fb7101083a0 2024-09-21T08:07:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb70cff9640 1 -- 172.21.15.6:0/882158026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb704009c30 con 0x7fb7101083a0 2024-09-21T08:07:04.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.508+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7101a05b0 con 0x7fb7101083a0 2024-09-21T08:07:04.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.509+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7101a6d10 con 0x7fb7101083a0 2024-09-21T08:07:04.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.509+0000 7fb70cff9640 1 -- 172.21.15.6:0/882158026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70400f620 con 0x7fb7101083a0 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.511+0000 7fb70cff9640 1 -- 172.21.15.6:0/882158026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb70401a070 con 0x7fb7101083a0 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.511+0000 7fb71c38a740 1 Processor -- start 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 -- start start 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20668a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20668f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55da20553dc0 con 0x55da202a1840 2024-09-21T08:07:04.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da205e01f0 con 0x55da202c2520 2024-09-21T08:07:04.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb71c38a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55da205cf620 con 0x55da20299660 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47060/0 (socket says 172.21.15.6:47060) 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb70ffff640 1 -- 172.21.15.6:0/3629184781 learned_addr learned my addr 172.21.15.6:0/3629184781 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb70effd640 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20668f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.512+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20668a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 -- 172.21.15.6:0/3629184781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 msgr2=0x55da20668a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20668a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 -- 172.21.15.6:0/3629184781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 msgr2=0x55da20668f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20668f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 -- 172.21.15.6:0/3629184781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da20597fd0 con 0x55da202c2520 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70cff9640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 0x7fb6f80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 0x7fb6f80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70ffff640 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb708010370 tx=0x7fb708010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=292ac81bcac497f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb70cff9640 1 -- 172.21.15.6:0/882158026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb7040e7320 con 0x7fb7101083a0 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb6f5ffb640 1 -- 172.21.15.6:0/3629184781 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708016070 con 0x55da202c2520 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb6f5ffb640 1 -- 172.21.15.6:0/3629184781 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb708004d20 con 0x55da202c2520 2024-09-21T08:07:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.513+0000 7fb6f5ffb640 1 -- 172.21.15.6:0/3629184781 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7080052c0 con 0x55da202c2520 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.514+0000 7fb71c38a740 1 -- 172.21.15.6:0/3629184781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 msgr2=0x55da20668510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.514+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 0x7fb6f80b8c10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7000057c0 tx=0x7fb7000058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.514+0000 7fb71c38a740 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb708010370 tx=0x7fb708010830 comp rx=0 tx=0).stop 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 -- 172.21.15.6:0/3629184781 shutdown_connections 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20668a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20668f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 --2- 172.21.15.6:0/3629184781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20668510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 -- 172.21.15.6:0/3629184781 >> 172.21.15.6:0/3629184781 conn(0x55da202b6910 msgr2=0x55da20666400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 -- 172.21.15.6:0/3629184781 shutdown_connections 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 -- 172.21.15.6:0/3629184781 wait complete. 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 -- start start 2024-09-21T08:07:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.515+0000 7fb71c38a740 1 Processor -- start 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 0x55da20677f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 0x55da20678480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da206789e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55da2056a300 con 0x55da20299660 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da205d3430 con 0x55da202a1840 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55da20430bb0 con 0x55da202c2520 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb71c38a740 10 client.0 _ll_register_callbacks cb 0x55da20584120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 0x55da20677f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 0x55da20678480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 0x55da20677f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38562/0 (socket says 172.21.15.6:38562) 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70f7fe640 1 -- 172.21.15.6:0/1043677358 learned_addr learned my addr 172.21.15.6:0/1043677358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70ffff640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da206789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 -- 172.21.15.6:0/1043677358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 msgr2=0x55da206789e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da206789e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 -- 172.21.15.6:0/1043677358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 msgr2=0x55da20677f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 0x55da20677f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.516+0000 7fb70effd640 1 -- 172.21.15.6:0/1043677358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da20559780 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb70effd640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 0x55da20678480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7040e46f0 tx=0x7fb7040a93e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d54fad2f6ece6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704021030 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb7040a87f0 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb708004d20 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb7040a8d40 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb71c38a740 10 client.26063 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55da2032db00 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb708004d20 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb7040a89f0 con 0x55da202a1840 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb71c38a740 10 client.26063 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.517+0000 7fb71c38a740 10 client.26063 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb71c38a740 20 client.26063 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20280ea0 0x55da2068a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb71c38a740 4 client.26063 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da205e2140 con 0x55da20280ea0 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20280ea0 0x55da2068a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb6eeffd640 10 client.26063 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.518+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20280ea0 0x55da2068a7f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a9f366ceb077e3 server_cookie=99fa981cbe4938df in_seq=0 out_seq=0 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb6eeffd640 1 -- 172.21.15.6:0/1043677358 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da205e2140 con 0x55da20280ea0 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb6eeffd640 10 client.26063 handle_command_reply: tid=0 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 client.26063 shutdown 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 msgr2=0x55da20678480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 0x55da20678480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7040e46f0 tx=0x7fb7040a93e0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 shutdown_connections 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20280ea0 0x55da2068a7f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da206789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202a1840 0x55da20678480 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 --2- 172.21.15.6:0/1043677358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da20299660 0x55da20677f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb6eeffd640 0 client.26063 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 >> 172.21.15.6:0/1043677358 conn(0x55da202b6910 msgr2=0x55da20664930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 shutdown_connections 2024-09-21T08:07:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.519+0000 7fb71c38a740 1 -- 172.21.15.6:0/1043677358 wait complete. 2024-09-21T08:07:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.520+0000 7fb71c38a740 20 client.26063 trim_cache size 0 max 16384 2024-09-21T08:07:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 Processor -- start 2024-09-21T08:07:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 -- start start 2024-09-21T08:07:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20673610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20675130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00de80 con 0x55da202a1840 2024-09-21T08:07:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc010700 con 0x55da202c2520 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.539+0000 7fb71c38a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00e4f0 con 0x55da20299660 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20673610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38574/0 (socket says 172.21.15.6:38574) 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 -- 172.21.15.6:0/54054760 learned_addr learned my addr 172.21.15.6:0/54054760 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70ffff640 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20675130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 -- 172.21.15.6:0/54054760 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 msgr2=0x55da20673610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20673610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 -- 172.21.15.6:0/54054760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 msgr2=0x55da20675130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20675130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 -- 172.21.15.6:0/54054760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da203a4960 con 0x55da202a1840 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20673610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.540+0000 7fb70effd640 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb7040ace30 tx=0x7fb704009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d18a296a46ea84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.541+0000 7fb6f57fa640 1 -- 172.21.15.6:0/54054760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704021070 con 0x55da202a1840 2024-09-21T08:07:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.541+0000 7fb6f57fa640 1 -- 172.21.15.6:0/54054760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7040ac9b0 con 0x55da202a1840 2024-09-21T08:07:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.541+0000 7fb6f57fa640 1 -- 172.21.15.6:0/54054760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704094320 con 0x55da202a1840 2024-09-21T08:07:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 -- 172.21.15.6:0/54054760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 msgr2=0x55da20669c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb7040ace30 tx=0x7fb704009760 comp rx=0 tx=0).stop 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 -- 172.21.15.6:0/54054760 shutdown_connections 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da202c2520 0x55da20675130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da20669c50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 --2- 172.21.15.6:0/54054760 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da20299660 0x55da20673610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 -- 172.21.15.6:0/54054760 >> 172.21.15.6:0/54054760 conn(0x55da202b6910 msgr2=0x55da20669540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.542+0000 7fb71c38a740 1 -- 172.21.15.6:0/54054760 shutdown_connections 2024-09-21T08:07:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.543+0000 7fb71c38a740 1 -- 172.21.15.6:0/54054760 wait complete. 2024-09-21T08:07:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.543+0000 7fb71c38a740 1 -- start start 2024-09-21T08:07:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.543+0000 7fb71c38a740 1 Processor -- start 2024-09-21T08:07:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 0x55da20680370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb71c38a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb70effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38586/0 (socket says 172.21.15.6:38586) 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 0x55da20680370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.544+0000 7fb70effd640 1 -- 172.21.15.6:0/2056375375 learned_addr learned my addr 172.21.15.6:0/2056375375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da2067b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00ebc0 con 0x55da202a1840 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc010030 con 0x55da20299660 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00f290 con 0x55da202c2520 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb71c38a740 10 client.0 _ll_register_callbacks cb 0x7fb7040eab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70ffff640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da2067b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 -- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 msgr2=0x55da2067b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da2067b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 -- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 msgr2=0x55da20680370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 0x55da20680370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2067b790 con 0x55da202a1840 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70ffff640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da2067b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 0x55da20680370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb70effd640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb7040097f0 tx=0x7fb7040b6920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b910e05021acd3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.545+0000 7fb6eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704021070 con 0x55da202a1840 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fb7040abd80 con 0x55da202a1840 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7040ac9b0 con 0x55da202a1840 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb704098070 con 0x55da202a1840 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb71c38a740 10 client.16410 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55da206f5b10 con 0x55da202a1840 2024-09-21T08:07:04.549 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:04.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7040ac9b0 con 0x55da202a1840 2024-09-21T08:07:04.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.546+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb70405d1a0 con 0x55da202a1840 2024-09-21T08:07:04.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 10 client.16410 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:04.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 10 client.16410 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:04.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 20 client.16410 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20256250 0x55da206f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 4 client.16410 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6c9b2f0d", "release": true, "await": true}] 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6c9b2f0d", "release": true, "await": true}) -- 0x55da205ddbf0 con 0x55da20256250 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20256250 0x55da206f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb6eeffd640 10 client.16410 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.547+0000 7fb70f7fe640 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20256250 0x55da206f80f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2068539ac0f0deb3 server_cookie=7352fd8ccdbe720 in_seq=0 out_seq=0 2024-09-21T08:07:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.988+0000 7fb6eeffd640 1 -- 172.21.15.6:0/2056375375 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55da205ddbf0 con 0x55da20256250 2024-09-21T08:07:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.988+0000 7fb6eeffd640 10 client.16410 handle_command_reply: tid=0 2024-09-21T08:07:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.988+0000 7fb71c38a740 1 client.16410 shutdown 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 msgr2=0x55da206808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb7040097f0 tx=0x7fb7040b6920 comp rx=0 tx=0).stop 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 shutdown_connections 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da20256250 0x55da206f80f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da202c2520 0x55da2067b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da202a1840 0x55da206808b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 --2- 172.21.15.6:0/2056375375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da20299660 0x55da20680370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 >> 172.21.15.6:0/2056375375 conn(0x55da202b6910 msgr2=0x55da206733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb6eeffd640 0 client.16410 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 shutdown_connections 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 1 -- 172.21.15.6:0/2056375375 wait complete. 2024-09-21T08:07:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.989+0000 7fb71c38a740 20 client.16410 trim_cache size 0 max 16384 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 24, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "6c9b2f0d": { 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 24, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 139.2, 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:04.993 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 msgr2=0x7fb6f80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 0x7fb6f80b8c10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7000057c0 tx=0x7fb7000058d0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 msgr2=0x7fb71019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d770 tx=0x7fb70400dc30 comp rx=0 tx=0).stop 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 shutdown_connections 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6f80b6700 0x7fb6f80b8c10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb710108cf0 0x7fb71019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7101083a0 0x7fb71019a8f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 --2- 172.21.15.6:0/882158026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb710102a60 0x7fb71019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 >> 172.21.15.6:0/882158026 conn(0x7fb710079730 msgr2=0x7fb710101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 shutdown_connections 2024-09-21T08:07:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:04.990+0000 7fb715e16640 1 -- 172.21.15.6:0/882158026 wait complete. 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.041+0000 7fcb397fd640 1 -- 172.21.15.6:0/813170269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 msgr2=0x7fcb34102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 --2- 172.21.15.6:0/813170269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb34102e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009900 tx=0x7fcb2402a400 comp rx=0 tx=0).stop 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 -- 172.21.15.6:0/813170269 shutdown_connections 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 --2- 172.21.15.6:0/813170269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 0x7fcb341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 --2- 172.21.15.6:0/813170269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb34108cf0 0x7fcb3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 --2- 172.21.15.6:0/813170269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb34102e70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 -- 172.21.15.6:0/813170269 >> 172.21.15.6:0/813170269 conn(0x7fcb34079730 msgr2=0x7fcb34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 -- 172.21.15.6:0/813170269 shutdown_connections 2024-09-21T08:07:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.042+0000 7fcb397fd640 1 -- 172.21.15.6:0/813170269 wait complete. 2024-09-21T08:07:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.043+0000 7fcb397fd640 1 Processor -- start 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.043+0000 7fcb397fd640 1 -- start start 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 0x7fcb3410cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb34108cf0 0x7fcb3410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34111700 con 0x7fcb34108cf0 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34111580 con 0x7fcb34102a60 2024-09-21T08:07:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb397fd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34111880 con 0x7fcb341083a0 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47100/0 (socket says 172.21.15.6:47100) 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 -- 172.21.15.6:0/1279806198 learned_addr learned my addr 172.21.15.6:0/1279806198 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb327fc640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 0x7fcb3410cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 -- 172.21.15.6:0/1279806198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 msgr2=0x7fcb3410cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 0x7fcb3410cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 -- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb34108cf0 msgr2=0x7fcb3410d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb34108cf0 0x7fcb3410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.044+0000 7fcb32ffd640 1 -- 172.21.15.6:0/1279806198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb341acaa0 con 0x7fcb34102a60 2024-09-21T08:07:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.045+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009230 tx=0x7fcb240319a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.049+0000 7fcb1bfff640 1 -- 172.21.15.6:0/1279806198 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2403f030 con 0x7fcb34102a60 2024-09-21T08:07:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.049+0000 7fcb1bfff640 1 -- 172.21.15.6:0/1279806198 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb240043d0 con 0x7fcb34102a60 2024-09-21T08:07:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.050+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb341acd30 con 0x7fcb34102a60 2024-09-21T08:07:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.050+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb341ad1c0 con 0x7fcb34102a60 2024-09-21T08:07:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.050+0000 7fcb1bfff640 1 -- 172.21.15.6:0/1279806198 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24035070 con 0x7fcb34102a60 2024-09-21T08:07:05.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 Processor -- start 2024-09-21T08:07:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 -- start start 2024-09-21T08:07:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x56313180b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x56313180bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x56313180c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563131781e50 con 0x563131464070 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563131771280 con 0x563131443390 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.053+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563131775090 con 0x56313143b1b0 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x56313180b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x56313180b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38614/0 (socket says 172.21.15.6:38614) 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb337fe640 1 -- 172.21.15.6:0/3543978833 learned_addr learned my addr 172.21.15.6:0/3543978833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x56313180c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 -- 172.21.15.6:0/3543978833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 msgr2=0x56313180bb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x56313180bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb1bfff640 1 -- 172.21.15.6:0/1279806198 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcb24042030 con 0x7fcb34102a60 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 -- 172.21.15.6:0/3543978833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 msgr2=0x56313180b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x56313180b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 -- 172.21.15.6:0/3543978833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631314cf650 con 0x563131443390 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.054+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x56313180c0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406aaa0 tx=0x7fcb280113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de45b65a6c7a7a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb197fa640 1 -- 172.21.15.6:0/3543978833 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28011de0 con 0x563131443390 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb197fa640 1 -- 172.21.15.6:0/3543978833 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb280128e0 con 0x563131443390 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb197fa640 1 -- 172.21.15.6:0/3543978833 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800f880 con 0x563131443390 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb1bfff640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 0x7fcb1c0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb337fe640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 0x7fcb1c0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.055+0000 7fcb1bfff640 1 -- 172.21.15.6:0/1279806198 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fcb24107ed0 con 0x7fcb34102a60 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3543978833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 msgr2=0x56313180c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x56313180c0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406aaa0 tx=0x7fcb280113e0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb337fe640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 0x7fcb1c0b8c60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0049d0 tx=0x7fcb2c0099b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3543978833 shutdown_connections 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x56313180bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x56313180c0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3543978833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x56313180b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3543978833 >> 172.21.15.6:0/3543978833 conn(0x563131458460 msgr2=0x563131809540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3543978833 shutdown_connections 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.056+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3543978833 wait complete. 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 -- start start 2024-09-21T08:07:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 Processor -- start 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x563131816d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131823150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5631315d2700 con 0x563131464070 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56313170c110 con 0x563131443390 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563131819e30 con 0x56313143b1b0 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb3fd71740 10 client.0 _ll_register_callbacks cb 0x563131725990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb327fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb327fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47108/0 (socket says 172.21.15.6:47108) 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.057+0000 7fcb327fc640 1 -- 172.21.15.6:0/1871870662 learned_addr learned my addr 172.21.15.6:0/1871870662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x563131816d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb337fe640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131823150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 -- 172.21.15.6:0/1871870662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 msgr2=0x563131816d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x563131816d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 -- 172.21.15.6:0/1871870662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 msgr2=0x563131823150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131823150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 -- 172.21.15.6:0/1871870662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563131739c40 con 0x563131443390 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb337fe640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131823150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x563131816d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb327fc640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb2801c040 tx=0x7fcb280126e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecabf4a867eab71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb16ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28028020 con 0x563131443390 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb280128e0 con 0x563131443390 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fcb28005050 con 0x563131443390 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb28033050 con 0x563131443390 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb3fd71740 10 client.26081 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.058+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563131825b30 con 0x563131443390 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb280128e0 con 0x563131443390 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb2800f5c0 con 0x563131443390 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 10 client.26081 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 10 client.26081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 20 client.26081 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631314229f0 0x563131828f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 4 client.26081 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563131783da0 con 0x5631314229f0 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.059+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631314229f0 0x563131828f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.060+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631314229f0 0x563131828f50 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66ccd05485f8a58 server_cookie=b1cc9694963447fe in_seq=0 out_seq=0 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.060+0000 7fcb16ff5640 10 client.26081 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.061+0000 7fcb16ff5640 1 -- 172.21.15.6:0/1871870662 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563131783da0 con 0x5631314229f0 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.061+0000 7fcb16ff5640 10 client.26081 handle_command_reply: tid=0 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.061+0000 7fcb3fd71740 1 client.26081 shutdown 2024-09-21T08:07:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.061+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 msgr2=0x5631318172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb2801c040 tx=0x7fcb280126e0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 shutdown_connections 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631314229f0 0x563131828f50 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131823150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131443390 0x5631318172b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/1871870662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56313143b1b0 0x563131816d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 >> 172.21.15.6:0/1871870662 conn(0x563131458460 msgr2=0x56313180e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb16ff5640 0 client.26081 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 shutdown_connections 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 1 -- 172.21.15.6:0/1871870662 wait complete. 2024-09-21T08:07:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.062+0000 7fcb3fd71740 20 client.26081 trim_cache size 0 max 16384 2024-09-21T08:07:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.086+0000 7fcb3fd71740 1 Processor -- start 2024-09-21T08:07:05.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:05 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:07:05.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:05 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:05.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:05 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:07:05.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:05 smithi006 ceph-mon[30970]: pgmap v524: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 470 KiB/s wr, 31 op/s 2024-09-21T08:07:05.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:05 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.086+0000 7fcb3fd71740 1 -- start start 2024-09-21T08:07:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x563131823050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131813f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b5360 con 0x563131464070 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b7be0 con 0x56313143b1b0 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb3fd71740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b59d0 con 0x563131443390 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb337fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131813f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47118/0 (socket says 172.21.15.6:47118) 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 -- 172.21.15.6:0/288424688 learned_addr learned my addr 172.21.15.6:0/288424688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb327fc640 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x563131823050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 -- 172.21.15.6:0/288424688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 msgr2=0x563131823050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x563131823050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 -- 172.21.15.6:0/288424688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 msgr2=0x563131813f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131813f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.087+0000 7fcb32ffd640 1 -- 172.21.15.6:0/288424688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563131422c20 con 0x56313143b1b0 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.088+0000 7fcb337fe640 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131813f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.088+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb240cd6a0 tx=0x7fcb240f1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a408f702010649a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.088+0000 7fcb18ff9640 1 -- 172.21.15.6:0/288424688 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24049040 con 0x56313143b1b0 2024-09-21T08:07:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.088+0000 7fcb18ff9640 1 -- 172.21.15.6:0/288424688 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb240ce0a0 con 0x56313143b1b0 2024-09-21T08:07:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.088+0000 7fcb18ff9640 1 -- 172.21.15.6:0/288424688 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb240c92f0 con 0x56313143b1b0 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 -- 172.21.15.6:0/288424688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 msgr2=0x5631318189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb240cd6a0 tx=0x7fcb240f1040 comp rx=0 tx=0).stop 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 -- 172.21.15.6:0/288424688 shutdown_connections 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x563131823050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563131464070 0x563131813f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/288424688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56313143b1b0 0x5631318189a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 -- 172.21.15.6:0/288424688 >> 172.21.15.6:0/288424688 conn(0x563131458460 msgr2=0x563131818290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 -- 172.21.15.6:0/288424688 shutdown_connections 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.089+0000 7fcb3fd71740 1 -- 172.21.15.6:0/288424688 wait complete. 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.090+0000 7fcb3fd71740 1 -- start start 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.090+0000 7fcb3fd71740 1 Processor -- start 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.090+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 0x56313181ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.090+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 0x56313181ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.090+0000 7fcb3fd71740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x56313181b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 0x56313181ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38630/0 (socket says 172.21.15.6:38630) 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb32ffd640 1 -- 172.21.15.6:0/3756354165 learned_addr learned my addr 172.21.15.6:0/3756354165 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 0x56313188b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b60a0 con 0x56313143b1b0 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b7510 con 0x563131464070 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341b6770 con 0x563131443390 2024-09-21T08:07:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb3fd71740 10 client.0 _ll_register_callbacks cb 0x7fcb2c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x56313181b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb337fe640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 0x56313188b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 -- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 msgr2=0x56313188b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 0x56313188b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 -- 172.21.15.6:0/3756354165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 msgr2=0x56313181ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 0x56313181ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb327fc640 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313188bdb0 con 0x563131443390 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.091+0000 7fcb337fe640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 0x56313188b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb327fc640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x56313181b0f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb28006010 tx=0x7fcb280119f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58dc29c2d9043d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb16ff5640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2803c060 con 0x563131443390 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb240ce0a0 con 0x563131443390 2024-09-21T08:07:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7fcb2800f4c0 con 0x563131443390 2024-09-21T08:07:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb28043050 con 0x563131443390 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb3fd71740 10 client.26179 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5631318931b0 con 0x563131443390 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.092+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb240ce0a0 con 0x563131443390 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb28003680 con 0x563131443390 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 10 client.26179 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 10 client.26179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 20 client.26179 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631313f7da0 0x563131895880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 4 client.26179 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56313177f850 con 0x5631313f7da0 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.093+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631313f7da0 0x563131895880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.094+0000 7fcb16ff5640 10 client.26179 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.094+0000 7fcb32ffd640 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631313f7da0 0x563131895880 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3afbd18ce906798f server_cookie=bd75bc260352a483 in_seq=0 out_seq=0 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb16ff5640 1 -- 172.21.15.6:0/3756354165 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x56313177f850 con 0x5631313f7da0 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb16ff5640 10 client.26179 handle_command_reply: tid=0 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 client.26179 shutdown 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 msgr2=0x56313181b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x56313181b0f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb28006010 tx=0x7fcb280119f0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 shutdown_connections 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5631313f7da0 0x563131895880 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563131443390 0x56313181b0f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563131464070 0x56313188b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 --2- 172.21.15.6:0/3756354165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56313143b1b0 0x56313181ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb16ff5640 0 client.26179 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.095+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 >> 172.21.15.6:0/3756354165 conn(0x563131458460 msgr2=0x56313180e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.096+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 shutdown_connections 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.096+0000 7fcb3fd71740 1 -- 172.21.15.6:0/3756354165 wait complete. 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.096+0000 7fcb3fd71740 20 client.26179 trim_cache size 0 max 16384 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "848e85ef-6ec6-4bad-bce6-4f1367fd842c", 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:07:05.100 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.101 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.102 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:07:05.103 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:07:05.104 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:05.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:05.106 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 msgr2=0x7fcb1c0b8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 0x7fcb1c0b8c60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0049d0 tx=0x7fcb2c0099b0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 msgr2=0x7fcb3410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009230 tx=0x7fcb240319a0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 shutdown_connections 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcb1c0b6750 0x7fcb1c0b8c60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb341083a0 0x7fcb3410cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb34108cf0 0x7fcb3410d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 --2- 172.21.15.6:0/1279806198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34102a60 0x7fcb3410ca40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 >> 172.21.15.6:0/1279806198 conn(0x7fcb34079730 msgr2=0x7fcb34101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 shutdown_connections 2024-09-21T08:07:05.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:05.097+0000 7fcb397fd640 1 -- 172.21.15.6:0/1279806198 wait complete. 2024-09-21T08:07:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:05 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:07:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:05 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:05 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:07:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:05 smithi119 ceph-mon[33564]: pgmap v524: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 470 KiB/s wr, 31 op/s 2024-09-21T08:07:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:05 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:05 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:07:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:05 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:05 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:07:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:05 smithi145 ceph-mon[34049]: pgmap v524: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 470 KiB/s wr, 31 op/s 2024-09-21T08:07:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:05 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:06.254 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6c9b2f0d', total seconds elapsed: 26.2 2024-09-21T08:07:06.255 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T08:07:06.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:07:07.165 INFO:tasks.cephfs.filesystem:scrub status for tag:848e85ef-6ec6-4bad-bce6-4f1367fd842c - {'path': '/', 'tag': '848e85ef-6ec6-4bad-bce6-4f1367fd842c', 'options': 'recursive,force'} 2024-09-21T08:07:07.204 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:07.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:07 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:07:07.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:07 smithi006 ceph-mon[30970]: pgmap v525: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 793 KiB/s wr, 27 op/s 2024-09-21T08:07:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:07 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:07:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:07 smithi119 ceph-mon[33564]: pgmap v525: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 793 KiB/s wr, 27 op/s 2024-09-21T08:07:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:07 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:07:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:07 smithi145 ceph-mon[34049]: pgmap v525: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 793 KiB/s wr, 27 op/s 2024-09-21T08:07:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 250.0 s, 402.9 tps, lat 1199.424 ms stddev 4820.882 2024-09-21T08:07:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.124+0000 7f11dd8ef640 1 -- 172.21.15.6:0/4283321255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8111f40 msgr2=0x7f11d810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.124+0000 7f11dd8ef640 1 --2- 172.21.15.6:0/4283321255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8111f40 0x7f11d810a3c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f11d001acb0 tx=0x7f11d003b920 comp rx=0 tx=0).stop 2024-09-21T08:07:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.128+0000 7f11dd8ef640 1 -- 172.21.15.6:0/4283321255 shutdown_connections 2024-09-21T08:07:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.128+0000 7f11dd8ef640 1 --2- 172.21.15.6:0/4283321255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.128+0000 7f11dd8ef640 1 --2- 172.21.15.6:0/4283321255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d811cc30 0x7f11d811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.128+0000 7f11dd8ef640 1 --2- 172.21.15.6:0/4283321255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8111f40 0x7f11d810a3c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.128+0000 7f11dd8ef640 1 -- 172.21.15.6:0/4283321255 >> 172.21.15.6:0/4283321255 conn(0x7f11d8070ec0 msgr2=0x7f11d80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.131+0000 7f11dd8ef640 1 -- 172.21.15.6:0/4283321255 shutdown_connections 2024-09-21T08:07:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.131+0000 7f11dd8ef640 1 -- 172.21.15.6:0/4283321255 wait complete. 2024-09-21T08:07:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.133+0000 7f11dd8ef640 1 Processor -- start 2024-09-21T08:07:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.139+0000 7f11dd8ef640 1 -- start start 2024-09-21T08:07:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d811c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d8111f40 0x7f11d8118740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 0x7f11d8118d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8114bc0 con 0x7f11d811cc30 2024-09-21T08:07:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8114a40 con 0x7f11d8111f40 2024-09-21T08:07:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.140+0000 7f11dd8ef640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8114d40 con 0x7f11d810a9e0 2024-09-21T08:07:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.141+0000 7f11d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 0x7f11d8118d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.141+0000 7f11d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 0x7f11d8118d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41088/0 (socket says 172.21.15.6:41088) 2024-09-21T08:07:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.141+0000 7f11d77fe640 1 -- 172.21.15.6:0/1417063961 learned_addr learned my addr 172.21.15.6:0/1417063961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d811c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d67fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d8111f40 0x7f11d8118740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 -- 172.21.15.6:0/1417063961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d8111f40 msgr2=0x7f11d8118740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d8111f40 0x7f11d8118740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 -- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 msgr2=0x7f11d8118d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 0x7f11d8118d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.142+0000 7f11d6ffd640 1 -- 172.21.15.6:0/1417063961 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d8119520 con 0x7f11d810a9e0 2024-09-21T08:07:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.143+0000 7f11d6ffd640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d811c460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11d001ac00 tx=0x7f11d0003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.144+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0045070 con 0x7f11d810a9e0 2024-09-21T08:07:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.144+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d0003dd0 con 0x7f11d810a9e0 2024-09-21T08:07:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.144+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0004610 con 0x7f11d810a9e0 2024-09-21T08:07:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.144+0000 7f11dd8ef640 1 -- 172.21.15.6:0/1417063961 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d81ace30 con 0x7f11d810a9e0 2024-09-21T08:07:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.145+0000 7f11dd8ef640 1 -- 172.21.15.6:0/1417063961 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d81ad2b0 con 0x7f11d810a9e0 2024-09-21T08:07:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.152+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b8005290 con 0x7f11d810a9e0 2024-09-21T08:07:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.154+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f11d0048020 con 0x7f11d810a9e0 2024-09-21T08:07:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.155+0000 7f11dc8ed640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 0x7f11c00b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.155+0000 7f11d67fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 0x7f11c00b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.156+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f11d01197c0 con 0x7f11d810a9e0 2024-09-21T08:07:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.156+0000 7f11d67fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 0x7f11c00b8d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11d811e810 tx=0x7f11c8008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.160+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11d003e070 con 0x7f11d810a9e0 2024-09-21T08:07:08.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.566+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11b8005850 con 0x7f11d810a9e0 2024-09-21T08:07:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.567+0000 7f11dc8ed640 1 -- 172.21.15.6:0/1417063961 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f11d00df930 con 0x7f11d810a9e0 2024-09-21T08:07:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:07:08.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:07:08.569 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 msgr2=0x7f11c00b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 0x7f11c00b8d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11d811e810 tx=0x7f11c8008040 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 msgr2=0x7f11d811c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d811c460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11d001ac00 tx=0x7f11d0003ba0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 shutdown_connections 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f11c00b6880 0x7f11c00b8d90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d811cc30 0x7f11d8118d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d8111f40 0x7f11d8118740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 --2- 172.21.15.6:0/1417063961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d810a9e0 0x7f11d811c460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 >> 172.21.15.6:0/1417063961 conn(0x7f11d8070ec0 msgr2=0x7f11d810ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 shutdown_connections 2024-09-21T08:07:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:08.570+0000 7f11be7fc640 1 -- 172.21.15.6:0/1417063961 wait complete. 2024-09-21T08:07:09.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:09 smithi006 ceph-mon[30970]: pgmap v526: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-09-21T08:07:09.212 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:09 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1417063961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:09.287 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T08:07:09.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T08:07:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:09 smithi119 ceph-mon[33564]: pgmap v526: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-09-21T08:07:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:09 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1417063961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:09 smithi145 ceph-mon[34049]: pgmap v526: 129 pgs: 129 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-09-21T08:07:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:09 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1417063961' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:09.787 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.393+0000 7f7bef371640 1 -- 172.21.15.6:0/573784133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 msgr2=0x7f7be811f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.393+0000 7f7bef371640 1 --2- 172.21.15.6:0/573784133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 0x7f7be811f500 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009be0 tx=0x7f7be002a6f0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.394+0000 7f7bef371640 1 -- 172.21.15.6:0/573784133 shutdown_connections 2024-09-21T08:07:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.394+0000 7f7bef371640 1 --2- 172.21.15.6:0/573784133 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810ad10 0x7f7be811cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.394+0000 7f7bef371640 1 --2- 172.21.15.6:0/573784133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 0x7f7be811f500 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.394+0000 7f7bef371640 1 --2- 172.21.15.6:0/573784133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810a3c0 0x7f7be810a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.394+0000 7f7bef371640 1 -- 172.21.15.6:0/573784133 >> 172.21.15.6:0/573784133 conn(0x7f7be8070e80 msgr2=0x7f7be8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.397+0000 7f7bef371640 1 -- 172.21.15.6:0/573784133 shutdown_connections 2024-09-21T08:07:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.397+0000 7f7bef371640 1 -- 172.21.15.6:0/573784133 wait complete. 2024-09-21T08:07:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.398+0000 7f7bef371640 1 Processor -- start 2024-09-21T08:07:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.398+0000 7f7bef371640 1 -- start start 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.398+0000 7f7bef371640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810a3c0 0x7f7be81a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.398+0000 7f7bef371640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.398+0000 7f7bef371640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 0x7f7be81ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bef371640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81227b0 con 0x7f7be811d0e0 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bef371640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8122630 con 0x7f7be810ad10 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bef371640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8122930 con 0x7f7be810a3c0 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bec90c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bec90c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56980/0 (socket says 172.21.15.6:56980) 2024-09-21T08:07:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.399+0000 7f7bec90c640 1 -- 172.21.15.6:0/2522546300 learned_addr learned my addr 172.21.15.6:0/2522546300 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.401+0000 7f7bed10d640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810a3c0 0x7f7be81a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.403+0000 7f7bec90c640 1 -- 172.21.15.6:0/2522546300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810a3c0 msgr2=0x7f7be81a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.403+0000 7f7bec90c640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810a3c0 0x7f7be81a9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.403+0000 7f7bec90c640 1 -- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 msgr2=0x7f7be81ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.403+0000 7f7bec90c640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 0x7f7be81ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.403+0000 7f7bec90c640 1 -- 172.21.15.6:0/2522546300 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be81aef70 con 0x7f7be810ad10 2024-09-21T08:07:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.413+0000 7f7bec90c640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b450 tx=0x7f7bd800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.421+0000 7f7bde7fc640 1 -- 172.21.15.6:0/2522546300 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8015020 con 0x7f7be810ad10 2024-09-21T08:07:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.421+0000 7f7bde7fc640 1 -- 172.21.15.6:0/2522546300 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bd8011d20 con 0x7f7be810ad10 2024-09-21T08:07:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.421+0000 7f7bde7fc640 1 -- 172.21.15.6:0/2522546300 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8010dd0 con 0x7f7be810ad10 2024-09-21T08:07:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.422+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be81af260 con 0x7f7be810ad10 2024-09-21T08:07:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.422+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be81b59c0 con 0x7f7be810ad10 2024-09-21T08:07:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.431+0000 7f7bde7fc640 1 -- 172.21.15.6:0/2522546300 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7bd8018020 con 0x7f7be810ad10 2024-09-21T08:07:10.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.433+0000 7f7bf58e5740 1 Processor -- start 2024-09-21T08:07:10.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.433+0000 7f7bde7fc640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 0x7f7bd40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.433+0000 7f7bf58e5740 1 -- start start 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bde7fc640 1 -- 172.21.15.6:0/2522546300 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7bd80e7430 con 0x7f7be810ad10 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e4d990 0x55f00721d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e55b70 0x55f00721d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f007193bb0 con 0x55f006e55b70 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f007182fe0 con 0x55f006e76850 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f007186df0 con 0x55f006e4d990 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56986/0 (socket says 172.21.15.6:56986) 2024-09-21T08:07:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.434+0000 7f7bed10d640 1 -- 172.21.15.6:0/800408705 learned_addr learned my addr 172.21.15.6:0/800408705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.435+0000 7f7bed10d640 1 -- 172.21.15.6:0/800408705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e4d990 msgr2=0x55f00721d3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.435+0000 7f7bec90c640 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e4d990 0x55f00721d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.435+0000 7f7bed10d640 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e4d990 0x55f00721d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.435+0000 7f7bed10d640 1 -- 172.21.15.6:0/800408705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e55b70 msgr2=0x55f00721d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.435+0000 7f7bed10d640 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e55b70 0x55f00721d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.436+0000 7f7bed10d640 1 -- 172.21.15.6:0/800408705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f006ef0ba0 con 0x55f006e76850 2024-09-21T08:07:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.438+0000 7f7bed90e640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 0x7f7bd40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.438+0000 7f7bed10d640 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009b50 tx=0x7f7be4010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6399cc85fe1f5f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.438+0000 7f7bd37fe640 1 -- 172.21.15.6:0/800408705 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4009e40 con 0x55f006e76850 2024-09-21T08:07:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.438+0000 7f7bd37fe640 1 -- 172.21.15.6:0/800408705 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7be40044c0 con 0x55f006e76850 2024-09-21T08:07:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.438+0000 7f7bd37fe640 1 -- 172.21.15.6:0/800408705 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4004a00 con 0x55f006e76850 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 -- 172.21.15.6:0/800408705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 msgr2=0x55f00721ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009b50 tx=0x7f7be4010740 comp rx=0 tx=0).stop 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 -- 172.21.15.6:0/800408705 shutdown_connections 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e4d990 0x55f00721d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e55b70 0x55f00721d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/800408705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e76850 0x55f00721ce70 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009b50 tx=0x7f7be4010740 comp rx=0 tx=0).stop 2024-09-21T08:07:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.440+0000 7f7bf58e5740 1 -- 172.21.15.6:0/800408705 >> 172.21.15.6:0/800408705 conn(0x55f006e6ac40 msgr2=0x55f00721ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.445+0000 7f7bed90e640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 0x7f7bd40b8d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009560 tx=0x7f7be0009840 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.445+0000 7f7bf58e5740 1 -- 172.21.15.6:0/800408705 shutdown_connections 2024-09-21T08:07:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.447+0000 7f7bf58e5740 1 -- 172.21.15.6:0/800408705 wait complete. 2024-09-21T08:07:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.448+0000 7f7bf58e5740 1 -- start start 2024-09-21T08:07:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.448+0000 7f7bf58e5740 1 Processor -- start 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f007229180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f00722e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f006fe47b0 con 0x55f006e4d990 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f00711de90 con 0x55f006e55b70 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f00722b650 con 0x55f006e351d0 2024-09-21T08:07:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.451+0000 7f7bf58e5740 10 client.0 _ll_register_callbacks cb 0x55f007180710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.453+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.453+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41144/0 (socket says 172.21.15.6:41144) 2024-09-21T08:07:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.453+0000 7f7bed10d640 1 -- 172.21.15.6:0/1398457871 learned_addr learned my addr 172.21.15.6:0/1398457871 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.453+0000 7f7bec90c640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f007229180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.455+0000 7f7bed10d640 1 -- 172.21.15.6:0/1398457871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 msgr2=0x55f00722e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.455+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f00722e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.455+0000 7f7bed10d640 1 -- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 msgr2=0x55f007229180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.455+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f007229180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.455+0000 7f7bed10d640 1 -- 172.21.15.6:0/1398457871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f00722efb0 con 0x55f006e4d990 2024-09-21T08:07:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.456+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006010 tx=0x7f7be4013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975601d041cc9e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.456+0000 7f7bd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.458+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be402a060 con 0x55f006e4d990 2024-09-21T08:07:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.459+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f007195b00 con 0x55f006e4d990 2024-09-21T08:07:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.459+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7be4013a60 con 0x55f006e4d990 2024-09-21T08:07:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.459+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7be4031050 con 0x55f006e4d990 2024-09-21T08:07:10.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.462+0000 7f7bf58e5740 10 client.16434 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:10.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.462+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f007248990 con 0x55f006e4d990 2024-09-21T08:07:10.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f007195b00 con 0x55f006e4d990 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7be400f040 con 0x55f006e4d990 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 10 client.16434 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 10 client.16434 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 20 client.16434 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f006e0a580 0x55f00724c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 4 client.16434 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:10.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0071915b0 con 0x55f006e0a580 2024-09-21T08:07:10.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.464+0000 7f7bec90c640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f006e0a580 0x55f00724c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.476+0000 7f7bd0ff9640 10 client.16434 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.476+0000 7f7bec90c640 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f006e0a580 0x55f00724c270 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c24b7c8ccb307e server_cookie=466e2e4ebd8c9b7 in_seq=0 out_seq=0 2024-09-21T08:07:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.478+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/1398457871 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0071915b0 con 0x55f006e0a580 2024-09-21T08:07:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.478+0000 7f7bd0ff9640 10 client.16434 handle_command_reply: tid=0 2024-09-21T08:07:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.478+0000 7f7bf58e5740 1 client.16434 shutdown 2024-09-21T08:07:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.481+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 msgr2=0x55f007228ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.481+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006010 tx=0x7f7be4013460 comp rx=0 tx=0).stop 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 shutdown_connections 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f006e0a580 0x55f00724c270 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f00722e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f007229180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1398457871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007228ba0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 >> 172.21.15.6:0/1398457871 conn(0x55f006e6ac40 msgr2=0x55f0072209c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bd0ff9640 0 client.16434 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.483+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 shutdown_connections 2024-09-21T08:07:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.485+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1398457871 wait complete. 2024-09-21T08:07:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.485+0000 7f7bf58e5740 20 client.16434 trim_cache size 0 max 16384 2024-09-21T08:07:10.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.523+0000 7f7bf58e5740 1 Processor -- start 2024-09-21T08:07:10.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.523+0000 7f7bf58e5740 1 -- start start 2024-09-21T08:07:10.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f00721a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bed10d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:34228/0 (socket says 172.21.15.6:34228) 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bed10d640 1 -- 172.21.15.6:0/1464421870 learned_addr learned my addr 172.21.15.6:0/1464421870 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.524+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f00721ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.525+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7be811a490 con 0x55f006e4d990 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.525+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81b7c90 con 0x55f006e55b70 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.525+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81b5b90 con 0x55f006e351d0 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.525+0000 7f7bed90e640 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f00721ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.525+0000 7f7bec90c640 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f00721a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 -- 172.21.15.6:0/1464421870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 msgr2=0x55f00721ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f00721ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 -- 172.21.15.6:0/1464421870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 msgr2=0x55f00721a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f00721a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 -- 172.21.15.6:0/1464421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0072241e0 con 0x55f006e351d0 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.526+0000 7f7bed10d640 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7be4010780 tx=0x7f7be4009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54dae0b70843f789 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.527+0000 7f7bd2ffd640 1 -- 172.21.15.6:0/1464421870 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be402a070 con 0x55f006e351d0 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.527+0000 7f7bd2ffd640 1 -- 172.21.15.6:0/1464421870 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7be4025d90 con 0x55f006e351d0 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.527+0000 7f7bd2ffd640 1 -- 172.21.15.6:0/1464421870 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be401a420 con 0x55f006e351d0 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 msgr2=0x55f007227eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7be4010780 tx=0x7f7be4009600 comp rx=0 tx=0).stop 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 shutdown_connections 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e55b70 0x55f00721ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f00721a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.529+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/1464421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e351d0 0x55f007227eb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.530+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 >> 172.21.15.6:0/1464421870 conn(0x55f006e6ac40 msgr2=0x55f007219240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.532+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 shutdown_connections 2024-09-21T08:07:10.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.532+0000 7f7bf58e5740 1 -- 172.21.15.6:0/1464421870 wait complete. 2024-09-21T08:07:10.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.532+0000 7f7bf58e5740 1 -- start start 2024-09-21T08:07:10.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.533+0000 7f7bf58e5740 1 Processor -- start 2024-09-21T08:07:10.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e351d0 0x55f007230cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007231200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81b6150 con 0x55f006e4d990 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81b75c0 con 0x55f006e351d0 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7be81b6820 con 0x55f006e55b70 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.534+0000 7f7bf58e5740 10 client.0 _ll_register_callbacks cb 0x7f7be40099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:34236/0 (socket says 172.21.15.6:34236) 2024-09-21T08:07:10.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 -- 172.21.15.6:0/624826857 learned_addr learned my addr 172.21.15.6:0/624826857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed10d640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e351d0 0x55f007230cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 -- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e351d0 msgr2=0x55f007230cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e351d0 0x55f007230cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 -- 172.21.15.6:0/624826857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 msgr2=0x55f007231200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007231200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.535+0000 7f7bed90e640 1 -- 172.21.15.6:0/624826857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0072294f0 con 0x55f006e55b70 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.536+0000 7f7bed90e640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be0033000 tx=0x7f7be0030ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c25aa8039231b35c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:10.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.536+0000 7f7bd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:07:10.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.537+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0040040 con 0x55f006e55b70 2024-09-21T08:07:10.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.537+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be4025d90 con 0x55f006e55b70 2024-09-21T08:07:10.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.537+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7be0031b40 con 0x55f006e55b70 2024-09-21T08:07:10.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.537+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7be005a050 con 0x55f006e55b70 2024-09-21T08:07:10.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.538+0000 7f7bf58e5740 10 client.26188 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:10.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.538+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f0072b70b0 con 0x55f006e55b70 2024-09-21T08:07:10.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.539+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7be0030cd0 con 0x55f006e55b70 2024-09-21T08:07:10.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7be0046040 con 0x55f006e55b70 2024-09-21T08:07:10.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 10 client.26188 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:10.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 10 client.26188 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:10.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 20 client.26188 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:10.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f0072b7900 0x55f0072b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:10.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 4 client.26188 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T08:07:10.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x7f7be4025d90 con 0x55f0072b7900 2024-09-21T08:07:10.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.540+0000 7f7bed10d640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f0072b7900 0x55f0072b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:10.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.543+0000 7f7bed10d640 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f0072b7900 0x55f0072b9d20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0e1b4d940cca810 server_cookie=f0aeab4b7428ef57 in_seq=0 out_seq=0 2024-09-21T08:07:10.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.543+0000 7f7bd0ff9640 10 client.26188 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bd0ff9640 1 -- 172.21.15.6:0/624826857 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f7be4025d90 con 0x55f0072b7900 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bd0ff9640 10 client.26188 handle_command_reply: tid=0 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 client.26188 shutdown 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 msgr2=0x55f0072b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be0033000 tx=0x7f7be0030ae0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 shutdown_connections 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f0072b7900 0x55f0072b9d20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f006e55b70 0x55f0072b5cd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f006e4d990 0x55f007231200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bd0ff9640 0 client.26188 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 --2- 172.21.15.6:0/624826857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f006e351d0 0x55f007230cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 >> 172.21.15.6:0/624826857 conn(0x55f006e6ac40 msgr2=0x55f007221f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 shutdown_connections 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 1 -- 172.21.15.6:0/624826857 wait complete. 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.918+0000 7f7bf58e5740 20 client.26188 trim_cache size 0 max 16384 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 26, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "6abdc731": { 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 26, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 139.2, 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:07:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:10.923 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 msgr2=0x7f7bd40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 0x7f7bd40b8d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009560 tx=0x7f7be0009840 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 msgr2=0x7f7be81a95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b450 tx=0x7f7bd800b910 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 shutdown_connections 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7bd40b6880 0x7f7bd40b8d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be811d0e0 0x7f7be81ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be810ad10 0x7f7be81a95a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 --2- 172.21.15.6:0/2522546300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7be810a3c0 0x7f7be81a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 >> 172.21.15.6:0/2522546300 conn(0x7f7be8070e80 msgr2=0x7f7be8071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.919+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 shutdown_connections 2024-09-21T08:07:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:10.920+0000 7f7bef371640 1 -- 172.21.15.6:0/2522546300 wait complete. 2024-09-21T08:07:11.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:11 smithi006 ceph-mon[30970]: pgmap v527: 129 pgs: 129 active+clean; 2.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-21T08:07:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:11 smithi119 ceph-mon[33564]: pgmap v527: 129 pgs: 129 active+clean; 2.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-21T08:07:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:11 smithi145 ceph-mon[34049]: pgmap v527: 129 pgs: 129 active+clean; 2.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2024-09-21T08:07:12.183 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6abdc731', quiesce took 5.9 seconds. Will release after: 13.35 2024-09-21T08:07:12.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 255.0 s, 416.8 tps, lat 139.375 ms stddev 242.790 2024-09-21T08:07:13.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:13 smithi006 ceph-mon[30970]: pgmap v528: 129 pgs: 129 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-09-21T08:07:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:13 smithi119 ceph-mon[33564]: pgmap v528: 129 pgs: 129 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-09-21T08:07:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:13 smithi145 ceph-mon[34049]: pgmap v528: 129 pgs: 129 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-09-21T08:07:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:15 smithi119 ceph-mon[33564]: pgmap v529: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.8 MiB/s wr, 387 op/s 2024-09-21T08:07:15.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:15 smithi145 ceph-mon[34049]: pgmap v529: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.8 MiB/s wr, 387 op/s 2024-09-21T08:07:15.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:15 smithi006 ceph-mon[30970]: pgmap v529: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.8 MiB/s wr, 387 op/s 2024-09-21T08:07:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:17 smithi119 ceph-mon[33564]: pgmap v530: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-21T08:07:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:17 smithi145 ceph-mon[34049]: pgmap v530: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-21T08:07:17.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:17 smithi006 ceph-mon[30970]: pgmap v530: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-21T08:07:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:07:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:19 smithi119 ceph-mon[33564]: pgmap v531: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.9 MiB/s wr, 398 op/s 2024-09-21T08:07:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:19 smithi145 ceph-mon[34049]: pgmap v531: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.9 MiB/s wr, 398 op/s 2024-09-21T08:07:19.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:19 smithi006 ceph-mon[30970]: pgmap v531: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.9 MiB/s wr, 398 op/s 2024-09-21T08:07:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:21 smithi119 ceph-mon[33564]: pgmap v532: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.8 MiB/s wr, 390 op/s 2024-09-21T08:07:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:21 smithi145 ceph-mon[34049]: pgmap v532: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.8 MiB/s wr, 390 op/s 2024-09-21T08:07:21.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:21 smithi006 ceph-mon[30970]: pgmap v532: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 7.8 MiB/s wr, 390 op/s 2024-09-21T08:07:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:07:23.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:23 smithi119 ceph-mon[33564]: pgmap v533: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.4 MiB/s wr, 301 op/s 2024-09-21T08:07:23.421 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:23 smithi006 ceph-mon[30970]: pgmap v533: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.4 MiB/s wr, 301 op/s 2024-09-21T08:07:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:23 smithi145 ceph-mon[34049]: pgmap v533: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.4 MiB/s wr, 301 op/s 2024-09-21T08:07:25.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:25 smithi119 ceph-mon[33564]: pgmap v534: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T08:07:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:25 smithi145 ceph-mon[34049]: pgmap v534: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T08:07:25.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:25 smithi006 ceph-mon[30970]: pgmap v534: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T08:07:25.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:07:25.810 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 -- 172.21.15.6:0/1089528108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278109df0 msgr2=0x7f8278110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 --2- 172.21.15.6:0/1089528108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278109df0 0x7f8278110620 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8270009ca0 tx=0x7f827002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 -- 172.21.15.6:0/1089528108 shutdown_connections 2024-09-21T08:07:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 --2- 172.21.15.6:0/1089528108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278109df0 0x7f8278110620 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 --2- 172.21.15.6:0/1089528108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f82781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 --2- 172.21.15.6:0/1089528108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278103b60 0x7f8278103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 -- 172.21.15.6:0/1089528108 >> 172.21.15.6:0/1089528108 conn(0x7f827807b850 msgr2=0x7f827807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 -- 172.21.15.6:0/1089528108 shutdown_connections 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.335+0000 7f827fd10640 1 -- 172.21.15.6:0/1089528108 wait complete. 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.336+0000 7f827fd10640 1 Processor -- start 2024-09-21T08:07:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.336+0000 7f827fd10640 1 -- start start 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.336+0000 7f827fd10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.336+0000 7f827fd10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f827819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.336+0000 7f827fd10640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 0x7f827819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827fd10640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82781139b0 con 0x7f8278103b60 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827fd10640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8278113830 con 0x7f82781094a0 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827fd10640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8278113b30 con 0x7f8278109df0 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37170/0 (socket says 172.21.15.6:37170) 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 -- 172.21.15.6:0/3761972872 learned_addr learned my addr 172.21.15.6:0/3761972872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827e2ad640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 0x7f827819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827d2ab640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f827819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 -- 172.21.15.6:0/3761972872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 msgr2=0x7f827819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 0x7f827819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 -- 172.21.15.6:0/3761972872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 msgr2=0x7f827819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f827819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 -- 172.21.15.6:0/3761972872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82781a0430 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827d2ab640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f827819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827e2ad640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 0x7f827819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827daac640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f827400d770 tx=0x7f827400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274017070 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82740054b0 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274004c60 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.337+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82781a0720 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.338+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a6e80 con 0x7f8278103b60 2024-09-21T08:07:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.338+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8278103f70 con 0x7f8278103b60 2024-09-21T08:07:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.340+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8274004e00 con 0x7f8278103b60 2024-09-21T08:07:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.341+0000 7f826effd640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 0x7f82640b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.341+0000 7f827d2ab640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 0x7f82640b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.341+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f82740e79d0 con 0x7f8278103b60 2024-09-21T08:07:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.341+0000 7f827d2ab640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 0x7f82640b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82781071a0 tx=0x7f8268005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.344+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82740adbc0 con 0x7f8278103b60 2024-09-21T08:07:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.570+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f827819b5f0 con 0x7f8278103b60 2024-09-21T08:07:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.570+0000 7f826effd640 1 -- 172.21.15.6:0/3761972872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f82740b1fa0 con 0x7f8278103b60 2024-09-21T08:07:26.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:07:26.572 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:07:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:07:26.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 msgr2=0x7f82640b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 0x7f82640b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82781071a0 tx=0x7f8268005f90 comp rx=0 tx=0).stop 2024-09-21T08:07:26.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 msgr2=0x7f827819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:26.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f827400d770 tx=0x7f827400dc30 comp rx=0 tx=0).stop 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 shutdown_connections 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f82640b6700 0x7f82640b8c10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8278109df0 0x7f827819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82781094a0 0x7f827819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 --2- 172.21.15.6:0/3761972872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8278103b60 0x7f827819a4c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 >> 172.21.15.6:0/3761972872 conn(0x7f827807b850 msgr2=0x7f8278105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 shutdown_connections 2024-09-21T08:07:26.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:26.574+0000 7f827fd10640 1 -- 172.21.15.6:0/3761972872 wait complete. 2024-09-21T08:07:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:27 smithi006 ceph-mon[30970]: pgmap v535: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-09-21T08:07:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:27 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3761972872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:27.308 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 6abdc731 --release --await' 2024-09-21T08:07:27.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 6abdc731 --release --await 2024-09-21T08:07:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:27 smithi119 ceph-mon[33564]: pgmap v535: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-09-21T08:07:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:27 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3761972872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:27 smithi145 ceph-mon[34049]: pgmap v535: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-09-21T08:07:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:27 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3761972872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 -- 172.21.15.6:0/4140517053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f01094a0 msgr2=0x7f87f01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 --2- 172.21.15.6:0/4140517053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f01094a0 0x7f87f01098b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009ca0 tx=0x7f87e002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 -- 172.21.15.6:0/4140517053 shutdown_connections 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 --2- 172.21.15.6:0/4140517053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f0109df0 0x7f87f0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 --2- 172.21.15.6:0/4140517053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f01094a0 0x7f87f01098b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 --2- 172.21.15.6:0/4140517053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0103b60 0x7f87f0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 -- 172.21.15.6:0/4140517053 >> 172.21.15.6:0/4140517053 conn(0x7f87f007b850 msgr2=0x7f87f007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.077+0000 7f87f725f640 1 -- 172.21.15.6:0/4140517053 shutdown_connections 2024-09-21T08:07:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.078+0000 7f87f725f640 1 -- 172.21.15.6:0/4140517053 wait complete. 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.078+0000 7f87f725f640 1 Processor -- start 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.078+0000 7f87f725f640 1 -- start start 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f01094a0 0x7f87f019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0109df0 0x7f87f019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01139b0 con 0x7f87f0103b60 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0113830 con 0x7f87f0109df0 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f725f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0113b30 con 0x7f87f01094a0 2024-09-21T08:07:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37184/0 (socket says 172.21.15.6:37184) 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 -- 172.21.15.6:0/1281741108 learned_addr learned my addr 172.21.15.6:0/1281741108 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f57fc640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0109df0 0x7f87f019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87effff640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f01094a0 0x7f87f019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 -- 172.21.15.6:0/1281741108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f01094a0 msgr2=0x7f87f019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f01094a0 0x7f87f019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 -- 172.21.15.6:0/1281741108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0109df0 msgr2=0x7f87f019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0109df0 0x7f87f019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 -- 172.21.15.6:0/1281741108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01a0330 con 0x7f87f0103b60 2024-09-21T08:07:28.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.079+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87d800d950 tx=0x7f87d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.082+0000 7f87edffb640 1 -- 172.21.15.6:0/1281741108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8017070 con 0x7f87f0103b60 2024-09-21T08:07:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.083+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01a0620 con 0x7f87f0103b60 2024-09-21T08:07:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.083+0000 7f87edffb640 1 -- 172.21.15.6:0/1281741108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87d8009c30 con 0x7f87f0103b60 2024-09-21T08:07:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.083+0000 7f87edffb640 1 -- 172.21.15.6:0/1281741108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d800f620 con 0x7f87f0103b60 2024-09-21T08:07:28.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.083+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01a6d80 con 0x7f87f0103b60 2024-09-21T08:07:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.085+0000 7f87edffb640 1 -- 172.21.15.6:0/1281741108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f87d8010460 con 0x7f87f0103b60 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.085+0000 7f87fd7d3740 1 Processor -- start 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.085+0000 7f87fd7d3740 1 -- start start 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a792510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3cb840 0x55695a792f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55695a67ddc0 con 0x55695a3c3660 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55695a70a1f0 con 0x55695a3cb840 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55695a6f9620 con 0x55695a3ec520 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37190/0 (socket says 172.21.15.6:37190) 2024-09-21T08:07:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 -- 172.21.15.6:0/3631986805 learned_addr learned my addr 172.21.15.6:0/3631986805 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f57fc640 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a792510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87effff640 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3cb840 0x55695a792f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 -- 172.21.15.6:0/3631986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 msgr2=0x55695a792510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a792510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87edffb640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 0x7f87dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 -- 172.21.15.6:0/3631986805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3cb840 msgr2=0x55695a792f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3cb840 0x55695a792f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f4ffb640 1 -- 172.21.15.6:0/3631986805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695a6c1fd0 con 0x55695a3c3660 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.086+0000 7f87f57fc640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 0x7f87dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.087+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f87d80e49f0 tx=0x7f87d80ad3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2bf497d8dfe00e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.087+0000 7f87edffb640 1 -- 172.21.15.6:0/1281741108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f87d80e7740 con 0x7f87f0103b60 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.087+0000 7f87e6ffd640 1 -- 172.21.15.6:0/3631986805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d80acf80 con 0x55695a3c3660 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.087+0000 7f87e6ffd640 1 -- 172.21.15.6:0/3631986805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87d80accc0 con 0x55695a3c3660 2024-09-21T08:07:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.087+0000 7f87e6ffd640 1 -- 172.21.15.6:0/3631986805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d80ac920 con 0x55695a3c3660 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3631986805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 msgr2=0x55695a792a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87f57fc640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 0x7f87dc0b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f87e800b7f0 tx=0x7f87e800b2e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f87d80e49f0 tx=0x7f87d80ad3a0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3631986805 shutdown_connections 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3cb840 0x55695a792f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3c3660 0x55695a792a50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3631986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a792510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3631986805 >> 172.21.15.6:0/3631986805 conn(0x55695a3e0910 msgr2=0x55695a790400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3631986805 shutdown_connections 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3631986805 wait complete. 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.088+0000 7f87fd7d3740 1 -- start start 2024-09-21T08:07:28.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 Processor -- start 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3c3660 0x55695a79db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a79e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55695a694300 con 0x55695a3cb840 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55695a6fd430 con 0x55695a3c3660 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55695a55abb0 con 0x55695a3ec520 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87fd7d3740 10 client.0 _ll_register_callbacks cb 0x55695a6ae120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37204/0 (socket says 172.21.15.6:37204) 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87effff640 1 -- 172.21.15.6:0/953656896 learned_addr learned my addr 172.21.15.6:0/953656896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3c3660 0x55695a79db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.089+0000 7f87f57fc640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a79e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 -- 172.21.15.6:0/953656896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 msgr2=0x55695a79e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a79e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 -- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3c3660 msgr2=0x55695a79db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3c3660 0x55695a79db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 -- 172.21.15.6:0/953656896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695a683780 con 0x55695a3cb840 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87f57fc640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a79e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87effff640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f87e0005cc0 tx=0x7f87e0031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1283b556c2c112 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87cffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0003970 con 0x55695a3cb840 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f87e0003b10 con 0x55695a3cb840 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d80accc0 con 0x55695a3cb840 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f87e0003d10 con 0x55695a3cb840 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87fd7d3740 10 client.16455 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:28.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.090+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55695a457b00 con 0x55695a3cb840 2024-09-21T08:07:28.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87d80accc0 con 0x55695a3cb840 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f87e00305c0 con 0x55695a3cb840 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 10 client.16455 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 10 client.16455 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 20 client.16455 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a3aaea0 0x55695a7afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 4 client.16455 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55695a70c140 con 0x55695a3aaea0 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.091+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a3aaea0 0x55695a7afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.092+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a3aaea0 0x55695a7afeb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9034bbb22b4cb6ea server_cookie=2bed02e17afcea0a in_seq=0 out_seq=0 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.092+0000 7f87cffff640 10 client.16455 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.092+0000 7f87cffff640 1 -- 172.21.15.6:0/953656896 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55695a70c140 con 0x55695a3aaea0 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.092+0000 7f87cffff640 10 client.16455 handle_command_reply: tid=0 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 client.16455 shutdown 2024-09-21T08:07:28.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 msgr2=0x55695a79e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f87e0005cc0 tx=0x7f87e0031bb0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 shutdown_connections 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a3aaea0 0x55695a7afeb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3ec520 0x55695a79e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a3cb840 0x55695a79e080 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87cffff640 0 client.16455 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/953656896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3c3660 0x55695a79db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 >> 172.21.15.6:0/953656896 conn(0x55695a3e0910 msgr2=0x55695a7956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 shutdown_connections 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 1 -- 172.21.15.6:0/953656896 wait complete. 2024-09-21T08:07:28.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.093+0000 7f87fd7d3740 20 client.16455 trim_cache size 0 max 16384 2024-09-21T08:07:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.110+0000 7f87fd7d3740 1 Processor -- start 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.110+0000 7f87fd7d3740 1 -- start start 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.110+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a79fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.110+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a79ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.110+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01aee20 con 0x55695a380250 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01b16a0 con 0x55695a3ec520 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01af490 con 0x55695a3c3660 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37214/0 (socket says 172.21.15.6:37214) 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 -- 172.21.15.6:0/3086782327 learned_addr learned my addr 172.21.15.6:0/3086782327 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87effff640 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a79ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a79fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 -- 172.21.15.6:0/3086782327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 msgr2=0x55695a79fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a79fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 -- 172.21.15.6:0/3086782327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 msgr2=0x55695a79ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a79ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 -- 172.21.15.6:0/3086782327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695a4ce960 con 0x55695a380250 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87f57fc640 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f87e8003f10 tx=0x7f87e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b678ebd29fafb83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.111+0000 7f87e67fc640 1 -- 172.21.15.6:0/3086782327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e802d070 con 0x55695a380250 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87e67fc640 1 -- 172.21.15.6:0/3086782327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e80288a0 con 0x55695a380250 2024-09-21T08:07:28.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87e67fc640 1 -- 172.21.15.6:0/3086782327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e801c570 con 0x55695a380250 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3086782327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 msgr2=0x55695a79b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f87e8003f10 tx=0x7f87e8016000 comp rx=0 tx=0).stop 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3086782327 shutdown_connections 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a79b270 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a79ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/3086782327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a79fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3086782327 >> 172.21.15.6:0/3086782327 conn(0x55695a3e0910 msgr2=0x55695a79ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3086782327 shutdown_connections 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.112+0000 7f87fd7d3740 1 -- 172.21.15.6:0/3086782327 wait complete. 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 -- start start 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 Processor -- start 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a7a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a813910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01afb60 con 0x55695a380250 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01b0fd0 con 0x55695a3ec520 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01b0230 con 0x55695a3c3660 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87fd7d3740 10 client.0 _ll_register_callbacks cb 0x7f87e0009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.113+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37230/0 (socket says 172.21.15.6:37230) 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 -- 172.21.15.6:0/2539863682 learned_addr learned my addr 172.21.15.6:0/2539863682 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87effff640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a7a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f57fc640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a813910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 -- 172.21.15.6:0/2539863682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 msgr2=0x55695a7a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a7a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 -- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 msgr2=0x55695a813910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a813910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 -- 172.21.15.6:0/2539863682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695a813f80 con 0x55695a380250 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87f4ffb640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f87d80a9730 tx=0x7f87d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4815a72deb0cb2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87cffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8020040 con 0x55695a380250 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f87d80e4d30 con 0x55695a380250 2024-09-21T08:07:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e80288a0 con 0x55695a380250 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f87d80acb00 con 0x55695a380250 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87fd7d3740 10 client.16461 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.114+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55695a81b3c0 con 0x55695a380250 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e80288a0 con 0x55695a380250 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f87d80e7300 con 0x55695a380250 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 10 client.16461 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 10 client.16461 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 20 client.16461 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a81b6f0 0x55695a81db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 4 client.16461 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6abdc731", "release": true, "await": true}] 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6abdc731", "release": true, "await": true}) -- 0x55695a707bf0 con 0x55695a81b6f0 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.115+0000 7f87effff640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a81b6f0 0x55695a81db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.116+0000 7f87effff640 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a81b6f0 0x55695a81db10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ddc91dee0a4e15 server_cookie=9af1ea4e94d69251 in_seq=0 out_seq=0 2024-09-21T08:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.116+0000 7f87cffff640 10 client.16461 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.175+0000 7f87cffff640 1 -- 172.21.15.6:0/2539863682 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55695a707bf0 con 0x55695a81b6f0 2024-09-21T08:07:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.175+0000 7f87cffff640 10 client.16461 handle_command_reply: tid=0 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.175+0000 7f87fd7d3740 1 client.16461 shutdown 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 msgr2=0x55695a7a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f87d80a9730 tx=0x7f87d8000bc0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 shutdown_connections 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55695a81b6f0 0x55695a81db10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55695a3c3660 0x55695a7a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55695a3ec520 0x55695a813910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 --2- 172.21.15.6:0/2539863682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55695a380250 0x55695a7a4810 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 >> 172.21.15.6:0/2539863682 conn(0x55695a3e0910 msgr2=0x55695a7a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87cffff640 0 client.16461 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 shutdown_connections 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 1 -- 172.21.15.6:0/2539863682 wait complete. 2024-09-21T08:07:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.176+0000 7f87fd7d3740 20 client.16461 trim_cache size 0 max 16384 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 28, 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "6abdc731": { 2024-09-21T08:07:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 28, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 139.2, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:28.181 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 msgr2=0x7f87dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 0x7f87dc0b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f87e800b7f0 tx=0x7f87e800b2e0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 msgr2=0x7f87f019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87d800d950 tx=0x7f87d800de10 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 shutdown_connections 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f87dc0b6680 0x7f87dc0b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87f01094a0 0x7f87f019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f0109df0 0x7f87f019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 --2- 172.21.15.6:0/1281741108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f0103b60 0x7f87f019a3c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 >> 172.21.15.6:0/1281741108 conn(0x7f87f007b850 msgr2=0x7f87f0105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 shutdown_connections 2024-09-21T08:07:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:28.177+0000 7f87f725f640 1 -- 172.21.15.6:0/1281741108 wait complete. 2024-09-21T08:07:29.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6abdc731', total seconds elapsed: 22.8 2024-09-21T08:07:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:29 smithi119 ceph-mon[33564]: pgmap v536: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 699 KiB/s wr, 14 op/s 2024-09-21T08:07:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:29 smithi145 ceph-mon[34049]: pgmap v536: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 699 KiB/s wr, 14 op/s 2024-09-21T08:07:29.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:29 smithi006 ceph-mon[30970]: pgmap v536: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 699 KiB/s wr, 14 op/s 2024-09-21T08:07:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:31 smithi119 ceph-mon[33564]: pgmap v537: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 692 KiB/s wr, 13 op/s 2024-09-21T08:07:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:31 smithi145 ceph-mon[34049]: pgmap v537: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 692 KiB/s wr, 13 op/s 2024-09-21T08:07:31.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:31 smithi006 ceph-mon[30970]: pgmap v537: 129 pgs: 129 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 692 KiB/s wr, 13 op/s 2024-09-21T08:07:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 275.0 s, 883.8 tps, lat 498.986 ms stddev 2727.640 2024-09-21T08:07:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:33 smithi119 ceph-mon[33564]: pgmap v538: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-21T08:07:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:33 smithi145 ceph-mon[34049]: pgmap v538: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-21T08:07:33.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:33 smithi006 ceph-mon[30970]: pgmap v538: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-21T08:07:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:35 smithi119 ceph-mon[33564]: pgmap v539: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2024-09-21T08:07:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:35 smithi145 ceph-mon[34049]: pgmap v539: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2024-09-21T08:07:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:35 smithi006 ceph-mon[30970]: pgmap v539: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2024-09-21T08:07:37.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:07:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:37 smithi119 ceph-mon[33564]: pgmap v540: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.0 MiB/s wr, 315 op/s 2024-09-21T08:07:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:37 smithi145 ceph-mon[34049]: pgmap v540: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.0 MiB/s wr, 315 op/s 2024-09-21T08:07:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:37 smithi006 ceph-mon[30970]: pgmap v540: 129 pgs: 129 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.0 MiB/s wr, 315 op/s 2024-09-21T08:07:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 280.0 s, 950.3 tps, lat 103.558 ms stddev 174.215 2024-09-21T08:07:37.626 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:39 smithi119 ceph-mon[33564]: pgmap v541: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 12 MiB/s wr, 469 op/s 2024-09-21T08:07:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:39 smithi145 ceph-mon[34049]: pgmap v541: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 12 MiB/s wr, 469 op/s 2024-09-21T08:07:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:39 smithi006 ceph-mon[30970]: pgmap v541: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 12 MiB/s wr, 469 op/s 2024-09-21T08:07:39.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 -- 172.21.15.6:0/2128186590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc10fad0 msgr2=0x7f9ebc10fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/2128186590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc10fad0 0x7f9ebc10fee0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009860 tx=0x7f9eb002a340 comp rx=0 tx=0).stop 2024-09-21T08:07:39.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 -- 172.21.15.6:0/2128186590 shutdown_connections 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/2128186590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc110420 0x7f9ebc116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/2128186590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc10fad0 0x7f9ebc10fee0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/2128186590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ebc10a190 0x7f9ebc10a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.257+0000 7f9ec10e4640 1 -- 172.21.15.6:0/2128186590 >> 172.21.15.6:0/2128186590 conn(0x7f9ebc0780f0 msgr2=0x7f9ebc1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.258+0000 7f9ec10e4640 1 -- 172.21.15.6:0/2128186590 shutdown_connections 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.258+0000 7f9ec10e4640 1 -- 172.21.15.6:0/2128186590 wait complete. 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.259+0000 7f9ec10e4640 1 Processor -- start 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.259+0000 7f9ec10e4640 1 -- start start 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc10a190 0x7f9ebc1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ebc10fad0 0x7f9ebc1a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc119f40 con 0x7f9ebc110420 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc119dc0 con 0x7f9ebc10fad0 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ec10e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc11a0c0 con 0x7f9ebc10a190 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ebb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ebb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43906/0 (socket says 172.21.15.6:43906) 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.260+0000 7f9ebb59e640 1 -- 172.21.15.6:0/3734177337 learned_addr learned my addr 172.21.15.6:0/3734177337 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.261+0000 7f9ebb59e640 1 -- 172.21.15.6:0/3734177337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc10a190 msgr2=0x7f9ebc1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.261+0000 7f9ebb59e640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc10a190 0x7f9ebc1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.261+0000 7f9ebb59e640 1 -- 172.21.15.6:0/3734177337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ebc10fad0 msgr2=0x7f9ebc1a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.261+0000 7f9ebb59e640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ebc10fad0 0x7f9ebc1a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.261+0000 7f9ebb59e640 1 -- 172.21.15.6:0/3734177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ebc1a6940 con 0x7f9ebc110420 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.262+0000 7f9ebb59e640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009fd0 tx=0x7f9eb400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.262+0000 7f9ea3fff640 1 -- 172.21.15.6:0/3734177337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4004b20 con 0x7f9ebc110420 2024-09-21T08:07:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.262+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ebc1a6c30 con 0x7f9ebc110420 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.262+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ebc1ad390 con 0x7f9ebc110420 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.262+0000 7f9ea3fff640 1 -- 172.21.15.6:0/3734177337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb400bac0 con 0x7f9ebc110420 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.263+0000 7f9ea3fff640 1 -- 172.21.15.6:0/3734177337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb401a020 con 0x7f9ebc110420 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.268+0000 7f9ea3fff640 1 -- 172.21.15.6:0/3734177337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9eb401d020 con 0x7f9ebc110420 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 Processor -- start 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 -- start start 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09373bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093373390 0x55d09373c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d0936b1e50 con 0x55d093373390 2024-09-21T08:07:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d0936a1280 con 0x55d093394070 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.269+0000 7f9ec7658740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d0936a5090 con 0x55d09336b1b0 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9ebad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09373bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9ea3fff640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 0x7f9ea40b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55888/0 (socket says 172.21.15.6:55888) 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 -- 172.21.15.6:0/4159329495 learned_addr learned my addr 172.21.15.6:0/4159329495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093373390 0x55d09373c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 -- 172.21.15.6:0/4159329495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 msgr2=0x55d09373bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09373bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 -- 172.21.15.6:0/4159329495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093373390 msgr2=0x55d09373c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093373390 0x55d09373c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.270+0000 7f9eba59c640 1 -- 172.21.15.6:0/4159329495 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0933ff650 con 0x55d093394070 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.271+0000 7f9ebb59e640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 0x7f9ea40b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.271+0000 7f9ea3fff640 1 -- 172.21.15.6:0/3734177337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f9eb40e7a70 con 0x7f9ebc110420 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.272+0000 7f9eba59c640 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009780 tx=0x7f9eb00056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7bbc93854432f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.272+0000 7f9ebb59e640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 0x7f9ea40b8c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009fa0 tx=0x7f9eb400bf90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.275+0000 7f9ea17fa640 1 -- 172.21.15.6:0/4159329495 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0056070 con 0x55d093394070 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.275+0000 7f9ea17fa640 1 -- 172.21.15.6:0/4159329495 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb0038040 con 0x55d093394070 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.275+0000 7f9ea17fa640 1 -- 172.21.15.6:0/4159329495 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0037070 con 0x55d093394070 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 -- 172.21.15.6:0/4159329495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 msgr2=0x55d09373b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009780 tx=0x7f9eb00056d0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 -- 172.21.15.6:0/4159329495 shutdown_connections 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09373bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093373390 0x55d09373c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 --2- 172.21.15.6:0/4159329495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d09373b650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.276+0000 7f9ec7658740 1 -- 172.21.15.6:0/4159329495 >> 172.21.15.6:0/4159329495 conn(0x55d093388460 msgr2=0x55d093739540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.277+0000 7f9ec7658740 1 -- 172.21.15.6:0/4159329495 shutdown_connections 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.277+0000 7f9ec7658740 1 -- 172.21.15.6:0/4159329495 wait complete. 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 -- start start 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 Processor -- start 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d09336b1b0 0x55d093746d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093753150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d093502700 con 0x55d09336b1b0 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d09363c110 con 0x55d093394070 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d093749dd0 con 0x55d093373390 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.278+0000 7f9ec7658740 10 client.0 _ll_register_callbacks cb 0x55d093655990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47544/0 (socket says 172.21.15.6:47544) 2024-09-21T08:07:39.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1302030800 learned_addr learned my addr 172.21.15.6:0/1302030800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093753150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d09336b1b0 0x55d093746d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 msgr2=0x55d093753150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093753150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1302030800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d09336b1b0 msgr2=0x55d093746d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d09336b1b0 0x55d093746d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.279+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1302030800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d093669c40 con 0x55d093373390 2024-09-21T08:07:39.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.280+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00f640 tx=0x7f9eac00af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=984f39441136c16e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.280+0000 7f9e9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.281+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004220 con 0x55d093373390 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.281+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f9eac0043c0 con 0x55d093373390 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.281+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb0038040 con 0x55d093373390 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.281+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9eac00d850 con 0x55d093373390 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 10 client.26221 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d093755be0 con 0x55d093373390 2024-09-21T08:07:39.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb0038040 con 0x55d093373390 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9eac005020 con 0x55d093373390 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 10 client.26221 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 10 client.26221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 20 client.26221 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0933529f0 0x55d093759230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 4 client.26221 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.282+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0936b3da0 con 0x55d0933529f0 2024-09-21T08:07:39.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.283+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0933529f0 0x55d093759230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.283+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0933529f0 0x55d093759230 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8d6046d72381b9 server_cookie=68c54c5b3f1d9f5 in_seq=0 out_seq=0 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.283+0000 7f9e9eff5640 10 client.26221 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9e9eff5640 1 -- 172.21.15.6:0/1302030800 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0936b3da0 con 0x55d0933529f0 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9e9eff5640 10 client.26221 handle_command_reply: tid=0 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 client.26221 shutdown 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 msgr2=0x55d093747290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00f640 tx=0x7f9eac00af90 comp rx=0 tx=0).stop 2024-09-21T08:07:39.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 shutdown_connections 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0933529f0 0x55d093759230 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d093373390 0x55d093747290 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00f640 tx=0x7f9eac00af90 comp rx=0 tx=0).stop 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093753150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1302030800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d09336b1b0 0x55d093746d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 >> 172.21.15.6:0/1302030800 conn(0x55d093388460 msgr2=0x55d09373e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.284+0000 7f9e9eff5640 0 client.26221 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.285+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 shutdown_connections 2024-09-21T08:07:39.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.285+0000 7f9ec7658740 1 -- 172.21.15.6:0/1302030800 wait complete. 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.285+0000 7f9ec7658740 20 client.26221 trim_cache size 0 max 16384 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.318+0000 7f9ec7658740 1 Processor -- start 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.318+0000 7f9ec7658740 1 -- start start 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d093742500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093327da0 0x55d09373cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea800df20 con 0x55d093327da0 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80107a0 con 0x55d093394070 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ec7658740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea800e590 con 0x55d09336b1b0 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55912/0 (socket says 172.21.15.6:55912) 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1782837333 learned_addr learned my addr 172.21.15.6:0/1782837333 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d093742500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9eba59c640 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093327da0 0x55d09373cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1782837333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 msgr2=0x55d093742500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d093742500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1782837333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093327da0 msgr2=0x55d09373cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093327da0 0x55d09373cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.319+0000 7f9ebad9d640 1 -- 172.21.15.6:0/1782837333 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d093747df0 con 0x55d093394070 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.320+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9eac005680 tx=0x7f9eac005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb21f6d8f93246f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.320+0000 7f9ea0ff9640 1 -- 172.21.15.6:0/1782837333 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac005200 con 0x55d093394070 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.320+0000 7f9ea0ff9640 1 -- 172.21.15.6:0/1782837333 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eac00de80 con 0x55d093394070 2024-09-21T08:07:39.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.320+0000 7f9ea0ff9640 1 -- 172.21.15.6:0/1782837333 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004dc0 con 0x55d093394070 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.321+0000 7f9ec7658740 1 -- 172.21.15.6:0/1782837333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 msgr2=0x55d093745f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.321+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9eac005680 tx=0x7f9eac005700 comp rx=0 tx=0).stop 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 -- 172.21.15.6:0/1782837333 shutdown_connections 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093327da0 0x55d09373cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093394070 0x55d093745f90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 --2- 172.21.15.6:0/1782837333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d093742500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 -- 172.21.15.6:0/1782837333 >> 172.21.15.6:0/1782837333 conn(0x55d093388460 msgr2=0x55d09373c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 -- 172.21.15.6:0/1782837333 shutdown_connections 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.322+0000 7f9ec7658740 1 -- 172.21.15.6:0/1782837333 wait complete. 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.323+0000 7f9ec7658740 1 -- start start 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.323+0000 7f9ec7658740 1 Processor -- start 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.323+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ec7658740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09374acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55914/0 (socket says 172.21.15.6:55914) 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 -- 172.21.15.6:0/286821119 learned_addr learned my addr 172.21.15.6:0/286821119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093394070 0x55d09374b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09374acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea800ec60 con 0x55d093394070 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80100d0 con 0x55d093327da0 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea800f330 con 0x55d09336b1b0 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 -- 172.21.15.6:0/286821119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 msgr2=0x55d09374acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09374acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 -- 172.21.15.6:0/286821119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093394070 msgr2=0x55d09374b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093394070 0x55d09374b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.324+0000 7f9eba59c640 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09374b970 con 0x55d093327da0 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9ec7658740 10 client.0 _ll_register_callbacks cb 0x7f9eac00a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:39.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9eba59c640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009860 tx=0x7f9eb002aae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2802ba8f76420852 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9e9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0936af850 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9e9eff5640 1 -- 172.21.15.6:0/286821119 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0056040 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9e9eff5640 1 -- 172.21.15.6:0/286821119 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f9eb0030800 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9e9eff5640 1 -- 172.21.15.6:0/286821119 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9eb0037040 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9ec7658740 10 client.26132 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.325+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55d0937c39d0 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9e9eff5640 1 -- 172.21.15.6:0/286821119 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9eb005c040 con 0x55d093327da0 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 10 client.26132 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 10 client.26132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 20 client.26132 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0937c3ca0 0x55d0937c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:39.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 4 client.26132 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.326+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0936af850 con 0x55d0937c3ca0 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.327+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0937c3ca0 0x55d0937c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ebad9d640 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0937c3ca0 0x55d0937c60c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607974cd89e2971b server_cookie=299a37d1f12546ad in_seq=0 out_seq=0 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9e9eff5640 10 client.26132 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9e9eff5640 1 -- 172.21.15.6:0/286821119 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55d0936af850 con 0x55d0937c3ca0 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9e9eff5640 10 client.26132 handle_command_reply: tid=0 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 client.26132 shutdown 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 msgr2=0x55d09374f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009860 tx=0x7f9eb002aae0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 shutdown_connections 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d0937c3ca0 0x55d0937c60c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d09336b1b0 0x55d09374acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d093394070 0x55d09374b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.329+0000 7f9ec7658740 1 --2- 172.21.15.6:0/286821119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d093327da0 0x55d09374f840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 >> 172.21.15.6:0/286821119 conn(0x55d093388460 msgr2=0x55d093745d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9e9eff5640 0 client.26132 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:07:39.800 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:07:39.801 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:39.805 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 shutdown_connections 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec7658740 1 -- 172.21.15.6:0/286821119 wait complete. 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec7658740 20 client.26132 trim_cache size 0 max 16384 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 msgr2=0x7f9ea40b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 0x7f9ea40b8c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009fa0 tx=0x7f9eb400bf90 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 msgr2=0x7f9ebc1a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009fd0 tx=0x7f9eb400c800 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 shutdown_connections 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ea40b6780 0x7f9ea40b8c90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc110420 0x7f9ebc1a6210 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ebc10fad0 0x7f9ebc1a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 --2- 172.21.15.6:0/3734177337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc10a190 0x7f9ebc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.330+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 >> 172.21.15.6:0/3734177337 conn(0x7f9ebc0780f0 msgr2=0x7f9ebc1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:39.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.331+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 shutdown_connections 2024-09-21T08:07:39.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:39.331+0000 7f9ec10e4640 1 -- 172.21.15.6:0/3734177337 wait complete. 2024-09-21T08:07:41.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:41 smithi006 ceph-mon[30970]: pgmap v542: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 623 op/s 2024-09-21T08:07:41.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:41 smithi119 ceph-mon[33564]: pgmap v542: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 623 op/s 2024-09-21T08:07:41.437 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:07:41.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:07:41.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:41 smithi145 ceph-mon[34049]: pgmap v542: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 623 op/s 2024-09-21T08:07:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:42.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.450+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/2209775740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d48111f40 msgr2=0x7f2d4810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:42.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.450+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/2209775740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d48111f40 0x7f2d4810a3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009900 tx=0x7f2d3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.452+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/2209775740 shutdown_connections 2024-09-21T08:07:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.452+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/2209775740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4811cc30 0x7f2d4811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.452+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/2209775740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4810a9e0 0x7f2d4810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.452+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/2209775740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d48111f40 0x7f2d4810a3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.452+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/2209775740 >> 172.21.15.6:0/2209775740 conn(0x7f2d48070ec0 msgr2=0x7f2d480712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.455+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/2209775740 shutdown_connections 2024-09-21T08:07:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.455+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/2209775740 wait complete. 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.456+0000 7f2d4c8a0640 1 Processor -- start 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.456+0000 7f2d4c8a0640 1 -- start start 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.456+0000 7f2d4c8a0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4c8a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d48111f40 0x7f2d481a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4c8a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4811cc30 0x7f2d481aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4c8a0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d481227b0 con 0x7f2d48111f40 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4c8a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48122630 con 0x7f2d4811cc30 2024-09-21T08:07:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4c8a0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48122930 con 0x7f2d4810a9e0 2024-09-21T08:07:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47582/0 (socket says 172.21.15.6:47582) 2024-09-21T08:07:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d4659c640 1 -- 172.21.15.6:0/3725136821 learned_addr learned my addr 172.21.15.6:0/3725136821 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.457+0000 7f2d46d9d640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4811cc30 0x7f2d481aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d45d9b640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d48111f40 0x7f2d481a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d4659c640 1 -- 172.21.15.6:0/3725136821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4811cc30 msgr2=0x7f2d481aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d4659c640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4811cc30 0x7f2d481aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d4659c640 1 -- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d48111f40 msgr2=0x7f2d481a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d4659c640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d48111f40 0x7f2d481a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.458+0000 7f2d4659c640 1 -- 172.21.15.6:0/3725136821 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d481af230 con 0x7f2d4810a9e0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d4659c640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c02a960 tx=0x7f2d3c003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c03f070 con 0x7f2d4810a9e0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d3c03bd00 con 0x7f2d4810a9e0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c035030 con 0x7f2d4810a9e0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d481af4c0 con 0x7f2d4810a9e0 2024-09-21T08:07:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.459+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d481af890 con 0x7f2d4810a9e0 2024-09-21T08:07:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.461+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d4810adf0 con 0x7f2d4810a9e0 2024-09-21T08:07:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.463+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2d3c042070 con 0x7f2d4810a9e0 2024-09-21T08:07:42.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.464+0000 7f2d377fe640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 0x7f2d300b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:42.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.465+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f2d3c108280 con 0x7f2d4810a9e0 2024-09-21T08:07:42.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.465+0000 7f2d45d9b640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 0x7f2d300b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:42.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.466+0000 7f2d45d9b640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 0x7f2d300b8c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d4811c280 tx=0x7f2d40009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.469+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d3c0d27d0 con 0x7f2d4810a9e0 2024-09-21T08:07:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 285.0 s, 911.9 tps, lat 118.812 ms stddev 196.692 2024-09-21T08:07:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.903+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d481b5ea0 con 0x7f2d4810a9e0 2024-09-21T08:07:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.905+0000 7f2d377fe640 1 -- 172.21.15.6:0/3725136821 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f2d3c0d7710 con 0x7f2d4810a9e0 2024-09-21T08:07:42.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:07:42.908 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:07:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:07:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 msgr2=0x7f2d300b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 0x7f2d300b8c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d4811c280 tx=0x7f2d40009680 comp rx=0 tx=0).stop 2024-09-21T08:07:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 msgr2=0x7f2d481a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c02a960 tx=0x7f2d3c003cd0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 shutdown_connections 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f2d300b6730 0x7f2d300b8c40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4811cc30 0x7f2d481aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d48111f40 0x7f2d481a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 --2- 172.21.15.6:0/3725136821 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d4810a9e0 0x7f2d481a92c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.910+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 >> 172.21.15.6:0/3725136821 conn(0x7f2d48070ec0 msgr2=0x7f2d4811e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.911+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 shutdown_connections 2024-09-21T08:07:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:42.911+0000 7f2d4c8a0640 1 -- 172.21.15.6:0/3725136821 wait complete. 2024-09-21T08:07:43.161 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:43 smithi006 ceph-mon[30970]: pgmap v543: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 18 MiB/s wr, 779 op/s 2024-09-21T08:07:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:43 smithi119 ceph-mon[33564]: pgmap v543: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 18 MiB/s wr, 779 op/s 2024-09-21T08:07:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:43 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3725136821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:43 smithi145 ceph-mon[34049]: pgmap v543: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 18 MiB/s wr, 779 op/s 2024-09-21T08:07:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3725136821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3725136821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:07:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:45 smithi119 ceph-mon[33564]: pgmap v544: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 844 op/s 2024-09-21T08:07:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:45 smithi145 ceph-mon[34049]: pgmap v544: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 844 op/s 2024-09-21T08:07:45.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:45 smithi006 ceph-mon[30970]: pgmap v544: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 844 op/s 2024-09-21T08:07:45.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:07:46.272 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.921+0000 7f761f59e640 1 -- 172.21.15.6:0/2289661829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7620102870 msgr2=0x7f7620102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.921+0000 7f761f59e640 1 --2- 172.21.15.6:0/2289661829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7620102870 0x7f7620102c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7610009be0 tx=0x7f761002a6c0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.922+0000 7f761f59e640 1 -- 172.21.15.6:0/2289661829 shutdown_connections 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.922+0000 7f761f59e640 1 --2- 172.21.15.6:0/2289661829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.922+0000 7f761f59e640 1 --2- 172.21.15.6:0/2289661829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76201081b0 0x7f76201085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.922+0000 7f761f59e640 1 --2- 172.21.15.6:0/2289661829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7620102870 0x7f7620102c80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.922+0000 7f761f59e640 1 -- 172.21.15.6:0/2289661829 >> 172.21.15.6:0/2289661829 conn(0x7f76200fe2c0 msgr2=0x7f7620100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.923+0000 7f761f59e640 1 -- 172.21.15.6:0/2289661829 shutdown_connections 2024-09-21T08:07:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.924+0000 7f761f59e640 1 -- 172.21.15.6:0/2289661829 wait complete. 2024-09-21T08:07:46.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.925+0000 7f761f59e640 1 Processor -- start 2024-09-21T08:07:46.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.926+0000 7f761f59e640 1 -- start start 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.926+0000 7f761f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76201081b0 0x7f762019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761f59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761f59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76201137d0 con 0x7f76201081b0 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761f59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7620113650 con 0x7f7620102870 2024-09-21T08:07:46.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761f59e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7620113950 con 0x7f7620108b00 2024-09-21T08:07:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2024-09-21T08:07:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761ed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f761e59c640 1 -- 172.21.15.6:0/3190263364 learned_addr learned my addr 172.21.15.6:0/3190263364 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.927+0000 7f7615d9b640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76201081b0 0x7f762019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 -- 172.21.15.6:0/3190263364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 msgr2=0x7f762019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 -- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76201081b0 msgr2=0x7f762019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76201081b0 0x7f762019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 -- 172.21.15.6:0/3190263364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76201a01d0 con 0x7f7620102870 2024-09-21T08:07:46.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.928+0000 7f761e59c640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f761002acb0 tx=0x7f7610030d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.929+0000 7f7617fff640 1 -- 172.21.15.6:0/3190263364 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610041020 con 0x7f7620102870 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.929+0000 7f7617fff640 1 -- 172.21.15.6:0/3190263364 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7610037040 con 0x7f7620102870 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.929+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76201a0460 con 0x7f7620102870 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.929+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7620110e30 con 0x7f7620102870 2024-09-21T08:07:46.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.929+0000 7f7617fff640 1 -- 172.21.15.6:0/3190263364 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610036070 con 0x7f7620102870 2024-09-21T08:07:46.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.933+0000 7f7617fff640 1 -- 172.21.15.6:0/3190263364 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7610044020 con 0x7f7620102870 2024-09-21T08:07:46.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.934+0000 7f762af73740 1 Processor -- start 2024-09-21T08:07:46.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.935+0000 7f7617fff640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 0x7f760c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.935+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 0x7f760c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.935+0000 7f7617fff640 1 -- 172.21.15.6:0/3190263364 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7610108200 con 0x7f7620102870 2024-09-21T08:07:46.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.936+0000 7f762af73740 1 -- start start 2024-09-21T08:07:46.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.936+0000 7f762af73740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f762af73740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f762af73740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f761e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f761e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36434/0 (socket says 172.21.15.6:36434) 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.937+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34488/0 (socket says 172.21.15.6:34488) 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f762af73740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56099d91cea0 con 0x56099d5d61b0 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f762af73740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56099d90c2d0 con 0x56099d5de390 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f762af73740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56099d9100e0 con 0x56099d5ff070 2024-09-21T08:07:46.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f761e59c640 1 -- 172.21.15.6:0/1145132977 learned_addr learned my addr 172.21.15.6:0/1145132977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 0x7f760c0b8d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7618009fc0 tx=0x7f7618005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f7615d9b640 1 -- 172.21.15.6:0/1145132977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 msgr2=0x56099d9a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f7615d9b640 1 -- 172.21.15.6:0/1145132977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 msgr2=0x56099d9a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f761ed9d640 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f7615d9b640 1 -- 172.21.15.6:0/1145132977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099d66a650 con 0x56099d5d61b0 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.938+0000 7f761e59c640 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.939+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f762006a800 tx=0x7f7608011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190eaa84bf7fb4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.939+0000 7f7614d99640 1 -- 172.21.15.6:0/1145132977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608004030 con 0x56099d5d61b0 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.939+0000 7f7614d99640 1 -- 172.21.15.6:0/1145132977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76080035f0 con 0x56099d5d61b0 2024-09-21T08:07:46.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.939+0000 7f7614d99640 1 -- 172.21.15.6:0/1145132977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608019640 con 0x56099d5d61b0 2024-09-21T08:07:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 -- 172.21.15.6:0/1145132977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 msgr2=0x56099d9a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f762006a800 tx=0x7f7608011440 comp rx=0 tx=0).stop 2024-09-21T08:07:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 -- 172.21.15.6:0/1145132977 shutdown_connections 2024-09-21T08:07:46.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9a6da0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 --2- 172.21.15.6:0/1145132977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5ff070 0x56099d9a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.941+0000 7f762af73740 1 -- 172.21.15.6:0/1145132977 >> 172.21.15.6:0/1145132977 conn(0x56099d5f3460 msgr2=0x56099d9a4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.942+0000 7f762af73740 1 -- 172.21.15.6:0/1145132977 shutdown_connections 2024-09-21T08:07:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.943+0000 7f762af73740 1 -- 172.21.15.6:0/1145132977 wait complete. 2024-09-21T08:07:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.943+0000 7f762af73740 1 -- start start 2024-09-21T08:07:46.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 Processor -- start 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099d9be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56099d76d700 con 0x56099d5d61b0 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56099d8a7160 con 0x56099d5ff070 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.944+0000 7f762af73740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56099d9b5040 con 0x56099d5de390 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f762af73740 10 client.0 _ll_register_callbacks cb 0x56099d8c09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36438/0 (socket says 172.21.15.6:36438) 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 -- 172.21.15.6:0/1092233048 learned_addr learned my addr 172.21.15.6:0/1092233048 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f761ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099d9be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f761e59c640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 -- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 msgr2=0x56099d9be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099d9be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 -- 172.21.15.6:0/1092233048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 msgr2=0x56099d9b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 -- 172.21.15.6:0/1092233048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099d8d4c90 con 0x56099d5de390 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f761e59c640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7615d9b640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7608003f00 tx=0x7f76080044d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4874183e5c97ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.945+0000 7f7605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608028020 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7608003a20 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76080035f0 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f760801f040 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f762af73740 10 client.26242 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.946+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56099d9c0d80 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7608003c60 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7608018070 con 0x56099d5de390 2024-09-21T08:07:46.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 10 client.26242 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 10 client.26242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 20 client.26242 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d5bd9f0 0x56099d9c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 4 client.26242 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f76080035f0 con 0x56099d5bd9f0 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.947+0000 7f761e59c640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d5bd9f0 0x56099d9c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.948+0000 7f761e59c640 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d5bd9f0 0x56099d9c4190 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f537f8448640b96 server_cookie=efc54474c11170e7 in_seq=0 out_seq=0 2024-09-21T08:07:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.948+0000 7f7605ffb640 10 client.26242 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.949+0000 7f7605ffb640 1 -- 172.21.15.6:0/1092233048 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f76080035f0 con 0x56099d5bd9f0 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.949+0000 7f7605ffb640 10 client.26242 handle_command_reply: tid=0 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.949+0000 7f762af73740 1 client.26242 shutdown 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.949+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 msgr2=0x56099d9b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.949+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7608003f00 tx=0x7f76080044d0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 shutdown_connections 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d5bd9f0 0x56099d9c4190 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b2490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099d9be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 --2- 172.21.15.6:0/1092233048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 >> 172.21.15.6:0/1092233048 conn(0x56099d5f3460 msgr2=0x56099d9a99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f7605ffb640 0 client.26242 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 shutdown_connections 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 1 -- 172.21.15.6:0/1092233048 wait complete. 2024-09-21T08:07:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.950+0000 7f762af73740 20 client.26242 trim_cache size 0 max 16384 2024-09-21T08:07:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.973+0000 7f762af73740 1 Processor -- start 2024-09-21T08:07:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.973+0000 7f762af73740 1 -- start start 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5d61b0 0x56099d9a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b0d80 con 0x56099d5ff070 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b3600 con 0x56099d5de390 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f762af73740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b13f0 con 0x56099d5d61b0 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f761ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.974+0000 7f761ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34506/0 (socket says 172.21.15.6:34506) 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 -- 172.21.15.6:0/3366456974 learned_addr learned my addr 172.21.15.6:0/3366456974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f7615d9b640 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761e59c640 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5d61b0 0x56099d9a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 -- 172.21.15.6:0/3366456974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5d61b0 msgr2=0x56099d9a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5d61b0 0x56099d9a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 -- 172.21.15.6:0/3366456974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 msgr2=0x56099d9a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.975+0000 7f761ed9d640 1 -- 172.21.15.6:0/3366456974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099d5bdc20 con 0x56099d5ff070 2024-09-21T08:07:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.976+0000 7f761ed9d640 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f76180045c0 tx=0x7f7618014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d383c88993db55b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.976+0000 7f7607fff640 1 -- 172.21.15.6:0/3366456974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761802b070 con 0x56099d5ff070 2024-09-21T08:07:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.976+0000 7f7607fff640 1 -- 172.21.15.6:0/3366456974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f761801d940 con 0x56099d5ff070 2024-09-21T08:07:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.977+0000 7f7607fff640 1 -- 172.21.15.6:0/3366456974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761801c9a0 con 0x56099d5ff070 2024-09-21T08:07:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 -- 172.21.15.6:0/3366456974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 msgr2=0x56099d9af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f76180045c0 tx=0x7f7618014000 comp rx=0 tx=0).stop 2024-09-21T08:07:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 -- 172.21.15.6:0/3366456974 shutdown_connections 2024-09-21T08:07:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5ff070 0x56099d9af140 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5de390 0x56099d9a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 --2- 172.21.15.6:0/3366456974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5d61b0 0x56099d9a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 -- 172.21.15.6:0/3366456974 >> 172.21.15.6:0/3366456974 conn(0x56099d5f3460 msgr2=0x56099d9b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 -- 172.21.15.6:0/3366456974 shutdown_connections 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.978+0000 7f762af73740 1 -- 172.21.15.6:0/3366456974 wait complete. 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.979+0000 7f762af73740 1 -- start start 2024-09-21T08:07:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.979+0000 7f762af73740 1 Processor -- start 2024-09-21T08:07:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099da362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b1ac0 con 0x56099d5d61b0 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b2f30 con 0x56099d5ff070 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b2190 con 0x56099d5de390 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.980+0000 7f762af73740 10 client.0 _ll_register_callbacks cb 0x7f7608009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f761ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099da362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f7615d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36450/0 (socket says 172.21.15.6:36450) 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f7615d9b640 1 -- 172.21.15.6:0/870378218 learned_addr learned my addr 172.21.15.6:0/870378218 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f761e59c640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f7615d9b640 1 -- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 msgr2=0x56099da362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.981+0000 7f7615d9b640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099da362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7615d9b640 1 -- 172.21.15.6:0/870378218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 msgr2=0x56099d9b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7615d9b640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7615d9b640 1 -- 172.21.15.6:0/870378218 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099da367e0 con 0x56099d5de390 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7615d9b640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7608009b80 tx=0x7f7608011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ed39963d0dbfcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.982+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760803c060 con 0x56099d5de390 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f7608004740 con 0x56099d5de390 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f761801d940 con 0x56099d5de390 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7608004980 con 0x56099d5de390 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f762af73740 10 client.26248 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56099da379f0 con 0x56099d5de390 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.983+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7608003a80 con 0x56099d5de390 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7608018040 con 0x56099d5de390 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 10 client.26248 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 10 client.26248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 20 client.26248 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d592da0 0x56099da3a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 4 client.26248 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:07:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f761801d940 con 0x56099d592da0 2024-09-21T08:07:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.984+0000 7f761e59c640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d592da0 0x56099da3a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.986+0000 7f761e59c640 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d592da0 0x56099da3a160 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ca688ee004c4ef server_cookie=e0f6dcfc5a748dbc in_seq=0 out_seq=0 2024-09-21T08:07:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.986+0000 7f7605ffb640 10 client.26248 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f7605ffb640 1 -- 172.21.15.6:0/870378218 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f761801d940 con 0x56099d592da0 2024-09-21T08:07:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f7605ffb640 10 client.26248 handle_command_reply: tid=0 2024-09-21T08:07:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 client.26248 shutdown 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 msgr2=0x56099d9b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7608009b80 tx=0x7f7608011a30 comp rx=0 tx=0).stop 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 shutdown_connections 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56099d592da0 0x56099da3a160 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.987+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56099d5de390 0x56099d9b6f30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f7605ffb640 0 client.26248 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56099d5ff070 0x56099da362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 1 --2- 172.21.15.6:0/870378218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56099d5d61b0 0x56099d9b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 >> 172.21.15.6:0/870378218 conn(0x56099d5f3460 msgr2=0x56099d9a9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 shutdown_connections 2024-09-21T08:07:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 1 -- 172.21.15.6:0/870378218 wait complete. 2024-09-21T08:07:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.988+0000 7f762af73740 20 client.26248 trim_cache size 0 max 16384 2024-09-21T08:07:46.991 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:07:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.989+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 msgr2=0x7f760c0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.989+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 0x7f760c0b8d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7618009fc0 tx=0x7f7618005f90 comp rx=0 tx=0).stop 2024-09-21T08:07:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 msgr2=0x7f762019a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f761002acb0 tx=0x7f7610030d50 comp rx=0 tx=0).stop 2024-09-21T08:07:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 shutdown_connections 2024-09-21T08:07:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f760c0b6880 0x7f760c0b8d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7620108b00 0x7f762019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76201081b0 0x7f762019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 --2- 172.21.15.6:0/3190263364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7620102870 0x7f762019a260 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 >> 172.21.15.6:0/3190263364 conn(0x7f76200fe2c0 msgr2=0x7f76201006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 shutdown_connections 2024-09-21T08:07:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:46.990+0000 7f761f59e640 1 -- 172.21.15.6:0/3190263364 wait complete. 2024-09-21T08:07:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:47 smithi119 ceph-mon[33564]: pgmap v545: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 18 MiB/s wr, 823 op/s 2024-09-21T08:07:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:47 smithi145 ceph-mon[34049]: pgmap v545: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 18 MiB/s wr, 823 op/s 2024-09-21T08:07:47.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:47 smithi006 ceph-mon[30970]: pgmap v545: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 18 MiB/s wr, 823 op/s 2024-09-21T08:07:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 290.0 s, 714.8 tps, lat 124.894 ms stddev 163.009 2024-09-21T08:07:48.825 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:07:48.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:07:49.282 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:49 smithi119 ceph-mon[33564]: pgmap v546: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 18 MiB/s wr, 847 op/s 2024-09-21T08:07:49.421 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:49 smithi006 ceph-mon[30970]: pgmap v546: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 18 MiB/s wr, 847 op/s 2024-09-21T08:07:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:49 smithi145 ceph-mon[34049]: pgmap v546: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 18 MiB/s wr, 847 op/s 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 -- 172.21.15.6:0/416704434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 msgr2=0x7f44781098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 --2- 172.21.15.6:0/416704434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781098d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f446c009900 tx=0x7f446c02a400 comp rx=0 tx=0).stop 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 -- 172.21.15.6:0/416704434 shutdown_connections 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 --2- 172.21.15.6:0/416704434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f4478110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 --2- 172.21.15.6:0/416704434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781098d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 --2- 172.21.15.6:0/416704434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 0x7f4478103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 -- 172.21.15.6:0/416704434 >> 172.21.15.6:0/416704434 conn(0x7f44780ff610 msgr2=0x7f4478101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 -- 172.21.15.6:0/416704434 shutdown_connections 2024-09-21T08:07:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.870+0000 7f447de16640 1 -- 172.21.15.6:0/416704434 wait complete. 2024-09-21T08:07:49.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.871+0000 7f447de16640 1 Processor -- start 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.871+0000 7f447de16640 1 -- start start 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 0x7f44781a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44781117f0 con 0x7f44781094c0 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4478111670 con 0x7f4478109e10 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f447de16640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4478111970 con 0x7f4478103b80 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f44777fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 0x7f44781a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f4477fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f4477fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39840/0 (socket says 172.21.15.6:39840) 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f4477fff640 1 -- 172.21.15.6:0/1291621908 learned_addr learned my addr 172.21.15.6:0/1291621908 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.872+0000 7f4476ffd640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 -- 172.21.15.6:0/1291621908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 msgr2=0x7f44781a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 0x7f44781a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 -- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 msgr2=0x7f44781a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 -- 172.21.15.6:0/1291621908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44781a6910 con 0x7f4478109e10 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4476ffd640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.873+0000 7f4477fff640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f447000eb10 tx=0x7f447000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.874+0000 7f4474ff9640 1 -- 172.21.15.6:0/1291621908 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470004b20 con 0x7f4478109e10 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.874+0000 7f4474ff9640 1 -- 172.21.15.6:0/1291621908 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4470004cc0 con 0x7f4478109e10 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.874+0000 7f4474ff9640 1 -- 172.21.15.6:0/1291621908 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470010690 con 0x7f4478109e10 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.874+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44781a6c00 con 0x7f4478109e10 2024-09-21T08:07:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.874+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781ad360 con 0x7f4478109e10 2024-09-21T08:07:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.878+0000 7f448438a740 1 Processor -- start 2024-09-21T08:07:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.878+0000 7f4474ff9640 1 -- 172.21.15.6:0/1291621908 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4470010830 con 0x7f4478109e10 2024-09-21T08:07:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.878+0000 7f448438a740 1 -- start start 2024-09-21T08:07:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 0x5630e2b8c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 0x5630e2b8c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b8ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5630e2b02e60 con 0x5630e27c4670 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5630e2af2290 con 0x5630e27bc490 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f448438a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630e2af60a0 con 0x5630e27e5350 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f44777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 0x5630e2b8c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f44777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 0x5630e2b8c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39844/0 (socket says 172.21.15.6:39844) 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f44777fe640 1 -- 172.21.15.6:0/790315563 learned_addr learned my addr 172.21.15.6:0/790315563 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 0x5630e2b8c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.879+0000 7f4476ffd640 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b8ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.880+0000 7f4476ffd640 1 -- 172.21.15.6:0/790315563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 msgr2=0x5630e2b8c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.880+0000 7f4476ffd640 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 0x5630e2b8c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.880+0000 7f4476ffd640 1 -- 172.21.15.6:0/790315563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 msgr2=0x5630e2b8ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.880+0000 7f4476ffd640 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b8ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.880+0000 7f4476ffd640 1 -- 172.21.15.6:0/790315563 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e2850930 con 0x5630e27e5350 2024-09-21T08:07:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.881+0000 7f4474ff9640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 0x7f44600b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.881+0000 7f4474ff9640 1 -- 172.21.15.6:0/1291621908 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f44700e8110 con 0x7f4478109e10 2024-09-21T08:07:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.882+0000 7f44777fe640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 0x7f44600b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.882+0000 7f4476ffd640 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 0x5630e2b8c430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f446c02a9f0 tx=0x7f446c005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374c0fa4e7feb0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.883+0000 7f445dffb640 1 -- 172.21.15.6:0/790315563 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c035040 con 0x5630e27e5350 2024-09-21T08:07:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.883+0000 7f445dffb640 1 -- 172.21.15.6:0/790315563 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f446c003d00 con 0x5630e27e5350 2024-09-21T08:07:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.883+0000 7f445dffb640 1 -- 172.21.15.6:0/790315563 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c03dcb0 con 0x5630e27e5350 2024-09-21T08:07:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.884+0000 7f448438a740 1 -- 172.21.15.6:0/790315563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 msgr2=0x5630e2b8c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.884+0000 7f448438a740 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 0x5630e2b8c430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f446c02a9f0 tx=0x7f446c005a20 comp rx=0 tx=0).stop 2024-09-21T08:07:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.884+0000 7f44777fe640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 0x7f44600b8da0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5630e2b8b0b0 tx=0x7f446800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.889+0000 7f448438a740 1 -- 172.21.15.6:0/790315563 shutdown_connections 2024-09-21T08:07:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.889+0000 7f448438a740 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b8ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.889+0000 7f448438a740 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27bc490 0x5630e2b8c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.889+0000 7f448438a740 1 --2- 172.21.15.6:0/790315563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27e5350 0x5630e2b8c430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.889+0000 7f448438a740 1 -- 172.21.15.6:0/790315563 >> 172.21.15.6:0/790315563 conn(0x5630e27d9740 msgr2=0x5630e2b8a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.890+0000 7f448438a740 1 -- 172.21.15.6:0/790315563 shutdown_connections 2024-09-21T08:07:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.890+0000 7f448438a740 1 -- 172.21.15.6:0/790315563 wait complete. 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.891+0000 7f448438a740 1 -- start start 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.892+0000 7f448438a740 1 Processor -- start 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.892+0000 7f448438a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b98090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b98670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 0x5630e2b9dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5630e2953890 con 0x5630e27c4670 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5630e2a8cd40 con 0x5630e27e5350 2024-09-21T08:07:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630e2b9ac00 con 0x5630e27bc490 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f448438a740 10 client.0 _ll_register_callbacks cb 0x5630e2af0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f4477fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 0x5630e2b9dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.894+0000 7f4477fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 0x5630e2b9dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39858/0 (socket says 172.21.15.6:39858) 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.894+0000 7f4477fff640 1 -- 172.21.15.6:0/3851500955 learned_addr learned my addr 172.21.15.6:0/3851500955 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.893+0000 7f44777fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.894+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b98670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 -- 172.21.15.6:0/3851500955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 msgr2=0x5630e2b98090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b98090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 -- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 msgr2=0x5630e2b9dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 0x5630e2b9dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 -- 172.21.15.6:0/3851500955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e2b9e530 con 0x5630e27c4670 2024-09-21T08:07:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.896+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b98670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f446c0057c0 tx=0x7f446c03dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf2f2a7069c23e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.897+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.897+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c04c070 con 0x5630e27c4670 2024-09-21T08:07:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.898+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f446c003870 con 0x5630e27c4670 2024-09-21T08:07:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.898+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f446c003d00 con 0x5630e27c4670 2024-09-21T08:07:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.898+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f446c058050 con 0x5630e27c4670 2024-09-21T08:07:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.898+0000 7f448438a740 10 client.16512 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.898+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630e2ba6ee0 con 0x5630e27c4670 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f446c003d00 con 0x5630e27c4670 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f446c03a040 con 0x5630e27c4670 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 10 client.16512 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 20 client.16512 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27a3cd0 0x5630e2baa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 4 client.16512 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e2b04db0 con 0x5630e27a3cd0 2024-09-21T08:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.899+0000 7f44777fe640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27a3cd0 0x5630e2baa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.900+0000 7f4456ffd640 10 client.16512 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.900+0000 7f44777fe640 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27a3cd0 0x5630e2baa490 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=268a9d541295ab1 server_cookie=c3cccebae7008abd in_seq=0 out_seq=0 2024-09-21T08:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.901+0000 7f4456ffd640 1 -- 172.21.15.6:0/3851500955 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630e2b04db0 con 0x5630e27a3cd0 2024-09-21T08:07:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.901+0000 7f4456ffd640 10 client.16512 handle_command_reply: tid=0 2024-09-21T08:07:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.902+0000 7f448438a740 1 client.16512 shutdown 2024-09-21T08:07:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.902+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 msgr2=0x5630e2b98670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b98670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f446c0057c0 tx=0x7f446c03dc60 comp rx=0 tx=0).stop 2024-09-21T08:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 shutdown_connections 2024-09-21T08:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27a3cd0 0x5630e2baa490 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27e5350 0x5630e2b9dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f4456ffd640 0 client.16512 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.903+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b98670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.904+0000 7f448438a740 1 --2- 172.21.15.6:0/3851500955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b98090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.904+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 >> 172.21.15.6:0/3851500955 conn(0x5630e27d9740 msgr2=0x5630e2b8f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.904+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 shutdown_connections 2024-09-21T08:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.904+0000 7f448438a740 1 -- 172.21.15.6:0/3851500955 wait complete. 2024-09-21T08:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.904+0000 7f448438a740 20 client.16512 trim_cache size 0 max 16384 2024-09-21T08:07:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.940+0000 7f448438a740 1 Processor -- start 2024-09-21T08:07:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.940+0000 7f448438a740 1 -- start start 2024-09-21T08:07:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b8fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b914c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f44777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f44777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39868/0 (socket says 172.21.15.6:39868) 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b53b0 con 0x5630e27c4670 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b7c30 con 0x5630e27a3cd0 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f44777fe640 1 -- 172.21.15.6:0/3801984959 learned_addr learned my addr 172.21.15.6:0/3801984959 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b5a20 con 0x5630e27bc490 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.941+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b8fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 -- 172.21.15.6:0/3801984959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 msgr2=0x5630e2b8fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b8fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 -- 172.21.15.6:0/3801984959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 msgr2=0x5630e2b914c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:07:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b914c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 -- 172.21.15.6:0/3801984959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e2b93720 con 0x5630e27a3cd0 2024-09-21T08:07:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f44777fe640 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4468011010 tx=0x7f4468017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ec83f7f1e667e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.942+0000 7f445d7fa640 1 -- 172.21.15.6:0/3801984959 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446802a040 con 0x5630e27a3cd0 2024-09-21T08:07:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.943+0000 7f445d7fa640 1 -- 172.21.15.6:0/3801984959 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f446801be00 con 0x5630e27a3cd0 2024-09-21T08:07:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.943+0000 7f445d7fa640 1 -- 172.21.15.6:0/3801984959 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468003e00 con 0x5630e27a3cd0 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 msgr2=0x5630e2b8f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4468011010 tx=0x7f4468017000 comp rx=0 tx=0).stop 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 shutdown_connections 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27bc490 0x5630e2b8fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27c4670 0x5630e2b914c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 --2- 172.21.15.6:0/3801984959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2b8f530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.944+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 >> 172.21.15.6:0/3801984959 conn(0x5630e27d9740 msgr2=0x5630e2b96710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.945+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 shutdown_connections 2024-09-21T08:07:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.945+0000 7f448438a740 1 -- 172.21.15.6:0/3801984959 wait complete. 2024-09-21T08:07:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.946+0000 7f448438a740 1 -- start start 2024-09-21T08:07:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.946+0000 7f448438a740 1 Processor -- start 2024-09-21T08:07:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2ba0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27c4670 0x5630e2ba0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b60f0 con 0x5630e27bc490 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b7560 con 0x5630e27a3cd0 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f448438a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f44781b67c0 con 0x5630e27c4670 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.947+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f448438a740 10 client.0 _ll_register_callbacks cb 0x7f446800a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34562/0 (socket says 172.21.15.6:34562) 2024-09-21T08:07:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 -- 172.21.15.6:0/3418333048 learned_addr learned my addr 172.21.15.6:0/3418333048 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4477fff640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27c4670 0x5630e2ba0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 -- 172.21.15.6:0/3418333048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27c4670 msgr2=0x5630e2ba0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27c4670 0x5630e2ba0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 -- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 msgr2=0x5630e2ba0270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2ba0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.948+0000 7f4476ffd640 1 -- 172.21.15.6:0/3418333048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e2c140b0 con 0x5630e27bc490 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.949+0000 7f4476ffd640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f446c006010 tx=0x7f446c03d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7283376fbf4e1415 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.949+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.950+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c061060 con 0x5630e27bc490 2024-09-21T08:07:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.950+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f446c0035f0 con 0x5630e27bc490 2024-09-21T08:07:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.950+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f446801be00 con 0x5630e27bc490 2024-09-21T08:07:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.951+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f446c068050 con 0x5630e27bc490 2024-09-21T08:07:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.951+0000 7f448438a740 10 client.16515 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.951+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630e2c15370 con 0x5630e27bc490 2024-09-21T08:07:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f446c055070 con 0x5630e27bc490 2024-09-21T08:07:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f446c051440 con 0x5630e27bc490 2024-09-21T08:07:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 10 client.16515 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 20 client.16515 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27e5350 0x5630e2c17ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 4 client.16515 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f446801be00 con 0x5630e27e5350 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.952+0000 7f44777fe640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27e5350 0x5630e2c17ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.953+0000 7f44777fe640 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27e5350 0x5630e2c17ab0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c1189da16d1577 server_cookie=825afc96bd905842 in_seq=0 out_seq=0 2024-09-21T08:07:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.953+0000 7f4456ffd640 10 client.16515 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.955+0000 7f4456ffd640 1 -- 172.21.15.6:0/3418333048 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f446801be00 con 0x5630e27e5350 2024-09-21T08:07:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.955+0000 7f4456ffd640 10 client.16515 handle_command_reply: tid=0 2024-09-21T08:07:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.955+0000 7f448438a740 1 client.16515 shutdown 2024-09-21T08:07:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.957+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 msgr2=0x5630e2ba07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.957+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f446c006010 tx=0x7f446c03d9c0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 shutdown_connections 2024-09-21T08:07:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5630e27e5350 0x5630e2c17ab0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630e27c4670 0x5630e2ba0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5630e27bc490 0x5630e2ba07b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 --2- 172.21.15.6:0/3418333048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630e27a3cd0 0x5630e2ba0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 >> 172.21.15.6:0/3418333048 conn(0x5630e27d9740 msgr2=0x5630e2b8f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.958+0000 7f4456ffd640 0 client.16515 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.959+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 shutdown_connections 2024-09-21T08:07:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.959+0000 7f448438a740 1 -- 172.21.15.6:0/3418333048 wait complete. 2024-09-21T08:07:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.959+0000 7f448438a740 20 client.16515 trim_cache size 0 max 16384 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "d5eacd38-1730-4388-90b5-68f260b0d3cd", 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 msgr2=0x7f44600b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 0x7f44600b8da0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5630e2b8b0b0 tx=0x7f446800a2d0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 msgr2=0x7f44781a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f447000eb10 tx=0x7f447000c2d0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 shutdown_connections 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44600b6890 0x7f44600b8da0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4478109e10 0x7f44781a61e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44781094c0 0x7f44781a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 --2- 172.21.15.6:0/1291621908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4478103b80 0x7f44781a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.961+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 >> 172.21.15.6:0/1291621908 conn(0x7f44780ff610 msgr2=0x7f4478101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.963+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 shutdown_connections 2024-09-21T08:07:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:49.963+0000 7f447de16640 1 -- 172.21.15.6:0/1291621908 wait complete. 2024-09-21T08:07:50.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:07:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:07:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:51 smithi119 ceph-mon[33564]: pgmap v547: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 17 MiB/s wr, 851 op/s 2024-09-21T08:07:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:51 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:07:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:51 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:51 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:07:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:51 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:07:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:51 smithi145 ceph-mon[34049]: pgmap v547: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 17 MiB/s wr, 851 op/s 2024-09-21T08:07:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:51 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:07:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:51 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:51 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:07:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:51 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:07:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:51 smithi006 ceph-mon[30970]: pgmap v547: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 17 MiB/s wr, 851 op/s 2024-09-21T08:07:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:51 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:07:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:51 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:51 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:07:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:51 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:07:52.377 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:07:52.377 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:07:52.377 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:07:52.377 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "d5eacd38-1730-4388-90b5-68f260b0d3cd", 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.378 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:07:52.381 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.382 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:07:52.387 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:07:52.388 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:07:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 -- 172.21.15.6:0/2134513317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 msgr2=0x7f423c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 --2- 172.21.15.6:0/2134513317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c110650 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4234009ca0 tx=0x7f423402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 -- 172.21.15.6:0/2134513317 shutdown_connections 2024-09-21T08:07:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 --2- 172.21.15.6:0/2134513317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c110650 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 --2- 172.21.15.6:0/2134513317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c1094d0 0x7f423c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 --2- 172.21.15.6:0/2134513317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c103b90 0x7f423c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 -- 172.21.15.6:0/2134513317 >> 172.21.15.6:0/2134513317 conn(0x7f423c0ff600 msgr2=0x7f423c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 -- 172.21.15.6:0/2134513317 shutdown_connections 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.727+0000 7f4243c60640 1 -- 172.21.15.6:0/2134513317 wait complete. 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 Processor -- start 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 -- start start 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 0x7f423c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c1094d0 0x7f423c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1139e0 con 0x7f423c109e20 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f423c113860 con 0x7f423c103b90 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f4243c60640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f423c113b60 con 0x7f423c1094d0 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f42421fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f42421fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34580/0 (socket says 172.21.15.6:34580) 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f42421fd640 1 -- 172.21.15.6:0/188424862 learned_addr learned my addr 172.21.15.6:0/188424862 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.728+0000 7f42419fc640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 0x7f423c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42411fb640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c1094d0 0x7f423c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 -- 172.21.15.6:0/188424862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c1094d0 msgr2=0x7f423c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c1094d0 0x7f423c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 -- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 msgr2=0x7f423c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 -- 172.21.15.6:0/188424862 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c1a8630 con 0x7f423c103b90 2024-09-21T08:07:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f42419fc640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 0x7f423c075710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f423800d6d0 tx=0x7f423800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f4232ffd640 1 -- 172.21.15.6:0/188424862 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238017070 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f4232ffd640 1 -- 172.21.15.6:0/188424862 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4238009820 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f4232ffd640 1 -- 172.21.15.6:0/188424862 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238004bc0 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c1a8920 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.729+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c1a8eb0 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.732+0000 7f424a1d4740 1 Processor -- start 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.732+0000 7f424a1d4740 1 -- start start 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.732+0000 7f4232ffd640 1 -- 172.21.15.6:0/188424862 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4238005220 con 0x7f423c103b90 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 0x5590b5363270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b53637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 0x5590b5363cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5590b52d9e50 con 0x5590b4fbc070 2024-09-21T08:07:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5590b52c9280 con 0x5590b4f9b390 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f424a1d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5590b52cd090 con 0x5590b4f931b0 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42421fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 0x5590b5363270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42421fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 0x5590b5363270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42421fd640 1 -- 172.21.15.6:0/849384675 learned_addr learned my addr 172.21.15.6:0/849384675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 0x5590b5363cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42419fc640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b53637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 -- 172.21.15.6:0/849384675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 msgr2=0x5590b53637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b53637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 -- 172.21.15.6:0/849384675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 msgr2=0x5590b5363270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 0x5590b5363270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42411fb640 1 -- 172.21.15.6:0/849384675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b5027650 con 0x5590b4f9b390 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f42419fc640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b53637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.733+0000 7f4232ffd640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 0x7f42280b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f42421fd640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 0x7f42280b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f4232ffd640 1 -- 172.21.15.6:0/188424862 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f42380e74f0 con 0x7f423c103b90 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f42411fb640 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 0x5590b5363cf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f423c06b8a0 tx=0x7f422c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99715b495c7d68af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f4227fff640 1 -- 172.21.15.6:0/849384675 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c009d70 con 0x5590b4f9b390 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f4227fff640 1 -- 172.21.15.6:0/849384675 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c0198a0 con 0x5590b4f9b390 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.734+0000 7f4227fff640 1 -- 172.21.15.6:0/849384675 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c018730 con 0x5590b4f9b390 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- 172.21.15.6:0/849384675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 msgr2=0x5590b5363cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 0x5590b5363cf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f423c06b8a0 tx=0x7f422c011810 comp rx=0 tx=0).stop 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f42421fd640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 0x7f42280b8c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4234009a60 tx=0x7f4234005c50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- 172.21.15.6:0/849384675 shutdown_connections 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b53637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f9b390 0x5590b5363cf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 --2- 172.21.15.6:0/849384675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4fbc070 0x5590b5363270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- 172.21.15.6:0/849384675 >> 172.21.15.6:0/849384675 conn(0x5590b4fb0460 msgr2=0x5590b5361160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- 172.21.15.6:0/849384675 shutdown_connections 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- 172.21.15.6:0/849384675 wait complete. 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.735+0000 7f424a1d4740 1 -- start start 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 Processor -- start 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b536e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b536f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5590b512a700 con 0x5590b4f9b390 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.736+0000 7f424a1d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5590b5264110 con 0x5590b4fbc070 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f424a1d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5590b5371a50 con 0x5590b4f931b0 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34590/0 (socket says 172.21.15.6:34590) 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f424a1d4740 10 client.0 _ll_register_callbacks cb 0x5590b527d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 -- 172.21.15.6:0/2717196599 learned_addr learned my addr 172.21.15.6:0/2717196599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42419fc640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b536e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42421fd640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b536f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 -- 172.21.15.6:0/2717196599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 msgr2=0x5590b536e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b536e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 -- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 msgr2=0x5590b536f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b536f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 -- 172.21.15.6:0/2717196599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590b5291c40 con 0x5590b4f9b390 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42411fb640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f422c018410 tx=0x7f422c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c445ab6a62de2474 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42257fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c026020 con 0x5590b4f9b390 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f422c016040 con 0x5590b4f9b390 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.737+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422c0198a0 con 0x5590b4f9b390 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.738+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f422c031050 con 0x5590b4f9b390 2024-09-21T08:07:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.738+0000 7f424a1d4740 10 client.16527 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.738+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5590b537d700 con 0x5590b4f9b390 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.738+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c0198a0 con 0x5590b4f9b390 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f422c0046c0 con 0x5590b4f9b390 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 10 client.16527 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 20 client.16527 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f7a9f0 0x5590b5380ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 4 client.16527 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590b52dbda0 con 0x5590b4f7a9f0 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.739+0000 7f42419fc640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f7a9f0 0x5590b5380ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.740+0000 7f42419fc640 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f7a9f0 0x5590b5380ac0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35214fbde77000b8 server_cookie=d56ce213e92d0131 in_seq=0 out_seq=0 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.740+0000 7f42257fa640 10 client.16527 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.740+0000 7f42257fa640 1 -- 172.21.15.6:0/2717196599 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590b52dbda0 con 0x5590b4f7a9f0 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.740+0000 7f42257fa640 10 client.16527 handle_command_reply: tid=0 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.740+0000 7f424a1d4740 1 client.16527 shutdown 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 msgr2=0x5590b536ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f422c018410 tx=0x7f422c0098e0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 shutdown_connections 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f7a9f0 0x5590b5380ac0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b536f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536ee20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2717196599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f931b0 0x5590b536e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 >> 172.21.15.6:0/2717196599 conn(0x5590b4fb0460 msgr2=0x5590b5366450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f42257fa640 0 client.16527 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 shutdown_connections 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 1 -- 172.21.15.6:0/2717196599 wait complete. 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.741+0000 7f424a1d4740 20 client.16527 trim_cache size 0 max 16384 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 Processor -- start 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 -- start start 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f931b0 0x5590b536eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 0x5590b536c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b1030 con 0x5590b4f9b390 2024-09-21T08:07:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b38b0 con 0x5590b4f931b0 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f424a1d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b16a0 con 0x5590b4fbc070 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.764+0000 7f42411fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34602/0 (socket says 172.21.15.6:34602) 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 -- 172.21.15.6:0/2359204671 learned_addr learned my addr 172.21.15.6:0/2359204671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42419fc640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f931b0 0x5590b536eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42421fd640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 0x5590b536c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 -- 172.21.15.6:0/2359204671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 msgr2=0x5590b536c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 0x5590b536c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 -- 172.21.15.6:0/2359204671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f931b0 msgr2=0x5590b536eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f931b0 0x5590b536eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 -- 172.21.15.6:0/2359204671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b537ac70 con 0x5590b4f9b390 2024-09-21T08:07:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42421fd640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 0x5590b536c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.765+0000 7f42411fb640 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097e0 tx=0x7f422c019a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfe34ee80952f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.766+0000 7f42277fe640 1 -- 172.21.15.6:0/2359204671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c026040 con 0x5590b4f9b390 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.766+0000 7f42277fe640 1 -- 172.21.15.6:0/2359204671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c005360 con 0x5590b4f9b390 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.766+0000 7f42277fe640 1 -- 172.21.15.6:0/2359204671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0046f0 con 0x5590b4f9b390 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- 172.21.15.6:0/2359204671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 msgr2=0x5590b536bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097e0 tx=0x7f422c019a40 comp rx=0 tx=0).stop 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- 172.21.15.6:0/2359204671 shutdown_connections 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4fbc070 0x5590b536c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f9b390 0x5590b536bad0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 --2- 172.21.15.6:0/2359204671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4f931b0 0x5590b536eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- 172.21.15.6:0/2359204671 >> 172.21.15.6:0/2359204671 conn(0x5590b4fb0460 msgr2=0x5590b536e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- 172.21.15.6:0/2359204671 shutdown_connections 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- 172.21.15.6:0/2359204671 wait complete. 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.767+0000 7f424a1d4740 1 -- start start 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f424a1d4740 1 Processor -- start 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f9b390 0x5590b5373fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f424a1d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b53e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f42419fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.768+0000 7f424a1d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b1d70 con 0x5590b4f931b0 2024-09-21T08:07:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f424a1d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b31e0 con 0x5590b4fbc070 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f424a1d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1b2440 con 0x5590b4f9b390 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34604/0 (socket says 172.21.15.6:34604) 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 -- 172.21.15.6:0/474384579 learned_addr learned my addr 172.21.15.6:0/474384579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f424a1d4740 10 client.0 _ll_register_callbacks cb 0x7f42380eadf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42421fd640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b53e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42411fb640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f9b390 0x5590b5373fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 -- 172.21.15.6:0/474384579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f9b390 msgr2=0x5590b5373fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f9b390 0x5590b5373fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 -- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 msgr2=0x5590b53e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b53e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 -- 172.21.15.6:0/474384579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590b53e98f0 con 0x5590b4f931b0 2024-09-21T08:07:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42419fc640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f42380aa280 tx=0x7f4238094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0426c8b91006a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.769+0000 7f42257fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238020040 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422c005360 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9423+0+0 (secure 0 0 0) 0x7f42380e4ae0 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f42380ac960 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f424a1d4740 10 client.16533 fetch_fsmap learned FSMap version 21 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5590b53eab80 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.770+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c005360 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f42380a9280 con 0x5590b4f931b0 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 10 client.16533 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:07:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 20 client.16533 populate_metadata read hostname 'smithi006' 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f4fda0 0x5590b53ed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 4 client.16533 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590b52d7850 con 0x5590b4f4fda0 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.771+0000 7f42411fb640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f4fda0 0x5590b53ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f42257fa640 10 client.16533 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f42411fb640 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f4fda0 0x5590b53ed260 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b265f2f2bccd576d server_cookie=32575ea2c2af7b0e in_seq=0 out_seq=0 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f42257fa640 1 -- 172.21.15.6:0/474384579 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x5590b52d7850 con 0x5590b4f4fda0 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f42257fa640 10 client.16533 handle_command_reply: tid=0 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 client.16533 shutdown 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 msgr2=0x5590b5373a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f42380aa280 tx=0x7f4238094040 comp rx=0 tx=0).stop 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 shutdown_connections 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5590b4f4fda0 0x5590b53ed260 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5590b4f9b390 0x5590b5373fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590b4fbc070 0x5590b53e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f42257fa640 0 client.16533 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 --2- 172.21.15.6:0/474384579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590b4f931b0 0x5590b5373a40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.772+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 >> 172.21.15.6:0/474384579 conn(0x5590b4fb0460 msgr2=0x5590b53642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 shutdown_connections 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f424a1d4740 1 -- 172.21.15.6:0/474384579 wait complete. 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f424a1d4740 20 client.16533 trim_cache size 0 max 16384 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 msgr2=0x7f42280b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 0x7f42280b8c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4234009a60 tx=0x7f4234005c50 comp rx=0 tx=0).stop 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 msgr2=0x7f423c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:07:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 0x7f423c075710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f423800d6d0 tx=0x7f423800db90 comp rx=0 tx=0).stop 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 shutdown_connections 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f42280b6780 0x7f42280b8c90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f423c1094d0 0x7f423c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f423c109e20 0x7f423c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 --2- 172.21.15.6:0/188424862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f423c103b90 0x7f423c075710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 >> 172.21.15.6:0/188424862 conn(0x7f423c0ff600 msgr2=0x7f423c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 shutdown_connections 2024-09-21T08:07:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:07:51.773+0000 7f4243c60640 1 -- 172.21.15.6:0/188424862 wait complete. 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:07:52.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:07:52.409 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:07:52.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:07:52.444 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:07:52.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:07:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 295.0 s, 948.6 tps, lat 116.633 ms stddev 195.913 2024-09-21T08:07:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:53 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:07:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:53 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:07:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:53 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:07:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:53 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:07:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:53 smithi119 ceph-mon[33564]: pgmap v548: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 17 MiB/s wr, 894 op/s 2024-09-21T08:07:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:53 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:07:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:53 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:07:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:53 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:07:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:53 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:07:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:53 smithi145 ceph-mon[34049]: pgmap v548: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 17 MiB/s wr, 894 op/s 2024-09-21T08:07:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:53 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:07:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:53 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:07:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:53 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:07:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:53 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:07:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:53 smithi006 ceph-mon[30970]: pgmap v548: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 17 MiB/s wr, 894 op/s 2024-09-21T08:07:54.020 INFO:tasks.cephfs.filesystem:scrub status for tag:d5eacd38-1730-4388-90b5-68f260b0d3cd - {'path': '/', 'tag': 'd5eacd38-1730-4388-90b5-68f260b0d3cd', 'options': 'recursive,force'} 2024-09-21T08:07:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:55 smithi119 ceph-mon[33564]: pgmap v549: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 871 op/s 2024-09-21T08:07:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:55 smithi145 ceph-mon[34049]: pgmap v549: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 871 op/s 2024-09-21T08:07:55.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:55 smithi006 ceph-mon[30970]: pgmap v549: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 871 op/s 2024-09-21T08:07:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:57 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:07:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:57 smithi119 ceph-mon[33564]: pgmap v550: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-09-21T08:07:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:57 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:07:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:57 smithi145 ceph-mon[34049]: pgmap v550: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-09-21T08:07:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:57 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:07:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:57 smithi006 ceph-mon[30970]: pgmap v550: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-09-21T08:07:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 300.0 s, 906.8 tps, lat 102.721 ms stddev 127.746 2024-09-21T08:07:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:07:59 smithi119 ceph-mon[33564]: pgmap v551: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 15 MiB/s wr, 838 op/s 2024-09-21T08:07:59.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:07:59 smithi145 ceph-mon[34049]: pgmap v551: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 15 MiB/s wr, 838 op/s 2024-09-21T08:07:59.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:07:59 smithi006 ceph-mon[30970]: pgmap v551: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 15 MiB/s wr, 838 op/s 2024-09-21T08:08:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:01 smithi119 ceph-mon[33564]: pgmap v552: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 17 MiB/s wr, 940 op/s 2024-09-21T08:08:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:01 smithi145 ceph-mon[34049]: pgmap v552: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 17 MiB/s wr, 940 op/s 2024-09-21T08:08:01.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:01 smithi006 ceph-mon[30970]: pgmap v552: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 17 MiB/s wr, 940 op/s 2024-09-21T08:08:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 305.0 s, 904.6 tps, lat 118.181 ms stddev 205.924 2024-09-21T08:08:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:03 smithi119 ceph-mon[33564]: pgmap v553: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 17 MiB/s wr, 984 op/s 2024-09-21T08:08:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:03 smithi145 ceph-mon[34049]: pgmap v553: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 17 MiB/s wr, 984 op/s 2024-09-21T08:08:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:03 smithi006 ceph-mon[30970]: pgmap v553: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 17 MiB/s wr, 984 op/s 2024-09-21T08:08:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:05 smithi145 ceph-mon[34049]: pgmap v554: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 17 MiB/s wr, 945 op/s 2024-09-21T08:08:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:05 smithi006 ceph-mon[30970]: pgmap v554: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 17 MiB/s wr, 945 op/s 2024-09-21T08:08:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:05 smithi119 ceph-mon[33564]: pgmap v554: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 17 MiB/s wr, 945 op/s 2024-09-21T08:08:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:07 smithi145 ceph-mon[34049]: pgmap v555: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 15 MiB/s wr, 900 op/s 2024-09-21T08:08:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:07 smithi145 ceph-mon[34049]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T08:08:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:07 smithi006 ceph-mon[30970]: pgmap v555: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 15 MiB/s wr, 900 op/s 2024-09-21T08:08:07.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:07 smithi006 ceph-mon[30970]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T08:08:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 310.0 s, 923.6 tps, lat 108.108 ms stddev 142.240 2024-09-21T08:08:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:07 smithi119 ceph-mon[33564]: pgmap v555: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 15 MiB/s wr, 900 op/s 2024-09-21T08:08:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:07 smithi119 ceph-mon[33564]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T08:08:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:09 smithi145 ceph-mon[34049]: pgmap v557: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T08:08:09.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:09 smithi006 ceph-mon[30970]: pgmap v557: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T08:08:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:09 smithi119 ceph-mon[33564]: pgmap v557: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T08:08:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:11 smithi145 ceph-mon[34049]: pgmap v558: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-09-21T08:08:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:11 smithi006 ceph-mon[30970]: pgmap v558: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-09-21T08:08:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:11 smithi119 ceph-mon[33564]: pgmap v558: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-09-21T08:08:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 315.0 s, 878.4 tps, lat 113.833 ms stddev 136.847 2024-09-21T08:08:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:13 smithi145 ceph-mon[34049]: pgmap v559: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:08:13.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:13 smithi006 ceph-mon[30970]: pgmap v559: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:08:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:13 smithi119 ceph-mon[33564]: pgmap v559: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:08:14.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:14 smithi119 ceph-mon[33564]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T08:08:14.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:14 smithi145 ceph-mon[34049]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T08:08:14.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:14 smithi006 ceph-mon[30970]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T08:08:15.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:15 smithi119 ceph-mon[33564]: pgmap v561: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 16 MiB/s wr, 940 op/s 2024-09-21T08:08:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:15 smithi145 ceph-mon[34049]: pgmap v561: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 16 MiB/s wr, 940 op/s 2024-09-21T08:08:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:15 smithi006 ceph-mon[30970]: pgmap v561: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 16 MiB/s wr, 940 op/s 2024-09-21T08:08:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 320.0 s, 936.6 tps, lat 106.703 ms stddev 136.424 2024-09-21T08:08:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:17 smithi145 ceph-mon[34049]: pgmap v562: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 17 MiB/s wr, 930 op/s 2024-09-21T08:08:17.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:17 smithi006 ceph-mon[30970]: pgmap v562: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 17 MiB/s wr, 930 op/s 2024-09-21T08:08:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:17 smithi119 ceph-mon[33564]: pgmap v562: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 17 MiB/s wr, 930 op/s 2024-09-21T08:08:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:19 smithi145 ceph-mon[34049]: pgmap v563: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 14 MiB/s wr, 869 op/s 2024-09-21T08:08:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:19 smithi006 ceph-mon[30970]: pgmap v563: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 14 MiB/s wr, 869 op/s 2024-09-21T08:08:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:19 smithi119 ceph-mon[33564]: pgmap v563: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 14 MiB/s wr, 869 op/s 2024-09-21T08:08:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:21 smithi145 ceph-mon[34049]: pgmap v564: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T08:08:21.709 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:21 smithi119 ceph-mon[33564]: pgmap v564: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T08:08:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:21 smithi006 ceph-mon[30970]: pgmap v564: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T08:08:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 325.0 s, 887.6 tps, lat 112.844 ms stddev 139.127 2024-09-21T08:08:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:23 smithi145 ceph-mon[34049]: pgmap v565: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 14 MiB/s wr, 902 op/s 2024-09-21T08:08:23.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:23 smithi006 ceph-mon[30970]: pgmap v565: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 14 MiB/s wr, 902 op/s 2024-09-21T08:08:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:23 smithi119 ceph-mon[33564]: pgmap v565: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 14 MiB/s wr, 902 op/s 2024-09-21T08:08:24.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:08:24.786 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:25 smithi145 ceph-mon[34049]: pgmap v566: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-09-21T08:08:25.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:25 smithi006 ceph-mon[30970]: pgmap v566: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-09-21T08:08:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:25 smithi119 ceph-mon[33564]: pgmap v566: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-09-21T08:08:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 330.0 s, 697.4 tps, lat 143.212 ms stddev 202.292 2024-09-21T08:08:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:27 smithi145 ceph-mon[34049]: pgmap v567: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 13 MiB/s wr, 858 op/s 2024-09-21T08:08:27.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:27 smithi006 ceph-mon[30970]: pgmap v567: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 13 MiB/s wr, 858 op/s 2024-09-21T08:08:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:27 smithi119 ceph-mon[33564]: pgmap v567: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 13 MiB/s wr, 858 op/s 2024-09-21T08:08:29.658 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:29 smithi006 ceph-mon[30970]: pgmap v568: 129 pgs: 129 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 873 op/s 2024-09-21T08:08:29.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:29 smithi145 ceph-mon[34049]: pgmap v568: 129 pgs: 129 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 873 op/s 2024-09-21T08:08:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:29 smithi119 ceph-mon[33564]: pgmap v568: 129 pgs: 129 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 873 op/s 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 -- 172.21.15.6:0/370625221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810a190 msgr2=0x7f84e810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 --2- 172.21.15.6:0/370625221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810a190 0x7f84e810a5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009860 tx=0x7f84e402a340 comp rx=0 tx=0).stop 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 -- 172.21.15.6:0/370625221 shutdown_connections 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 --2- 172.21.15.6:0/370625221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e8110420 0x7f84e8116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 --2- 172.21.15.6:0/370625221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e810fad0 0x7f84e810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 --2- 172.21.15.6:0/370625221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810a190 0x7f84e810a5a0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009860 tx=0x7f84e402a340 comp rx=0 tx=0).stop 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.572+0000 7f84efbb2640 1 -- 172.21.15.6:0/370625221 >> 172.21.15.6:0/370625221 conn(0x7f84e80780f0 msgr2=0x7f84e81081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.573+0000 7f84efbb2640 1 -- 172.21.15.6:0/370625221 shutdown_connections 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.573+0000 7f84efbb2640 1 -- 172.21.15.6:0/370625221 wait complete. 2024-09-21T08:08:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 Processor -- start 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 -- start start 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 0x7f84e81a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e8110420 0x7f84e81a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 0x7f84e81a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8119fa0 con 0x7f84e8110420 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8119e20 con 0x7f84e810fad0 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.574+0000 7f84efbb2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f84e811a120 con 0x7f84e81a6350 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.575+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 0x7f84e81a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.575+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 0x7f84e81a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56334/0 (socket says 172.21.15.6:56334) 2024-09-21T08:08:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.575+0000 7f84ee14f640 1 -- 172.21.15.6:0/3100125658 learned_addr learned my addr 172.21.15.6:0/3100125658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.575+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 0x7f84e81a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 -- 172.21.15.6:0/3100125658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 msgr2=0x7f84e81a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 0x7f84e81a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 -- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e8110420 msgr2=0x7f84e81a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e8110420 0x7f84e81a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 -- 172.21.15.6:0/3100125658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e81a6f30 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.576+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 0x7f84e81a0bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e8109de0 tx=0x7f84e4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.577+0000 7f84deffd640 1 -- 172.21.15.6:0/3100125658 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4040020 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.577+0000 7f84deffd640 1 -- 172.21.15.6:0/3100125658 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e4004430 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.577+0000 7f84deffd640 1 -- 172.21.15.6:0/3100125658 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4037040 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.577+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e81ad4d0 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.577+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e81ad870 con 0x7f84e810fad0 2024-09-21T08:08:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.580+0000 7f84f6126740 1 Processor -- start 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.581+0000 7f84f6126740 1 -- start start 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84deffd640 1 -- 172.21.15.6:0/3100125658 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f84e4043020 con 0x7f84e810fad0 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb88f1b0 0x556edbc5fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556edbbd5e50 con 0x556edb8b8070 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556edbbc5280 con 0x556edb897390 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84f6126740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556edbbc9090 con 0x556edb88f1b0 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84ed94e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb88f1b0 0x556edbc5fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.582+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57112/0 (socket says 172.21.15.6:57112) 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 -- 172.21.15.6:0/213318837 learned_addr learned my addr 172.21.15.6:0/213318837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ed14d640 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 -- 172.21.15.6:0/213318837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb88f1b0 msgr2=0x556edbc5fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb88f1b0 0x556edbc5fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 -- 172.21.15.6:0/213318837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 msgr2=0x556edbc600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84ee14f640 1 -- 172.21.15.6:0/213318837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb923650 con 0x556edb8b8070 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.583+0000 7f84deffd640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 0x7f84d40b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.584+0000 7f84ee14f640 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009fa0 tx=0x7f84e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb127b3208660620 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.584+0000 7f84deffd640 1 -- 172.21.15.6:0/3100125658 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f84e4107940 con 0x7f84e810fad0 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.584+0000 7f84d3fff640 1 -- 172.21.15.6:0/213318837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012650 con 0x556edb8b8070 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.584+0000 7f84d3fff640 1 -- 172.21.15.6:0/213318837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e0012c80 con 0x556edb8b8070 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84d3fff640 1 -- 172.21.15.6:0/213318837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e000fd40 con 0x556edb8b8070 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 -- 172.21.15.6:0/213318837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 msgr2=0x556edbc5f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009fa0 tx=0x7f84e00117b0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 0x7f84d40b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 -- 172.21.15.6:0/213318837 shutdown_connections 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb88f1b0 0x556edbc5fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 --2- 172.21.15.6:0/213318837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc5f650 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 -- 172.21.15.6:0/213318837 >> 172.21.15.6:0/213318837 conn(0x556edb8ac460 msgr2=0x556edbc5d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.585+0000 7f84f6126740 1 -- 172.21.15.6:0/213318837 shutdown_connections 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.586+0000 7f84f6126740 1 -- 172.21.15.6:0/213318837 wait complete. 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.586+0000 7f84f6126740 1 -- start start 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.586+0000 7f84f6126740 1 Processor -- start 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84ed94e640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 0x7f84d40b8d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x556edbc5e2d0 tx=0x7f84e4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 0x556edbc6ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x556edba26700 con 0x556edb8b8070 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556edbb60110 con 0x556edb88f1b0 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556edbc6de80 con 0x556edb897390 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84f6126740 10 client.0 _ll_register_callbacks cb 0x556edbb79990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84ed14d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84ed14d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56352/0 (socket says 172.21.15.6:56352) 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.587+0000 7f84ed14d640 1 -- 172.21.15.6:0/3878461681 learned_addr learned my addr 172.21.15.6:0/3878461681 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ee14f640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 0x556edbc6ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ee14f640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 -- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 msgr2=0x556edbc6ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 0x556edbc6ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 -- 172.21.15.6:0/3878461681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 msgr2=0x556edbc6b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc6b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 -- 172.21.15.6:0/3878461681 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556edbb8dc40 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ee14f640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 0x556edbc6ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84ed14d640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84d80116f0 tx=0x7f84d8011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c7ac9ff10dc8139 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.588+0000 7f84d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d801e060 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e0012c80 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f84d800fd70 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84d8025050 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84f6126740 10 client.26287 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.589+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556edbc79be0 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e0012c80 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f84d800d340 con 0x556edb897390 2024-09-21T08:08:30.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 10 client.26287 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 10 client.26287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 20 client.26287 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8769f0 0x556edbc7d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 4 client.26287 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556edbbd7da0 con 0x556edb8769f0 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.590+0000 7f84ee14f640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8769f0 0x556edbc7d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.592+0000 7f84ee14f640 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8769f0 0x556edbc7d4c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd65fe8670e2234 server_cookie=6ceb2cdfd3f350b8 in_seq=0 out_seq=0 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.592+0000 7f84d17fa640 10 client.26287 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.592+0000 7f84d17fa640 1 -- 172.21.15.6:0/3878461681 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556edbbd7da0 con 0x556edb8769f0 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.592+0000 7f84d17fa640 10 client.26287 handle_command_reply: tid=0 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.592+0000 7f84f6126740 1 client.26287 shutdown 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 msgr2=0x556edbc6b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84d80116f0 tx=0x7f84d8011bb0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 shutdown_connections 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8769f0 0x556edbc7d4c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb897390 0x556edbc6b1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84d17fa640 0 client.26287 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb8b8070 0x556edbc6b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 --2- 172.21.15.6:0/3878461681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb88f1b0 0x556edbc6ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.593+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 >> 172.21.15.6:0/3878461681 conn(0x556edb8ac460 msgr2=0x556edbc62830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.594+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 shutdown_connections 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.594+0000 7f84f6126740 1 -- 172.21.15.6:0/3878461681 wait complete. 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.594+0000 7f84f6126740 20 client.26287 trim_cache size 0 max 16384 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 Processor -- start 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 -- start start 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc67e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc68390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b5ab0 con 0x556edb88f1b0 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b8310 con 0x556edb897390 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84f6126740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b6100 con 0x556edb8769f0 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84ed14d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc67e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56354/0 (socket says 172.21.15.6:56354) 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84ee14f640 1 -- 172.21.15.6:0/1629973057 learned_addr learned my addr 172.21.15.6:0/1629973057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.629+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc68390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 -- 172.21.15.6:0/1629973057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 msgr2=0x556edbc68390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc68390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 -- 172.21.15.6:0/1629973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 msgr2=0x556edbc67e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc67e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 -- 172.21.15.6:0/1629973057 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edbc69bc0 con 0x556edb8769f0 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ed14d640 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc67e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009db0 tx=0x7f84e000f920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24f233089e4c19c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.630+0000 7f84d37fe640 1 -- 172.21.15.6:0/1629973057 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e002b070 con 0x556edb8769f0 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.631+0000 7f84d37fe640 1 -- 172.21.15.6:0/1629973057 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e0004a00 con 0x556edb8769f0 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.631+0000 7f84d37fe640 1 -- 172.21.15.6:0/1629973057 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0005210 con 0x556edb8769f0 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 -- 172.21.15.6:0/1629973057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 msgr2=0x556edbc60d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009db0 tx=0x7f84e000f920 comp rx=0 tx=0).stop 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 -- 172.21.15.6:0/1629973057 shutdown_connections 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc68390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc67e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 --2- 172.21.15.6:0/1629973057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc60d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 -- 172.21.15.6:0/1629973057 >> 172.21.15.6:0/1629973057 conn(0x556edb8ac460 msgr2=0x556edbc60680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 -- 172.21.15.6:0/1629973057 shutdown_connections 2024-09-21T08:08:30.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.632+0000 7f84f6126740 1 -- 172.21.15.6:0/1629973057 wait complete. 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.633+0000 7f84f6126740 1 -- start start 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.633+0000 7f84f6126740 1 Processor -- start 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.634+0000 7f84f6126740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc73a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.634+0000 7f84f6126740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.634+0000 7f84f6126740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc6f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.634+0000 7f84f6126740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b67d0 con 0x556edb88f1b0 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.634+0000 7f84f6126740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b7c40 con 0x556edb897390 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ee14f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc73a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57142/0 (socket says 172.21.15.6:57142) 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 -- 172.21.15.6:0/1271417096 learned_addr learned my addr 172.21.15.6:0/1271417096 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81b6ea0 con 0x556edb8769f0 2024-09-21T08:08:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84f6126740 10 client.0 _ll_register_callbacks cb 0x7f84d8009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 -- 172.21.15.6:0/1271417096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 msgr2=0x556edbc73a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc73a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 -- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 msgr2=0x556edbc6f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc6f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc6f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 -- 172.21.15.6:0/1271417096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556edbc6fca0 con 0x556edb88f1b0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84ed14d640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d900 tx=0x7f84d8009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af04dc9a144d533b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.635+0000 7f84d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d800db80 con 0x556edb88f1b0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f84d800fb70 con 0x556edb88f1b0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e0004a00 con 0x556edb88f1b0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84d8038050 con 0x556edb88f1b0 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84f6126740 10 client.16548 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.636+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556edbce7ec0 con 0x556edb88f1b0 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.637+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e0004a00 con 0x556edb88f1b0 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f84d8003700 con 0x556edb88f1b0 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 10 client.16548 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 20 client.16548 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8b8070 0x556edbcea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 4 client.16548 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.638+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556edbbd3850 con 0x556edb8b8070 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.639+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8b8070 0x556edbcea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.641+0000 7f84d17fa640 10 client.16548 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.641+0000 7f84ee14f640 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8b8070 0x556edbcea670 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fed5d25b164386 server_cookie=6db766f490b498f6 in_seq=0 out_seq=0 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.642+0000 7f84d17fa640 1 -- 172.21.15.6:0/1271417096 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x556edbbd3850 con 0x556edb8b8070 2024-09-21T08:08:30.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.642+0000 7f84d17fa640 10 client.16548 handle_command_reply: tid=0 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.642+0000 7f84f6126740 1 client.16548 shutdown 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 msgr2=0x556edbc6eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d900 tx=0x7f84d8009eb0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 shutdown_connections 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x556edb8b8070 0x556edbcea670 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556edb897390 0x556edbc6f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84d17fa640 0 client.16548 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556edb88f1b0 0x556edbc6eee0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 --2- 172.21.15.6:0/1271417096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556edb8769f0 0x556edbc73a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 >> 172.21.15.6:0/1271417096 conn(0x556edb8ac460 msgr2=0x556edbc6c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 shutdown_connections 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.644 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.646 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:30.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 1 -- 172.21.15.6:0/1271417096 wait complete. 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.643+0000 7f84f6126740 20 client.16548 trim_cache size 0 max 16384 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 msgr2=0x7f84d40b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 0x7f84d40b8d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x556edbc5e2d0 tx=0x7f84e4005f90 comp rx=0 tx=0).stop 2024-09-21T08:08:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 msgr2=0x7f84e81a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 0x7f84e81a0bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e8109de0 tx=0x7f84e4004040 comp rx=0 tx=0).stop 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 shutdown_connections 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f84d40b6850 0x7f84d40b8d60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84e81a6350 0x7f84e81a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e8110420 0x7f84e81a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 --2- 172.21.15.6:0/3100125658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e810fad0 0x7f84e81a0bd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.644+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 >> 172.21.15.6:0/3100125658 conn(0x7f84e80780f0 msgr2=0x7f84e810e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.645+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 shutdown_connections 2024-09-21T08:08:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:29.645+0000 7f84efbb2640 1 -- 172.21.15.6:0/3100125658 wait complete. 2024-09-21T08:08:31.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:31 smithi145 ceph-mon[34049]: pgmap v569: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 918 op/s 2024-09-21T08:08:31.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:31 smithi006 ceph-mon[30970]: pgmap v569: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 918 op/s 2024-09-21T08:08:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:31 smithi119 ceph-mon[33564]: pgmap v569: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 918 op/s 2024-09-21T08:08:31.914 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:08:31.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:08:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 335.0 s, 762.4 tps, lat 130.921 ms stddev 113.914 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.120+0000 7f07f4dbc640 1 -- 172.21.15.6:0/1123905365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 msgr2=0x7f07f0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.120+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/1123905365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f0108a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f07e000fb10 tx=0x7f07e002e570 comp rx=0 tx=0).stop 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 -- 172.21.15.6:0/1123905365 shutdown_connections 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/1123905365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/1123905365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 0x7f07f0107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/1123905365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f0108a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 -- 172.21.15.6:0/1123905365 >> 172.21.15.6:0/1123905365 conn(0x7f07f0077800 msgr2=0x7f07f0077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 -- 172.21.15.6:0/1123905365 shutdown_connections 2024-09-21T08:08:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.121+0000 7f07f4dbc640 1 -- 172.21.15.6:0/1123905365 wait complete. 2024-09-21T08:08:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.122+0000 7f07f4dbc640 1 Processor -- start 2024-09-21T08:08:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.122+0000 7f07f4dbc640 1 -- start start 2024-09-21T08:08:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 0x7f07f01a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f01a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07f01118b0 con 0x7f07f01072f0 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07f0111730 con 0x7f07f0107c40 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07f4dbc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f07f0111a30 con 0x7f07f0108600 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07edd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.123+0000 7f07edd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01a0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46266/0 (socket says 172.21.15.6:46266) 2024-09-21T08:08:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.124+0000 7f07edd9b640 1 -- 172.21.15.6:0/2465985905 learned_addr learned my addr 172.21.15.6:0/2465985905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.124+0000 7f07eed9d640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f01a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.124+0000 7f07ee59c640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 0x7f07f01a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.125+0000 7f07eed9d640 1 -- 172.21.15.6:0/2465985905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 msgr2=0x7f07f01a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.125+0000 7f07eed9d640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.125+0000 7f07eed9d640 1 -- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 msgr2=0x7f07f01a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.125+0000 7f07eed9d640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 0x7f07f01a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.125+0000 7f07eed9d640 1 -- 172.21.15.6:0/2465985905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f01a6900 con 0x7f07f0108600 2024-09-21T08:08:33.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.126+0000 7f07eed9d640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f01a6200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07e800ea80 tx=0x7f07e800ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:33.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.127+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e800cea0 con 0x7f07f0108600 2024-09-21T08:08:33.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.127+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f01a6bf0 con 0x7f07f0108600 2024-09-21T08:08:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.127+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f006cde0 con 0x7f07f0108600 2024-09-21T08:08:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.127+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07e8005020 con 0x7f07f0108600 2024-09-21T08:08:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.129+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8010690 con 0x7f07f0108600 2024-09-21T08:08:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.129+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d00052c0 con 0x7f07f0108600 2024-09-21T08:08:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.132+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f07e80051d0 con 0x7f07f0108600 2024-09-21T08:08:33.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.132+0000 7f07df7fe640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 0x7f07d80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.133+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f07e80e8610 con 0x7f07f0108600 2024-09-21T08:08:33.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.134+0000 7f07ee59c640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 0x7f07d80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.135+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07e80ae7a0 con 0x7f07f0108600 2024-09-21T08:08:33.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.135+0000 7f07ee59c640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 0x7f07d80b8c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f07e0005ec0 tx=0x7f07e0000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:33.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.582+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07d00055b0 con 0x7f07f0108600 2024-09-21T08:08:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.583+0000 7f07df7fe640 1 -- 172.21.15.6:0/2465985905 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f07e80b2b80 con 0x7f07f0108600 2024-09-21T08:08:33.585 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:08:33.585 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:08:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:08:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 msgr2=0x7f07d80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 0x7f07d80b8c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f07e0005ec0 tx=0x7f07e0000bc0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 msgr2=0x7f07f01a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f01a6200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07e800ea80 tx=0x7f07e800ef40 comp rx=0 tx=0).stop 2024-09-21T08:08:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 shutdown_connections 2024-09-21T08:08:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f07d80b6730 0x7f07d80b8c40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.588+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07f0108600 0x7f07f01a6200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.589+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f0107c40 0x7f07f01a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.589+0000 7f07f4dbc640 1 --2- 172.21.15.6:0/2465985905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f01072f0 0x7f07f01a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.589+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 >> 172.21.15.6:0/2465985905 conn(0x7f07f0077800 msgr2=0x7f07f010d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.590+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 shutdown_connections 2024-09-21T08:08:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:33.590+0000 7f07f4dbc640 1 -- 172.21.15.6:0/2465985905 wait complete. 2024-09-21T08:08:33.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:33 smithi006 ceph-mon[30970]: pgmap v570: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-21T08:08:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:33 smithi119 ceph-mon[33564]: pgmap v570: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-21T08:08:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:33 smithi145 ceph-mon[34049]: pgmap v570: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-21T08:08:34.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2465985905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2465985905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:34.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2465985905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:35.526 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:35 smithi006 ceph-mon[30970]: pgmap v571: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-21T08:08:35.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:08:35.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:35 smithi119 ceph-mon[33564]: pgmap v571: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-21T08:08:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:35 smithi145 ceph-mon[34049]: pgmap v571: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-21T08:08:36.054 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 -- 172.21.15.6:0/77061152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 msgr2=0x7f4500116e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 --2- 172.21.15.6:0/77061152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f4500116e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44f40074e0 tx=0x7f44f402b070 comp rx=0 tx=0).stop 2024-09-21T08:08:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 -- 172.21.15.6:0/77061152 shutdown_connections 2024-09-21T08:08:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 --2- 172.21.15.6:0/77061152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f4500116e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 --2- 172.21.15.6:0/77061152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f4500110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 --2- 172.21.15.6:0/77061152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f450010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.672+0000 7f4505add640 1 -- 172.21.15.6:0/77061152 >> 172.21.15.6:0/77061152 conn(0x7f450006ee50 msgr2=0x7f450006f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.673+0000 7f4505add640 1 -- 172.21.15.6:0/77061152 shutdown_connections 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.673+0000 7f4505add640 1 -- 172.21.15.6:0/77061152 wait complete. 2024-09-21T08:08:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.674+0000 7f4505add640 1 Processor -- start 2024-09-21T08:08:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.674+0000 7f4505add640 1 -- start start 2024-09-21T08:08:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.674+0000 7f4505add640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f45001a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.674+0000 7f4505add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.674+0000 7f4505add640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f45001ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.675+0000 7f4505add640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4500119d80 con 0x7f450010fcf0 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.675+0000 7f4505add640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4500119c00 con 0x7f4500110640 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.675+0000 7f4505add640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4500119f00 con 0x7f450010a650 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.676+0000 7f44fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.676+0000 7f44fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39714/0 (socket says 172.21.15.6:39714) 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.676+0000 7f44fffff640 1 -- 172.21.15.6:0/2259256956 learned_addr learned my addr 172.21.15.6:0/2259256956 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f4504adb640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f45001a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f44fffff640 1 -- 172.21.15.6:0/2259256956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 msgr2=0x7f45001a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f44fffff640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f45001a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f44fffff640 1 -- 172.21.15.6:0/2259256956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 msgr2=0x7f45001ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f45052dc640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f45001ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f44fffff640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f45001ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f44fffff640 1 -- 172.21.15.6:0/2259256956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45001ab940 con 0x7f450010fcf0 2024-09-21T08:08:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.677+0000 7f4504adb640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f45001a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.678+0000 7f44fffff640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ebc0 tx=0x7f44f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.679+0000 7f44fdffb640 1 -- 172.21.15.6:0/2259256956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8010630 con 0x7f450010fcf0 2024-09-21T08:08:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.679+0000 7f44fdffb640 1 -- 172.21.15.6:0/2259256956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f8010c60 con 0x7f450010fcf0 2024-09-21T08:08:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.679+0000 7f44fdffb640 1 -- 172.21.15.6:0/2259256956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017ad0 con 0x7f450010fcf0 2024-09-21T08:08:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.679+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45001abbd0 con 0x7f450010fcf0 2024-09-21T08:08:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.679+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45001a6310 con 0x7f450010fcf0 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.682+0000 7f450d2b3740 1 Processor -- start 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 -- start start 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded27da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de95f390 0x5604ded282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5604dec9dea0 con 0x5604de95f390 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5604dec8d2d0 con 0x5604de980070 2024-09-21T08:08:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.683+0000 7f450d2b3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604dec910e0 con 0x5604de9571b0 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.684+0000 7f45052dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.684+0000 7f45052dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51150/0 (socket says 172.21.15.6:51150) 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.684+0000 7f45052dc640 1 -- 172.21.15.6:0/3645116670 learned_addr learned my addr 172.21.15.6:0/3645116670 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.685+0000 7f44fdffb640 1 -- 172.21.15.6:0/2259256956 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f44f8017c70 con 0x7f450010fcf0 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f45052dc640 1 -- 172.21.15.6:0/3645116670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 msgr2=0x5604ded27da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f45052dc640 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded27da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f45052dc640 1 -- 172.21.15.6:0/3645116670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de95f390 msgr2=0x5604ded282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f45052dc640 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de95f390 0x5604ded282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f45052dc640 1 -- 172.21.15.6:0/3645116670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604de9eb650 con 0x5604de980070 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.686+0000 7f44fdffb640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 0x7f44e80b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.687+0000 7f44fdffb640 1 -- 172.21.15.6:0/2259256956 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f44f80e83d0 con 0x7f450010fcf0 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.687+0000 7f45052dc640 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44f4006010 tx=0x7f44f4005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4a314e82adcdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.687+0000 7f44e6ffd640 1 -- 172.21.15.6:0/3645116670 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007ad0 con 0x5604de980070 2024-09-21T08:08:36.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.687+0000 7f4504adb640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 0x7f44e80b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.687+0000 7f44e6ffd640 1 -- 172.21.15.6:0/3645116670 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f402be40 con 0x5604de980070 2024-09-21T08:08:36.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.688+0000 7f450d2b3740 1 -- 172.21.15.6:0/3645116670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 msgr2=0x5604ded27860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.688+0000 7f4504adb640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 0x7f44e80b8c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5604ded264e0 tx=0x7f44f0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.688+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44f4006010 tx=0x7f44f4005df0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 -- 172.21.15.6:0/3645116670 shutdown_connections 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded27da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de95f390 0x5604ded282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3645116670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de980070 0x5604ded27860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 -- 172.21.15.6:0/3645116670 >> 172.21.15.6:0/3645116670 conn(0x5604de974460 msgr2=0x5604ded25750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 -- 172.21.15.6:0/3645116670 shutdown_connections 2024-09-21T08:08:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 -- 172.21.15.6:0/3645116670 wait complete. 2024-09-21T08:08:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.689+0000 7f450d2b3740 1 -- start start 2024-09-21T08:08:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.690+0000 7f450d2b3740 1 Processor -- start 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.690+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded33480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de980070 0x5604ded3f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5604deaee700 con 0x5604de980070 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5604dec28160 con 0x5604de9571b0 2024-09-21T08:08:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604ded36030 con 0x5604de95f390 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f450d2b3740 10 client.0 _ll_register_callbacks cb 0x5604dec419e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51164/0 (socket says 172.21.15.6:51164) 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 -- 172.21.15.6:0/3451050551 learned_addr learned my addr 172.21.15.6:0/3451050551 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f44fffff640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded33480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f45052dc640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de980070 0x5604ded3f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 -- 172.21.15.6:0/3451050551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 msgr2=0x5604ded33480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded33480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 -- 172.21.15.6:0/3451050551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de980070 msgr2=0x5604ded3f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de980070 0x5604ded3f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.691+0000 7f4504adb640 1 -- 172.21.15.6:0/3451050551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604dec55c90 con 0x5604de9571b0 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f4504adb640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44f0010f10 tx=0x7f44f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827c79436a0b6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f44dffff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:08:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0023020 con 0x5604de9571b0 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604dec9fdf0 con 0x5604de9571b0 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f44f0004250 con 0x5604de9571b0 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f44f002e050 con 0x5604de9571b0 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.692+0000 7f450d2b3740 10 client.26216 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.693+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604ded41ea0 con 0x5604de9571b0 2024-09-21T08:08:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.693+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5604dec9fdf0 con 0x5604de9571b0 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.693+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f44f000f040 con 0x5604de9571b0 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 10 client.26216 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 10 client.26216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 20 client.26216 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de93e9f0 0x5604ded45770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 4 client.26216 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604dec9b8a0 con 0x5604de93e9f0 2024-09-21T08:08:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.694+0000 7f44fffff640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de93e9f0 0x5604ded45770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.695+0000 7f44dffff640 10 client.26216 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.695+0000 7f44fffff640 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de93e9f0 0x5604ded45770 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55660ca167f7a961 server_cookie=c71c38efff4ea21a in_seq=0 out_seq=0 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.696+0000 7f44dffff640 1 -- 172.21.15.6:0/3451050551 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604dec9b8a0 con 0x5604de93e9f0 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.696+0000 7f44dffff640 10 client.26216 handle_command_reply: tid=0 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.696+0000 7f450d2b3740 1 client.26216 shutdown 2024-09-21T08:08:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.696+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 msgr2=0x5604ded32f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.696+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44f0010f10 tx=0x7f44f00046c0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 shutdown_connections 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de93e9f0 0x5604ded45770 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded33480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f44dffff640 0 client.26216 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de980070 0x5604ded3f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3451050551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de9571b0 0x5604ded32f40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 >> 172.21.15.6:0/3451050551 conn(0x5604de974460 msgr2=0x5604ded2a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.697+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 shutdown_connections 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.698+0000 7f450d2b3740 1 -- 172.21.15.6:0/3451050551 wait complete. 2024-09-21T08:08:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.698+0000 7f450d2b3740 20 client.26216 trim_cache size 0 max 16384 2024-09-21T08:08:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.723+0000 7f450d2b3740 1 Processor -- start 2024-09-21T08:08:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.723+0000 7f450d2b3740 1 -- start start 2024-09-21T08:08:36.725 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:36 smithi006 ceph-mon[30970]: pgmap v572: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 9.6 MiB/s wr, 685 op/s 2024-09-21T08:08:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de93e9f0 0x5604ded31e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de95f390 0x5604ded3f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c6410 con 0x5604de93e9f0 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c8c70 con 0x5604de95f390 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f450d2b3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c6a60 con 0x5604de9571b0 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f44fffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f4504adb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de93e9f0 0x5604ded31e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f44fffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:45804/0 (socket says 172.21.15.6:45804) 2024-09-21T08:08:36.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.724+0000 7f44fffff640 1 -- 172.21.15.6:0/1024952412 learned_addr learned my addr 172.21.15.6:0/1024952412 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 -- 172.21.15.6:0/1024952412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de95f390 msgr2=0x5604ded3f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de95f390 0x5604ded3f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 -- 172.21.15.6:0/1024952412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de93e9f0 msgr2=0x5604ded31e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de93e9f0 0x5604ded31e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 -- 172.21.15.6:0/1024952412 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ded31440 con 0x5604de9571b0 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44fffff640 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44f80adae0 tx=0x7f44f800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f05003c8692b0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44e67fc640 1 -- 172.21.15.6:0/1024952412 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8010e10 con 0x5604de9571b0 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44e67fc640 1 -- 172.21.15.6:0/1024952412 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80ad8f0 con 0x5604de9571b0 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.725+0000 7f44e67fc640 1 -- 172.21.15.6:0/1024952412 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8010e10 con 0x5604de9571b0 2024-09-21T08:08:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 -- 172.21.15.6:0/1024952412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 msgr2=0x5604ded28fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44f80adae0 tx=0x7f44f800eec0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 -- 172.21.15.6:0/1024952412 shutdown_connections 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de9571b0 0x5604ded28fa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de95f390 0x5604ded3f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 --2- 172.21.15.6:0/1024952412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de93e9f0 0x5604ded31e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.727+0000 7f450d2b3740 1 -- 172.21.15.6:0/1024952412 >> 172.21.15.6:0/1024952412 conn(0x5604de974460 msgr2=0x5604ded28890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.728+0000 7f450d2b3740 1 -- 172.21.15.6:0/1024952412 shutdown_connections 2024-09-21T08:08:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.728+0000 7f450d2b3740 1 -- 172.21.15.6:0/1024952412 wait complete. 2024-09-21T08:08:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.729+0000 7f450d2b3740 1 -- start start 2024-09-21T08:08:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.729+0000 7f450d2b3740 1 Processor -- start 2024-09-21T08:08:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f450d2b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 0x5604ded462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f4504adb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f4504adb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51188/0 (socket says 172.21.15.6:51188) 2024-09-21T08:08:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f4504adb640 1 -- 172.21.15.6:0/3194193480 learned_addr learned my addr 172.21.15.6:0/3194193480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded46820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c7130 con 0x5604de9571b0 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.730+0000 7f44fffff640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 0x5604ded462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c85a0 con 0x5604de93e9f0 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f45052dc640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded46820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45001c7800 con 0x5604de95f390 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f450d2b3740 10 client.0 _ll_register_callbacks cb 0x7f44f0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f4504adb640 1 -- 172.21.15.6:0/3194193480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 msgr2=0x5604ded46820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f4504adb640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded46820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f4504adb640 1 -- 172.21.15.6:0/3194193480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 msgr2=0x5604ded462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f4504adb640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 0x5604ded462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f4504adb640 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ded46ec0 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.731+0000 7f44fffff640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 0x5604ded462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.732+0000 7f4504adb640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44f0010f10 tx=0x7f44f001f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682f5926584fa88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.732+0000 7f44dffff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.732+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0023070 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.732+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f44f003b650 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.732+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f80ad8f0 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f44f0005020 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 10 client.26219 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604dedafe90 con 0x5604de93e9f0 2024-09-21T08:08:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f0004730 con 0x5604de93e9f0 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f44f0032400 con 0x5604de93e9f0 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 10 client.26219 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 10 client.26219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 20 client.26219 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de980070 0x5604dedb2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 4 client.26219 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.733+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f44f80ad8f0 con 0x5604de980070 2024-09-21T08:08:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.734+0000 7f44fffff640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de980070 0x5604dedb2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.736+0000 7f44dffff640 10 client.26219 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.736+0000 7f44fffff640 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de980070 0x5604dedb2650 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3ca30b70f6c4e9 server_cookie=aac6c5999495673c in_seq=0 out_seq=0 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.736+0000 7f44dffff640 1 -- 172.21.15.6:0/3194193480 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f44f80ad8f0 con 0x5604de980070 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.736+0000 7f44dffff640 10 client.26219 handle_command_reply: tid=0 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.736+0000 7f450d2b3740 1 client.26219 shutdown 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 msgr2=0x5604ded48e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44f0010f10 tx=0x7f44f001f680 comp rx=0 tx=0).stop 2024-09-21T08:08:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 shutdown_connections 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5604de980070 0x5604dedb2650 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f44dffff640 0 client.26219 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604de95f390 0x5604ded46820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604de9571b0 0x5604ded462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 --2- 172.21.15.6:0/3194193480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604de93e9f0 0x5604ded48e10 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44f0010f10 tx=0x7f44f001f680 comp rx=0 tx=0).stop 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.737+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 >> 172.21.15.6:0/3194193480 conn(0x5604de974460 msgr2=0x5604ded34200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.738+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 shutdown_connections 2024-09-21T08:08:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.738+0000 7f450d2b3740 1 -- 172.21.15.6:0/3194193480 wait complete. 2024-09-21T08:08:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.739+0000 7f450d2b3740 20 client.26219 trim_cache size 0 max 16384 2024-09-21T08:08:36.740 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:08:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 msgr2=0x7f44e80b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 0x7f44e80b8c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5604ded264e0 tx=0x7f44f0005f90 comp rx=0 tx=0).stop 2024-09-21T08:08:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 msgr2=0x7f45001a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ebc0 tx=0x7f44f800c6a0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 shutdown_connections 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f44e80b6780 0x7f44e80b8c90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4500110640 0x7f45001ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450010fcf0 0x7f45001a0dc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 --2- 172.21.15.6:0/2259256956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f450010a650 0x7f45001a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 >> 172.21.15.6:0/2259256956 conn(0x7f450006ee50 msgr2=0x7f4500072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 shutdown_connections 2024-09-21T08:08:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:36.740+0000 7f4505add640 1 -- 172.21.15.6:0/2259256956 wait complete. 2024-09-21T08:08:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:36 smithi119 ceph-mon[33564]: pgmap v572: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 9.6 MiB/s wr, 685 op/s 2024-09-21T08:08:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:36 smithi145 ceph-mon[34049]: pgmap v572: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 9.6 MiB/s wr, 685 op/s 2024-09-21T08:08:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 340.0 s, 704.0 tps, lat 141.939 ms stddev 238.727 2024-09-21T08:08:38.481 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:08:38.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:08:38.979 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:39.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:39 smithi119 ceph-mon[33564]: pgmap v573: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-21T08:08:39.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:39 smithi145 ceph-mon[34049]: pgmap v573: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-21T08:08:39.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:39 smithi006 ceph-mon[30970]: pgmap v573: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 10 MiB/s wr, 696 op/s 2024-09-21T08:08:40.545 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:08:40.545 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T08:08:40.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:08:41.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:41 smithi119 ceph-mon[33564]: pgmap v574: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T08:08:41.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:41 smithi145 ceph-mon[34049]: pgmap v574: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T08:08:41.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:41 smithi006 ceph-mon[30970]: pgmap v574: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T08:08:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 345.0 s, 844.2 tps, lat 117.943 ms stddev 90.623 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 -- 172.21.15.6:0/3887736115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 msgr2=0x7f5670115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 --2- 172.21.15.6:0/3887736115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f5670115fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5660009860 tx=0x7f566002a360 comp rx=0 tx=0).stop 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 -- 172.21.15.6:0/3887736115 shutdown_connections 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 --2- 172.21.15.6:0/3887736115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f5670118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 --2- 172.21.15.6:0/3887736115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f5670115fd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 --2- 172.21.15.6:0/3887736115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010a590 0x7f567010a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.616+0000 7f56761ea640 1 -- 172.21.15.6:0/3887736115 >> 172.21.15.6:0/3887736115 conn(0x7f5670070ec0 msgr2=0x7f56700712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.618+0000 7f56761ea640 1 -- 172.21.15.6:0/3887736115 shutdown_connections 2024-09-21T08:08:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.618+0000 7f56761ea640 1 -- 172.21.15.6:0/3887736115 wait complete. 2024-09-21T08:08:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 Processor -- start 2024-09-21T08:08:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 -- start start 2024-09-21T08:08:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010a590 0x7f5670115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f56701103b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5670119fe0 con 0x7f5670116640 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5670119e60 con 0x7f567010aee0 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.619+0000 7f56761ea640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f567011a160 con 0x7f567010a590 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51204/0 (socket says 172.21.15.6:51204) 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 -- 172.21.15.6:0/1014005721 learned_addr learned my addr 172.21.15.6:0/1014005721 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566ffff640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f56701103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 -- 172.21.15.6:0/1014005721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010a590 msgr2=0x7f5670115bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010a590 0x7f5670115bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 -- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 msgr2=0x7f56701103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f56701103b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.620+0000 7f566effd640 1 -- 172.21.15.6:0/1014005721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56701109f0 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f566effd640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5660035040 tx=0x7f5660032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f566cff9640 1 -- 172.21.15.6:0/1014005721 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660040020 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5670110c80 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f566cff9640 1 -- 172.21.15.6:0/1014005721 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5660038040 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f566cff9640 1 -- 172.21.15.6:0/1014005721 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660037070 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f566ffff640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f56701103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.621+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56701be310 con 0x7f567010aee0 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.625+0000 7f567c75e740 1 Processor -- start 2024-09-21T08:08:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 -- start start 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795de970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979216670 0x55f9795deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f979554e60 con 0x55f979237350 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f979544290 con 0x55f979216670 2024-09-21T08:08:42.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.626+0000 7f567c75e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f9795480a0 con 0x55f97920e490 2024-09-21T08:08:42.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.628+0000 7f566ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.628+0000 7f566ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795de430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39792/0 (socket says 172.21.15.6:39792) 2024-09-21T08:08:42.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.628+0000 7f566ffff640 1 -- 172.21.15.6:0/2079934082 learned_addr learned my addr 172.21.15.6:0/2079934082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:42.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.628+0000 7f566f7fe640 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 -- 172.21.15.6:0/2079934082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979216670 msgr2=0x55f9795deeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979216670 0x55f9795deeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 -- 172.21.15.6:0/2079934082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 msgr2=0x55f9795de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795de430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 -- 172.21.15.6:0/2079934082 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9792a2930 con 0x55f97920e490 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.629+0000 7f566f7fe640 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795de970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5668005fd0 tx=0x7f566800e760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9849d67f4e1da71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.630+0000 7f5655ffb640 1 -- 172.21.15.6:0/2079934082 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668003b70 con 0x55f97920e490 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.630+0000 7f566cff9640 1 -- 172.21.15.6:0/1014005721 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5660043020 con 0x7f567010aee0 2024-09-21T08:08:42.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.630+0000 7f5655ffb640 1 -- 172.21.15.6:0/2079934082 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5668003d10 con 0x55f97920e490 2024-09-21T08:08:42.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.631+0000 7f566cff9640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 0x7f56580b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.631+0000 7f567c75e740 1 -- 172.21.15.6:0/2079934082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 msgr2=0x55f9795de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.631+0000 7f567c75e740 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795de970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5668005fd0 tx=0x7f566800e760 comp rx=0 tx=0).stop 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.631+0000 7f566cff9640 1 -- 172.21.15.6:0/1014005721 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f5660107a00 con 0x7f567010aee0 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f566ffff640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 0x7f56580b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 -- 172.21.15.6:0/2079934082 shutdown_connections 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795de970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979216670 0x55f9795deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 --2- 172.21.15.6:0/2079934082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 -- 172.21.15.6:0/2079934082 >> 172.21.15.6:0/2079934082 conn(0x55f97922b740 msgr2=0x55f9795dc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 -- 172.21.15.6:0/2079934082 shutdown_connections 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.632+0000 7f567c75e740 1 -- 172.21.15.6:0/2079934082 wait complete. 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.633+0000 7f566ffff640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 0x7f56580b8cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5664009460 tx=0x7f5664005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.633+0000 7f567c75e740 1 -- start start 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.633+0000 7f567c75e740 1 Processor -- start 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f9795ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f9793a5890 con 0x55f979237350 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f9794ded40 con 0x55f97920e490 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f9795ecc60 con 0x55f979216670 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f567c75e740 10 client.0 _ll_register_callbacks cb 0x55f979542c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51230/0 (socket says 172.21.15.6:51230) 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f566f7fe640 1 -- 172.21.15.6:0/3426452225 learned_addr learned my addr 172.21.15.6:0/3426452225 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f566effd640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f9795ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.634+0000 7f566ffff640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 -- 172.21.15.6:0/3426452225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 msgr2=0x55f9795ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f9795ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 -- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 msgr2=0x55f9795ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 -- 172.21.15.6:0/3426452225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9795f6560 con 0x55f979237350 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566effd640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f9795ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566f7fe640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f566ffff640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795f5fd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f566401e620 tx=0x7f56640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bd795553dcdead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f564effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.635+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664004220 con 0x55f979237350 2024-09-21T08:08:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.636+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5668003d10 con 0x55f979237350 2024-09-21T08:08:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.636+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f56640043c0 con 0x55f979237350 2024-09-21T08:08:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.636+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f56640035f0 con 0x55f979237350 2024-09-21T08:08:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.636+0000 7f567c75e740 10 client.16575 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.636+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f9795f8f20 con 0x55f979237350 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5668003d10 con 0x55f979237350 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f566400f040 con 0x55f979237350 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 10 client.16575 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 20 client.16575 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791f5cd0 0x55f9795fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 4 client.16575 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f979556db0 con 0x55f9791f5cd0 2024-09-21T08:08:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.637+0000 7f566f7fe640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791f5cd0 0x55f9795fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.638+0000 7f566f7fe640 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791f5cd0 0x55f9795fc480 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16c573061eefaabe server_cookie=e3e3f77c878dfb62 in_seq=0 out_seq=0 2024-09-21T08:08:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.638+0000 7f564effd640 10 client.16575 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.640+0000 7f564effd640 1 -- 172.21.15.6:0/3426452225 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f979556db0 con 0x55f9791f5cd0 2024-09-21T08:08:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.640+0000 7f564effd640 10 client.16575 handle_command_reply: tid=0 2024-09-21T08:08:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.640+0000 7f567c75e740 1 client.16575 shutdown 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 msgr2=0x55f9795f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795f5fd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f566401e620 tx=0x7f56640046c0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 shutdown_connections 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791f5cd0 0x55f9795fc480 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f9795ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f9795f5fd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 --2- 172.21.15.6:0/3426452225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.641+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 >> 172.21.15.6:0/3426452225 conn(0x55f97922b740 msgr2=0x55f9795e1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.643+0000 7f564effd640 0 client.16575 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.643+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 shutdown_connections 2024-09-21T08:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.643+0000 7f567c75e740 1 -- 172.21.15.6:0/3426452225 wait complete. 2024-09-21T08:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.643+0000 7f567c75e740 20 client.16575 trim_cache size 0 max 16384 2024-09-21T08:08:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 Processor -- start 2024-09-21T08:08:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 -- start start 2024-09-21T08:08:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979216670 0x55f9795e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979237350 0x55f9795e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c65a0 con 0x55f979216670 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c8e00 con 0x55f979237350 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f567c75e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c6bf0 con 0x55f97920e490 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f566effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979216670 0x55f9795e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:45840/0 (socket says 172.21.15.6:45840) 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.677+0000 7f566f7fe640 1 -- 172.21.15.6:0/312147373 learned_addr learned my addr 172.21.15.6:0/312147373 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.678+0000 7f566f7fe640 1 -- 172.21.15.6:0/312147373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979237350 msgr2=0x55f9795e3a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.678+0000 7f566f7fe640 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979237350 0x55f9795e3a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.678+0000 7f566f7fe640 1 -- 172.21.15.6:0/312147373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979216670 msgr2=0x55f9795e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.678+0000 7f566f7fe640 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979216670 0x55f9795e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.678+0000 7f566f7fe640 1 -- 172.21.15.6:0/312147373 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9795dba70 con 0x55f97920e490 2024-09-21T08:08:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.679+0000 7f566f7fe640 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f566800f470 tx=0x7f566800f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac39433d15f8647b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.679+0000 7f56557fa640 1 -- 172.21.15.6:0/312147373 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668003d10 con 0x55f97920e490 2024-09-21T08:08:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.679+0000 7f56557fa640 1 -- 172.21.15.6:0/312147373 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f566800fa80 con 0x55f97920e490 2024-09-21T08:08:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.680+0000 7f56557fa640 1 -- 172.21.15.6:0/312147373 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668011360 con 0x55f97920e490 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 -- 172.21.15.6:0/312147373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 msgr2=0x55f9795f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f566800f470 tx=0x7f566800f4a0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 -- 172.21.15.6:0/312147373 shutdown_connections 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f979237350 0x55f9795e3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979216670 0x55f9795e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 --2- 172.21.15.6:0/312147373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f97920e490 0x55f9795f5ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 -- 172.21.15.6:0/312147373 >> 172.21.15.6:0/312147373 conn(0x55f97922b740 msgr2=0x55f9795e8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 -- 172.21.15.6:0/312147373 shutdown_connections 2024-09-21T08:08:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.683+0000 7f567c75e740 1 -- 172.21.15.6:0/312147373 wait complete. 2024-09-21T08:08:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.684+0000 7f567c75e740 1 -- start start 2024-09-21T08:08:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.684+0000 7f567c75e740 1 Processor -- start 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.684+0000 7f567c75e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.684+0000 7f567c75e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f979601990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.684+0000 7f567c75e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f979601fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f567c75e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c72c0 con 0x55f979237350 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f567c75e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c8730 con 0x55f97920e490 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f567c75e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f56701c7990 con 0x55f979216670 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f567c75e740 10 client.0 _ll_register_callbacks cb 0x7f56640093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51248/0 (socket says 172.21.15.6:51248) 2024-09-21T08:08:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 -- 172.21.15.6:0/1652539574 learned_addr learned my addr 172.21.15.6:0/1652539574 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566effd640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f979601990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566ffff640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f979601fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 -- 172.21.15.6:0/1652539574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 msgr2=0x55f979601990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f979601990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 -- 172.21.15.6:0/1652539574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 msgr2=0x55f979601fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f979601fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.685+0000 7f566f7fe640 1 -- 172.21.15.6:0/1652539574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f979602750 con 0x55f97920e490 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.686+0000 7f566ffff640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f979601fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.686+0000 7f566f7fe640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566800f870 tx=0x7f5668005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d83da88c0f15cac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.686+0000 7f564effd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:08:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668003cc0 con 0x55f97920e490 2024-09-21T08:08:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f5668011ba0 con 0x55f97920e490 2024-09-21T08:08:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f566800fa80 con 0x55f97920e490 2024-09-21T08:08:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5668011de0 con 0x55f97920e490 2024-09-21T08:08:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f567c75e740 10 client.26231 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.687+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f979666f40 con 0x55f97920e490 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f566800fa80 con 0x55f97920e490 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f566800b030 con 0x55f97920e490 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 10 client.26231 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 10 client.26231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 20 client.26231 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791cb080 0x55f9796695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:42.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 4 client.26231 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:08:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f979552860 con 0x55f9791cb080 2024-09-21T08:08:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.688+0000 7f566effd640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791cb080 0x55f9796695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.689+0000 7f566effd640 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791cb080 0x55f9796695a0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5b75b05daccc1e server_cookie=70a8227a1a402111 in_seq=0 out_seq=0 2024-09-21T08:08:42.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.689+0000 7f564effd640 10 client.26231 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.692+0000 7f564effd640 1 -- 172.21.15.6:0/1652539574 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f979552860 con 0x55f9791cb080 2024-09-21T08:08:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.692+0000 7f564effd640 10 client.26231 handle_command_reply: tid=0 2024-09-21T08:08:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.692+0000 7f567c75e740 1 client.26231 shutdown 2024-09-21T08:08:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 msgr2=0x55f9795f2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566800f870 tx=0x7f5668005df0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 shutdown_connections 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f9791cb080 0x55f9796695a0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f979216670 0x55f979601990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f979237350 0x55f979601fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 --2- 172.21.15.6:0/1652539574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f97920e490 0x55f9795f2810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.693+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 >> 172.21.15.6:0/1652539574 conn(0x55f97922b740 msgr2=0x55f9795dbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.694+0000 7f564effd640 0 client.26231 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.694+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 shutdown_connections 2024-09-21T08:08:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.694+0000 7f567c75e740 1 -- 172.21.15.6:0/1652539574 wait complete. 2024-09-21T08:08:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.694+0000 7f567c75e740 20 client.26231 trim_cache size 0 max 16384 2024-09-21T08:08:42.698 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:42.698 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "5d8aef01-33f1-44fe-abcd-397baa796fb3", 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 msgr2=0x7f56580b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 0x7f56580b8cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5664009460 tx=0x7f5664005f90 comp rx=0 tx=0).stop 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 msgr2=0x7f567010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5660035040 tx=0x7f5660032cb0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 shutdown_connections 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56580b67c0 0x7f56580b8cd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5670116640 0x7f56701103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567010aee0 0x7f567010fe70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 --2- 172.21.15.6:0/1014005721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010a590 0x7f5670115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.697+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 >> 172.21.15.6:0/1014005721 conn(0x7f5670070ec0 msgr2=0x7f5670073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.698+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 shutdown_connections 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:42.698+0000 7f56761ea640 1 -- 172.21.15.6:0/1014005721 wait complete. 2024-09-21T08:08:42.700 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:43.647 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:43 smithi006 ceph-mon[30970]: pgmap v575: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-09-21T08:08:43.647 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:43 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:08:43.647 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:43 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:43.647 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:43 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:08:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:43 smithi145 ceph-mon[34049]: pgmap v575: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-09-21T08:08:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:43 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:08:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:43 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:43.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:43 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:08:43.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:08:43.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:43 smithi119 ceph-mon[33564]: pgmap v575: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-09-21T08:08:43.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:43 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:08:43.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:43 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:43.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:43 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:08:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.988+0000 7f94cdf59640 1 -- 172.21.15.6:0/2271597793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 msgr2=0x7f94c810f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.988+0000 7f94cdf59640 1 --2- 172.21.15.6:0/2271597793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c810f330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009be0 tx=0x7f94c002a6d0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.989+0000 7f94cdf59640 1 -- 172.21.15.6:0/2271597793 shutdown_connections 2024-09-21T08:08:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.989+0000 7f94cdf59640 1 --2- 172.21.15.6:0/2271597793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c81081b0 0x7f94c81085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.989+0000 7f94cdf59640 1 --2- 172.21.15.6:0/2271597793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c810f330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.989+0000 7f94cdf59640 1 --2- 172.21.15.6:0/2271597793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c8102870 0x7f94c8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.989+0000 7f94cdf59640 1 -- 172.21.15.6:0/2271597793 >> 172.21.15.6:0/2271597793 conn(0x7f94c80fe2c0 msgr2=0x7f94c8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.991+0000 7f94cdf59640 1 -- 172.21.15.6:0/2271597793 shutdown_connections 2024-09-21T08:08:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.992+0000 7f94cdf59640 1 -- 172.21.15.6:0/2271597793 wait complete. 2024-09-21T08:08:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.993+0000 7f94cdf59640 1 Processor -- start 2024-09-21T08:08:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.993+0000 7f94cdf59640 1 -- start start 2024-09-21T08:08:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.994+0000 7f94cdf59640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c8102870 0x7f94c8198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.994+0000 7f94cdf59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 0x7f94c8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.994+0000 7f94cdf59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.994+0000 7f94cdf59640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8112660 con 0x7f94c81081b0 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94cd758640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94cd758640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c819e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51262/0 (socket says 172.21.15.6:51262) 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94cd758640 1 -- 172.21.15.6:0/3744480195 learned_addr learned my addr 172.21.15.6:0/3744480195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94c81124e0 con 0x7f94c8108b00 2024-09-21T08:08:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f94c81127e0 con 0x7f94c8102870 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94ccf57640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c8102870 0x7f94c8198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.995+0000 7f94c7fff640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 0x7f94c8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.996+0000 7f94c7fff640 1 -- 172.21.15.6:0/3744480195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c8102870 msgr2=0x7f94c8198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.996+0000 7f94c7fff640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c8102870 0x7f94c8198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.996+0000 7f94c7fff640 1 -- 172.21.15.6:0/3744480195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 msgr2=0x7f94c819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.996+0000 7f94c7fff640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.996+0000 7f94c7fff640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c819ee00 con 0x7f94c81081b0 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.997+0000 7f94c7fff640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 0x7f94c8199430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f94c806aa90 tx=0x7f94b400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.998+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b400cc90 con 0x7f94c81081b0 2024-09-21T08:08:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.998+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94b400ee70 con 0x7f94c81081b0 2024-09-21T08:08:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.998+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4018680 con 0x7f94c81081b0 2024-09-21T08:08:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.998+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c819f0f0 con 0x7f94c81081b0 2024-09-21T08:08:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:43.998+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c819f4f0 con 0x7f94c81081b0 2024-09-21T08:08:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.001+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c8199fc0 con 0x7f94c81081b0 2024-09-21T08:08:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.003+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f94b4010430 con 0x7f94c81081b0 2024-09-21T08:08:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.004+0000 7f94c5ffb640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 0x7f94b80b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.005+0000 7f94ccf57640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 0x7f94b80b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.005+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f94b401ad60 con 0x7f94c81081b0 2024-09-21T08:08:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.006+0000 7f94ccf57640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 0x7f94b80b8ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005fd0 tx=0x7f94bc005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.015+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94b40adde0 con 0x7f94c81081b0 2024-09-21T08:08:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:44.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.430+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94c810a360 con 0x7f94c81081b0 2024-09-21T08:08:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.443+0000 7f94c5ffb640 1 -- 172.21.15.6:0/3744480195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f94c810a360 con 0x7f94c81081b0 2024-09-21T08:08:44.445 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:08:44.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:08:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:08:44.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.448+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 msgr2=0x7f94b80b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.448+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 0x7f94b80b8ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005fd0 tx=0x7f94bc005850 comp rx=0 tx=0).stop 2024-09-21T08:08:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.448+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 msgr2=0x7f94c8199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.448+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 0x7f94c8199430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f94c806aa90 tx=0x7f94b400ec20 comp rx=0 tx=0).stop 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 shutdown_connections 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f94b80b67d0 0x7f94b80b8ce0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8108b00 0x7f94c819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c81081b0 0x7f94c8199430 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 --2- 172.21.15.6:0/3744480195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94c8102870 0x7f94c8198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.451+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 >> 172.21.15.6:0/3744480195 conn(0x7f94c80fe2c0 msgr2=0x7f94c8105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.452+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 shutdown_connections 2024-09-21T08:08:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:44.452+0000 7f94cdf59640 1 -- 172.21.15.6:0/3744480195 wait complete. 2024-09-21T08:08:44.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:44 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:44.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:44 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:44.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:44 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:45 smithi145 ceph-mon[34049]: pgmap v576: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 10 MiB/s wr, 780 op/s 2024-09-21T08:08:45.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:45 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3744480195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:45.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:45 smithi006 ceph-mon[30970]: pgmap v576: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 10 MiB/s wr, 780 op/s 2024-09-21T08:08:45.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:45 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3744480195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:45.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:45 smithi119 ceph-mon[33564]: pgmap v576: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 10 MiB/s wr, 780 op/s 2024-09-21T08:08:45.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:45 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3744480195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 -- 172.21.15.6:0/2804963881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc109e20 msgr2=0x7f26dc110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 --2- 172.21.15.6:0/2804963881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc109e20 0x7f26dc110650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009ca0 tx=0x7f26d402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 -- 172.21.15.6:0/2804963881 shutdown_connections 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 --2- 172.21.15.6:0/2804963881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc109e20 0x7f26dc110650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 --2- 172.21.15.6:0/2804963881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 0x7f26dc1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 --2- 172.21.15.6:0/2804963881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc103b90 0x7f26dc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 -- 172.21.15.6:0/2804963881 >> 172.21.15.6:0/2804963881 conn(0x7f26dc0ff600 msgr2=0x7f26dc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 -- 172.21.15.6:0/2804963881 shutdown_connections 2024-09-21T08:08:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.052+0000 7f26e1722640 1 -- 172.21.15.6:0/2804963881 wait complete. 2024-09-21T08:08:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.054+0000 7f26e1722640 1 Processor -- start 2024-09-21T08:08:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.054+0000 7f26e1722640 1 -- start start 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.054+0000 7f26e1722640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.054+0000 7f26e1722640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 0x7f26dc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26e1722640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 0x7f26dc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26e1722640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1139e0 con 0x7f26dc1094d0 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26e1722640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc113860 con 0x7f26dc103b90 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26e1722640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc113b60 con 0x7f26dc109e20 2024-09-21T08:08:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51288/0 (socket says 172.21.15.6:51288) 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 -- 172.21.15.6:0/1678515901 learned_addr learned my addr 172.21.15.6:0/1678515901 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26d3fff640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 0x7f26dc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26db7fe640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 0x7f26dc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 -- 172.21.15.6:0/1678515901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 msgr2=0x7f26dc19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 0x7f26dc19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 -- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 msgr2=0x7f26dc19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 0x7f26dc19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 -- 172.21.15.6:0/1678515901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc1a02e0 con 0x7f26dc103b90 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26db7fe640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 0x7f26dc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.055+0000 7f26daffd640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ea60 tx=0x7f26cc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.056+0000 7f26d8ff9640 1 -- 172.21.15.6:0/1678515901 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00cde0 con 0x7f26dc103b90 2024-09-21T08:08:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.056+0000 7f26d8ff9640 1 -- 172.21.15.6:0/1678515901 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26cc0035f0 con 0x7f26dc103b90 2024-09-21T08:08:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.056+0000 7f26d8ff9640 1 -- 172.21.15.6:0/1678515901 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc010690 con 0x7f26dc103b90 2024-09-21T08:08:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.056+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc1a05d0 con 0x7f26dc103b90 2024-09-21T08:08:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.056+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc0755f0 con 0x7f26dc103b90 2024-09-21T08:08:46.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.060+0000 7f26d8ff9640 1 -- 172.21.15.6:0/1678515901 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f26cc004000 con 0x7f26dc103b90 2024-09-21T08:08:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.061+0000 7f26e7c96740 1 Processor -- start 2024-09-21T08:08:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.061+0000 7f26e7c96740 1 -- start start 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95a9070 0x55c2b9958e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b95801b0 0x55c2b99593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c2b98c6e50 con 0x55c2b95a9070 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c2b98b6280 con 0x55c2b95801b0 2024-09-21T08:08:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26e7c96740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c2b98ba090 con 0x55c2b9588390 2024-09-21T08:08:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:45906/0 (socket says 172.21.15.6:45906) 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 -- 172.21.15.6:0/49202255 learned_addr learned my addr 172.21.15.6:0/49202255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26daffd640 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b95801b0 0x55c2b99593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 -- 172.21.15.6:0/49202255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b95801b0 msgr2=0x55c2b99593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b95801b0 0x55c2b99593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 -- 172.21.15.6:0/49202255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95a9070 msgr2=0x55c2b9958e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95a9070 0x55c2b9958e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.062+0000 7f26d3fff640 1 -- 172.21.15.6:0/49202255 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b9614650 con 0x55c2b9588390 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.063+0000 7f26d8ff9640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 0x7f26c80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.063+0000 7f26d3fff640 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009bb0 tx=0x7f26c40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a362b41cbccaa36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.063+0000 7f26d8ff9640 1 -- 172.21.15.6:0/1678515901 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f26cc0e7ef0 con 0x7f26dc103b90 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.064+0000 7f26db7fe640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 0x7f26c80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.064+0000 7f26d17fa640 1 -- 172.21.15.6:0/49202255 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4012450 con 0x55c2b9588390 2024-09-21T08:08:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.064+0000 7f26d17fa640 1 -- 172.21.15.6:0/49202255 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26c4012a80 con 0x55c2b9588390 2024-09-21T08:08:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.064+0000 7f26d17fa640 1 -- 172.21.15.6:0/49202255 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c400f950 con 0x55c2b9588390 2024-09-21T08:08:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26db7fe640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 0x7f26c80b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009a60 tx=0x7f26d4009890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 -- 172.21.15.6:0/49202255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 msgr2=0x55c2b99598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009bb0 tx=0x7f26c40117b0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 -- 172.21.15.6:0/49202255 shutdown_connections 2024-09-21T08:08:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b9588390 0x55c2b99598e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b95801b0 0x55c2b99593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 --2- 172.21.15.6:0/49202255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95a9070 0x55c2b9958e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.065+0000 7f26e7c96740 1 -- 172.21.15.6:0/49202255 >> 172.21.15.6:0/49202255 conn(0x55c2b959d460 msgr2=0x55c2b9956d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.066+0000 7f26e7c96740 1 -- 172.21.15.6:0/49202255 shutdown_connections 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.066+0000 7f26e7c96740 1 -- 172.21.15.6:0/49202255 wait complete. 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.066+0000 7f26e7c96740 1 -- start start 2024-09-21T08:08:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.066+0000 7f26e7c96740 1 Processor -- start 2024-09-21T08:08:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 0x55c2b99649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95a9070 0x55c2b9964f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c2b9717700 con 0x55c2b95801b0 2024-09-21T08:08:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c2b9851110 con 0x55c2b9588390 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c2b99676e0 con 0x55c2b95a9070 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26e7c96740 10 client.0 _ll_register_callbacks cb 0x55c2b986a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39870/0 (socket says 172.21.15.6:39870) 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 0x55c2b99649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26daffd640 1 -- 172.21.15.6:0/2643093979 learned_addr learned my addr 172.21.15.6:0/2643093979 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26db7fe640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95a9070 0x55c2b9964f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26daffd640 1 -- 172.21.15.6:0/2643093979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95a9070 msgr2=0x55c2b9964f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.067+0000 7f26daffd640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95a9070 0x55c2b9964f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26daffd640 1 -- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 msgr2=0x55c2b99649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26daffd640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 0x55c2b99649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26daffd640 1 -- 172.21.15.6:0/2643093979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b987ec40 con 0x55c2b95801b0 2024-09-21T08:08:46.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26d3fff640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 0x55c2b99649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26daffd640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00c760 tx=0x7f26cc0aa010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e18c963225bc48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0ad6d0 con 0x55c2b95801b0 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c4012a80 con 0x55c2b95801b0 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.068+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f26cc0eb020 con 0x55c2b95801b0 2024-09-21T08:08:46.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.069+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f26cc0a9070 con 0x55c2b95801b0 2024-09-21T08:08:46.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.069+0000 7f26e7c96740 10 client.16596 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:46.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.069+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c2b9973420 con 0x55c2b95801b0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26c4012a80 con 0x55c2b95801b0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f26cc0a9250 con 0x55c2b95801b0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 10 client.16596 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 20 client.16596 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b95679f0 0x55c2b9976910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 4 client.16596 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.070+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2b98c8da0 con 0x55c2b95679f0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.071+0000 7f26d3fff640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b95679f0 0x55c2b9976910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.071+0000 7f26c27fc640 10 client.16596 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.072+0000 7f26d3fff640 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b95679f0 0x55c2b9976910 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6282634f3283cf20 server_cookie=61d023e5c88a7d6a in_seq=0 out_seq=0 2024-09-21T08:08:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.073+0000 7f26c27fc640 1 -- 172.21.15.6:0/2643093979 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2b98c8da0 con 0x55c2b95679f0 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.073+0000 7f26c27fc640 10 client.16596 handle_command_reply: tid=0 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.073+0000 7f26e7c96740 1 client.16596 shutdown 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 msgr2=0x55c2b9964480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00c760 tx=0x7f26cc0aa010 comp rx=0 tx=0).stop 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 shutdown_connections 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b95679f0 0x55c2b9976910 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95a9070 0x55c2b9964f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26c27fc640 0 client.16596 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b9588390 0x55c2b99649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 --2- 172.21.15.6:0/2643093979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95801b0 0x55c2b9964480 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 >> 172.21.15.6:0/2643093979 conn(0x55c2b959d460 msgr2=0x55c2b995c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 shutdown_connections 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.074+0000 7f26e7c96740 1 -- 172.21.15.6:0/2643093979 wait complete. 2024-09-21T08:08:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.075+0000 7f26e7c96740 20 client.16596 trim_cache size 0 max 16384 2024-09-21T08:08:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.108+0000 7f26e7c96740 1 Processor -- start 2024-09-21T08:08:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 -- start start 2024-09-21T08:08:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b995a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9961bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1acda0 con 0x55c2b95679f0 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1af600 con 0x55c2b959d460 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26e7c96740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1ad3f0 con 0x55c2b95801b0 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39872/0 (socket says 172.21.15.6:39872) 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.109+0000 7f26d3fff640 1 -- 172.21.15.6:0/606425426 learned_addr learned my addr 172.21.15.6:0/606425426 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.110+0000 7f26d3fff640 1 -- 172.21.15.6:0/606425426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 msgr2=0x55c2b9961bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.110+0000 7f26d3fff640 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9961bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.110+0000 7f26d3fff640 1 -- 172.21.15.6:0/606425426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 msgr2=0x55c2b995a5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.110+0000 7f26d3fff640 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b995a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.110+0000 7f26d3fff640 1 -- 172.21.15.6:0/606425426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b99633e0 con 0x55c2b95679f0 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.111+0000 7f26d3fff640 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f26c4011cb0 tx=0x7f26c4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ebcadfd6fa9f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.111+0000 7f26d0ff9640 1 -- 172.21.15.6:0/606425426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4005220 con 0x55c2b95679f0 2024-09-21T08:08:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.112+0000 7f26d0ff9640 1 -- 172.21.15.6:0/606425426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26c40128e0 con 0x55c2b95679f0 2024-09-21T08:08:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.112+0000 7f26d0ff9640 1 -- 172.21.15.6:0/606425426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4003970 con 0x55c2b95679f0 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 -- 172.21.15.6:0/606425426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 msgr2=0x55c2b9961670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f26c4011cb0 tx=0x7f26c4009740 comp rx=0 tx=0).stop 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 -- 172.21.15.6:0/606425426 shutdown_connections 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9961bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9961670 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 --2- 172.21.15.6:0/606425426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b995a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.113+0000 7f26e7c96740 1 -- 172.21.15.6:0/606425426 >> 172.21.15.6:0/606425426 conn(0x55c2b9976c60 msgr2=0x55c2b9959e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.115+0000 7f26e7c96740 1 -- 172.21.15.6:0/606425426 shutdown_connections 2024-09-21T08:08:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.115+0000 7f26e7c96740 1 -- 172.21.15.6:0/606425426 wait complete. 2024-09-21T08:08:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.116+0000 7f26e7c96740 1 -- start start 2024-09-21T08:08:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.116+0000 7f26e7c96740 1 Processor -- start 2024-09-21T08:08:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9968c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b99e0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1adac0 con 0x55c2b95679f0 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1aef30 con 0x55c2b959d460 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1ae190 con 0x55c2b95801b0 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:45914/0 (socket says 172.21.15.6:45914) 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26d3fff640 1 -- 172.21.15.6:0/3483140461 learned_addr learned my addr 172.21.15.6:0/3483140461 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26daffd640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9968c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.117+0000 7f26e7c96740 10 client.0 _ll_register_callbacks cb 0x7f26cc003ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 -- 172.21.15.6:0/3483140461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 msgr2=0x55c2b9969180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 -- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 msgr2=0x55c2b99e0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b99e0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 -- 172.21.15.6:0/3483140461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b9969970 con 0x55c2b95679f0 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26daffd640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9968c40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0ad890 tx=0x7f26cc0a9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24914606e900976 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.118+0000 7f26c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.119+0000 7f26d3fff640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.119+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0042f0 con 0x55c2b95679f0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.119+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f26cc0acd60 con 0x55c2b95679f0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.119+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c40128e0 con 0x55c2b95679f0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.120+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f26cc0ad070 con 0x55c2b95679f0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.120+0000 7f26e7c96740 10 client.16602 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.120+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c2b99e1820 con 0x55c2b95679f0 2024-09-21T08:08:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.120+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26cc0ad410 con 0x55c2b95679f0 2024-09-21T08:08:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f26cc0b3570 con 0x55c2b95679f0 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 10 client.16602 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 20 client.16602 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b9588390 0x55c2b99e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 4 client.16602 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.121+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f26c40128e0 con 0x55c2b9588390 2024-09-21T08:08:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.122+0000 7f26d3fff640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b9588390 0x55c2b99e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.122+0000 7f26d3fff640 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b9588390 0x55c2b99e3f90 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a3377488905299 server_cookie=764ec63c0237c2f1 in_seq=0 out_seq=0 2024-09-21T08:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26c27fc640 10 client.16602 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26c27fc640 1 -- 172.21.15.6:0/3483140461 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x7f26c40128e0 con 0x55c2b9588390 2024-09-21T08:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26c27fc640 10 client.16602 handle_command_reply: tid=0 2024-09-21T08:08:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26e7c96740 1 client.16602 shutdown 2024-09-21T08:08:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 msgr2=0x55c2b9968c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.123+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9968c40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0ad890 tx=0x7f26cc0a9460 comp rx=0 tx=0).stop 2024-09-21T08:08:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 shutdown_connections 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c2b9588390 0x55c2b99e3f90 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c2b95801b0 0x55c2b9969180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2b959d460 0x55c2b99e0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 --2- 172.21.15.6:0/3483140461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c2b95679f0 0x55c2b9968c40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.125+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 >> 172.21.15.6:0/3483140461 conn(0x55c2b9976c60 msgr2=0x55c2b9965930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.127+0000 7f26c27fc640 0 client.16602 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.127+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 shutdown_connections 2024-09-21T08:08:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.127+0000 7f26e7c96740 1 -- 172.21.15.6:0/3483140461 wait complete. 2024-09-21T08:08:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.127+0000 7f26e7c96740 20 client.16602 trim_cache size 0 max 16384 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:08:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:08:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:46.137 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.128+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 msgr2=0x7f26c80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.128+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 0x7f26c80b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009a60 tx=0x7f26d4009890 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.128+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 msgr2=0x7f26dc19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.128+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ea60 tx=0x7f26cc00ef20 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 shutdown_connections 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26c80b6700 0x7f26c80b8c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26dc109e20 0x7f26dc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26dc1094d0 0x7f26dc19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 --2- 172.21.15.6:0/1678515901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc103b90 0x7f26dc19a370 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00ea60 tx=0x7f26cc00ef20 comp rx=0 tx=0).stop 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 >> 172.21.15.6:0/1678515901 conn(0x7f26dc0ff600 msgr2=0x7f26dc108b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.129+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 shutdown_connections 2024-09-21T08:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:46.130+0000 7f26e1722640 1 -- 172.21.15.6:0/1678515901 wait complete. 2024-09-21T08:08:46.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:46 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:08:46.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:46 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:08:46.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:46 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:08:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 350.0 s, 858.4 tps, lat 116.932 ms stddev 48.102 2024-09-21T08:08:47.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:47 smithi006 ceph-mon[30970]: pgmap v577: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-09-21T08:08:47.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:47 smithi119 ceph-mon[33564]: pgmap v577: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-09-21T08:08:47.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:47 smithi145 ceph-mon[34049]: pgmap v577: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-09-21T08:08:49.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:49 smithi145 ceph-mon[34049]: pgmap v578: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-21T08:08:49.712 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:49 smithi006 ceph-mon[30970]: pgmap v578: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-21T08:08:49.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:49 smithi119 ceph-mon[33564]: pgmap v578: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-21T08:08:49.948 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T08:08:49.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T08:08:51.594 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:08:51.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:08:51.684 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:51 smithi006 ceph-mon[30970]: pgmap v579: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 9.6 MiB/s wr, 837 op/s 2024-09-21T08:08:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:51 smithi145 ceph-mon[34049]: pgmap v579: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 9.6 MiB/s wr, 837 op/s 2024-09-21T08:08:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:51.709 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:51 smithi119 ceph-mon[33564]: pgmap v579: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 9.6 MiB/s wr, 837 op/s 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 -- 172.21.15.6:0/2892428001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c107c10 msgr2=0x7f800c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 --2- 172.21.15.6:0/2892428001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c107c10 0x7f800c101910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8000009900 tx=0x7f800002a420 comp rx=0 tx=0).stop 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 -- 172.21.15.6:0/2892428001 shutdown_connections 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 --2- 172.21.15.6:0/2892428001 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c101e50 0x7f800c102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 --2- 172.21.15.6:0/2892428001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c107c10 0x7f800c101910 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 --2- 172.21.15.6:0/2892428001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 0x7f800c1076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.340+0000 7f8010b9d640 1 -- 172.21.15.6:0/2892428001 >> 172.21.15.6:0/2892428001 conn(0x7f800c0776b0 msgr2=0x7f800c077b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.341+0000 7f8010b9d640 1 -- 172.21.15.6:0/2892428001 shutdown_connections 2024-09-21T08:08:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.346+0000 7f8010b9d640 1 -- 172.21.15.6:0/2892428001 wait complete. 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.347+0000 7f8010b9d640 1 Processor -- start 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.347+0000 7f8010b9d640 1 -- start start 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c101e50 0x7f800c075080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 0x7f800c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f800c119f90 con 0x7f800c101e50 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f800c119e10 con 0x7f800c1072c0 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.348+0000 7f8010b9d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f800c11a110 con 0x7f800c06e950 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.349+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.349+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:39398/0 (socket says 172.21.15.6:39398) 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.349+0000 7f800ad9d640 1 -- 172.21.15.6:0/713616622 learned_addr learned my addr 172.21.15.6:0/713616622 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.350+0000 7f800a59c640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c101e50 0x7f800c075080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.350+0000 7f8009d9b640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 0x7f800c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 -- 172.21.15.6:0/713616622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 msgr2=0x7f800c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 0x7f800c06e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 -- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c101e50 msgr2=0x7f800c075080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c101e50 0x7f800c075080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 -- 172.21.15.6:0/713616622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c074170 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f800ad9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f800400eaa0 tx=0x7f800400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.351+0000 7f7ffb7fe640 1 -- 172.21.15.6:0/713616622 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800400cdb0 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.352+0000 7f7ffb7fe640 1 -- 172.21.15.6:0/713616622 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8004005020 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.352+0000 7f7ffb7fe640 1 -- 172.21.15.6:0/713616622 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040116d0 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.352+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c074460 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.352+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c074920 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.357+0000 7f7ffb7fe640 1 -- 172.21.15.6:0/713616622 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f80040051d0 con 0x7f800c06e950 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.358+0000 7f8017111740 1 Processor -- start 2024-09-21T08:08:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.359+0000 7f7ffb7fe640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 0x7f7ff40b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.359+0000 7f8017111740 1 -- start start 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.359+0000 7f7ffb7fe640 1 -- 172.21.15.6:0/713616622 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f80040e7c80 con 0x7f800c06e950 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.359+0000 7f8017111740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d855850 0x55595dbfbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f8017111740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dbfc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f8017111740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f8017111740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55595db72bb0 con 0x55595d834b70 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f8017111740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55595db61fe0 con 0x55595d82c990 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f8017111740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55595db65df0 con 0x55595d855850 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46440/0 (socket says 172.21.15.6:46440) 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.360+0000 7f800ad9d640 1 -- 172.21.15.6:0/3871840528 learned_addr learned my addr 172.21.15.6:0/3871840528 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.361+0000 7f800ad9d640 1 -- 172.21.15.6:0/3871840528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d855850 msgr2=0x55595dbfbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.361+0000 7f800ad9d640 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d855850 0x55595dbfbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.361+0000 7f800ad9d640 1 -- 172.21.15.6:0/3871840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 msgr2=0x55595dbfc3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.361+0000 7f800ad9d640 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dbfc3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.361+0000 7f800ad9d640 1 -- 172.21.15.6:0/3871840528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595d8cfba0 con 0x55595d834b70 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.362+0000 7f800ad9d640 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f80040ad620 tx=0x7f80040a9e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2275a8e02b6e1765 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.362+0000 7f8009d9b640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 0x7f7ff40b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.364+0000 7f8009d9b640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 0x7f7ff40b8d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8000008000 tx=0x7f8000005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.364+0000 7f7ff8ff9640 1 -- 172.21.15.6:0/3871840528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800401f040 con 0x55595d834b70 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.364+0000 7f7ff8ff9640 1 -- 172.21.15.6:0/3871840528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80040b70b0 con 0x55595d834b70 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.364+0000 7f7ff8ff9640 1 -- 172.21.15.6:0/3871840528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040b6040 con 0x55595d834b70 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 -- 172.21.15.6:0/3871840528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 msgr2=0x55595dbfc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f80040ad620 tx=0x7f80040a9e10 comp rx=0 tx=0).stop 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 -- 172.21.15.6:0/3871840528 shutdown_connections 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dbfc8f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dbfc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 --2- 172.21.15.6:0/3871840528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d855850 0x55595dbfbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 -- 172.21.15.6:0/3871840528 >> 172.21.15.6:0/3871840528 conn(0x55595d849c40 msgr2=0x55595dbf9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.366+0000 7f8017111740 1 -- 172.21.15.6:0/3871840528 shutdown_connections 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.367+0000 7f8017111740 1 -- 172.21.15.6:0/3871840528 wait complete. 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.368+0000 7f8017111740 1 -- start start 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.368+0000 7f8017111740 1 Processor -- start 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dc07f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55595d9c37b0 con 0x55595d855850 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55595dafce90 con 0x55595d82c990 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55595dc0a590 con 0x55595d834b70 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f8017111740 10 client.0 _ll_register_callbacks cb 0x55595db5f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f800ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46448/0 (socket says 172.21.15.6:46448) 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.369+0000 7f800ad9d640 1 -- 172.21.15.6:0/2868112655 learned_addr learned my addr 172.21.15.6:0/2868112655 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 -- 172.21.15.6:0/2868112655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 msgr2=0x55595dc07f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dc07f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 -- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 msgr2=0x55595dc07a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc07a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 -- 172.21.15.6:0/2868112655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595dc13e70 con 0x55595d855850 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f80040aa900 tx=0x7f80040a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368d1f21fbba2115 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.370+0000 7f7ff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.371+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800401f040 con 0x55595d855850 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.371+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80040b70b0 con 0x55595d855850 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.371+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f80040b6040 con 0x55595d855850 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.371+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f80040c8050 con 0x55595d855850 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.373+0000 7f8017111740 10 client.16614 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.373+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55595dc16780 con 0x55595d855850 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.373+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80040b6280 con 0x55595d855850 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f80040c8ce0 con 0x55595d855850 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 10 client.16614 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 10 client.16614 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 20 client.16614 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d8141d0 0x55595dc19ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 4 client.16614 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.374+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f80040b70b0 con 0x55595d8141d0 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.375+0000 7f800a59c640 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d8141d0 0x55595dc19ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.378+0000 7f800a59c640 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d8141d0 0x55595dc19ae0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d161fcbfad1cf server_cookie=f60a62046f2c7150 in_seq=0 out_seq=0 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.378+0000 7f7ff1ffb640 10 client.16614 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.379+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/2868112655 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f80040b70b0 con 0x55595d8141d0 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.379+0000 7f7ff1ffb640 10 client.16614 handle_command_reply: tid=0 2024-09-21T08:08:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.380+0000 7f8017111740 1 client.16614 shutdown 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.380+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 msgr2=0x55595dc13880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.380+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f80040aa900 tx=0x7f80040a9900 comp rx=0 tx=0).stop 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.381+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 shutdown_connections 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.381+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d8141d0 0x55595dc19ae0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.381+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dc07f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.381+0000 7f7ff1ffb640 0 client.16614 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.382+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d855850 0x55595dc13880 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.382+0000 7f8017111740 1 --2- 172.21.15.6:0/2868112655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.382+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 >> 172.21.15.6:0/2868112655 conn(0x55595d849c40 msgr2=0x55595dbfcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.382+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 shutdown_connections 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.382+0000 7f8017111740 1 -- 172.21.15.6:0/2868112655 wait complete. 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.383+0000 7f8017111740 20 client.16614 trim_cache size 0 max 16384 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.417+0000 7f8017111740 1 Processor -- start 2024-09-21T08:08:52.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.417+0000 7f8017111740 1 -- start start 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f8017111740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 0x55595dbfd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f8017111740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d82c990 0x55595dc01f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f800a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 0x55595dbfd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f800a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 0x55595dbfd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53032/0 (socket says 172.21.15.6:53032) 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f800a59c640 1 -- 172.21.15.6:0/2565067570 learned_addr learned my addr 172.21.15.6:0/2565067570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f8017111740 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dbf96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.418+0000 7f8009d9b640 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d82c990 0x55595dc01f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1be3b0 con 0x55595d82c990 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1c0c10 con 0x55595d8141d0 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1bea00 con 0x55595d834b70 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dbf96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 -- 172.21.15.6:0/2565067570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 msgr2=0x55595dbfd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 0x55595dbfd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 -- 172.21.15.6:0/2565067570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d82c990 msgr2=0x55595dc01f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d82c990 0x55595dc01f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.419+0000 7f800ad9d640 1 -- 172.21.15.6:0/2565067570 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595dc08b00 con 0x55595d834b70 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.420+0000 7f800ad9d640 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dbf96a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80040a9c60 tx=0x7f80040e5520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8758031aa909cb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.420+0000 7f7ff3fff640 1 -- 172.21.15.6:0/2565067570 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040cc030 con 0x55595d834b70 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.421+0000 7f7ff3fff640 1 -- 172.21.15.6:0/2565067570 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80040b36b0 con 0x55595d834b70 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.421+0000 7f7ff3fff640 1 -- 172.21.15.6:0/2565067570 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800401f030 con 0x55595d834b70 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 msgr2=0x55595dbf96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dbf96a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80040a9c60 tx=0x7f80040e5520 comp rx=0 tx=0).stop 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 shutdown_connections 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d834b70 0x55595dbf96a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d82c990 0x55595dc01f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 --2- 172.21.15.6:0/2565067570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d8141d0 0x55595dbfd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.422+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 >> 172.21.15.6:0/2565067570 conn(0x55595d849c40 msgr2=0x55595dbfce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.423+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 shutdown_connections 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.423+0000 7f8017111740 1 -- 172.21.15.6:0/2565067570 wait complete. 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.423+0000 7f8017111740 1 -- start start 2024-09-21T08:08:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.424+0000 7f8017111740 1 Processor -- start 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.424+0000 7f8017111740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.424+0000 7f8017111740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc1b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f800a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f800a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:39442/0 (socket says 172.21.15.6:39442) 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8009d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc1b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8009d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc1b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53048/0 (socket says 172.21.15.6:53048) 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f800a59c640 1 -- 172.21.15.6:0/366511688 learned_addr learned my addr 172.21.15.6:0/366511688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dc1b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1bf0d0 con 0x55595d834b70 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1c0540 con 0x55595d82c990 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f800c1bf7a0 con 0x55595d8141d0 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.425+0000 7f800ad9d640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dc1b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 -- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 msgr2=0x55595dc1b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc1b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 -- 172.21.15.6:0/366511688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 msgr2=0x55595dc1b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dc1b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595dc83460 con 0x55595d8141d0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.426+0000 7f800a59c640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00be80 tx=0x7f7ffc004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3bcf5b5265d6ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.427+0000 7f8017111740 10 client.0 _ll_register_callbacks cb 0x7f80040ace90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.427+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55595db74b00 con 0x55595d8141d0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.427+0000 7f7ff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.427+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/366511688 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc011440 con 0x55595d8141d0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.427+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/366511688 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f7ffc0115e0 con 0x55595d8141d0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.428+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/366511688 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7ffc02c050 con 0x55595d8141d0 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.428+0000 7f8017111740 10 client.26350 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.428+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55595dc845d0 con 0x55595d8141d0 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.429+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/366511688 <== mon.1 v2:172.21.15.145:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7ffc0117e0 con 0x55595d8141d0 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.429+0000 7f8017111740 10 client.26350 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.429+0000 7f8017111740 10 client.26350 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.429+0000 7f8017111740 20 client.26350 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.429+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d855850 0x55595dc86c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.430+0000 7f8017111740 4 client.26350 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.430+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x55595db74b00 con 0x55595d855850 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.430+0000 7f8009d9b640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d855850 0x55595dc86c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.430+0000 7f8009d9b640 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d855850 0x55595dc86c70 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b0e9b62abc4d3c server_cookie=d7baab136183dbe9 in_seq=0 out_seq=0 2024-09-21T08:08:52.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.431+0000 7f7ff1ffb640 10 client.26350 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 355.0 s, 616.2 tps, lat 158.510 ms stddev 163.647 2024-09-21T08:08:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:08:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:08:52.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f7ff1ffb640 1 -- 172.21.15.6:0/366511688 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55595db74b00 con 0x55595d855850 2024-09-21T08:08:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f7ff1ffb640 10 client.26350 handle_command_reply: tid=0 2024-09-21T08:08:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 client.26350 shutdown 2024-09-21T08:08:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 msgr2=0x55595dc1ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00be80 tx=0x7f7ffc004410 comp rx=0 tx=0).stop 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 shutdown_connections 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55595d855850 0x55595dc86c70 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55595d834b70 0x55595dc1b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55595d82c990 0x55595dc1b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 --2- 172.21.15.6:0/366511688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55595d8141d0 0x55595dc1ad00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f7ff1ffb640 0 client.26350 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:52.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 >> 172.21.15.6:0/366511688 conn(0x55595d849c40 msgr2=0x55595dbf9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 shutdown_connections 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 1 -- 172.21.15.6:0/366511688 wait complete. 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.855+0000 7f8017111740 20 client.26350 trim_cache size 0 max 16384 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:08:52.859 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 30, 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "de742908": { 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 30, 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:08:52.860 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 141.1, 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:52.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:52.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:52.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:52.862 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 msgr2=0x7f7ff40b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 0x7f7ff40b8d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8000008000 tx=0x7f8000005fd0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 msgr2=0x7f800c073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f800400eaa0 tx=0x7f800400ef60 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 shutdown_connections 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7ff40b6800 0x7f7ff40b8d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f800c06e950 0x7f800c073c30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f800c1072c0 0x7f800c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 --2- 172.21.15.6:0/713616622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f800c101e50 0x7f800c075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 >> 172.21.15.6:0/713616622 conn(0x7f800c0776b0 msgr2=0x7f800c102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 shutdown_connections 2024-09-21T08:08:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:52.856+0000 7f8010b9d640 1 -- 172.21.15.6:0/713616622 wait complete. 2024-09-21T08:08:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:08:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:52.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.338+0000 7f8a024bd640 1 -- 172.21.15.6:0/628674294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1094a0 msgr2=0x7f89fc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.338+0000 7f8a024bd640 1 --2- 172.21.15.6:0/628674294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1094a0 0x7f89fc1098b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009900 tx=0x7f89f002a410 comp rx=0 tx=0).stop 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 -- 172.21.15.6:0/628674294 shutdown_connections 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 --2- 172.21.15.6:0/628674294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc109df0 0x7f89fc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 --2- 172.21.15.6:0/628674294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1094a0 0x7f89fc1098b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 --2- 172.21.15.6:0/628674294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc103b60 0x7f89fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 -- 172.21.15.6:0/628674294 >> 172.21.15.6:0/628674294 conn(0x7f89fc07b850 msgr2=0x7f89fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 -- 172.21.15.6:0/628674294 shutdown_connections 2024-09-21T08:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 -- 172.21.15.6:0/628674294 wait complete. 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 Processor -- start 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.339+0000 7f8a024bd640 1 -- start start 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc103b60 0x7f89fc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc1094a0 0x7f89fc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc113960 con 0x7f89fc109df0 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1137e0 con 0x7f89fc103b60 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a024bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc113ae0 con 0x7f89fc1094a0 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46474/0 (socket says 172.21.15.6:46474) 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 -- 172.21.15.6:0/3824435162 learned_addr learned my addr 172.21.15.6:0/3824435162 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc1094a0 0x7f89fc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:53.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc103b60 0x7f89fc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 -- 172.21.15.6:0/3824435162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc1094a0 msgr2=0x7f89fc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc1094a0 0x7f89fc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 -- 172.21.15.6:0/3824435162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc103b60 msgr2=0x7f89fc19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc103b60 0x7f89fc19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 -- 172.21.15.6:0/3824435162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc1a03a0 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.340+0000 7f8a00a5a640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f89f400cad0 tx=0x7f89f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.341+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400ae20 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.341+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89f4005020 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.341+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc1a0690 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.341+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400f6b0 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.341+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a6df0 con 0x7f89fc109df0 2024-09-21T08:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.342+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc103f70 con 0x7f89fc109df0 2024-09-21T08:08:53.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.344+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f89f40051d0 con 0x7f89fc109df0 2024-09-21T08:08:53.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.345+0000 7f89f97fa640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 0x7f89e40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:53.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.345+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 0x7f89e40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:53.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.345+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f89f40e7d30 con 0x7f89fc109df0 2024-09-21T08:08:53.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.345+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 0x7f89e40b8c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00bbe0 tx=0x7f89ec00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:53.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.348+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89f4014030 con 0x7f89fc109df0 2024-09-21T08:08:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.579+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89fc19b560 con 0x7f89fc109df0 2024-09-21T08:08:53.581 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: pgmap v580: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 8.8 MiB/s wr, 818 op/s 2024-09-21T08:08:53.581 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:08:53.581 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:08:53.581 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:08:53.582 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:08:53.582 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:08:53.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.580+0000 7f89f97fa640 1 -- 172.21.15.6:0/3824435162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f89f40b22a0 con 0x7f89fc109df0 2024-09-21T08:08:53.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:08:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:08:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.582+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 msgr2=0x7f89e40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.582+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 0x7f89e40b8c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00bbe0 tx=0x7f89ec00b390 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 msgr2=0x7f89fc19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f89f400cad0 tx=0x7f89f400cf90 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 shutdown_connections 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f89e40b6700 0x7f89e40b8c10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f89fc1094a0 0x7f89fc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc109df0 0x7f89fc19fc70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 --2- 172.21.15.6:0/3824435162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89fc103b60 0x7f89fc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 >> 172.21.15.6:0/3824435162 conn(0x7f89fc07b850 msgr2=0x7f89fc1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 shutdown_connections 2024-09-21T08:08:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:53.583+0000 7f8a024bd640 1 -- 172.21.15.6:0/3824435162 wait complete. 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: pgmap v580: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 8.8 MiB/s wr, 818 op/s 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:08:53.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: pgmap v580: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 8.8 MiB/s wr, 818 op/s 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:08:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:08:53.944 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'de742908', quiesce took 13.4 seconds. Will release after: 7.65 2024-09-21T08:08:54.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3824435162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:54.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:08:54.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3824435162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:54.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3824435162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 -- 172.21.15.6:0/3627684814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 msgr2=0x7f8e8c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 --2- 172.21.15.6:0/3627684814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c10f5a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009ca0 tx=0x7f8e8402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 -- 172.21.15.6:0/3627684814 shutdown_connections 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 --2- 172.21.15.6:0/3627684814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c10f5a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 --2- 172.21.15.6:0/3627684814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 0x7f8e8c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 --2- 172.21.15.6:0/3627684814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 0x7f8e8c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 -- 172.21.15.6:0/3627684814 >> 172.21.15.6:0/3627684814 conn(0x7f8e8c079770 msgr2=0x7f8e8c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 -- 172.21.15.6:0/3627684814 shutdown_connections 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 -- 172.21.15.6:0/3627684814 wait complete. 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.303+0000 7f8e923a1640 1 Processor -- start 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 -- start start 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 0x7f8e8c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 0x7f8e8c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c113a90 con 0x7f8e8c108d70 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c113910 con 0x7f8e8c108420 2024-09-21T08:08:55.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e923a1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c113c10 con 0x7f8e8c102ae0 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46496/0 (socket says 172.21.15.6:46496) 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 -- 172.21.15.6:0/1368452439 learned_addr learned my addr 172.21.15.6:0/1368452439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 0x7f8e8c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 0x7f8e8c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 -- 172.21.15.6:0/1368452439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 msgr2=0x7f8e8c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 0x7f8e8c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 -- 172.21.15.6:0/1368452439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 msgr2=0x7f8e8c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 0x7f8e8c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 -- 172.21.15.6:0/1368452439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c1a03d0 con 0x7f8e8c108d70 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.304+0000 7f8e9093e640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8e84005cc0 tx=0x7f8e84032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.305+0000 7f8e897fa640 1 -- 172.21.15.6:0/1368452439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84032e00 con 0x7f8e8c108d70 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.305+0000 7f8e897fa640 1 -- 172.21.15.6:0/1368452439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e840044d0 con 0x7f8e8c108d70 2024-09-21T08:08:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.305+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c1a0660 con 0x7f8e8c108d70 2024-09-21T08:08:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.305+0000 7f8e897fa640 1 -- 172.21.15.6:0/1368452439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84030b70 con 0x7f8e8c108d70 2024-09-21T08:08:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.305+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c1a6e20 con 0x7f8e8c108d70 2024-09-21T08:08:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.307+0000 7f8e98915740 1 Processor -- start 2024-09-21T08:08:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e897fa640 1 -- 172.21.15.6:0/1368452439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8e8404e440 con 0x7f8e8c108d70 2024-09-21T08:08:55.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 -- start start 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x56536436b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536436bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5653642e1ea0 con 0x565363f9b1b0 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653642d12d0 con 0x565363fc4070 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e98915740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5653642d50e0 con 0x565363fa3390 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46508/0 (socket says 172.21.15.6:46508) 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e8bfff640 1 -- 172.21.15.6:0/828520692 learned_addr learned my addr 172.21.15.6:0/828520692 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x56536436b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.308+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536436bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e897fa640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 0x7f8e780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 -- 172.21.15.6:0/828520692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 msgr2=0x56536436bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536436bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 -- 172.21.15.6:0/828520692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 msgr2=0x56536436b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x56536436b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 -- 172.21.15.6:0/828520692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536402f650 con 0x565363f9b1b0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536436bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e9093e640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 0x7f8e780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b820 tx=0x7f8e7c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40347d05eb273c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e897fa640 1 -- 172.21.15.6:0/1368452439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f8e84108e10 con 0x7f8e8c108d70 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e827fc640 1 -- 172.21.15.6:0/828520692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00d8f0 con 0x565363f9b1b0 2024-09-21T08:08:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e827fc640 1 -- 172.21.15.6:0/828520692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e7c019070 con 0x565363f9b1b0 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.309+0000 7f8e827fc640 1 -- 172.21.15.6:0/828520692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c014d20 con 0x565363f9b1b0 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 -- 172.21.15.6:0/828520692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 msgr2=0x56536436b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e9093e640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 0x7f8e780b8c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e840cbaf0 tx=0x7f8e8404a000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b820 tx=0x7f8e7c00bce0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 -- 172.21.15.6:0/828520692 shutdown_connections 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536436bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536436b800 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 --2- 172.21.15.6:0/828520692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x56536436b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 -- 172.21.15.6:0/828520692 >> 172.21.15.6:0/828520692 conn(0x565363fb8460 msgr2=0x5653643691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 -- 172.21.15.6:0/828520692 shutdown_connections 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.310+0000 7f8e98915740 1 -- 172.21.15.6:0/828520692 wait complete. 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 -- start start 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 Processor -- start 2024-09-21T08:08:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x565364387160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x565364132700 con 0x565363f9b1b0 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56536426c160 con 0x565363fc4070 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56536437de00 con 0x565363fa3390 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e98915740 10 client.0 _ll_register_callbacks cb 0x5653642859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46520/0 (socket says 172.21.15.6:46520) 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3963046602 learned_addr learned my addr 172.21.15.6:0/3963046602 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.311+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x565364387160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3963046602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 msgr2=0x56536437b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 msgr2=0x565364387160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x565364387160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3963046602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565364299c90 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8e740129b0 tx=0x7f8e74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3c81959dcfb6a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74011af0 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f8e74011c90 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e7c019070 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8e74004030 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e98915740 10 client.16638 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565364389b20 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.312+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e7c019070 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8e74003ce0 con 0x565363f9b1b0 2024-09-21T08:08:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 10 client.16638 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 20 client.16638 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363f829f0 0x56536438cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 4 client.16638 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653642e3df0 con 0x565363f829f0 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.313+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363f829f0 0x56536438cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e6b7fe640 10 client.16638 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363f829f0 0x56536438cf80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9b5fc622ec4dc31 server_cookie=29b48e47f300a6e4 in_seq=0 out_seq=0 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/3963046602 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653642e3df0 con 0x565363f829f0 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e6b7fe640 10 client.16638 handle_command_reply: tid=0 2024-09-21T08:08:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e98915740 1 client.16638 shutdown 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 msgr2=0x56536437ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8e740129b0 tx=0x7f8e74004730 comp rx=0 tx=0).stop 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 shutdown_connections 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.314+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363f829f0 0x56536438cf80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e6b7fe640 0 client.16638 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363fc4070 0x565364387160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 --2- 172.21.15.6:0/3963046602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437ad50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 >> 172.21.15.6:0/3963046602 conn(0x565363fb8460 msgr2=0x565364367750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 shutdown_connections 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 1 -- 172.21.15.6:0/3963046602 wait complete. 2024-09-21T08:08:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.315+0000 7f8e98915740 20 client.16638 trim_cache size 0 max 16384 2024-09-21T08:08:55.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 Processor -- start 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 -- start start 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f9b1b0 0x565364370460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x5653643709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1acd20 con 0x565363f829f0 2024-09-21T08:08:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1af580 con 0x565363f9b1b0 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.328+0000 7f8e98915740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1ad370 con 0x565363fa3390 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46524/0 (socket says 172.21.15.6:46524) 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3244585259 learned_addr learned my addr 172.21.15.6:0/3244585259 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f9b1b0 0x565364370460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3244585259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 msgr2=0x5653643709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x5653643709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3244585259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f9b1b0 msgr2=0x565364370460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f9b1b0 0x565364370460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 -- 172.21.15.6:0/3244585259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565364379250 con 0x565363f829f0 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c010 tx=0x7f8e74005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e799959989f68a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e81ffb640 1 -- 172.21.15.6:0/3244585259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74000e60 con 0x565363f829f0 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e81ffb640 1 -- 172.21.15.6:0/3244585259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e7400b390 con 0x565363f829f0 2024-09-21T08:08:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.329+0000 7f8e81ffb640 1 -- 172.21.15.6:0/3244585259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e740041d0 con 0x565363f829f0 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- 172.21.15.6:0/3244585259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 msgr2=0x56536437b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c010 tx=0x7f8e74005850 comp rx=0 tx=0).stop 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- 172.21.15.6:0/3244585259 shutdown_connections 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x5653643709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f9b1b0 0x565364370460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 --2- 172.21.15.6:0/3244585259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f829f0 0x56536437b210 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- 172.21.15.6:0/3244585259 >> 172.21.15.6:0/3244585259 conn(0x565363fb8460 msgr2=0x56536437ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- 172.21.15.6:0/3244585259 shutdown_connections 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- 172.21.15.6:0/3244585259 wait complete. 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.330+0000 7f8e98915740 1 -- start start 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 Processor -- start 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f829f0 0x56536437efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1ada40 con 0x565363f9b1b0 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1aeeb0 con 0x565363f829f0 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1ae110 con 0x565363fa3390 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e98915740 10 client.0 _ll_register_callbacks cb 0x7f8e740125f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46526/0 (socket says 172.21.15.6:46526) 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 -- 172.21.15.6:0/1560604451 learned_addr learned my addr 172.21.15.6:0/1560604451 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f829f0 0x56536437efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 -- 172.21.15.6:0/1560604451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 msgr2=0x56536437fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 -- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f829f0 msgr2=0x56536437efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f829f0 0x56536437efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8bfff640 1 -- 172.21.15.6:0/1560604451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653643f6940 con 0x565363f9b1b0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.331+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e8bfff640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c014510 tx=0x7f8e7c00d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb6a70e184a7fea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00db00 con 0x565363f9b1b0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e7400b390 con 0x565363f9b1b0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f8e7c00dca0 con 0x565363f9b1b0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8e7c036050 con 0x565363f9b1b0 2024-09-21T08:08:55.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e98915740 10 client.16644 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5653643f7ae0 con 0x565363f9b1b0 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.332+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e7400b390 con 0x565363f9b1b0 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8e7c013070 con 0x565363f9b1b0 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 10 client.16644 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 20 client.16644 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363fc4070 0x5653643fa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 4 client.16644 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653642df8a0 con 0x565363fc4070 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363fc4070 0x5653643fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e8b7fe640 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363fc4070 0x5653643fa070 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c530092097d3d3 server_cookie=df57eb058cb17752 in_seq=0 out_seq=0 2024-09-21T08:08:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e6b7fe640 10 client.16644 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e6b7fe640 1 -- 172.21.15.6:0/1560604451 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653642df8a0 con 0x565363fc4070 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e6b7fe640 10 client.16644 handle_command_reply: tid=0 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.333+0000 7f8e98915740 1 client.16644 shutdown 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 msgr2=0x56536437f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c014510 tx=0x7f8e7c00d5e0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 shutdown_connections 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565363fc4070 0x5653643fa070 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565363fa3390 0x56536437fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565363f9b1b0 0x56536437f500 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 --2- 172.21.15.6:0/1560604451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565363f829f0 0x56536437efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 >> 172.21.15.6:0/1560604451 conn(0x565363fb8460 msgr2=0x56536437c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e6b7fe640 0 client.16644 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 shutdown_connections 2024-09-21T08:08:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 1 -- 172.21.15.6:0/1560604451 wait complete. 2024-09-21T08:08:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e98915740 20 client.16644 trim_cache size 0 max 16384 2024-09-21T08:08:55.344 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:08:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 msgr2=0x7f8e780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.334+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 0x7f8e780b8c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e840cbaf0 tx=0x7f8e8404a000 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 msgr2=0x7f8e8c19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8e84005cc0 tx=0x7f8e84032a10 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 shutdown_connections 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8e780b6700 0x7f8e780b8c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e8c108d70 0x7f8e8c19fca0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e8c108420 0x7f8e8c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 --2- 172.21.15.6:0/1368452439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c102ae0 0x7f8e8c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 >> 172.21.15.6:0/1368452439 conn(0x7f8e8c079770 msgr2=0x7f8e8c106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 shutdown_connections 2024-09-21T08:08:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:55.335+0000 7f8e923a1640 1 -- 172.21.15.6:0/1368452439 wait complete. 2024-09-21T08:08:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:55 smithi006 ceph-mon[30970]: pgmap v581: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-09-21T08:08:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:55 smithi145 ceph-mon[34049]: pgmap v581: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-09-21T08:08:55.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:55 smithi119 ceph-mon[33564]: pgmap v581: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-09-21T08:08:57.220 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:08:57.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:08:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:57.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 360.0 s, 8.8 tps, lat 75.705 ms stddev 60.315 2024-09-21T08:08:57.615 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:57 smithi006 ceph-mon[30970]: pgmap v582: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-09-21T08:08:57.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:57 smithi145 ceph-mon[34049]: pgmap v582: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-09-21T08:08:57.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:57 smithi119 ceph-mon[33564]: pgmap v582: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-09-21T08:08:58.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 -- 172.21.15.6:0/2323436738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 msgr2=0x7f70f81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/2323436738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f81087b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009900 tx=0x7f70ec02a410 comp rx=0 tx=0).stop 2024-09-21T08:08:58.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 -- 172.21.15.6:0/2323436738 shutdown_connections 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/2323436738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/2323436738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f81087b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/2323436738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 -- 172.21.15.6:0/2323436738 >> 172.21.15.6:0/2323436738 conn(0x7f70f8079730 msgr2=0x7f70f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 -- 172.21.15.6:0/2323436738 shutdown_connections 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.305+0000 7f70ffd8a640 1 -- 172.21.15.6:0/2323436738 wait complete. 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 Processor -- start 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 -- start start 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112810 con 0x7f70f81083a0 2024-09-21T08:08:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112690 con 0x7f70f8108cf0 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.306+0000 7f70ffd8a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112990 con 0x7f70f8102a60 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41222/0 (socket says 172.21.15.6:41222) 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 -- 172.21.15.6:0/3756917503 learned_addr learned my addr 172.21.15.6:0/3756917503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fe327640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 -- 172.21.15.6:0/3756917503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 msgr2=0x7f70f819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 -- 172.21.15.6:0/3756917503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 msgr2=0x7f70f819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 -- 172.21.15.6:0/3756917503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f81a0280 con 0x7f70f81083a0 2024-09-21T08:08:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fe327640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70fd325640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005940 tx=0x7f70ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70eaffd640 1 -- 172.21.15.6:0/3756917503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec03f030 con 0x7f70f81083a0 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70eaffd640 1 -- 172.21.15.6:0/3756917503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70ec003c90 con 0x7f70f81083a0 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81a0510 con 0x7f70f81083a0 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70eaffd640 1 -- 172.21.15.6:0/3756917503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec035070 con 0x7f70f81083a0 2024-09-21T08:08:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.307+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a09f0 con 0x7f70f81083a0 2024-09-21T08:08:58.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 Processor -- start 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 -- start start 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3889970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3889eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560c37ffe60 con 0x5560c34e2350 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5560c37ef290 con 0x5560c34c1670 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f71062fe740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5560c37f30a0 con 0x5560c34b9490 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f70eaffd640 1 -- 172.21.15.6:0/3756917503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f70ec042030 con 0x7f70f81083a0 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f70fe327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f70fe327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41230/0 (socket says 172.21.15.6:41230) 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f70fe327640 1 -- 172.21.15.6:0/1637799328 learned_addr learned my addr 172.21.15.6:0/1637799328 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.311+0000 7f70fdb26640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3889970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fd325640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3889eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 -- 172.21.15.6:0/1637799328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 msgr2=0x5560c3889970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3889970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 -- 172.21.15.6:0/1637799328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 msgr2=0x5560c3889eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3889eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 -- 172.21.15.6:0/1637799328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c354d930 con 0x5560c34e2350 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fd325640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3889eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70fe327640 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f70f0008e60 tx=0x7f70f000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be9bbca0cab0173 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70e3fff640 1 -- 172.21.15.6:0/1637799328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f000f830 con 0x5560c34e2350 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70e3fff640 1 -- 172.21.15.6:0/1637799328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70f0018480 con 0x5560c34e2350 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.312+0000 7f70e3fff640 1 -- 172.21.15.6:0/1637799328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f000fe60 con 0x5560c34e2350 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f70eaffd640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 0x7f70e40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 0x7f70e40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f70eaffd640 1 -- 172.21.15.6:0/3756917503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f70ec108110 con 0x7f70f81083a0 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f71062fe740 1 -- 172.21.15.6:0/1637799328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 msgr2=0x5560c3889430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 0x7f70e40b8bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5560c38880b0 tx=0x7f70f400b5a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.313+0000 7f71062fe740 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f70f0008e60 tx=0x7f70f000d710 comp rx=0 tx=0).stop 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 -- 172.21.15.6:0/1637799328 shutdown_connections 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3889970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3889eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 --2- 172.21.15.6:0/1637799328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34e2350 0x5560c3889430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 -- 172.21.15.6:0/1637799328 >> 172.21.15.6:0/1637799328 conn(0x5560c34d6740 msgr2=0x5560c3887320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 -- 172.21.15.6:0/1637799328 shutdown_connections 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 -- 172.21.15.6:0/1637799328 wait complete. 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 -- start start 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.314+0000 7f71062fe740 1 Processor -- start 2024-09-21T08:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3895670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34e2350 0x5560c38a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560c3650890 con 0x5560c34b9490 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5560c3789d40 con 0x5560c34c1670 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5560c3897c10 con 0x5560c34e2350 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f71062fe740 10 client.0 _ll_register_callbacks cb 0x5560c37edc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41232/0 (socket says 172.21.15.6:41232) 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fd325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3895670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 -- 172.21.15.6:0/3414862079 learned_addr learned my addr 172.21.15.6:0/3414862079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fe327640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34e2350 0x5560c38a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 -- 172.21.15.6:0/3414862079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34e2350 msgr2=0x5560c38a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34e2350 0x5560c38a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 -- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 msgr2=0x5560c3895670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3895670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 -- 172.21.15.6:0/3414862079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c38a15a0 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70fdb26640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bfd0 tx=0x7f70f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c736aed094c969 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.315+0000 7f70e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f400fac0 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f70f400fc60 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f0018480 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f70f4030050 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 10 client.16656 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560c38a3e80 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70f0018480 con 0x5560c34b9490 2024-09-21T08:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f70f401f3f0 con 0x5560c34b9490 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 10 client.16656 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 20 client.16656 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34a0cd0 0x5560c38a7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 4 client.16656 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.316+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c3801db0 con 0x5560c34a0cd0 2024-09-21T08:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.317+0000 7f70fd325640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34a0cd0 0x5560c38a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.317+0000 7f70fd325640 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34a0cd0 0x5560c38a7390 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d204b1991c400924 server_cookie=63c2ad4bf4f5aa8b in_seq=0 out_seq=0 2024-09-21T08:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.317+0000 7f70e17fa640 10 client.16656 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f70e17fa640 1 -- 172.21.15.6:0/3414862079 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560c3801db0 con 0x5560c34a0cd0 2024-09-21T08:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f70e17fa640 10 client.16656 handle_command_reply: tid=0 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 client.16656 shutdown 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 msgr2=0x5560c38950b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bfd0 tx=0x7f70f40046c0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 shutdown_connections 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34a0cd0 0x5560c38a7390 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34e2350 0x5560c38a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3895670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f70e17fa640 0 client.16656 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 --2- 172.21.15.6:0/3414862079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34b9490 0x5560c38950b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.318+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 >> 172.21.15.6:0/3414862079 conn(0x5560c34d6740 msgr2=0x5560c388c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.319+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 shutdown_connections 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.319+0000 7f71062fe740 1 -- 172.21.15.6:0/3414862079 wait complete. 2024-09-21T08:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.319+0000 7f71062fe740 20 client.16656 trim_cache size 0 max 16384 2024-09-21T08:08:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 Processor -- start 2024-09-21T08:08:58.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 -- start start 2024-09-21T08:08:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34a0cd0 0x5560c388e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34b9490 0x5560c388ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81aee90 con 0x5560c34c1670 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81b16f0 con 0x5560c34b9490 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f71062fe740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81af4e0 con 0x5560c34a0cd0 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f70fe327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f70fe327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41240/0 (socket says 172.21.15.6:41240) 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f70fe327640 1 -- 172.21.15.6:0/2025475158 learned_addr learned my addr 172.21.15.6:0/2025475158 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f70fdb26640 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34a0cd0 0x5560c388e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.337+0000 7f70fd325640 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34b9490 0x5560c388ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 -- 172.21.15.6:0/2025475158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34a0cd0 msgr2=0x5560c388e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34a0cd0 0x5560c388e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 -- 172.21.15.6:0/2025475158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34b9490 msgr2=0x5560c388ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34b9490 0x5560c388ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 -- 172.21.15.6:0/2025475158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c388c290 con 0x5560c34c1670 2024-09-21T08:08:58.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70fe327640 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f70f0008e30 tx=0x7f70f0008b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f605de8f1e9950d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70e37fe640 1 -- 172.21.15.6:0/2025475158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0004c00 con 0x5560c34c1670 2024-09-21T08:08:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70e37fe640 1 -- 172.21.15.6:0/2025475158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70f0028070 con 0x5560c34c1670 2024-09-21T08:08:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.338+0000 7f70e37fe640 1 -- 172.21.15.6:0/2025475158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f000f960 con 0x5560c34c1670 2024-09-21T08:08:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- 172.21.15.6:0/2025475158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 msgr2=0x5560c388c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f70f0008e30 tx=0x7f70f0008b00 comp rx=0 tx=0).stop 2024-09-21T08:08:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- 172.21.15.6:0/2025475158 shutdown_connections 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34c1670 0x5560c388c530 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34b9490 0x5560c388ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 --2- 172.21.15.6:0/2025475158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34a0cd0 0x5560c388e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- 172.21.15.6:0/2025475158 >> 172.21.15.6:0/2025475158 conn(0x5560c34d6740 msgr2=0x5560c3893730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- 172.21.15.6:0/2025475158 shutdown_connections 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- 172.21.15.6:0/2025475158 wait complete. 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 -- start start 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.339+0000 7f71062fe740 1 Processor -- start 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3899b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3910d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81afbb0 con 0x5560c34a0cd0 2024-09-21T08:08:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81b1020 con 0x5560c34c1670 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81b0280 con 0x5560c34b9490 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f71062fe740 10 client.0 _ll_register_callbacks cb 0x7f70f400b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41254/0 (socket says 172.21.15.6:41254) 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 -- 172.21.15.6:0/1723511558 learned_addr learned my addr 172.21.15.6:0/1723511558 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fd325640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3899b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fe327640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3910d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 -- 172.21.15.6:0/1723511558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 msgr2=0x5560c3899b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3899b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 -- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 msgr2=0x5560c3910d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3910d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 -- 172.21.15.6:0/1723511558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c3911310 con 0x5560c34a0cd0 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fe327640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3910d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:08:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70fdb26640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b910 tx=0x7f70f401f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92148e953eea191a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.340+0000 7f70e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f402d040 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f70f4005030 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f0028070 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f70f4005230 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 10 client.16662 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560c3912660 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70f0028070 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f70f4004730 con 0x5560c34a0cd0 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 10 client.16662 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 10 client.16662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 20 client.16662 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34e2350 0x5560c3914e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 4 client.16662 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:08:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.341+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560c37fd860 con 0x5560c34e2350 2024-09-21T08:08:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.342+0000 7f70fd325640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34e2350 0x5560c3914e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.342+0000 7f70fd325640 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34e2350 0x5560c3914e50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcfbce55fb65cb6 server_cookie=baf44e8b0ed2a223 in_seq=0 out_seq=0 2024-09-21T08:08:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.342+0000 7f70e17fa640 10 client.16662 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f70e17fa640 1 -- 172.21.15.6:0/1723511558 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560c37fd860 con 0x5560c34e2350 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f70e17fa640 10 client.16662 handle_command_reply: tid=0 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 client.16662 shutdown 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 msgr2=0x5560c3899620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b910 tx=0x7f70f401f6a0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 shutdown_connections 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5560c34e2350 0x5560c3914e50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5560c34b9490 0x5560c3899b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5560c34c1670 0x5560c3910d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f70e17fa640 0 client.16662 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 --2- 172.21.15.6:0/1723511558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c34a0cd0 0x5560c3899620 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 >> 172.21.15.6:0/1723511558 conn(0x5560c34d6740 msgr2=0x5560c388c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 shutdown_connections 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.344+0000 7f71062fe740 1 -- 172.21.15.6:0/1723511558 wait complete. 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f71062fe740 20 client.16662 trim_cache size 0 max 16384 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "b7b6e0b5-1750-4a0c-bbcf-649873246a98", 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:08:58.349 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 msgr2=0x7f70e40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 0x7f70e40b8bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5560c38880b0 tx=0x7f70f400b5a0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 msgr2=0x7f70f819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005940 tx=0x7f70ec0042f0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 shutdown_connections 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f70e40b66b0 0x7f70e40b8bc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f8108cf0 0x7f70f819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81083a0 0x7f70f819a970 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 --2- 172.21.15.6:0/3756917503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70f8102a60 0x7f70f819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 >> 172.21.15.6:0/3756917503 conn(0x7f70f8079730 msgr2=0x7f70f806b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 shutdown_connections 2024-09-21T08:08:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:58.345+0000 7f70ffd8a640 1 -- 172.21.15.6:0/3756917503 wait complete. 2024-09-21T08:08:59.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:08:59.399 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:08:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:59 smithi145 ceph-mon[34049]: pgmap v583: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-09-21T08:08:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:59 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:08:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:59 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:59 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:08:59.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:08:59 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:59 smithi006 ceph-mon[30970]: pgmap v583: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-09-21T08:08:59.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:59 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:08:59.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:59 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:59 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:08:59.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:08:59 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 -- 172.21.15.6:0/3706303246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 msgr2=0x7f32801087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 --2- 172.21.15.6:0/3706303246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f32801087b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3274009900 tx=0x7f327402a410 comp rx=0 tx=0).stop 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 -- 172.21.15.6:0/3706303246 shutdown_connections 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 --2- 172.21.15.6:0/3706303246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 0x7f328010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 --2- 172.21.15.6:0/3706303246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f32801087b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 --2- 172.21.15.6:0/3706303246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f3280102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 -- 172.21.15.6:0/3706303246 >> 172.21.15.6:0/3706303246 conn(0x7f3280079730 msgr2=0x7f3280079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 -- 172.21.15.6:0/3706303246 shutdown_connections 2024-09-21T08:08:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.866+0000 7f3285112640 1 -- 172.21.15.6:0/3706303246 wait complete. 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 Processor -- start 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 -- start start 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f328019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 0x7f328019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3280113930 con 0x7f32801083a0 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32801137b0 con 0x7f3280102a60 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f3285112640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3280113ab0 con 0x7f3280108cf0 2024-09-21T08:08:59.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f327e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f327e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41274/0 (socket says 172.21.15.6:41274) 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f327e59c640 1 -- 172.21.15.6:0/599284582 learned_addr learned my addr 172.21.15.6:0/599284582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.867+0000 7f327ed9d640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f328019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327f59e640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 0x7f328019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 -- 172.21.15.6:0/599284582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 msgr2=0x7f328019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 0x7f328019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 -- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 msgr2=0x7f328019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 -- 172.21.15.6:0/599284582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32801a0330 con 0x7f3280102a60 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327e59c640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f327ed9d640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f328019a3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9f0 tx=0x7f327000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f3267fff640 1 -- 172.21.15.6:0/599284582 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327000ccc0 con 0x7f3280102a60 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f3267fff640 1 -- 172.21.15.6:0/599284582 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32700108c0 con 0x7f3280102a60 2024-09-21T08:08:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32801a0620 con 0x7f3280102a60 2024-09-21T08:08:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f3267fff640 1 -- 172.21.15.6:0/599284582 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700187e0 con 0x7f3280102a60 2024-09-21T08:08:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.868+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a6d80 con 0x7f3280102a60 2024-09-21T08:08:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.871+0000 7f3267fff640 1 -- 172.21.15.6:0/599284582 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3270010430 con 0x7f3280102a60 2024-09-21T08:08:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.871+0000 7f328b686740 1 Processor -- start 2024-09-21T08:08:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.871+0000 7f328b686740 1 -- start start 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8f1070 0x55702dc98270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dc98cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55702dc0ee50 con 0x55702d8c81b0 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55702dbfe280 con 0x55702d8f1070 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f328b686740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55702dc02090 con 0x55702d8d0390 2024-09-21T08:08:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41286/0 (socket says 172.21.15.6:41286) 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 -- 172.21.15.6:0/2832522196 learned_addr learned my addr 172.21.15.6:0/2832522196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8f1070 0x55702dc98270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327e59c640 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dc98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f3267fff640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 0x7f32680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 -- 172.21.15.6:0/2832522196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 msgr2=0x55702dc98cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dc98cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 -- 172.21.15.6:0/2832522196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8f1070 msgr2=0x55702dc98270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8f1070 0x55702dc98270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327ed9d640 1 -- 172.21.15.6:0/2832522196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55702d95c650 con 0x55702d8c81b0 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.872+0000 7f327f59e640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 0x7f32680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f3267fff640 1 -- 172.21.15.6:0/599284582 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f32700e7df0 con 0x7f3280102a60 2024-09-21T08:08:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f32700e50d0 tx=0x7f32700adb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0881b9aad7bd305 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f32657fa640 1 -- 172.21.15.6:0/2832522196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270026030 con 0x55702d8c81b0 2024-09-21T08:08:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f32657fa640 1 -- 172.21.15.6:0/2832522196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32700b25a0 con 0x55702d8c81b0 2024-09-21T08:08:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f32657fa640 1 -- 172.21.15.6:0/2832522196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700ad080 con 0x55702d8c81b0 2024-09-21T08:08:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.873+0000 7f327f59e640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 0x7f32680b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3278005fd0 tx=0x7f3278004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 -- 172.21.15.6:0/2832522196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 msgr2=0x55702dc987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f32700e50d0 tx=0x7f32700adb00 comp rx=0 tx=0).stop 2024-09-21T08:08:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 -- 172.21.15.6:0/2832522196 shutdown_connections 2024-09-21T08:08:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dc98cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dc987b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 --2- 172.21.15.6:0/2832522196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8f1070 0x55702dc98270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 -- 172.21.15.6:0/2832522196 >> 172.21.15.6:0/2832522196 conn(0x55702d8e5460 msgr2=0x55702dc96160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 -- 172.21.15.6:0/2832522196 shutdown_connections 2024-09-21T08:08:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.874+0000 7f328b686740 1 -- 172.21.15.6:0/2832522196 wait complete. 2024-09-21T08:08:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 -- start start 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 Processor -- start 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8c81b0 0x55702dca3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dca3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55702da5f700 con 0x55702d8f1070 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55702db99110 con 0x55702d8c81b0 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55702dca6a50 con 0x55702d8d0390 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f328b686740 10 client.0 _ll_register_callbacks cb 0x55702dbb2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f327f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f327f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41300/0 (socket says 172.21.15.6:41300) 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f327f59e640 1 -- 172.21.15.6:0/4245811055 learned_addr learned my addr 172.21.15.6:0/4245811055 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f327ed9d640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8c81b0 0x55702dca3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.875+0000 7f327e59c640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dca3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 -- 172.21.15.6:0/4245811055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 msgr2=0x55702dca3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dca3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 -- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8c81b0 msgr2=0x55702dca3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8c81b0 0x55702dca3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 -- 172.21.15.6:0/4245811055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55702dbc6c40 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f327f59e640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f32780042f0 tx=0x7f3278004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bc48718982d79c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f3262ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278011bc0 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f3278011d60 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55702dc10da0 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3278034050 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f328b686740 10 client.16674 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.876+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55702dcb26f0 con 0x55702d8f1070 2024-09-21T08:08:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55702dc10da0 con 0x55702d8f1070 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3278022420 con 0x55702d8f1070 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 10 client.16674 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 20 client.16674 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d8af9f0 0x55702dcb5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 4 client.16674 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55702dc0c850 con 0x55702d8af9f0 2024-09-21T08:08:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.877+0000 7f327ed9d640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d8af9f0 0x55702dcb5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f3262ff5640 10 client.16674 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f327ed9d640 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d8af9f0 0x55702dcb5c50 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96de19874348ae8 server_cookie=735b2bdd7fcec519 in_seq=0 out_seq=0 2024-09-21T08:08:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f3262ff5640 1 -- 172.21.15.6:0/4245811055 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55702dc0c850 con 0x55702d8af9f0 2024-09-21T08:08:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f3262ff5640 10 client.16674 handle_command_reply: tid=0 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f328b686740 1 client.16674 shutdown 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 msgr2=0x55702dca4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.878+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f32780042f0 tx=0x7f3278004ab0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 shutdown_connections 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d8af9f0 0x55702dcb5c50 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8d0390 0x55702dca3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8f1070 0x55702dca4310 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f3262ff5640 0 client.16674 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 --2- 172.21.15.6:0/4245811055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8c81b0 0x55702dca3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 >> 172.21.15.6:0/4245811055 conn(0x55702d8e5460 msgr2=0x55702dc9b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 shutdown_connections 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 1 -- 172.21.15.6:0/4245811055 wait complete. 2024-09-21T08:08:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.879+0000 7f328b686740 20 client.16674 trim_cache size 0 max 16384 2024-09-21T08:08:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.896+0000 7f328b686740 1 Processor -- start 2024-09-21T08:08:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.896+0000 7f328b686740 1 -- start start 2024-09-21T08:08:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32801accc0 con 0x55702d8c81b0 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32801af520 con 0x55702d8d0390 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f328b686740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ad310 con 0x55702d8f1070 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41312/0 (socket says 172.21.15.6:41312) 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 -- 172.21.15.6:0/2368296063 learned_addr learned my addr 172.21.15.6:0/2368296063 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327e59c640 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327f59e640 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 -- 172.21.15.6:0/2368296063 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 msgr2=0x55702dca0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 -- 172.21.15.6:0/2368296063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 msgr2=0x55702dca0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 -- 172.21.15.6:0/2368296063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55702dca5c60 con 0x55702d8c81b0 2024-09-21T08:08:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f327ed9d640 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f32700e5210 tx=0x7f327000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79b141e6e233c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.897+0000 7f3264ff9640 1 -- 172.21.15.6:0/2368296063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270010720 con 0x55702d8c81b0 2024-09-21T08:08:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f3264ff9640 1 -- 172.21.15.6:0/2368296063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32700ad420 con 0x55702d8c81b0 2024-09-21T08:08:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f3264ff9640 1 -- 172.21.15.6:0/2368296063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b2340 con 0x55702d8c81b0 2024-09-21T08:08:59.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:59 smithi119 ceph-mon[33564]: pgmap v583: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.4 MiB/s wr, 603 op/s 2024-09-21T08:08:59.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:59 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:08:59.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:59 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:59 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:08:59.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:08:59 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 -- 172.21.15.6:0/2368296063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 msgr2=0x55702dca4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f32700e5210 tx=0x7f327000ce60 comp rx=0 tx=0).stop 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 -- 172.21.15.6:0/2368296063 shutdown_connections 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 --2- 172.21.15.6:0/2368296063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca4db0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 -- 172.21.15.6:0/2368296063 >> 172.21.15.6:0/2368296063 conn(0x55702d8e5460 msgr2=0x55702dc99c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 -- 172.21.15.6:0/2368296063 shutdown_connections 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.898+0000 7f328b686740 1 -- 172.21.15.6:0/2368296063 wait complete. 2024-09-21T08:08:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 -- start start 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 Processor -- start 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ad9e0 con 0x55702d8c81b0 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32801aee50 con 0x55702d8d0390 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ae0b0 con 0x55702d8f1070 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f328b686740 10 client.0 _ll_register_callbacks cb 0x7f3278009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f327ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41318/0 (socket says 172.21.15.6:41318) 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f327ed9d640 1 -- 172.21.15.6:0/3011338747 learned_addr learned my addr 172.21.15.6:0/3011338747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:08:59.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.899+0000 7f327e59c640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327f59e640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 -- 172.21.15.6:0/3011338747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 msgr2=0x55702dca86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 -- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 msgr2=0x55702dca81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 -- 172.21.15.6:0/3011338747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55702dd1f610 con 0x55702d8c81b0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f327ed9d640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9c0 tx=0x7f32700ad360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5d93037347ab56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f3262ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b2e70 con 0x55702d8c81b0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f32700a9b80 con 0x55702d8c81b0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32700ad420 con 0x55702d8c81b0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32700b34d0 con 0x55702d8c81b0 2024-09-21T08:08:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f328b686740 10 client.16680 fetch_fsmap learned FSMap version 21 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55702dd20800 con 0x55702d8c81b0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.900+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32700ad420 con 0x55702d8c81b0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f32700b3670 con 0x55702d8c81b0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 10 client.16680 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 20 client.16680 populate_metadata read hostname 'smithi006' 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d884da0 0x55702dd22ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 4 client.16680 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55702dc09c80 con 0x55702d884da0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f327e59c640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d884da0 0x55702dd22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f327e59c640 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d884da0 0x55702dd22ae0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7918216d5a16769c server_cookie=e3fea550b637b6c5 in_seq=0 out_seq=0 2024-09-21T08:08:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.901+0000 7f3262ff5640 10 client.16680 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f3262ff5640 1 -- 172.21.15.6:0/3011338747 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55702dc09c80 con 0x55702d884da0 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f3262ff5640 10 client.16680 handle_command_reply: tid=0 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 client.16680 shutdown 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 msgr2=0x55702dca7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9c0 tx=0x7f32700ad360 comp rx=0 tx=0).stop 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 shutdown_connections 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55702d884da0 0x55702dd22ae0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55702d8f1070 0x55702dca86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55702d8d0390 0x55702dca81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f3262ff5640 0 client.16680 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 --2- 172.21.15.6:0/3011338747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55702d8c81b0 0x55702dca7c60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 >> 172.21.15.6:0/3011338747 conn(0x55702d8e5460 msgr2=0x55702dc992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 shutdown_connections 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 1 -- 172.21.15.6:0/3011338747 wait complete. 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.902+0000 7f328b686740 20 client.16680 trim_cache size 0 max 16384 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "b7b6e0b5-1750-4a0c-bbcf-649873246a98", 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:08:59.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.964 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:08:59.965 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.966 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.967 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:08:59.968 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:08:59.970 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 msgr2=0x7f32680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 0x7f32680b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3278005fd0 tx=0x7f3278004a40 comp rx=0 tx=0).stop 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 msgr2=0x7f328019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f328019a3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9f0 tx=0x7f327000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 shutdown_connections 2024-09-21T08:08:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f32680b6680 0x7f32680b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3280108cf0 0x7f328019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32801083a0 0x7f328019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 --2- 172.21.15.6:0/599284582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3280102a60 0x7f328019a3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 >> 172.21.15.6:0/599284582 conn(0x7f3280079730 msgr2=0x7f32801044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 shutdown_connections 2024-09-21T08:08:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:08:59.903+0000 7f3285112640 1 -- 172.21.15.6:0/599284582 wait complete. 2024-09-21T08:09:00.815 INFO:tasks.cephfs.filesystem:scrub status for tag:b7b6e0b5-1750-4a0c-bbcf-649873246a98 - {'path': '/', 'tag': 'b7b6e0b5-1750-4a0c-bbcf-649873246a98', 'options': 'recursive,force'} 2024-09-21T08:09:01.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:09:01.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:01 smithi145 ceph-mon[34049]: pgmap v584: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-21T08:09:01.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:01 smithi006 ceph-mon[30970]: pgmap v584: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-21T08:09:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:01 smithi119 ceph-mon[33564]: pgmap v584: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-21T08:09:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.339+0000 7f3e57080640 1 -- 172.21.15.6:0/3088189762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50105290 msgr2=0x7f3e5010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.339+0000 7f3e57080640 1 --2- 172.21.15.6:0/3088189762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50105290 0x7f3e5010d8d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009900 tx=0x7f3e4402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 -- 172.21.15.6:0/3088189762 shutdown_connections 2024-09-21T08:09:02.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 --2- 172.21.15.6:0/3088189762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e5010de10 0x7f3e50110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 --2- 172.21.15.6:0/3088189762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50105290 0x7f3e5010d8d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 --2- 172.21.15.6:0/3088189762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e50104860 0x7f3e50104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 -- 172.21.15.6:0/3088189762 >> 172.21.15.6:0/3088189762 conn(0x7f3e50079740 msgr2=0x7f3e50079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 -- 172.21.15.6:0/3088189762 shutdown_connections 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 -- 172.21.15.6:0/3088189762 wait complete. 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 Processor -- start 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.340+0000 7f3e57080640 1 -- start start 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50105290 0x7f3e5019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e5010de10 0x7f3e501a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e50113940 con 0x7f3e50104860 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e501137c0 con 0x7f3e5010de10 2024-09-21T08:09:02.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e57080640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e50113ac0 con 0x7f3e50105290 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41328/0 (socket says 172.21.15.6:41328) 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 -- 172.21.15.6:0/55250084 learned_addr learned my addr 172.21.15.6:0/55250084 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e5561d640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e5010de10 0x7f3e501a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e4ffff640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50105290 0x7f3e5019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 -- 172.21.15.6:0/55250084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50105290 msgr2=0x7f3e5019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50105290 0x7f3e5019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 -- 172.21.15.6:0/55250084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e5010de10 msgr2=0x7f3e501a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e5010de10 0x7f3e501a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 -- 172.21.15.6:0/55250084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e501a24a0 con 0x7f3e50104860 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.341+0000 7f3e54e1c640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000c970 tx=0x7f3e4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.342+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007c10 con 0x7f3e50104860 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.342+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e40007db0 con 0x7f3e50104860 2024-09-21T08:09:02.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.342+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501a2790 con 0x7f3e50104860 2024-09-21T08:09:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.342+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4000f7d0 con 0x7f3e50104860 2024-09-21T08:09:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.342+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501a8fb0 con 0x7f3e50104860 2024-09-21T08:09:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.343+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5006c1e0 con 0x7f3e50104860 2024-09-21T08:09:02.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.345+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3e40018480 con 0x7f3e50104860 2024-09-21T08:09:02.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.345+0000 7f3e4dffb640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 0x7f3e380b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:02.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.346+0000 7f3e4ffff640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 0x7f3e380b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:02.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.346+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f3e400e7fc0 con 0x7f3e50104860 2024-09-21T08:09:02.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.346+0000 7f3e4ffff640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 0x7f3e380b8bc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005940 tx=0x7f3e440058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:02.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.349+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e400ae250 con 0x7f3e50104860 2024-09-21T08:09:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.574+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e50104c70 con 0x7f3e50104860 2024-09-21T08:09:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.575+0000 7f3e4dffb640 1 -- 172.21.15.6:0/55250084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f3e400b2630 con 0x7f3e50104860 2024-09-21T08:09:02.576 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:09:02.577 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:09:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.577+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 msgr2=0x7f3e380b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.577+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 0x7f3e380b8bc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005940 tx=0x7f3e440058d0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.577+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 msgr2=0x7f3e5019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.577+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000c970 tx=0x7f3e4000ce30 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 shutdown_connections 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3e380b66b0 0x7f3e380b8bc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50105290 0x7f3e5019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e5010de10 0x7f3e501a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 --2- 172.21.15.6:0/55250084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e50104860 0x7f3e5019c5f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 >> 172.21.15.6:0/55250084 conn(0x7f3e50079740 msgr2=0x7f3e501006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 shutdown_connections 2024-09-21T08:09:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:02.578+0000 7f3e57080640 1 -- 172.21.15.6:0/55250084 wait complete. 2024-09-21T08:09:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:09:03.391 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id de742908 --release --await' 2024-09-21T08:09:03.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id de742908 --release --await 2024-09-21T08:09:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:03.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:03 smithi006 ceph-mon[30970]: pgmap v585: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-21T08:09:03.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:03 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/55250084' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:03 smithi119 ceph-mon[33564]: pgmap v585: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-21T08:09:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:03 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/55250084' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:03 smithi145 ceph-mon[34049]: pgmap v585: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-21T08:09:03.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:03 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/55250084' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 -- 172.21.15.6:0/3889224257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3554105340 msgr2=0x7f355410d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 --2- 172.21.15.6:0/3889224257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3554105340 0x7f355410d890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3544009900 tx=0x7f354402a410 comp rx=0 tx=0).stop 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 -- 172.21.15.6:0/3889224257 shutdown_connections 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 --2- 172.21.15.6:0/3889224257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f3554110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 --2- 172.21.15.6:0/3889224257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3554105340 0x7f355410d890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 --2- 172.21.15.6:0/3889224257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35541049f0 0x7f3554104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 -- 172.21.15.6:0/3889224257 >> 172.21.15.6:0/3889224257 conn(0x7f3554079750 msgr2=0x7f3554079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 -- 172.21.15.6:0/3889224257 shutdown_connections 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 -- 172.21.15.6:0/3889224257 wait complete. 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.152+0000 7f355b392640 1 Processor -- start 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 -- start start 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3554105340 0x7f355419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f355419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3554113920 con 0x7f35541049f0 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35541137a0 con 0x7f355410de50 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355b392640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3554113aa0 con 0x7f3554105340 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41346/0 (socket says 172.21.15.6:41346) 2024-09-21T08:09:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 -- 172.21.15.6:0/1571871802 learned_addr learned my addr 172.21.15.6:0/1571871802 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355892d640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3554105340 0x7f355419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355992f640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f355419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 -- 172.21.15.6:0/1571871802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3554105340 msgr2=0x7f355419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3554105340 0x7f355419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 -- 172.21.15.6:0/1571871802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 msgr2=0x7f355419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f355419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355912e640 1 -- 172.21.15.6:0/1571871802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35541a0340 con 0x7f35541049f0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.153+0000 7f355992f640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f355419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f355912e640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f355000d950 tx=0x7f355000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f354a7fc640 1 -- 172.21.15.6:0/1571871802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550017070 con 0x7f35541049f0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f354a7fc640 1 -- 172.21.15.6:0/1571871802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3550009c30 con 0x7f35541049f0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35541a0630 con 0x7f35541049f0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f354a7fc640 1 -- 172.21.15.6:0/1571871802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355000f620 con 0x7f35541049f0 2024-09-21T08:09:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.154+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35541a6d90 con 0x7f35541049f0 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.157+0000 7f354a7fc640 1 -- 172.21.15.6:0/1571871802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3550010460 con 0x7f35541049f0 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.157+0000 7f3561906740 1 Processor -- start 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.157+0000 7f3561906740 1 -- start start 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f3561906740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f354a7fc640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 0x7f35400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f355992f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f355992f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41360/0 (socket says 172.21.15.6:41360) 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f355892d640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 0x7f35400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.158+0000 7f354a7fc640 1 -- 172.21.15.6:0/1571871802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f35500e7780 con 0x7f35541049f0 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f3561906740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698745a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 -- 172.21.15.6:0/2616903235 learned_addr learned my addr 172.21.15.6:0/2616903235 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f3561906740 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869837e840 0x558698745f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558698630dc0 con 0x55869839f520 2024-09-21T08:09:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5586986bd1f0 con 0x558698376660 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5586986ac620 con 0x55869837e840 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355892d640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 0x7f35400b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3544005940 tx=0x7f35440058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355912e640 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698745a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 -- 172.21.15.6:0/2616903235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869837e840 msgr2=0x558698745f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869837e840 0x558698745f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 -- 172.21.15.6:0/2616903235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 msgr2=0x558698745a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698745a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.159+0000 7f355992f640 1 -- 172.21.15.6:0/2616903235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558698674fd0 con 0x55869839f520 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.160+0000 7f355992f640 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f354c008ed0 tx=0x7f354c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ca297c0dad3460 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.160+0000 7f353f7fe640 1 -- 172.21.15.6:0/2616903235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00f830 con 0x55869839f520 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.160+0000 7f353f7fe640 1 -- 172.21.15.6:0/2616903235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f354c018480 con 0x55869839f520 2024-09-21T08:09:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.160+0000 7f353f7fe640 1 -- 172.21.15.6:0/2616903235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00fe60 con 0x55869839f520 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 msgr2=0x558698745510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f354c008ed0 tx=0x7f354c00d710 comp rx=0 tx=0).stop 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 shutdown_connections 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869837e840 0x558698745f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698745a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 --2- 172.21.15.6:0/2616903235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869839f520 0x558698745510 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 >> 172.21.15.6:0/2616903235 conn(0x558698393910 msgr2=0x558698743400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 shutdown_connections 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- 172.21.15.6:0/2616903235 wait complete. 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.161+0000 7f3561906740 1 -- start start 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 Processor -- start 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698750be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869839f520 0x55869875ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558698647300 con 0x55869837e840 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5586986b0430 con 0x55869839f520 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55869850dbb0 con 0x558698376660 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f3561906740 10 client.0 _ll_register_callbacks cb 0x558698661120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f355892d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f355892d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41376/0 (socket says 172.21.15.6:41376) 2024-09-21T08:09:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f355892d640 1 -- 172.21.15.6:0/1650521120 learned_addr learned my addr 172.21.15.6:0/1650521120 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f355912e640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698750be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.162+0000 7f355992f640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869839f520 0x55869875ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 -- 172.21.15.6:0/1650521120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 msgr2=0x558698750be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698750be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 -- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869839f520 msgr2=0x55869875ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869839f520 0x55869875ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 -- 172.21.15.6:0/1650521120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558698636780 con 0x55869837e840 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f355892d640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f35440096c0 tx=0x7f3544009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b841991b54521ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f353cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354404c070 con 0x55869837e840 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f3544004250 con 0x55869837e840 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354c018480 con 0x55869837e840 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3544058050 con 0x55869837e840 2024-09-21T08:09:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f3561906740 10 client.16698 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.163+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55869840ab00 con 0x55869837e840 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f354c018480 con 0x55869837e840 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f354403c440 con 0x55869837e840 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 10 client.16698 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 10 client.16698 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 20 client.16698 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869835dea0 0x558698762f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 4 client.16698 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586986bf140 con 0x55869835dea0 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.164+0000 7f355912e640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869835dea0 0x558698762f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.165+0000 7f353cff9640 10 client.16698 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.165+0000 7f355912e640 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869835dea0 0x558698762f10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94d051c99e46eb6 server_cookie=36b013d7690dbe30 in_seq=0 out_seq=0 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f353cff9640 1 -- 172.21.15.6:0/1650521120 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586986bf140 con 0x55869835dea0 2024-09-21T08:09:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f353cff9640 10 client.16698 handle_command_reply: tid=0 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 client.16698 shutdown 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 msgr2=0x558698751120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f35440096c0 tx=0x7f3544009260 comp rx=0 tx=0).stop 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 shutdown_connections 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869835dea0 0x558698762f10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f353cff9640 0 client.16698 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869839f520 0x55869875ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x558698751120 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 --2- 172.21.15.6:0/1650521120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698750be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 >> 172.21.15.6:0/1650521120 conn(0x558698393910 msgr2=0x5586987486f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 shutdown_connections 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 1 -- 172.21.15.6:0/1650521120 wait complete. 2024-09-21T08:09:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.166+0000 7f3561906740 20 client.16698 trim_cache size 0 max 16384 2024-09-21T08:09:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 Processor -- start 2024-09-21T08:09:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 -- start start 2024-09-21T08:09:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869835dea0 0x558698746bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698752ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35541aeff0 con 0x55869837e840 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b1850 con 0x558698376660 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.184+0000 7f3561906740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35541af640 con 0x55869835dea0 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41392/0 (socket says 172.21.15.6:41392) 2024-09-21T08:09:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 -- 172.21.15.6:0/811898823 learned_addr learned my addr 172.21.15.6:0/811898823 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355912e640 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869835dea0 0x558698746bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355892d640 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698752ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 -- 172.21.15.6:0/811898823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869835dea0 msgr2=0x558698746bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869835dea0 0x558698746bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 -- 172.21.15.6:0/811898823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 msgr2=0x558698752ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698752ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 -- 172.21.15.6:0/811898823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558698481960 con 0x55869837e840 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.185+0000 7f355992f640 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f354c00dc10 tx=0x7f354c008b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f116ea4e9a852 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.186+0000 7f353effd640 1 -- 172.21.15.6:0/811898823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c018680 con 0x55869837e840 2024-09-21T08:09:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.186+0000 7f353effd640 1 -- 172.21.15.6:0/811898823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f354c02a070 con 0x55869837e840 2024-09-21T08:09:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.186+0000 7f353effd640 1 -- 172.21.15.6:0/811898823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00fe30 con 0x55869837e840 2024-09-21T08:09:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 -- 172.21.15.6:0/811898823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 msgr2=0x55869874fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f354c00dc10 tx=0x7f354c008b70 comp rx=0 tx=0).stop 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 -- 172.21.15.6:0/811898823 shutdown_connections 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869837e840 0x55869874fb70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558698376660 0x558698752ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 --2- 172.21.15.6:0/811898823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55869835dea0 0x558698746bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 -- 172.21.15.6:0/811898823 >> 172.21.15.6:0/811898823 conn(0x558698393910 msgr2=0x55869874f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 -- 172.21.15.6:0/811898823 shutdown_connections 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.187+0000 7f3561906740 1 -- 172.21.15.6:0/811898823 wait complete. 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 -- start start 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 Processor -- start 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698753d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 0x558698754490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35541afd10 con 0x55869835dea0 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b1180 con 0x55869837e840 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b03e0 con 0x558698376660 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.188+0000 7f3561906740 10 client.0 _ll_register_callbacks cb 0x7f3544040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41398/0 (socket says 172.21.15.6:41398) 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 -- 172.21.15.6:0/1975285669 learned_addr learned my addr 172.21.15.6:0/1975285669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355892d640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698753d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355992f640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 0x558698754490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 -- 172.21.15.6:0/1975285669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 msgr2=0x558698753d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698753d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 -- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 msgr2=0x558698754490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 0x558698754490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 -- 172.21.15.6:0/1975285669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586987cd900 con 0x55869835dea0 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355992f640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 0x558698754490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f355912e640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f35500a9760 tx=0x7f3550094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba4303fc2287992 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f353cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550020040 con 0x55869835dea0 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f35500ac3f0 con 0x55869835dea0 2024-09-21T08:09:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.189+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354c02a070 con 0x55869835dea0 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f35500b6bb0 con 0x55869835dea0 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 10 client.16704 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5586987cea60 con 0x55869835dea0 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f354c02a070 con 0x55869835dea0 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3550098250 con 0x55869835dea0 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 10 client.16704 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 10 client.16704 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 20 client.16704 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869839f520 0x5586987d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 4 client.16704 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "de742908", "release": true, "await": true}] 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "de742908", "release": true, "await": true}) -- 0x5586986babf0 con 0x55869839f520 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.190+0000 7f355892d640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869839f520 0x5586987d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.191+0000 7f353cff9640 10 client.16704 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.191+0000 7f355892d640 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869839f520 0x5586987d1220 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef587f2a78ab496e server_cookie=31ac50fb8940d173 in_seq=0 out_seq=0 2024-09-21T08:09:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f353cff9640 1 -- 172.21.15.6:0/1975285669 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5586986babf0 con 0x55869839f520 2024-09-21T08:09:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f353cff9640 10 client.16704 handle_command_reply: tid=0 2024-09-21T08:09:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 client.16704 shutdown 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 msgr2=0x558698759780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f35500a9760 tx=0x7f3550094040 comp rx=0 tx=0).stop 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 shutdown_connections 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55869839f520 0x5586987d1220 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558698376660 0x558698753d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55869837e840 0x558698754490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 --2- 172.21.15.6:0/1975285669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55869835dea0 0x558698759780 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 >> 172.21.15.6:0/1975285669 conn(0x558698393910 msgr2=0x55869874fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f353cff9640 0 client.16704 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 shutdown_connections 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 1 -- 172.21.15.6:0/1975285669 wait complete. 2024-09-21T08:09:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.719+0000 7f3561906740 20 client.16704 trim_cache size 0 max 16384 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 32, 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "de742908": { 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 32, 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:04.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 141.1, 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:04.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:04.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:04.725 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 msgr2=0x7f35400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 0x7f35400b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3544005940 tx=0x7f35440058d0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 msgr2=0x7f355419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f355000d950 tx=0x7f355000de10 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 shutdown_connections 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35400b6680 0x7f35400b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3554105340 0x7f355419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f355410de50 0x7f355419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 --2- 172.21.15.6:0/1571871802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35541049f0 0x7f355419a3d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 >> 172.21.15.6:0/1571871802 conn(0x7f3554079750 msgr2=0x7f3554100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 shutdown_connections 2024-09-21T08:09:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:04.720+0000 7f355b392640 1 -- 172.21.15.6:0/1571871802 wait complete. 2024-09-21T08:09:05.499 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'de742908', total seconds elapsed: 25.0 2024-09-21T08:09:05.499 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T08:09:05.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:09:05.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:05 smithi006 ceph-mon[30970]: pgmap v586: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-21T08:09:05.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:05 smithi119 ceph-mon[33564]: pgmap v586: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-21T08:09:05.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:05 smithi145 ceph-mon[34049]: pgmap v586: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-21T08:09:05.992 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:06 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:09:06.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:06 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:09:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:06 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:09:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 370.0 s, 418.7 tps, lat 720.403 ms stddev 2611.077 2024-09-21T08:09:07.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:07 smithi006 ceph-mon[30970]: pgmap v587: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 808 KiB/s wr, 91 op/s 2024-09-21T08:09:07.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:07 smithi119 ceph-mon[33564]: pgmap v587: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 808 KiB/s wr, 91 op/s 2024-09-21T08:09:07.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:07 smithi145 ceph-mon[34049]: pgmap v587: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 808 KiB/s wr, 91 op/s 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 -- 172.21.15.6:0/1044193601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc102870 msgr2=0x7f9cfc102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 --2- 172.21.15.6:0/1044193601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc102870 0x7f9cfc102c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009900 tx=0x7f9ce402a410 comp rx=0 tx=0).stop 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 -- 172.21.15.6:0/1044193601 shutdown_connections 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 --2- 172.21.15.6:0/1044193601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 --2- 172.21.15.6:0/1044193601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc1085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 --2- 172.21.15.6:0/1044193601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc102870 0x7f9cfc102c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 -- 172.21.15.6:0/1044193601 >> 172.21.15.6:0/1044193601 conn(0x7f9cfc0fe2c0 msgr2=0x7f9cfc100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 -- 172.21.15.6:0/1044193601 shutdown_connections 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.431+0000 7f9d01901640 1 -- 172.21.15.6:0/1044193601 wait complete. 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.433+0000 7f9d01901640 1 Processor -- start 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.433+0000 7f9d01901640 1 -- start start 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.433+0000 7f9d01901640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.433+0000 7f9d01901640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01901640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d008ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d008ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57606/0 (socket says 172.21.15.6:57606) 2024-09-21T08:09:08.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc19a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36846/0 (socket says 172.21.15.6:36846) 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01901640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc112730 con 0x7f9cfc108b00 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01901640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc1125b0 con 0x7f9cfc102870 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01901640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc1128b0 con 0x7f9cfc1081b0 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01100640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01100640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45024/0 (socket says 172.21.15.6:45024) 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.434+0000 7f9d01100640 1 -- 172.21.15.6:0/2160236326 learned_addr learned my addr 172.21.15.6:0/2160236326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 -- 172.21.15.6:0/2160236326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 msgr2=0x7f9cfc19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 -- 172.21.15.6:0/2160236326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 msgr2=0x7f9cfc19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 -- 172.21.15.6:0/2160236326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc1a02a0 con 0x7f9cfc108b00 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d008ff640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.435+0000 7f9d01100640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009fd0 tx=0x7f9cf400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.436+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011830 con 0x7f9cfc108b00 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.436+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf4016070 con 0x7f9cfc108b00 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.436+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4010d20 con 0x7f9cfc108b00 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:09:08.677 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.436+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc1a0590 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.436+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc0fe6d0 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.438+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cfc102d00 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.441+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9cf40119d0 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.442+0000 7f9cf9ffb640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 0x7f9ce80b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.443+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9511+0+0 (secure 0 0 0) 0x7f9cf40e7650 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.447+0000 7f9d008ff640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 0x7f9ce80b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.448+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cf40ad760 con 0x7f9cfc108b00 2024-09-21T08:09:08.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.450+0000 7f9d008ff640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 0x7f9ce80b8c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40057c0 tx=0x7f9ce40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.836+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cfc19b460 con 0x7f9cfc108b00 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.837+0000 7f9cf9ffb640 1 -- 172.21.15.6:0/2160236326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f9cfc19b460 con 0x7f9cfc108b00 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 msgr2=0x7f9ce80b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 0x7f9ce80b8c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40057c0 tx=0x7f9ce40058d0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 msgr2=0x7f9cfc19fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009fd0 tx=0x7f9cf400b8e0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 shutdown_connections 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9ce80b6780 0x7f9ce80b8c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9cfc1081b0 0x7f9cfc19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cfc108b00 0x7f9cfc19fb70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 --2- 172.21.15.6:0/2160236326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc102870 0x7f9cfc19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:08.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 >> 172.21.15.6:0/2160236326 conn(0x7f9cfc0fe2c0 msgr2=0x7f9cfc104770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:08.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 shutdown_connections 2024-09-21T08:09:08.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:07.841+0000 7f9d01901640 1 -- 172.21.15.6:0/2160236326 wait complete. 2024-09-21T08:09:08.680 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:08 smithi006 ceph-mon[30970]: pgmap v588: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-09-21T08:09:08.680 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:08 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2160236326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:08 smithi119 ceph-mon[33564]: pgmap v588: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-09-21T08:09:08.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:08 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2160236326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:08 smithi145 ceph-mon[34049]: pgmap v588: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-09-21T08:09:08.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:08 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2160236326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:11.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:10 smithi006 ceph-mon[30970]: pgmap v589: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-09-21T08:09:11.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:10 smithi119 ceph-mon[33564]: pgmap v589: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-09-21T08:09:11.181 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T08:09:11.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T08:09:11.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:10 smithi145 ceph-mon[34049]: pgmap v589: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-09-21T08:09:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:12.021 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:11 smithi006 ceph-mon[30970]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T08:09:12.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:11 smithi119 ceph-mon[33564]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T08:09:12.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:11 smithi145 ceph-mon[34049]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T08:09:12.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.198+0000 7f1616ae4640 1 -- 172.21.15.6:0/1210401161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610102a80 msgr2=0x7f1610102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.198+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1210401161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610102a80 0x7f1610102e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1604009900 tx=0x7f160402a410 comp rx=0 tx=0).stop 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 -- 172.21.15.6:0/1210401161 shutdown_connections 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1210401161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610108d10 0x7f161006ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1210401161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 0x7f16101087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1210401161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610102a80 0x7f1610102e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 -- 172.21.15.6:0/1210401161 >> 172.21.15.6:0/1210401161 conn(0x7f1610079760 msgr2=0x7f1610079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 -- 172.21.15.6:0/1210401161 shutdown_connections 2024-09-21T08:09:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.199+0000 7f1616ae4640 1 -- 172.21.15.6:0/1210401161 wait complete. 2024-09-21T08:09:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.200+0000 7f1616ae4640 1 Processor -- start 2024-09-21T08:09:12.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.201+0000 7f1616ae4640 1 -- start start 2024-09-21T08:09:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.201+0000 7f1616ae4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610102a80 0x7f1610111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1616ae4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 0x7f161010e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1616ae4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1616ae4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f161010af30 con 0x7f1610102a80 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1616ae4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f161010adb0 con 0x7f16101083c0 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1616ae4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f161010b0b0 con 0x7f1610108d10 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1615081640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1615081640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36874/0 (socket says 172.21.15.6:36874) 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.202+0000 7f1615081640 1 -- 172.21.15.6:0/1570748237 learned_addr learned my addr 172.21.15.6:0/1570748237 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:12.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f160ffff640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 0x7f161010e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1614880640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610102a80 0x7f1610111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 -- 172.21.15.6:0/1570748237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 msgr2=0x7f161010e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 0x7f161010e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 -- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610102a80 msgr2=0x7f1610111190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610102a80 0x7f1610111190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 -- 172.21.15.6:0/1570748237 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101ac8f0 con 0x7f1610108d10 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f1615081640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f160800eb10 tx=0x7f160800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.203+0000 7f160dffb640 1 -- 172.21.15.6:0/1570748237 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608004b20 con 0x7f1610108d10 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.204+0000 7f160dffb640 1 -- 172.21.15.6:0/1570748237 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1608004cc0 con 0x7f1610108d10 2024-09-21T08:09:12.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.204+0000 7f160dffb640 1 -- 172.21.15.6:0/1570748237 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608010690 con 0x7f1610108d10 2024-09-21T08:09:12.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.204+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16101acb20 con 0x7f1610108d10 2024-09-21T08:09:12.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.204+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101acfb0 con 0x7f1610108d10 2024-09-21T08:09:12.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.209+0000 7f161d058740 1 Processor -- start 2024-09-21T08:09:12.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.210+0000 7f160dffb640 1 -- 172.21.15.6:0/1570748237 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1608005020 con 0x7f1610108d10 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.211+0000 7f160dffb640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 0x7f16000b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.211+0000 7f160dffb640 1 -- 172.21.15.6:0/1570748237 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f16080e81e0 con 0x7f1610108d10 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.211+0000 7f161d058740 1 -- start start 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1e2850 0x5557fa588e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 0x5557fa5893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f160ffff640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 0x7f16000b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f160ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 0x5557fa5893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f160ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 0x5557fa5893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45032/0 (socket says 172.21.15.6:45032) 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 0x5557fa5898f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5557fa4ffbb0 con 0x5557fa1b9990 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5557fa4eefe0 con 0x5557fa1c1b70 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f161d058740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5557fa4f2df0 con 0x5557fa1e2850 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.212+0000 7f160ffff640 1 -- 172.21.15.6:0/2585396864 learned_addr learned my addr 172.21.15.6:0/2585396864 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 0x5557fa5898f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1614880640 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1e2850 0x5557fa588e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 -- 172.21.15.6:0/2585396864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1e2850 msgr2=0x5557fa588e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1e2850 0x5557fa588e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 -- 172.21.15.6:0/2585396864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 msgr2=0x5557fa5893b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 0x5557fa5893b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 -- 172.21.15.6:0/2585396864 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557fa25cba0 con 0x5557fa1c1b70 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.213+0000 7f1615081640 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 0x5557fa5898f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16080e54a0 tx=0x7f16080a9b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0ca7c1c18496b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.214+0000 7f15faffd640 1 -- 172.21.15.6:0/2585396864 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080ad310 con 0x5557fa1c1b70 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.214+0000 7f15faffd640 1 -- 172.21.15.6:0/2585396864 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16080ad6b0 con 0x5557fa1c1b70 2024-09-21T08:09:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.214+0000 7f15faffd640 1 -- 172.21.15.6:0/2585396864 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080b75c0 con 0x5557fa1c1b70 2024-09-21T08:09:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 -- 172.21.15.6:0/2585396864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 msgr2=0x5557fa5898f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 0x5557fa5898f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16080e54a0 tx=0x7f16080a9b00 comp rx=0 tx=0).stop 2024-09-21T08:09:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f160ffff640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 0x7f16000b8cc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0229a0 tx=0x7f15fc00cb60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 -- 172.21.15.6:0/2585396864 shutdown_connections 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1c1b70 0x5557fa5898f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1b9990 0x5557fa5893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 --2- 172.21.15.6:0/2585396864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1e2850 0x5557fa588e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.216+0000 7f161d058740 1 -- 172.21.15.6:0/2585396864 >> 172.21.15.6:0/2585396864 conn(0x5557fa1d6c40 msgr2=0x5557fa586d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.217+0000 7f161d058740 1 -- 172.21.15.6:0/2585396864 shutdown_connections 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.217+0000 7f161d058740 1 -- 172.21.15.6:0/2585396864 wait complete. 2024-09-21T08:09:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.217+0000 7f161d058740 1 -- start start 2024-09-21T08:09:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.217+0000 7f161d058740 1 Processor -- start 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 0x5557fa5949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1c1b70 0x5557fa594f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 0x5557fa5a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5557fa3507b0 con 0x5557fa1c1b70 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5557fa489e90 con 0x5557fa1e2850 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5557fa597650 con 0x5557fa1b9990 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.218+0000 7f161d058740 10 client.0 _ll_register_callbacks cb 0x5557fa4ec710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1614880640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 0x5557fa5949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1614880640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 0x5557fa5949f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36890/0 (socket says 172.21.15.6:36890) 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1614880640 1 -- 172.21.15.6:0/2486641190 learned_addr learned my addr 172.21.15.6:0/2486641190 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 0x5557fa5a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f160ffff640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1c1b70 0x5557fa594f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 -- 172.21.15.6:0/2486641190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 msgr2=0x5557fa5949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 0x5557fa5949f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 -- 172.21.15.6:0/2486641190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1c1b70 msgr2=0x5557fa594f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1c1b70 0x5557fa594f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.219+0000 7f1615081640 1 -- 172.21.15.6:0/2486641190 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557fa5a0eb0 con 0x5557fa1e2850 2024-09-21T08:09:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f1615081640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 0x5557fa5a0970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16080e54a0 tx=0x7f16080e5950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8301f859e0ddb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f15effff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080ad310 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16080ad6b0 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f16080cfbb0 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f16080d5170 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f161d058740 10 client.26327 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.220+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5557fa5a37c0 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16080ad6b0 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16080a94f0 con 0x5557fa1e2850 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 10 client.26327 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 10 client.26327 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 20 client.26327 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa1a11d0 0x5557fa5a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 4 client.26327 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557fa501b00 con 0x5557fa1a11d0 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.221+0000 7f1614880640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa1a11d0 0x5557fa5a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.222+0000 7f1614880640 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa1a11d0 0x5557fa5a6c60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47bb74dea8fef3fe server_cookie=5b825032a2b6ac35 in_seq=0 out_seq=0 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.222+0000 7f15effff640 10 client.26327 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.223+0000 7f15effff640 1 -- 172.21.15.6:0/2486641190 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557fa501b00 con 0x5557fa1a11d0 2024-09-21T08:09:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.223+0000 7f15effff640 10 client.26327 handle_command_reply: tid=0 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.223+0000 7f161d058740 1 client.26327 shutdown 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.223+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 msgr2=0x5557fa5a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.223+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 0x5557fa5a0970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16080e54a0 tx=0x7f16080e5950 comp rx=0 tx=0).stop 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 shutdown_connections 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa1a11d0 0x5557fa5a6c60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1e2850 0x5557fa5a0970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1c1b70 0x5557fa594f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 --2- 172.21.15.6:0/2486641190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1b9990 0x5557fa5949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 >> 172.21.15.6:0/2486641190 conn(0x5557fa1d6c40 msgr2=0x5557fa58c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f15effff640 0 client.26327 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 shutdown_connections 2024-09-21T08:09:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.224+0000 7f161d058740 1 -- 172.21.15.6:0/2486641190 wait complete. 2024-09-21T08:09:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.225+0000 7f161d058740 20 client.26327 trim_cache size 0 max 16384 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.254+0000 7f161d058740 1 Processor -- start 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.254+0000 7f161d058740 1 -- start start 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa58ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5919e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1610075120 con 0x5557fa1e2850 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16101af5b0 con 0x5557fa1b9990 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f161d058740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f16101ad3e0 con 0x5557fa1c1b70 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f160ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f160ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36894/0 (socket says 172.21.15.6:36894) 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.255+0000 7f160ffff640 1 -- 172.21.15.6:0/2189915578 learned_addr learned my addr 172.21.15.6:0/2189915578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 -- 172.21.15.6:0/2189915578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 msgr2=0x5557fa58ef90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa58ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 -- 172.21.15.6:0/2189915578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 msgr2=0x5557fa5919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 -- 172.21.15.6:0/2189915578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557fa580f80 con 0x5557fa1c1b70 2024-09-21T08:09:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.256+0000 7f160ffff640 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00c550 tx=0x7f15fc02f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26f9f6ab2db5f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.257+0000 7f15fa7fc640 1 -- 172.21.15.6:0/2189915578 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc03a430 con 0x5557fa1c1b70 2024-09-21T08:09:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.257+0000 7f15fa7fc640 1 -- 172.21.15.6:0/2189915578 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15fc0318a0 con 0x5557fa1c1b70 2024-09-21T08:09:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.257+0000 7f15fa7fc640 1 -- 172.21.15.6:0/2189915578 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0216d0 con 0x5557fa1c1b70 2024-09-21T08:09:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.259+0000 7f161d058740 1 -- 172.21.15.6:0/2189915578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 msgr2=0x5557fa58a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.259+0000 7f161d058740 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00c550 tx=0x7f15fc02f000 comp rx=0 tx=0).stop 2024-09-21T08:09:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.260+0000 7f161d058740 1 -- 172.21.15.6:0/2189915578 shutdown_connections 2024-09-21T08:09:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.260+0000 7f161d058740 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa58a5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.260+0000 7f161d058740 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.260+0000 7f161d058740 1 --2- 172.21.15.6:0/2189915578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa58ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.260+0000 7f161d058740 1 -- 172.21.15.6:0/2189915578 >> 172.21.15.6:0/2189915578 conn(0x5557fa1d6c40 msgr2=0x5557fa589ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.261+0000 7f161d058740 1 -- 172.21.15.6:0/2189915578 shutdown_connections 2024-09-21T08:09:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.261+0000 7f161d058740 1 -- 172.21.15.6:0/2189915578 wait complete. 2024-09-21T08:09:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.262+0000 7f161d058740 1 -- start start 2024-09-21T08:09:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.262+0000 7f161d058740 1 Processor -- start 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa59cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16101ada70 con 0x5557fa1e2850 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f1614880640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa59cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16101aeee0 con 0x5557fa1b9990 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f161d058740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f16101ae140 con 0x5557fa1c1b70 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.264+0000 7f160ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.265+0000 7f160ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:36896/0 (socket says 172.21.15.6:36896) 2024-09-21T08:09:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.265+0000 7f160ffff640 1 -- 172.21.15.6:0/2874533997 learned_addr learned my addr 172.21.15.6:0/2874533997 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.265+0000 7f161d058740 10 client.0 _ll_register_callbacks cb 0x7f16080d12f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.265+0000 7f1615081640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.266+0000 7f160ffff640 1 -- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 msgr2=0x5557fa59cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.266+0000 7f160ffff640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa59cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.266+0000 7f160ffff640 1 -- 172.21.15.6:0/2874533997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 msgr2=0x5557fa5997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.266+0000 7f160ffff640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.266+0000 7f160ffff640 1 -- 172.21.15.6:0/2874533997 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557fa599cf0 con 0x5557fa1c1b70 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.267+0000 7f160ffff640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f15fc005fd0 tx=0x7f15fc031650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6af55f5e7af79df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.267+0000 7f15effff640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:09:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.267+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc040070 con 0x5557fa1c1b70 2024-09-21T08:09:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.267+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15fc0318a0 con 0x5557fa1c1b70 2024-09-21T08:09:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.267+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f15fc021450 con 0x5557fa1c1b70 2024-09-21T08:09:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.268+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f15fc021650 con 0x5557fa1c1b70 2024-09-21T08:09:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.268+0000 7f161d058740 10 client.26446 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.268+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5557fa6121b0 con 0x5557fa1c1b70 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.268+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15fc0318a0 con 0x5557fa1c1b70 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f15fc02f070 con 0x5557fa1c1b70 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 10 client.26446 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 10 client.26446 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 20 client.26446 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa176580 0x5557fa614970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 4 client.26446 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T08:09:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x5557fa4fd5b0 con 0x5557fa176580 2024-09-21T08:09:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.269+0000 7f1614880640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa176580 0x5557fa614970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.270+0000 7f15effff640 10 client.26446 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:12.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.271+0000 7f1614880640 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa176580 0x5557fa614970 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f2555783b9c12a server_cookie=5a61a4f317a3ac32 in_seq=0 out_seq=0 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f15effff640 1 -- 172.21.15.6:0/2874533997 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5557fa4fd5b0 con 0x5557fa176580 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f15effff640 10 client.26446 handle_command_reply: tid=0 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 client.26446 shutdown 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 msgr2=0x5557fa599270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f15fc005fd0 tx=0x7f15fc031650 comp rx=0 tx=0).stop 2024-09-21T08:09:12.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 shutdown_connections 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5557fa176580 0x5557fa614970 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5557fa1c1b70 0x5557fa599270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557fa1e2850 0x5557fa5997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f15effff640 0 client.26446 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 --2- 172.21.15.6:0/2874533997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557fa1b9990 0x5557fa59cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.571+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 >> 172.21.15.6:0/2874533997 conn(0x5557fa1d6c40 msgr2=0x5557fa589e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 shutdown_connections 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f161d058740 1 -- 172.21.15.6:0/2874533997 wait complete. 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f161d058740 20 client.26446 trim_cache size 0 max 16384 2024-09-21T08:09:12.574 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 34, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "318480ac": { 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 34, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:09:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 141.1, 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:12.576 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 msgr2=0x7f16000b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 0x7f16000b8cc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0229a0 tx=0x7f15fc00cb60 comp rx=0 tx=0).stop 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 msgr2=0x7f161010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f160800eb10 tx=0x7f160800c2d0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 shutdown_connections 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f16000b67b0 0x7f16000b8cc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1610108d10 0x7f161010ebb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16101083c0 0x7f161010e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 --2- 172.21.15.6:0/1570748237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1610102a80 0x7f1610111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:12.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 >> 172.21.15.6:0/1570748237 conn(0x7f1610079760 msgr2=0x7f1610106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:12.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.572+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 shutdown_connections 2024-09-21T08:09:12.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:12.573+0000 7f1616ae4640 1 -- 172.21.15.6:0/1570748237 wait complete. 2024-09-21T08:09:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 375.0 s, 617.4 tps, lat 152.770 ms stddev 142.478 2024-09-21T08:09:13.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:12 smithi119 ceph-mon[33564]: pgmap v591: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.7 MiB/s wr, 364 op/s 2024-09-21T08:09:13.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:12 smithi145 ceph-mon[34049]: pgmap v591: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.7 MiB/s wr, 364 op/s 2024-09-21T08:09:13.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:12 smithi006 ceph-mon[30970]: pgmap v591: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.7 MiB/s wr, 364 op/s 2024-09-21T08:09:13.336 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '318480ac', quiesce took 7.8 seconds. Will release after: 13.25 2024-09-21T08:09:15.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:14 smithi119 ceph-mon[33564]: pgmap v592: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 455 op/s 2024-09-21T08:09:15.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:14 smithi145 ceph-mon[34049]: pgmap v592: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 455 op/s 2024-09-21T08:09:15.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:14 smithi006 ceph-mon[30970]: pgmap v592: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 455 op/s 2024-09-21T08:09:17.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:16 smithi119 ceph-mon[33564]: pgmap v593: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.9 MiB/s wr, 522 op/s 2024-09-21T08:09:17.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:16 smithi145 ceph-mon[34049]: pgmap v593: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.9 MiB/s wr, 522 op/s 2024-09-21T08:09:17.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:16 smithi006 ceph-mon[30970]: pgmap v593: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.9 MiB/s wr, 522 op/s 2024-09-21T08:09:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:09:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:19 smithi145 ceph-mon[34049]: pgmap v594: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T08:09:19.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:19 smithi145 ceph-mon[34049]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T08:09:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:19 smithi006 ceph-mon[30970]: pgmap v594: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T08:09:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:19 smithi006 ceph-mon[30970]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T08:09:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:19 smithi119 ceph-mon[33564]: pgmap v594: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.6 MiB/s wr, 518 op/s 2024-09-21T08:09:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:19 smithi119 ceph-mon[33564]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T08:09:21.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:21 smithi145 ceph-mon[34049]: pgmap v596: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 454 op/s 2024-09-21T08:09:21.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:21 smithi119 ceph-mon[33564]: pgmap v596: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 454 op/s 2024-09-21T08:09:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:21 smithi006 ceph-mon[30970]: pgmap v596: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 454 op/s 2024-09-21T08:09:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:09:23.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:23 smithi145 ceph-mon[34049]: pgmap v597: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 304 op/s 2024-09-21T08:09:23.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:23 smithi006 ceph-mon[30970]: pgmap v597: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 304 op/s 2024-09-21T08:09:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:23 smithi119 ceph-mon[33564]: pgmap v597: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 304 op/s 2024-09-21T08:09:25.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:25 smithi145 ceph-mon[34049]: pgmap v598: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-21T08:09:25.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:25 smithi006 ceph-mon[30970]: pgmap v598: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-21T08:09:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:25 smithi119 ceph-mon[33564]: pgmap v598: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-21T08:09:26.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:09:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 -- 172.21.15.6:0/1320332477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f4109e10 msgr2=0x7f56f4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 --2- 172.21.15.6:0/1320332477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f4109e10 0x7f56f4110640 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009ca0 tx=0x7f56ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 -- 172.21.15.6:0/1320332477 shutdown_connections 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 --2- 172.21.15.6:0/1320332477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f41094c0 0x7f56f41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 --2- 172.21.15.6:0/1320332477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f4109e10 0x7f56f4110640 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 --2- 172.21.15.6:0/1320332477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 0x7f56f4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 -- 172.21.15.6:0/1320332477 >> 172.21.15.6:0/1320332477 conn(0x7f56f40ff610 msgr2=0x7f56f4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 -- 172.21.15.6:0/1320332477 shutdown_connections 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.366+0000 7f56f91f8640 1 -- 172.21.15.6:0/1320332477 wait complete. 2024-09-21T08:09:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.367+0000 7f56f91f8640 1 Processor -- start 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.367+0000 7f56f91f8640 1 -- start start 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 0x7f56f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f4109e10 0x7f56f4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41139d0 con 0x7f56f41094c0 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4113850 con 0x7f56f4103b80 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f91f8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4113b50 con 0x7f56f4109e10 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44430/0 (socket says 172.21.15.6:44430) 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 -- 172.21.15.6:0/2431162115 learned_addr learned my addr 172.21.15.6:0/2431162115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f2d9d640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 0x7f56f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56f359e640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f4109e10 0x7f56f4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 -- 172.21.15.6:0/2431162115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f4109e10 msgr2=0x7f56f4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f4109e10 0x7f56f4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 -- 172.21.15.6:0/2431162115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 msgr2=0x7f56f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 0x7f56f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.368+0000 7f56ea59c640 1 -- 172.21.15.6:0/2431162115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f41a8620 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56ea59c640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d750 tx=0x7f56dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56dc0054b0 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc004bc0 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f41a8910 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.369+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f41a8e00 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.370+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f4103f90 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.372+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f56dc009c30 con 0x7f56f41094c0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.372+0000 7f56f0d99640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 0x7f56e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.373+0000 7f56f2d9d640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 0x7f56e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.373+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f56dc0e78b0 con 0x7f56f41094c0 2024-09-21T08:09:27.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.373+0000 7f56f2d9d640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 0x7f56e00b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f56f4077160 tx=0x7f56e400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:27.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.376+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56dc0b1e00 con 0x7f56f41094c0 2024-09-21T08:09:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:09:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.603+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56f4076a10 con 0x7f56f41094c0 2024-09-21T08:09:27.604 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:27 smithi006 ceph-mon[30970]: pgmap v599: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 995 KiB/s wr, 118 op/s 2024-09-21T08:09:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.604+0000 7f56f0d99640 1 -- 172.21.15.6:0/2431162115 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f56f4076a10 con 0x7f56f41094c0 2024-09-21T08:09:27.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:09:27.605 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:09:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 msgr2=0x7f56e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 0x7f56e00b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f56f4077160 tx=0x7f56e400b390 comp rx=0 tx=0).stop 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 msgr2=0x7f56f4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d750 tx=0x7f56dc00dc10 comp rx=0 tx=0).stop 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 shutdown_connections 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f56e00b6680 0x7f56e00b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56f4109e10 0x7f56f4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56f41094c0 0x7f56f4075c50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 --2- 172.21.15.6:0/2431162115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56f4103b80 0x7f56f4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.607+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 >> 172.21.15.6:0/2431162115 conn(0x7f56f40ff610 msgr2=0x7f56f4108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.608+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 shutdown_connections 2024-09-21T08:09:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:27.608+0000 7f56f91f8640 1 -- 172.21.15.6:0/2431162115 wait complete. 2024-09-21T08:09:27.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:27 smithi145 ceph-mon[34049]: pgmap v599: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 995 KiB/s wr, 118 op/s 2024-09-21T08:09:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:27 smithi119 ceph-mon[33564]: pgmap v599: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 995 KiB/s wr, 118 op/s 2024-09-21T08:09:28.402 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 318480ac --release --await' 2024-09-21T08:09:28.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 318480ac --release --await 2024-09-21T08:09:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:28.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:28 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2431162115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:28.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:28 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2431162115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:28.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:28 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2431162115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 -- 172.21.15.6:0/1486779753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff074109df0 msgr2=0x7ff074110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 --2- 172.21.15.6:0/1486779753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff074109df0 0x7ff074110620 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009ca0 tx=0x7ff06c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 -- 172.21.15.6:0/1486779753 shutdown_connections 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 --2- 172.21.15.6:0/1486779753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0741094a0 0x7ff0741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 --2- 172.21.15.6:0/1486779753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff074109df0 0x7ff074110620 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 --2- 172.21.15.6:0/1486779753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 0x7ff074103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 -- 172.21.15.6:0/1486779753 >> 172.21.15.6:0/1486779753 conn(0x7ff07407b850 msgr2=0x7ff07407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 -- 172.21.15.6:0/1486779753 shutdown_connections 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 -- 172.21.15.6:0/1486779753 wait complete. 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.189+0000 7ff07ad48640 1 Processor -- start 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 -- start start 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 0x7ff07419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074109df0 0x7ff07419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741139b0 con 0x7ff0741094a0 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff074113830 con 0x7ff074103b60 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff07ad48640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff074113b30 con 0x7ff074109df0 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44454/0 (socket says 172.21.15.6:44454) 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 -- 172.21.15.6:0/3790276402 learned_addr learned my addr 172.21.15.6:0/3790276402 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff078ae4640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 0x7ff07419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff0792e5640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074109df0 0x7ff07419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 -- 172.21.15.6:0/3790276402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074109df0 msgr2=0x7ff07419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074109df0 0x7ff07419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 -- 172.21.15.6:0/3790276402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 msgr2=0x7ff07419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 0x7ff07419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.190+0000 7ff073fff640 1 -- 172.21.15.6:0/3790276402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0741a0370 con 0x7ff0741094a0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff073fff640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e9c0 tx=0x7ff06000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff071ffb640 1 -- 172.21.15.6:0/3790276402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ccc0 con 0x7ff0741094a0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff071ffb640 1 -- 172.21.15.6:0/3790276402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0600054b0 con 0x7ff0741094a0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0741a0660 con 0x7ff0741094a0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff071ffb640 1 -- 172.21.15.6:0/3790276402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060010430 con 0x7ff0741094a0 2024-09-21T08:09:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.191+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0741a6dc0 con 0x7ff0741094a0 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff071ffb640 1 -- 172.21.15.6:0/3790276402 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff060004f20 con 0x7ff0741094a0 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 Processor -- start 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 -- start start 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684adcda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684adcdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55684acb8dc0 con 0x55684aa27520 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55684ad451f0 con 0x55684a9fe660 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0812bc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55684ad34620 con 0x55684aa06840 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0792e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0792e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44456/0 (socket says 172.21.15.6:44456) 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.194+0000 7ff0792e5640 1 -- 172.21.15.6:0/4071621937 learned_addr learned my addr 172.21.15.6:0/4071621937 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff071ffb640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 0x7ff0640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff078ae4640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684adcda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff073fff640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684adcdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 0x7ff0640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 -- 172.21.15.6:0/4071621937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 msgr2=0x55684adcdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684adcdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff071ffb640 1 -- 172.21.15.6:0/3790276402 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff0600e7e60 con 0x7ff0741094a0 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 -- 172.21.15.6:0/4071621937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 msgr2=0x55684adcda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684adcda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 -- 172.21.15.6:0/4071621937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684acfcfd0 con 0x55684aa27520 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff078ae4640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684adcda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.195+0000 7ff0792e5640 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009ca0 tx=0x7ff06c0318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd0dbc112d7009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.196+0000 7ff05effd640 1 -- 172.21.15.6:0/4071621937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c045040 con 0x55684aa27520 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.196+0000 7ff0792e5640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 0x7ff0640b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff06c048000 tx=0x7ff06c04a000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.196+0000 7ff05effd640 1 -- 172.21.15.6:0/4071621937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff06c04d030 con 0x55684aa27520 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.196+0000 7ff05effd640 1 -- 172.21.15.6:0/4071621937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c004720 con 0x55684aa27520 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- 172.21.15.6:0/4071621937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 msgr2=0x55684adcd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009ca0 tx=0x7ff06c0318d0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- 172.21.15.6:0/4071621937 shutdown_connections 2024-09-21T08:09:29.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684adcdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684adcda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 --2- 172.21.15.6:0/4071621937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa27520 0x55684adcd510 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- 172.21.15.6:0/4071621937 >> 172.21.15.6:0/4071621937 conn(0x55684aa1b910 msgr2=0x55684adcb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- 172.21.15.6:0/4071621937 shutdown_connections 2024-09-21T08:09:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- 172.21.15.6:0/4071621937 wait complete. 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 -- start start 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.197+0000 7ff0812bc740 1 Processor -- start 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684add8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa27520 0x55684ade4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55684accf300 con 0x55684aa06840 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55684ad38430 con 0x55684a9fe660 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55684ab95bb0 con 0x55684aa27520 2024-09-21T08:09:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0812bc740 10 client.0 _ll_register_callbacks cb 0x55684ace9120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44458/0 (socket says 172.21.15.6:44458) 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 -- 172.21.15.6:0/588438504 learned_addr learned my addr 172.21.15.6:0/588438504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff078ae4640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684add8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff0792e5640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa27520 0x55684ade4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 -- 172.21.15.6:0/588438504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa27520 msgr2=0x55684ade4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa27520 0x55684ade4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 -- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 msgr2=0x55684add8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684add8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 -- 172.21.15.6:0/588438504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55684acbe780 con 0x55684aa06840 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.198+0000 7ff073fff640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff0600aaae0 tx=0x7ff060005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffe44c99cb40555 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ce60 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff0600b7000 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c04d030 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0600e5600 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 10 client.16740 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55684aa92b00 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff06c04d030 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0600aeba0 con 0x55684aa06840 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 10 client.16740 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 10 client.16740 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 20 client.16740 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684a9e5ea0 0x55684adeafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 4 client.16740 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.199+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55684ad47140 con 0x55684a9e5ea0 2024-09-21T08:09:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.200+0000 7ff078ae4640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684a9e5ea0 0x55684adeafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.200+0000 7ff078ae4640 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684a9e5ea0 0x55684adeafd0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db8fb94c0365836 server_cookie=6ba5bdbeee034ce0 in_seq=0 out_seq=0 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.200+0000 7ff053fff640 10 client.16740 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff053fff640 1 -- 172.21.15.6:0/588438504 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55684ad47140 con 0x55684a9e5ea0 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff053fff640 10 client.16740 handle_command_reply: tid=0 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 client.16740 shutdown 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 msgr2=0x55684add9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff0600aaae0 tx=0x7ff060005440 comp rx=0 tx=0).stop 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 shutdown_connections 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684a9e5ea0 0x55684adeafd0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff053fff640 0 client.16740 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa27520 0x55684ade4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684aa06840 0x55684add9150 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 --2- 172.21.15.6:0/588438504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684add8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 >> 172.21.15.6:0/588438504 conn(0x55684aa1b910 msgr2=0x55684add06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 shutdown_connections 2024-09-21T08:09:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 1 -- 172.21.15.6:0/588438504 wait complete. 2024-09-21T08:09:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.201+0000 7ff0812bc740 20 client.16740 trim_cache size 0 max 16384 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 Processor -- start 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 -- start start 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684a9fe660 0x55684adda840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 0x55684add25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741aeea0 con 0x55684a9e5ea0 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741b1700 con 0x55684aa06840 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff0812bc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741af4f0 con 0x55684a9fe660 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff078ae4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff078ae4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44472/0 (socket says 172.21.15.6:44472) 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.219+0000 7ff078ae4640 1 -- 172.21.15.6:0/1778994442 learned_addr learned my addr 172.21.15.6:0/1778994442 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff0792e5640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 0x55684add25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff073fff640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684a9fe660 0x55684adda840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 -- 172.21.15.6:0/1778994442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684a9fe660 msgr2=0x55684adda840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684a9fe660 0x55684adda840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 -- 172.21.15.6:0/1778994442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 msgr2=0x55684add25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 0x55684add25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 -- 172.21.15.6:0/1778994442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684ab09960 con 0x55684a9e5ea0 2024-09-21T08:09:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff0792e5640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 0x55684add25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff078ae4640 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff068000c00 tx=0x7ff068005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4ea4da4d1a972 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff05e7fc640 1 -- 172.21.15.6:0/1778994442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068025440 con 0x55684a9e5ea0 2024-09-21T08:09:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff05e7fc640 1 -- 172.21.15.6:0/1778994442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0680108c0 con 0x55684a9e5ea0 2024-09-21T08:09:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.220+0000 7ff05e7fc640 1 -- 172.21.15.6:0/1778994442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06801f7f0 con 0x55684a9e5ea0 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- 172.21.15.6:0/1778994442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 msgr2=0x55684ade4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff068000c00 tx=0x7ff068005f90 comp rx=0 tx=0).stop 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- 172.21.15.6:0/1778994442 shutdown_connections 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684a9fe660 0x55684adda840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684aa06840 0x55684add25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 --2- 172.21.15.6:0/1778994442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade4d60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- 172.21.15.6:0/1778994442 >> 172.21.15.6:0/1778994442 conn(0x55684aa1b910 msgr2=0x55684adda130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- 172.21.15.6:0/1778994442 shutdown_connections 2024-09-21T08:09:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- 172.21.15.6:0/1778994442 wait complete. 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 -- start start 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.221+0000 7ff0812bc740 1 Processor -- start 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684addbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684addc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741afbc0 con 0x55684a9e5ea0 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741b1030 con 0x55684a9fe660 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0741b0290 con 0x55684aa06840 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0812bc740 10 client.0 _ll_register_callbacks cb 0x7ff0600a90b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44484/0 (socket says 172.21.15.6:44484) 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 -- 172.21.15.6:0/2092787527 learned_addr learned my addr 172.21.15.6:0/2092787527 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff073fff640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684addbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff0792e5640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684addc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 -- 172.21.15.6:0/2092787527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 msgr2=0x55684addc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684addc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 -- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 msgr2=0x55684addbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684addbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff078ae4640 1 -- 172.21.15.6:0/2092787527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55684addc900 con 0x55684a9e5ea0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.222+0000 7ff073fff640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684addbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff078ae4640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff068010500 tx=0x7ff068010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303ccd918ec59556 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068035060 con 0x55684a9e5ea0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff068010c70 con 0x55684a9e5ea0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0680108c0 con 0x55684a9e5ea0 2024-09-21T08:09:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff06803c050 con 0x55684a9e5ea0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 10 client.16746 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55684ae566f0 con 0x55684a9e5ea0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0680108c0 con 0x55684a9e5ea0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff068023070 con 0x55684a9e5ea0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 10 client.16746 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 10 client.16746 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 20 client.16746 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.223+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684aa27520 0x55684ae58e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.224+0000 7ff0812bc740 4 client.16746 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "318480ac", "release": true, "await": true}] 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.224+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "318480ac", "release": true, "await": true}) -- 0x55684ad42bf0 con 0x55684aa27520 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.224+0000 7ff073fff640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684aa27520 0x55684ae58e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.224+0000 7ff073fff640 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684aa27520 0x55684ae58e60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95bbbc83d9be6f4a server_cookie=e1a521a2b9f59a10 in_seq=0 out_seq=0 2024-09-21T08:09:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.224+0000 7ff053fff640 10 client.16746 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff053fff640 1 -- 172.21.15.6:0/2092787527 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55684ad42bf0 con 0x55684aa27520 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff053fff640 10 client.16746 handle_command_reply: tid=0 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 client.16746 shutdown 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 msgr2=0x55684ade1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff068010500 tx=0x7ff068010530 comp rx=0 tx=0).stop 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 shutdown_connections 2024-09-21T08:09:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55684aa27520 0x55684ae58e60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55684aa06840 0x55684addc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55684a9fe660 0x55684addbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 --2- 172.21.15.6:0/2092787527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55684a9e5ea0 0x55684ade1440 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 >> 172.21.15.6:0/2092787527 conn(0x55684aa1b910 msgr2=0x55684adcb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff053fff640 0 client.16746 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.285+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 shutdown_connections 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff0812bc740 1 -- 172.21.15.6:0/2092787527 wait complete. 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff0812bc740 20 client.16746 trim_cache size 0 max 16384 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:29.288 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 36, 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "318480ac": { 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 36, 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:29.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 141.1, 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:29.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:29.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:29.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:29.291 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 msgr2=0x7ff0640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 0x7ff0640b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff06c048000 tx=0x7ff06c04a000 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 msgr2=0x7ff07419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.286+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e9c0 tx=0x7ff06000ee80 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 shutdown_connections 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0640b6680 0x7ff0640b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074109df0 0x7ff07419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0741094a0 0x7ff07419a9a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 --2- 172.21.15.6:0/3790276402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff074103b60 0x7ff07419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 >> 172.21.15.6:0/3790276402 conn(0x7ff07407b850 msgr2=0x7ff0741075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 shutdown_connections 2024-09-21T08:09:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:29.287+0000 7ff07ad48640 1 -- 172.21.15.6:0/3790276402 wait complete. 2024-09-21T08:09:29.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:29 smithi006 ceph-mon[30970]: pgmap v600: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 530 KiB/s wr, 65 op/s 2024-09-21T08:09:29.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:29 smithi145 ceph-mon[34049]: pgmap v600: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 530 KiB/s wr, 65 op/s 2024-09-21T08:09:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:29 smithi119 ceph-mon[33564]: pgmap v600: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 530 KiB/s wr, 65 op/s 2024-09-21T08:09:30.071 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '318480ac', total seconds elapsed: 24.6 2024-09-21T08:09:30.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:09:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:31.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:31 smithi006 ceph-mon[30970]: pgmap v601: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 KiB/s wr, 21 op/s 2024-09-21T08:09:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:31 smithi119 ceph-mon[33564]: pgmap v601: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 KiB/s wr, 21 op/s 2024-09-21T08:09:31.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:31 smithi145 ceph-mon[34049]: pgmap v601: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 KiB/s wr, 21 op/s 2024-09-21T08:09:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 395.0 s, 634.0 tps, lat 638.272 ms stddev 2975.840 2024-09-21T08:09:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 -- 172.21.15.6:0/1780863410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102870 msgr2=0x7f7644102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 --2- 172.21.15.6:0/1780863410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102870 0x7f7644102c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f762c009900 tx=0x7f762c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 -- 172.21.15.6:0/1780863410 shutdown_connections 2024-09-21T08:09:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 --2- 172.21.15.6:0/1780863410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7644108b00 0x7f764410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 --2- 172.21.15.6:0/1780863410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76441081b0 0x7f76441085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 --2- 172.21.15.6:0/1780863410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102870 0x7f7644102c80 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f762c009900 tx=0x7f762c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 -- 172.21.15.6:0/1780863410 >> 172.21.15.6:0/1780863410 conn(0x7f76440fe2c0 msgr2=0x7f7644100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 -- 172.21.15.6:0/1780863410 shutdown_connections 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.583+0000 7f764359e640 1 -- 172.21.15.6:0/1780863410 wait complete. 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.585+0000 7f764359e640 1 Processor -- start 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.588+0000 7f764359e640 1 -- start start 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.588+0000 7f764359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76441081b0 0x7f7644199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.588+0000 7f764359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644108b00 0x7f76441997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f764359e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f764359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7644112660 con 0x7f76441081b0 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f764359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76441124e0 con 0x7f7644108b00 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f764359e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76441127e0 con 0x7f764419e9d0 2024-09-21T08:09:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f7642d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f7642d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44836/0 (socket says 172.21.15.6:44836) 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f7642d9d640 1 -- 172.21.15.6:0/353827191 learned_addr learned my addr 172.21.15.6:0/353827191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f7641d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644108b00 0x7f76441997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.589+0000 7f7642d9d640 1 -- 172.21.15.6:0/353827191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644108b00 msgr2=0x7f76441997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.590+0000 7f7642d9d640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644108b00 0x7f76441997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.590+0000 7f7642d9d640 1 -- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76441081b0 msgr2=0x7f7644199250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.590+0000 7f7642d9d640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76441081b0 0x7f7644199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.590+0000 7f7642d9d640 1 -- 172.21.15.6:0/353827191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764419f5b0 con 0x7f764419e9d0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.591+0000 7f7642d9d640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f763c00eaf0 tx=0x7f763c009e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.592+0000 7f763b7fe640 1 -- 172.21.15.6:0/353827191 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c004b20 con 0x7f764419e9d0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.592+0000 7f763b7fe640 1 -- 172.21.15.6:0/353827191 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f763c007cf0 con 0x7f764419e9d0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.592+0000 7f763b7fe640 1 -- 172.21.15.6:0/353827191 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c005680 con 0x7f764419e9d0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.592+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764406ae60 con 0x7f764419e9d0 2024-09-21T08:09:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.592+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764406b290 con 0x7f764419e9d0 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.596+0000 7f764ee41740 1 Processor -- start 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.597+0000 7f764ee41740 1 -- start start 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.597+0000 7f764ee41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.597+0000 7f764ee41740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b515f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.597+0000 7f7641d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.597+0000 7f7641d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:33936/0 (socket says 172.21.15.6:33936) 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764ee41740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764ee41740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b5156ae50 con 0x555b5122c390 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764ee41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b5155a280 con 0x555b5124d070 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764ee41740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b5155e090 con 0x555b512241b0 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f763b7fe640 1 -- 172.21.15.6:0/353827191 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f763c005820 con 0x7f764419e9d0 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b515f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b515f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44848/0 (socket says 172.21.15.6:44848) 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f764259c640 1 -- 172.21.15.6:0/3661399070 learned_addr learned my addr 172.21.15.6:0/3661399070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f7641d9b640 1 -- 172.21.15.6:0/3661399070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 msgr2=0x555b515f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f7641d9b640 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b515f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f7641d9b640 1 -- 172.21.15.6:0/3661399070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 msgr2=0x555b515f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f7641d9b640 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.600+0000 7f7641d9b640 1 -- 172.21.15.6:0/3661399070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b512b8650 con 0x555b5124d070 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.601+0000 7f7641d9b640 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76340108c0 tx=0x7f7634009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408b1fd0597feaed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.601+0000 7f763b7fe640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 0x7f76300c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.601+0000 7f7638ff9640 1 -- 172.21.15.6:0/3661399070 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634004230 con 0x555b5124d070 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.601+0000 7f7638ff9640 1 -- 172.21.15.6:0/3661399070 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76340043d0 con 0x555b5124d070 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.602+0000 7f763b7fe640 1 -- 172.21.15.6:0/353827191 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f763c0e7260 con 0x7f764419e9d0 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f7638ff9640 1 -- 172.21.15.6:0/3661399070 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763401a830 con 0x555b5124d070 2024-09-21T08:09:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 -- 172.21.15.6:0/3661399070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 msgr2=0x555b515f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76340108c0 tx=0x7f7634009860 comp rx=0 tx=0).stop 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 -- 172.21.15.6:0/3661399070 shutdown_connections 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b515f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 --2- 172.21.15.6:0/3661399070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f47f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 -- 172.21.15.6:0/3661399070 >> 172.21.15.6:0/3661399070 conn(0x555b51241460 msgr2=0x555b515f26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764259c640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 0x7f76300c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 -- 172.21.15.6:0/3661399070 shutdown_connections 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.603+0000 7f764ee41740 1 -- 172.21.15.6:0/3661399070 wait complete. 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.604+0000 7f764ee41740 1 -- start start 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.604+0000 7f764259c640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 0x7f76300c9d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f762c0096c0 tx=0x7f762c000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.604+0000 7f764ee41740 1 Processor -- start 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 0x555b515ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5122c390 0x555b51600340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b516008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b513bb700 con 0x555b512241b0 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b514f5110 con 0x555b5124d070 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b51603020 con 0x555b5122c390 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764ee41740 10 client.0 _ll_register_callbacks cb 0x555b5150e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 0x555b515ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f7642d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b516008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 0x555b515ffe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44514/0 (socket says 172.21.15.6:44514) 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f764259c640 1 -- 172.21.15.6:0/3565438056 learned_addr learned my addr 172.21.15.6:0/3565438056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.605+0000 7f7641d9b640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5122c390 0x555b51600340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 -- 172.21.15.6:0/3565438056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5122c390 msgr2=0x555b51600340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5122c390 0x555b51600340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 -- 172.21.15.6:0/3565438056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 msgr2=0x555b515ffe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 0x555b515ffe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 -- 172.21.15.6:0/3565438056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b51522c40 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7642d9d640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b516008a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f763c0e4570 tx=0x7f763c007c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8df5d98fd9ba1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c0ac5c0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76340043d0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.606+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f763c0a87c0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.607+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f763c0a83e0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.607+0000 7f764ee41740 10 client.26366 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.607+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b5160eda0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.607+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76340043d0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f763c0b4ad0 con 0x555b5124d070 2024-09-21T08:09:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 10 client.26366 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 10 client.26366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 20 client.26366 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5120b9f0 0x555b516121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 4 client.26366 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.608+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b5156cda0 con 0x555b5120b9f0 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.609+0000 7f764259c640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5120b9f0 0x555b516121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.609+0000 7f764259c640 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5120b9f0 0x555b516121c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=738b7c18c6d468fe server_cookie=712e0b6e472a95c8 in_seq=0 out_seq=0 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.609+0000 7f7629ffb640 10 client.26366 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f7629ffb640 1 -- 172.21.15.6:0/3565438056 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b5156cda0 con 0x555b5120b9f0 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f7629ffb640 10 client.26366 handle_command_reply: tid=0 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 client.26366 shutdown 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 msgr2=0x555b516008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b516008a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f763c0e4570 tx=0x7f763c007c30 comp rx=0 tx=0).stop 2024-09-21T08:09:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 shutdown_connections 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5120b9f0 0x555b516121c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5122c390 0x555b51600340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b516008a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 --2- 172.21.15.6:0/3565438056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b512241b0 0x555b515ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f7629ffb640 0 client.26366 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 >> 172.21.15.6:0/3565438056 conn(0x555b51241460 msgr2=0x555b515f7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 shutdown_connections 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 1 -- 172.21.15.6:0/3565438056 wait complete. 2024-09-21T08:09:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.611+0000 7f764ee41740 20 client.26366 trim_cache size 0 max 16384 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.646+0000 7f764ee41740 1 Processor -- start 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.646+0000 7f764ee41740 1 -- start start 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b51601ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76441ad0f0 con 0x555b5122c390 2024-09-21T08:09:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76441af950 con 0x555b5124d070 2024-09-21T08:09:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764ee41740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76441ad740 con 0x555b512241b0 2024-09-21T08:09:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f7641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f7641d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44520/0 (socket says 172.21.15.6:44520) 2024-09-21T08:09:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f7641d9b640 1 -- 172.21.15.6:0/1677347235 learned_addr learned my addr 172.21.15.6:0/1677347235 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.647+0000 7f764259c640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b51601ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7642d9d640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 -- 172.21.15.6:0/1677347235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 msgr2=0x555b51601ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b51601ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 -- 172.21.15.6:0/1677347235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 msgr2=0x555b515f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 -- 172.21.15.6:0/1677347235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5160c2c0 con 0x555b5122c390 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f764259c640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b51601ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.648+0000 7f7641d9b640 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f763400a010 tx=0x7f7634009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744c3bb6a09965ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.649+0000 7f762bfff640 1 -- 172.21.15.6:0/1677347235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763402b070 con 0x555b5122c390 2024-09-21T08:09:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.649+0000 7f762bfff640 1 -- 172.21.15.6:0/1677347235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7634005270 con 0x555b5122c390 2024-09-21T08:09:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.649+0000 7f762bfff640 1 -- 172.21.15.6:0/1677347235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763401a740 con 0x555b5122c390 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 -- 172.21.15.6:0/1677347235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 msgr2=0x555b515f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f763400a010 tx=0x7f7634009fa0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 -- 172.21.15.6:0/1677347235 shutdown_connections 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5124d070 0x555b515f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b515f5f30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 --2- 172.21.15.6:0/1677347235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b512241b0 0x555b51601ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.650+0000 7f764ee41740 1 -- 172.21.15.6:0/1677347235 >> 172.21.15.6:0/1677347235 conn(0x555b51241460 msgr2=0x555b515f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.651+0000 7f764ee41740 1 -- 172.21.15.6:0/1677347235 shutdown_connections 2024-09-21T08:09:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.651+0000 7f764ee41740 1 -- 172.21.15.6:0/1677347235 wait complete. 2024-09-21T08:09:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.652+0000 7f764ee41740 1 -- start start 2024-09-21T08:09:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.652+0000 7f764ee41740 1 Processor -- start 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.652+0000 7f764ee41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 0x555b51604c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b516051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76441ade10 con 0x555b5122c390 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76441af280 con 0x555b512241b0 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f7642d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f7642d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44888/0 (socket says 172.21.15.6:44888) 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f7642d9d640 1 -- 172.21.15.6:0/2388547123 learned_addr learned my addr 172.21.15.6:0/2388547123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f7641d9b640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b516051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76441ae4e0 con 0x555b5124d070 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764ee41740 10 client.0 _ll_register_callbacks cb 0x7f763c007ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.653+0000 7f764259c640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 0x555b51604c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 -- 172.21.15.6:0/2388547123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 msgr2=0x555b51675b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 -- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 msgr2=0x555b51604c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 0x555b51604c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 -- 172.21.15.6:0/2388547123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b51676170 con 0x555b5122c390 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7642d9d640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f764259c640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 0x555b51604c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7641d9b640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b516051e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f76340092a0 tx=0x7f7634003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823719eed634db8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.654+0000 7f7629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.655+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763402b030 con 0x555b5122c390 2024-09-21T08:09:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.655+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f7634026460 con 0x555b5122c390 2024-09-21T08:09:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.655+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7634005270 con 0x555b5122c390 2024-09-21T08:09:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f76340050c0 con 0x555b5122c390 2024-09-21T08:09:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f764ee41740 10 client.16758 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b5167d4c0 con 0x555b5122c390 2024-09-21T08:09:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f763402c040 con 0x555b5122c390 2024-09-21T08:09:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f763400f040 con 0x555b5122c390 2024-09-21T08:09:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f764ee41740 10 client.16758 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f764ee41740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.656+0000 7f764ee41740 20 client.16758 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.657+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b511e0da0 0x555b5167f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.657+0000 7f764ee41740 4 client.16758 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:09:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.657+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7634005270 con 0x555b511e0da0 2024-09-21T08:09:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.659+0000 7f764259c640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b511e0da0 0x555b5167f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:32.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.660+0000 7f764259c640 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b511e0da0 0x555b5167f850 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e244877e7bea59 server_cookie=c303900231bbff1a in_seq=0 out_seq=0 2024-09-21T08:09:32.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.660+0000 7f7629ffb640 10 client.16758 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.660+0000 7f7629ffb640 1 -- 172.21.15.6:0/2388547123 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x7f7634005270 con 0x555b511e0da0 2024-09-21T08:09:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.660+0000 7f7629ffb640 10 client.16758 handle_command_reply: tid=0 2024-09-21T08:09:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.660+0000 7f764ee41740 1 client.16758 shutdown 2024-09-21T08:09:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 msgr2=0x555b516051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b516051e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f76340092a0 tx=0x7f7634003ad0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 shutdown_connections 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b511e0da0 0x555b5167f850 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5124d070 0x555b51675b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5122c390 0x555b516051e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 --2- 172.21.15.6:0/2388547123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b512241b0 0x555b51604c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.661+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 >> 172.21.15.6:0/2388547123 conn(0x555b51241460 msgr2=0x555b5160ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.662+0000 7f7629ffb640 0 client.16758 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.662+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 shutdown_connections 2024-09-21T08:09:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.662+0000 7f764ee41740 1 -- 172.21.15.6:0/2388547123 wait complete. 2024-09-21T08:09:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.662+0000 7f764ee41740 20 client.16758 trim_cache size 0 max 16384 2024-09-21T08:09:32.665 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:32.665 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:09:32.666 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:09:32.669 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:09:32.672 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:32.673 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.663+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 msgr2=0x7f76300c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.663+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 0x7f76300c9d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f762c0096c0 tx=0x7f762c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 msgr2=0x7f764419ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f763c00eaf0 tx=0x7f763c009e40 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 shutdown_connections 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f76300c7860 0x7f76300c9d70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f764419e9d0 0x7f764419ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644108b00 0x7f76441997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 --2- 172.21.15.6:0/353827191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76441081b0 0x7f7644199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 >> 172.21.15.6:0/353827191 conn(0x7f76440fe2c0 msgr2=0x7f76441006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:32.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 shutdown_connections 2024-09-21T08:09:32.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:32.664+0000 7f764359e640 1 -- 172.21.15.6:0/353827191 wait complete. 2024-09-21T08:09:33.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:33 smithi006 ceph-mon[30970]: pgmap v602: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 944 KiB/s wr, 58 op/s 2024-09-21T08:09:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:33 smithi119 ceph-mon[33564]: pgmap v602: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 944 KiB/s wr, 58 op/s 2024-09-21T08:09:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:33 smithi145 ceph-mon[34049]: pgmap v602: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 944 KiB/s wr, 58 op/s 2024-09-21T08:09:34.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:09:34.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:09:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/1290625298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b4077940 msgr2=0x7fb0b4077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/1290625298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b4077940 0x7fb0b4077d50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009ca0 tx=0x7fb0a402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/1290625298 shutdown_connections 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/1290625298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b41145b0 0x7fb0b41169d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/1290625298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4078290 0x7fb0b4114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/1290625298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b4077940 0x7fb0b4077d50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.162+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/1290625298 >> 172.21.15.6:0/1290625298 conn(0x7fb0b41016c0 msgr2=0x7fb0b4103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:35.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.163+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/1290625298 shutdown_connections 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.163+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/1290625298 wait complete. 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 Processor -- start 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 -- start start 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4077940 0x7fb0b41a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 0x7fb0b41a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4119e10 con 0x7fb0b41145b0 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4119c90 con 0x7fb0b4077940 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.164+0000 7fb0b9d1a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4119f90 con 0x7fb0b4078290 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.165+0000 7fb0b2ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 0x7fb0b41a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.165+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.165+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44542/0 (socket says 172.21.15.6:44542) 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.165+0000 7fb0b3fff640 1 -- 172.21.15.6:0/2851649716 learned_addr learned my addr 172.21.15.6:0/2851649716 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.165+0000 7fb0b37fe640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4077940 0x7fb0b41a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b3fff640 1 -- 172.21.15.6:0/2851649716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 msgr2=0x7fb0b41a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b3fff640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 0x7fb0b41a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b3fff640 1 -- 172.21.15.6:0/2851649716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4077940 msgr2=0x7fb0b41a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b3fff640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4077940 0x7fb0b41a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b3fff640 1 -- 172.21.15.6:0/2851649716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b41a67f0 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.166+0000 7fb0b2ffd640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 0x7fb0b41a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.167+0000 7fb0b3fff640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00e970 tx=0x7fb0ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.168+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00ccc0 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.168+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0ac00ce60 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.168+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac010430 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.168+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b41a6ae0 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.168+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b4107830 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.169+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b4078e50 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.173+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb0ac004ef0 con 0x7fb0b41145b0 2024-09-21T08:09:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.175+0000 7fb0b0ff9640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 0x7fb0a00b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.175+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fb0ac0e80f0 con 0x7fb0b41145b0 2024-09-21T08:09:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.176+0000 7fb0b37fe640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 0x7fb0a00b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.178+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0ac056710 con 0x7fb0b41145b0 2024-09-21T08:09:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.179+0000 7fb0b37fe640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 0x7fb0a00b8d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4006010 tx=0x7fb0a4031000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.614+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0b4077d50 con 0x7fb0b41145b0 2024-09-21T08:09:35.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.621+0000 7fb0b0ff9640 1 -- 172.21.15.6:0/2851649716 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fb0ac0ae280 con 0x7fb0b41145b0 2024-09-21T08:09:35.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:09:35.624 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:09:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 msgr2=0x7fb0a00b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 0x7fb0a00b8d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4006010 tx=0x7fb0a4031000 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 msgr2=0x7fb0b41a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00e970 tx=0x7fb0ac00ed70 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 shutdown_connections 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb0a00b6850 0x7fb0a00b8d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0b4078290 0x7fb0b41a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b41145b0 0x7fb0b41a60c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 --2- 172.21.15.6:0/2851649716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0b4077940 0x7fb0b41a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.626+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 >> 172.21.15.6:0/2851649716 conn(0x7fb0b41016c0 msgr2=0x7fb0b4116690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.627+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 shutdown_connections 2024-09-21T08:09:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:35.627+0000 7fb0b9d1a640 1 -- 172.21.15.6:0/2851649716 wait complete. 2024-09-21T08:09:35.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:35 smithi006 ceph-mon[30970]: pgmap v603: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-09-21T08:09:35.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:35 smithi119 ceph-mon[33564]: pgmap v603: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-09-21T08:09:35.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:35 smithi145 ceph-mon[34049]: pgmap v603: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-09-21T08:09:36.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:36 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2851649716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:36.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:36 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2851649716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:36.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:36 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2851649716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 400.0 s, 810.8 tps, lat 125.190 ms stddev 104.856 2024-09-21T08:09:37.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:37 smithi119 ceph-mon[33564]: pgmap v604: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T08:09:37.933 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:37 smithi006 ceph-mon[30970]: pgmap v604: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T08:09:37.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:37 smithi145 ceph-mon[34049]: pgmap v604: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T08:09:37.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:09:38.435 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:39.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.066+0000 7fd1ceb14640 1 -- 172.21.15.6:0/610360788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c81083a0 msgr2=0x7fd1c81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.066+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/610360788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c81083a0 0x7fd1c81087b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009900 tx=0x7fd1b402a410 comp rx=0 tx=0).stop 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 -- 172.21.15.6:0/610360788 shutdown_connections 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/610360788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c81083a0 0x7fd1c81087b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/610360788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c8108cf0 0x7fd1c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/610360788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8102a60 0x7fd1c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 -- 172.21.15.6:0/610360788 >> 172.21.15.6:0/610360788 conn(0x7fd1c8079730 msgr2=0x7fd1c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 -- 172.21.15.6:0/610360788 shutdown_connections 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.067+0000 7fd1ceb14640 1 -- 172.21.15.6:0/610360788 wait complete. 2024-09-21T08:09:39.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.068+0000 7fd1ceb14640 1 Processor -- start 2024-09-21T08:09:39.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.068+0000 7fd1ceb14640 1 -- start start 2024-09-21T08:09:39.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 0x7fd1c8198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 0x7fd1c81987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8108cf0 0x7fd1c819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8111750 con 0x7fd1c8108cf0 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81115d0 con 0x7fd1c81083a0 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1ceb14640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81118d0 con 0x7fd1c8102a60 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1cc8b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 0x7fd1c8198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1cc8b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 0x7fd1c8198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48706/0 (socket says 172.21.15.6:48706) 2024-09-21T08:09:39.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.069+0000 7fd1cc8b0640 1 -- 172.21.15.6:0/630243208 learned_addr learned my addr 172.21.15.6:0/630243208 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 0x7fd1c81987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8108cf0 0x7fd1c819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 -- 172.21.15.6:0/630243208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 msgr2=0x7fd1c8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 0x7fd1c8198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 -- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8108cf0 msgr2=0x7fd1c819da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8108cf0 0x7fd1c819da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.070+0000 7fd1c7fff640 1 -- 172.21.15.6:0/630243208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c819e190 con 0x7fd1c81083a0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 0x7fd1c81987c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009230 tx=0x7fd1b4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1c5ffb640 1 -- 172.21.15.6:0/630243208 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b403f070 con 0x7fd1c81083a0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c819e420 con 0x7fd1c81083a0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1c5ffb640 1 -- 172.21.15.6:0/630243208 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1b403baf0 con 0x7fd1c81083a0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1c5ffb640 1 -- 172.21.15.6:0/630243208 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4035030 con 0x7fd1c81083a0 2024-09-21T08:09:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.071+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c81a4be0 con 0x7fd1c81083a0 2024-09-21T08:09:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.075+0000 7fd1d5088740 1 Processor -- start 2024-09-21T08:09:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1c5ffb640 1 -- 172.21.15.6:0/630243208 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd1b4042070 con 0x7fd1c81083a0 2024-09-21T08:09:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 -- start start 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2d9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed246ea0 con 0x55d7ecf29070 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed2362d0 con 0x55d7ecf08390 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.076+0000 7fd1d5088740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed23a0e0 con 0x55d7ecf001b0 2024-09-21T08:09:39.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1cc8b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1c5ffb640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 0x7fd1b80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1cc8b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48714/0 (socket says 172.21.15.6:48714) 2024-09-21T08:09:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2d9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1cc8b0640 1 -- 172.21.15.6:0/2135402664 learned_addr learned my addr 172.21.15.6:0/2135402664 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 0x7fd1b80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.077+0000 7fd1c5ffb640 1 -- 172.21.15.6:0/630243208 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd1b41082d0 con 0x7fd1c81083a0 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 -- 172.21.15.6:0/2135402664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 msgr2=0x55d7ed2d9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2d9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 -- 172.21.15.6:0/2135402664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 msgr2=0x55d7ed2d8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 0x7fd1b80b8bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009350 tx=0x7fd1c000b380 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2d8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 -- 172.21.15.6:0/2135402664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ecf94650 con 0x55d7ecf001b0 2024-09-21T08:09:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.078+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0115c0 tx=0x7fd1bc0119c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=926cb37573436234 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.079+0000 7fd1b2ffd640 1 -- 172.21.15.6:0/2135402664 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e070 con 0x55d7ecf001b0 2024-09-21T08:09:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.079+0000 7fd1b2ffd640 1 -- 172.21.15.6:0/2135402664 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1bc00f910 con 0x55d7ecf001b0 2024-09-21T08:09:39.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.080+0000 7fd1b2ffd640 1 -- 172.21.15.6:0/2135402664 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e070 con 0x55d7ecf001b0 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 -- 172.21.15.6:0/2135402664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 msgr2=0x55d7ed2d93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0115c0 tx=0x7fd1bc0119c0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 -- 172.21.15.6:0/2135402664 shutdown_connections 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2d93f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2d9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 --2- 172.21.15.6:0/2135402664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 -- 172.21.15.6:0/2135402664 >> 172.21.15.6:0/2135402664 conn(0x55d7ecf1d460 msgr2=0x55d7ed2d6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 -- 172.21.15.6:0/2135402664 shutdown_connections 2024-09-21T08:09:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.081+0000 7fd1d5088740 1 -- 172.21.15.6:0/2135402664 wait complete. 2024-09-21T08:09:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.082+0000 7fd1d5088740 1 -- start start 2024-09-21T08:09:39.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.082+0000 7fd1d5088740 1 Processor -- start 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed097700 con 0x55d7ecf29070 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed1d1160 con 0x55d7ecf08390 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed2e76e0 con 0x55d7ecf001b0 2024-09-21T08:09:39.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1d5088740 10 client.0 _ll_register_callbacks cb 0x55d7ed1ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.083+0000 7fd1cc8b0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55320/0 (socket says 172.21.15.6:55320) 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1c7fff640 1 -- 172.21.15.6:0/1858138576 learned_addr learned my addr 172.21.15.6:0/1858138576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/1858138576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 msgr2=0x55d7ed2e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 msgr2=0x55d7ed2e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.084+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/1858138576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ed1fec90 con 0x55d7ecf29070 2024-09-21T08:09:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.086+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2f0a20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000bcd0 tx=0x7fd1c0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dd32a9ece16216 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.086+0000 7fd1a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:39.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0016040 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd1c0009040 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1bc00f910 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd1c0041050 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1d5088740 10 client.16776 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.087+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d7ed2f3400 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1bc00f910 con 0x55d7ecf29070 2024-09-21T08:09:39.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd1c0003870 con 0x55d7ecf29070 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 10 client.16776 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 20 client.16776 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecee79f0 0x55d7ed2f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 4 client.16776 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.088+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7ed248df0 con 0x55d7ecee79f0 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.089+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecee79f0 0x55d7ed2f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.090+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecee79f0 0x55d7ed2f6dd0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80dc114b5c78b066 server_cookie=5b254c61eedf9e6b in_seq=0 out_seq=0 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.090+0000 7fd1a7fff640 10 client.16776 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.090+0000 7fd1a7fff640 1 -- 172.21.15.6:0/1858138576 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7ed248df0 con 0x55d7ecee79f0 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.090+0000 7fd1a7fff640 10 client.16776 handle_command_reply: tid=0 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.090+0000 7fd1d5088740 1 client.16776 shutdown 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 msgr2=0x55d7ed2f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2f0a20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000bcd0 tx=0x7fd1c0005f90 comp rx=0 tx=0).stop 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 shutdown_connections 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecee79f0 0x55d7ed2f6dd0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf29070 0x55d7ed2f0a20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1a7fff640 0 client.16776 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:39.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecf08390 0x55d7ed2e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 --2- 172.21.15.6:0/1858138576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.091+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 >> 172.21.15.6:0/1858138576 conn(0x55d7ecf1d460 msgr2=0x55d7ed2dc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.092+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 shutdown_connections 2024-09-21T08:09:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.092+0000 7fd1d5088740 1 -- 172.21.15.6:0/1858138576 wait complete. 2024-09-21T08:09:39.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.092+0000 7fd1d5088740 20 client.16776 trim_cache size 0 max 16384 2024-09-21T08:09:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.117+0000 7fd1d5088740 1 Processor -- start 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.117+0000 7fd1d5088740 1 -- start start 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf08390 0x55d7ed2e1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8074e00 con 0x55d7ecf08390 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81a6e20 con 0x55d7ecee79f0 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1d5088740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8075450 con 0x55d7ecf001b0 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48734/0 (socket says 172.21.15.6:48734) 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 -- 172.21.15.6:0/3914917942 learned_addr learned my addr 172.21.15.6:0/3914917942 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf08390 0x55d7ed2e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 -- 172.21.15.6:0/3914917942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 msgr2=0x55d7ed2e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 -- 172.21.15.6:0/3914917942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf08390 msgr2=0x55d7ed2e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf08390 0x55d7ed2e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.118+0000 7fd1c7fff640 1 -- 172.21.15.6:0/3914917942 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ed2c99c0 con 0x55d7ecf001b0 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.119+0000 7fd1c7fff640 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4108570 tx=0x7fd1b4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f7b0db451961817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.119+0000 7fd1b27fc640 1 -- 172.21.15.6:0/3914917942 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4049040 con 0x55d7ecf001b0 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.119+0000 7fd1b27fc640 1 -- 172.21.15.6:0/3914917942 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1b40cd7f0 con 0x55d7ecf001b0 2024-09-21T08:09:39.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.119+0000 7fd1b27fc640 1 -- 172.21.15.6:0/3914917942 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4105860 con 0x55d7ecf001b0 2024-09-21T08:09:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 -- 172.21.15.6:0/3914917942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 msgr2=0x55d7ed2f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4108570 tx=0x7fd1b4009260 comp rx=0 tx=0).stop 2024-09-21T08:09:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 -- 172.21.15.6:0/3914917942 shutdown_connections 2024-09-21T08:09:39.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf001b0 0x55d7ed2f0920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf08390 0x55d7ed2e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3914917942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.120+0000 7fd1d5088740 1 -- 172.21.15.6:0/3914917942 >> 172.21.15.6:0/3914917942 conn(0x55d7ecf1d460 msgr2=0x55d7ed2e42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.121+0000 7fd1d5088740 1 -- 172.21.15.6:0/3914917942 shutdown_connections 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.121+0000 7fd1d5088740 1 -- 172.21.15.6:0/3914917942 wait complete. 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.122+0000 7fd1d5088740 1 -- start start 2024-09-21T08:09:39.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.122+0000 7fd1d5088740 1 Processor -- start 2024-09-21T08:09:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.123+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2ed280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.123+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.123+0000 7fd1d5088740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.123+0000 7fd1d5088740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81a52e0 con 0x55d7ecf001b0 2024-09-21T08:09:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.123+0000 7fd1d5088740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81a6750 con 0x55d7ecee79f0 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1d5088740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81a59b0 con 0x55d7ecf08390 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48736/0 (socket says 172.21.15.6:48736) 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/3479713493 learned_addr learned my addr 172.21.15.6:0/3479713493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1d5088740 10 client.0 _ll_register_callbacks cb 0x7fd1c000bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 msgr2=0x55d7ed2ed280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2ed280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/3479713493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf001b0 msgr2=0x55d7ed2e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.124+0000 7fd1cd0b1640 1 -- 172.21.15.6:0/3479713493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ed2e9510 con 0x55d7ecf08390 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.125+0000 7fd1cd0b1640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000b800 tx=0x7fd1c001bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=348cbad7b44b43a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.125+0000 7fd1a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.125+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c004b070 con 0x55d7ecf08390 2024-09-21T08:09:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.126+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1b40cd7f0 con 0x55d7ecf08390 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.126+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd1c0003800 con 0x55d7ecf08390 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.127+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd1c0054050 con 0x55d7ecf08390 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.127+0000 7fd1d5088740 10 client.26512 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.127+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d7ed2d5e50 con 0x55d7ecf08390 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1c0003a40 con 0x55d7ecf08390 2024-09-21T08:09:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd1c004e020 con 0x55d7ecf08390 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 10 client.26512 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 10 client.26512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 20 client.26512 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecf29070 0x55d7ed36c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 4 client.26512 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.128+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd1b40cd7f0 con 0x55d7ecf29070 2024-09-21T08:09:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.129+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecf29070 0x55d7ed36c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.130+0000 7fd1a7fff640 10 client.26512 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.130+0000 7fd1cc8b0640 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecf29070 0x55d7ed36c7c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d21e09ea1bd1d7 server_cookie=f24bb46fc73b430c in_seq=0 out_seq=0 2024-09-21T08:09:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1a7fff640 1 -- 172.21.15.6:0/3479713493 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd1b40cd7f0 con 0x55d7ecf29070 2024-09-21T08:09:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1a7fff640 10 client.26512 handle_command_reply: tid=0 2024-09-21T08:09:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1d5088740 1 client.26512 shutdown 2024-09-21T08:09:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 msgr2=0x55d7ed2e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000b800 tx=0x7fd1c001bdb0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 shutdown_connections 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.132+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d7ecf29070 0x55d7ed36c7c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7ecf08390 0x55d7ed2e8d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7ecf001b0 0x55d7ed2e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1a7fff640 0 client.26512 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 --2- 172.21.15.6:0/3479713493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7ecee79f0 0x55d7ed2ed280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 >> 172.21.15.6:0/3479713493 conn(0x55d7ecf1d460 msgr2=0x55d7ed2d9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 shutdown_connections 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 1 -- 172.21.15.6:0/3479713493 wait complete. 2024-09-21T08:09:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.133+0000 7fd1d5088740 20 client.26512 trim_cache size 0 max 16384 2024-09-21T08:09:39.137 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:09:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 msgr2=0x7fd1b80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 0x7fd1b80b8bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009350 tx=0x7fd1c000b380 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 msgr2=0x7fd1c81987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 0x7fd1c81987c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009230 tx=0x7fd1b4003b90 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 shutdown_connections 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd1b80b66b0 0x7fd1b80b8bc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1c8108cf0 0x7fd1c819da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c81083a0 0x7fd1c81987c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 --2- 172.21.15.6:0/630243208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1c8102a60 0x7fd1c8198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.134+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 >> 172.21.15.6:0/630243208 conn(0x7fd1c8079730 msgr2=0x7fd1c81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.135+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 shutdown_connections 2024-09-21T08:09:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:39.135+0000 7fd1ceb14640 1 -- 172.21.15.6:0/630243208 wait complete. 2024-09-21T08:09:39.895 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:39 smithi006 ceph-mon[30970]: pgmap v605: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-21T08:09:39.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:39 smithi119 ceph-mon[33564]: pgmap v605: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-21T08:09:39.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:39 smithi145 ceph-mon[34049]: pgmap v605: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.3 MiB/s wr, 295 op/s 2024-09-21T08:09:40.950 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:09:40.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:09:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:41.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:41 smithi119 ceph-mon[33564]: pgmap v606: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2024-09-21T08:09:41.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:41 smithi145 ceph-mon[34049]: pgmap v606: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2024-09-21T08:09:41.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:41 smithi006 ceph-mon[30970]: pgmap v606: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2024-09-21T08:09:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 405.0 s, 854.6 tps, lat 117.046 ms stddev 45.915 2024-09-21T08:09:42.805 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:42 smithi006 ceph-mon[30970]: pgmap v607: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.2 MiB/s wr, 593 op/s 2024-09-21T08:09:42.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:42 smithi119 ceph-mon[33564]: pgmap v607: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.2 MiB/s wr, 593 op/s 2024-09-21T08:09:42.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:42 smithi145 ceph-mon[34049]: pgmap v607: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.2 MiB/s wr, 593 op/s 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 -- 172.21.15.6:0/3757985639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 msgr2=0x7f367c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 --2- 172.21.15.6:0/3757985639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c103dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3678009860 tx=0x7f367802a360 comp rx=0 tx=0).stop 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 -- 172.21.15.6:0/3757985639 shutdown_connections 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 --2- 172.21.15.6:0/3757985639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367c109c40 0x7f367c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 --2- 172.21.15.6:0/3757985639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c1092f0 0x7f367c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 --2- 172.21.15.6:0/3757985639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c103dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.431+0000 7f36827f9640 1 -- 172.21.15.6:0/3757985639 >> 172.21.15.6:0/3757985639 conn(0x7f367c0ff400 msgr2=0x7f367c101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.432+0000 7f36827f9640 1 -- 172.21.15.6:0/3757985639 shutdown_connections 2024-09-21T08:09:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.432+0000 7f36827f9640 1 -- 172.21.15.6:0/3757985639 wait complete. 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.433+0000 7f36827f9640 1 Processor -- start 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 -- start start 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367c1092f0 0x7f367c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 0x7f367c072930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f367c113840 con 0x7f367c1092f0 2024-09-21T08:09:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1136c0 con 0x7f367c109c40 2024-09-21T08:09:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.434+0000 7f36827f9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1139c0 con 0x7f367c1039b0 2024-09-21T08:09:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.435+0000 7f36817f7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.436+0000 7f36817f7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48758/0 (socket says 172.21.15.6:48758) 2024-09-21T08:09:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.436+0000 7f36817f7640 1 -- 172.21.15.6:0/535248024 learned_addr learned my addr 172.21.15.6:0/535248024 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.437+0000 7f3681ff8640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 0x7f367c072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.440+0000 7f3681ff8640 1 -- 172.21.15.6:0/535248024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 msgr2=0x7f367c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.440+0000 7f3681ff8640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.440+0000 7f3681ff8640 1 -- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367c1092f0 msgr2=0x7f367c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.440+0000 7f3681ff8640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367c1092f0 0x7f367c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.440+0000 7f3681ff8640 1 -- 172.21.15.6:0/535248024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c073060 con 0x7f367c109c40 2024-09-21T08:09:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.443+0000 7f3681ff8640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 0x7f367c072930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f367400efc0 tx=0x7f367400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.443+0000 7f36727fc640 1 -- 172.21.15.6:0/535248024 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674003970 con 0x7f367c109c40 2024-09-21T08:09:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.444+0000 7f36727fc640 1 -- 172.21.15.6:0/535248024 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3674004020 con 0x7f367c109c40 2024-09-21T08:09:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.444+0000 7f36727fc640 1 -- 172.21.15.6:0/535248024 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367400b850 con 0x7f367c109c40 2024-09-21T08:09:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.445+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c0732f0 con 0x7f367c109c40 2024-09-21T08:09:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.445+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c073aa0 con 0x7f367c109c40 2024-09-21T08:09:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.450+0000 7f3689fcf740 1 Processor -- start 2024-09-21T08:09:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.452+0000 7f36727fc640 1 -- 172.21.15.6:0/535248024 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f367401d020 con 0x7f367c109c40 2024-09-21T08:09:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.454+0000 7f3689fcf740 1 -- start start 2024-09-21T08:09:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.454+0000 7f36727fc640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 0x7f36680b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f36727fc640 1 -- 172.21.15.6:0/535248024 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f36740e7ab0 con 0x7f367c109c40 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3680ff6640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 0x7f36680b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f95b350 0x56519fd025e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd03060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56519fc78e60 con 0x56519f93a670 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56519fc68290 con 0x56519f95b350 2024-09-21T08:09:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.455+0000 7f3689fcf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56519fc6c0a0 con 0x56519f932490 2024-09-21T08:09:43.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.456+0000 7f3680ff6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.456+0000 7f3680ff6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48772/0 (socket says 172.21.15.6:48772) 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.456+0000 7f3680ff6640 1 -- 172.21.15.6:0/402047880 learned_addr learned my addr 172.21.15.6:0/402047880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.457+0000 7f3681ff8640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd03060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.457+0000 7f36817f7640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f95b350 0x56519fd025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 -- 172.21.15.6:0/402047880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f95b350 msgr2=0x56519fd025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f95b350 0x56519fd025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 -- 172.21.15.6:0/402047880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 msgr2=0x56519fd03060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd03060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 -- 172.21.15.6:0/402047880 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519f9c6930 con 0x56519f932490 2024-09-21T08:09:43.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3681ff8640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd03060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:43.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.458+0000 7f3680ff6640 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f366c014660 tx=0x7f366c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ade07e202379c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.459+0000 7f36677fe640 1 -- 172.21.15.6:0/402047880 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c005a30 con 0x56519f932490 2024-09-21T08:09:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.459+0000 7f36677fe640 1 -- 172.21.15.6:0/402047880 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f366c010040 con 0x56519f932490 2024-09-21T08:09:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.459+0000 7f36677fe640 1 -- 172.21.15.6:0/402047880 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c017cf0 con 0x56519f932490 2024-09-21T08:09:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.460+0000 7f3689fcf740 1 -- 172.21.15.6:0/402047880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 msgr2=0x56519fd02b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.460+0000 7f3689fcf740 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f366c014660 tx=0x7f366c009f90 comp rx=0 tx=0).stop 2024-09-21T08:09:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.460+0000 7f3680ff6640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 0x7f36680b8bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f366c014fb0 tx=0x7f366c00c000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 -- 172.21.15.6:0/402047880 shutdown_connections 2024-09-21T08:09:43.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f932490 0x56519fd02b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd03060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 --2- 172.21.15.6:0/402047880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f95b350 0x56519fd025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 -- 172.21.15.6:0/402047880 >> 172.21.15.6:0/402047880 conn(0x56519f94f740 msgr2=0x56519fd004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.461+0000 7f3689fcf740 1 -- 172.21.15.6:0/402047880 shutdown_connections 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.462+0000 7f3689fcf740 1 -- 172.21.15.6:0/402047880 wait complete. 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.462+0000 7f3689fcf740 1 -- start start 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.462+0000 7f3689fcf740 1 Processor -- start 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f932490 0x56519fd0e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd1a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56519fac9890 con 0x56519f932490 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56519fc02d40 con 0x56519f93a670 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56519fd10d60 con 0x56519f95b350 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3689fcf740 10 client.0 _ll_register_callbacks cb 0x56519fc66c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3680ff6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3681ff8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd1a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3680ff6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55364/0 (socket says 172.21.15.6:55364) 2024-09-21T08:09:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.463+0000 7f3680ff6640 1 -- 172.21.15.6:0/701702200 learned_addr learned my addr 172.21.15.6:0/701702200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 -- 172.21.15.6:0/701702200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 msgr2=0x56519fd1a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd1a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 -- 172.21.15.6:0/701702200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f932490 msgr2=0x56519fd0e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f932490 0x56519fd0e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 -- 172.21.15.6:0/701702200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519fd1a6c0 con 0x56519f93a670 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.464+0000 7f3680ff6640 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f366c017b50 tx=0x7f366c017b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43bbb0171f5df7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.465+0000 7f3664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.465+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0095f0 con 0x56519f93a670 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.465+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f366c010040 con 0x56519f93a670 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.465+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f366c006000 con 0x56519f93a670 2024-09-21T08:09:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.466+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f366c037050 con 0x56519f93a670 2024-09-21T08:09:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.470+0000 7f3689fcf740 10 client.26402 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.470+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56519fd1cfd0 con 0x56519f93a670 2024-09-21T08:09:43.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.473+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f366c010040 con 0x56519f93a670 2024-09-21T08:09:43.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.474+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f366c01f020 con 0x56519f93a670 2024-09-21T08:09:43.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 10 client.26402 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 10 client.26402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 20 client.26402 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f919cd0 0x56519fd20440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 4 client.26402 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56519fc7adb0 con 0x56519f919cd0 2024-09-21T08:09:43.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.476+0000 7f36817f7640 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f919cd0 0x56519fd20440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.478+0000 7f36817f7640 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f919cd0 0x56519fd20440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88b6e8591e003c2 server_cookie=467de05d4a33c0c9 in_seq=0 out_seq=0 2024-09-21T08:09:43.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.478+0000 7f3664ff9640 10 client.26402 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:43.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3664ff9640 1 -- 172.21.15.6:0/701702200 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56519fc7adb0 con 0x56519f919cd0 2024-09-21T08:09:43.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3664ff9640 10 client.26402 handle_command_reply: tid=0 2024-09-21T08:09:43.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 client.26402 shutdown 2024-09-21T08:09:43.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 msgr2=0x56519fd0e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f366c017b50 tx=0x7f366c017b80 comp rx=0 tx=0).stop 2024-09-21T08:09:43.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 shutdown_connections 2024-09-21T08:09:43.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f919cd0 0x56519fd20440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd1a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f93a670 0x56519fd0e7e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 --2- 172.21.15.6:0/701702200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f932490 0x56519fd0e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.480+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 >> 172.21.15.6:0/701702200 conn(0x56519f94f740 msgr2=0x56519fd057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.482+0000 7f3664ff9640 0 client.26402 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.486+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 shutdown_connections 2024-09-21T08:09:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.486+0000 7f3689fcf740 1 -- 172.21.15.6:0/701702200 wait complete. 2024-09-21T08:09:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.486+0000 7f3689fcf740 20 client.26402 trim_cache size 0 max 16384 2024-09-21T08:09:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.521+0000 7f3689fcf740 1 Processor -- start 2024-09-21T08:09:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.521+0000 7f3689fcf740 1 -- start start 2024-09-21T08:09:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 0x56519fd00540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f95b350 0x56519fd0d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1b9870 con 0x56519f95b350 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1bc040 con 0x56519f932490 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3689fcf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1b9e30 con 0x56519f93a670 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f36817f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f36817f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55376/0 (socket says 172.21.15.6:55376) 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f36817f7640 1 -- 172.21.15.6:0/1297735322 learned_addr learned my addr 172.21.15.6:0/1297735322 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.522+0000 7f3680ff6640 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 0x56519fd00540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 -- 172.21.15.6:0/1297735322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 msgr2=0x56519fd00540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 0x56519fd00540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 -- 172.21.15.6:0/1297735322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f95b350 msgr2=0x56519fd0d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f95b350 0x56519fd0d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 -- 172.21.15.6:0/1297735322 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519fd0f2e0 con 0x56519f932490 2024-09-21T08:09:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f3680ff6640 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 0x56519fd00540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.523+0000 7f36817f7640 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3678035040 tx=0x7f3678005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136f5acb19a67544 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.524+0000 7f3666ffd640 1 -- 172.21.15.6:0/1297735322 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678037040 con 0x56519f932490 2024-09-21T08:09:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.524+0000 7f3666ffd640 1 -- 172.21.15.6:0/1297735322 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3678038040 con 0x56519f932490 2024-09-21T08:09:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.524+0000 7f3666ffd640 1 -- 172.21.15.6:0/1297735322 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36780035f0 con 0x56519f932490 2024-09-21T08:09:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.525+0000 7f3689fcf740 1 -- 172.21.15.6:0/1297735322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 msgr2=0x56519fd097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.525+0000 7f3689fcf740 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3678035040 tx=0x7f3678005760 comp rx=0 tx=0).stop 2024-09-21T08:09:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.528+0000 7f3689fcf740 1 -- 172.21.15.6:0/1297735322 shutdown_connections 2024-09-21T08:09:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.528+0000 7f3689fcf740 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f93a670 0x56519fd00540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.528+0000 7f3689fcf740 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f95b350 0x56519fd0d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.528+0000 7f3689fcf740 1 --2- 172.21.15.6:0/1297735322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd097d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.528+0000 7f3689fcf740 1 -- 172.21.15.6:0/1297735322 >> 172.21.15.6:0/1297735322 conn(0x56519f94f740 msgr2=0x56519fcffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.529+0000 7f3689fcf740 1 -- 172.21.15.6:0/1297735322 shutdown_connections 2024-09-21T08:09:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.530+0000 7f3689fcf740 1 -- 172.21.15.6:0/1297735322 wait complete. 2024-09-21T08:09:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.531+0000 7f3689fcf740 1 -- start start 2024-09-21T08:09:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.531+0000 7f3689fcf740 1 Processor -- start 2024-09-21T08:09:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd25f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1ba500 con 0x56519f93a670 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1bb970 con 0x56519f932490 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1babd0 con 0x56519f95b350 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3689fcf740 10 client.0 _ll_register_callbacks cb 0x7f366c0144b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f36817f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f3681ff8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f36817f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55390/0 (socket says 172.21.15.6:55390) 2024-09-21T08:09:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.532+0000 7f36817f7640 1 -- 172.21.15.6:0/747495830 learned_addr learned my addr 172.21.15.6:0/747495830 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f3680ff6640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd25f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f36817f7640 1 -- 172.21.15.6:0/747495830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 msgr2=0x56519fd264a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f36817f7640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd264a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f36817f7640 1 -- 172.21.15.6:0/747495830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 msgr2=0x56519fd25f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f36817f7640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd25f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.533+0000 7f36817f7640 1 -- 172.21.15.6:0/747495830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519fd11340 con 0x56519f932490 2024-09-21T08:09:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.535+0000 7f3680ff6640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd25f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.539+0000 7f36817f7640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f367802a950 tx=0x7f36780304a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e956a041c70f98ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.540+0000 7f3664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.541+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678055020 con 0x56519f932490 2024-09-21T08:09:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.541+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f3678004230 con 0x56519f932490 2024-09-21T08:09:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.541+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3678038040 con 0x56519f932490 2024-09-21T08:09:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3678037040 con 0x56519f932490 2024-09-21T08:09:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 10 client.26408 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56519fd93730 con 0x56519f932490 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3678038040 con 0x56519f932490 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3678048030 con 0x56519f932490 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 10 client.26408 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 10 client.26408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 20 client.26408 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.542+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f8ef080 0x56519fd95ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.543+0000 7f3689fcf740 4 client.26408 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:09:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.543+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56519fc76860 con 0x56519f8ef080 2024-09-21T08:09:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.543+0000 7f3680ff6640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f8ef080 0x56519fd95ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.543+0000 7f3664ff9640 10 client.26408 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.544+0000 7f3680ff6640 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f8ef080 0x56519fd95ea0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7976070d81bbb73c server_cookie=cc9f93ef4ed7b41d in_seq=0 out_seq=0 2024-09-21T08:09:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3664ff9640 1 -- 172.21.15.6:0/747495830 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56519fc76860 con 0x56519f8ef080 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3664ff9640 10 client.26408 handle_command_reply: tid=0 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 client.26408 shutdown 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 msgr2=0x56519fd25a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f367802a950 tx=0x7f36780304a0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 shutdown_connections 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56519f8ef080 0x56519fd95ea0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56519f95b350 0x56519fd264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56519f93a670 0x56519fd25f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 --2- 172.21.15.6:0/747495830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56519f932490 0x56519fd25a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 >> 172.21.15.6:0/747495830 conn(0x56519f94f740 msgr2=0x56519fcfed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.546+0000 7f3664ff9640 0 client.26408 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.547+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 shutdown_connections 2024-09-21T08:09:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.547+0000 7f3689fcf740 1 -- 172.21.15.6:0/747495830 wait complete. 2024-09-21T08:09:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.547+0000 7f3689fcf740 20 client.26408 trim_cache size 0 max 16384 2024-09-21T08:09:43.550 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:43.551 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:09:43.551 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "848988bd-4662-4f2c-b70b-978cbeef237a", 2024-09-21T08:09:43.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:09:43.551 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 msgr2=0x7f36680b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 0x7f36680b8bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f366c014fb0 tx=0x7f366c00c000 comp rx=0 tx=0).stop 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 msgr2=0x7f367c072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 0x7f367c072930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f367400efc0 tx=0x7f367400c800 comp rx=0 tx=0).stop 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 shutdown_connections 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f36680b66b0 0x7f36680b8bc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f367c109c40 0x7f367c072930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367c1092f0 0x7f367c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 --2- 172.21.15.6:0/535248024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f367c1039b0 0x7f367c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.549+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 >> 172.21.15.6:0/535248024 conn(0x7f367c0ff400 msgr2=0x7f367c108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.550+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 shutdown_connections 2024-09-21T08:09:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:43.550+0000 7f36827f9640 1 -- 172.21.15.6:0/535248024 wait complete. 2024-09-21T08:09:44.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:09:44.922 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:45.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:44 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:09:45.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:44 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:44 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:09:45.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:44 smithi006 ceph-mon[30970]: pgmap v608: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-21T08:09:45.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:44 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:44 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:09:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:44 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:44 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:09:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:44 smithi119 ceph-mon[33564]: pgmap v608: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-21T08:09:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:44 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:44 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:09:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:44 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:44 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:09:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:44 smithi145 ceph-mon[34049]: pgmap v608: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-21T08:09:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:44 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 -- 172.21.15.6:0/3850812755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 msgr2=0x7fa284110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 --2- 172.21.15.6:0/3850812755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa284110450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009be0 tx=0x7fa27c02a6e0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 -- 172.21.15.6:0/3850812755 shutdown_connections 2024-09-21T08:09:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 --2- 172.21.15.6:0/3850812755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 0x7fa2841096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 --2- 172.21.15.6:0/3850812755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa284110450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 --2- 172.21.15.6:0/3850812755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 -- 172.21.15.6:0/3850812755 >> 172.21.15.6:0/3850812755 conn(0x7fa284077aa0 msgr2=0x7fa284077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 -- 172.21.15.6:0/3850812755 shutdown_connections 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.566+0000 7fa28a150640 1 -- 172.21.15.6:0/3850812755 wait complete. 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.568+0000 7fa28a150640 1 Processor -- start 2024-09-21T08:09:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.568+0000 7fa28a150640 1 -- start start 2024-09-21T08:09:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28a150640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28a150640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 0x7fa2841a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28914e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28914e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39614/0 (socket says 172.21.15.6:39614) 2024-09-21T08:09:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28914e640 1 -- 172.21.15.6:0/2029848911 learned_addr learned my addr 172.21.15.6:0/2029848911 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa2841a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.569+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa284119db0 con 0x7fa284101d90 2024-09-21T08:09:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa284119c30 con 0x7fa284109c20 2024-09-21T08:09:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28994f640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa2841a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa284119f30 con 0x7fa2841092d0 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28894d640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 0x7fa2841a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28914e640 1 -- 172.21.15.6:0/2029848911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 msgr2=0x7fa2841a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28914e640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 0x7fa2841a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28914e640 1 -- 172.21.15.6:0/2029848911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 msgr2=0x7fa2841a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28914e640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa2841a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.570+0000 7fa28914e640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2841a6690 con 0x7fa284101d90 2024-09-21T08:09:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.571+0000 7fa28914e640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c920 tx=0x7fa27400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.571+0000 7fa27a7fc640 1 -- 172.21.15.6:0/2029848911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274007bb0 con 0x7fa284101d90 2024-09-21T08:09:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.571+0000 7fa27a7fc640 1 -- 172.21.15.6:0/2029848911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa274007d50 con 0x7fa284101d90 2024-09-21T08:09:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.571+0000 7fa27a7fc640 1 -- 172.21.15.6:0/2029848911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27400e610 con 0x7fa284101d90 2024-09-21T08:09:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.572+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2841a6980 con 0x7fa284101d90 2024-09-21T08:09:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.572+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2841a6e10 con 0x7fa284101d90 2024-09-21T08:09:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.578+0000 7fa291926740 1 Processor -- start 2024-09-21T08:09:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.578+0000 7fa291926740 1 -- start start 2024-09-21T08:09:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.578+0000 7fa291926740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 0x558da4ec3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.578+0000 7fa291926740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4af31b0 0x558da4ec3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa291926740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 0x558da4ec4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa291926740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558da4e39e50 con 0x558da4af31b0 2024-09-21T08:09:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa291926740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558da4e29280 con 0x558da4b1c070 2024-09-21T08:09:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa291926740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558da4e2d090 con 0x558da4afb390 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa28894d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 0x558da4ec4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa28894d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 0x558da4ec4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48822/0 (socket says 172.21.15.6:48822) 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa28894d640 1 -- 172.21.15.6:0/1710698607 learned_addr learned my addr 172.21.15.6:0/1710698607 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.579+0000 7fa28994f640 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 0x558da4ec3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 -- 172.21.15.6:0/1710698607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 msgr2=0x558da4ec4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 0x558da4ec4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 -- 172.21.15.6:0/1710698607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4af31b0 msgr2=0x558da4ec3d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4af31b0 0x558da4ec3d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 -- 172.21.15.6:0/1710698607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da4b87650 con 0x558da4b1c070 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.580+0000 7fa28994f640 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 0x558da4ec3810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa27c034040 tx=0x7fa27c030630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc68d9415db0c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.581+0000 7fa26f7fe640 1 -- 172.21.15.6:0/1710698607 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c036040 con 0x558da4b1c070 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.581+0000 7fa26f7fe640 1 -- 172.21.15.6:0/1710698607 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa27c003e00 con 0x558da4b1c070 2024-09-21T08:09:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.581+0000 7fa26f7fe640 1 -- 172.21.15.6:0/1710698607 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c031930 con 0x558da4b1c070 2024-09-21T08:09:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.582+0000 7fa291926740 1 -- 172.21.15.6:0/1710698607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 msgr2=0x558da4ec3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.582+0000 7fa291926740 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 0x558da4ec3810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa27c034040 tx=0x7fa27c030630 comp rx=0 tx=0).stop 2024-09-21T08:09:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.584+0000 7fa27a7fc640 1 -- 172.21.15.6:0/2029848911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa27400f450 con 0x7fa284101d90 2024-09-21T08:09:45.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.585+0000 7fa27a7fc640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 0x7fa2700b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.585+0000 7fa27a7fc640 1 -- 172.21.15.6:0/2029848911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa2740e7b60 con 0x7fa284101d90 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa291926740 1 -- 172.21.15.6:0/1710698607 shutdown_connections 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa291926740 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4afb390 0x558da4ec4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa291926740 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4af31b0 0x558da4ec3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa28994f640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 0x7fa2700b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa291926740 1 --2- 172.21.15.6:0/1710698607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4b1c070 0x558da4ec3810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.586+0000 7fa291926740 1 -- 172.21.15.6:0/1710698607 >> 172.21.15.6:0/1710698607 conn(0x558da4b10460 msgr2=0x558da4ec1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.589+0000 7fa28994f640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 0x7fa2700b8d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa27c030500 tx=0x7fa27c02a6e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.589+0000 7fa291926740 1 -- 172.21.15.6:0/1710698607 shutdown_connections 2024-09-21T08:09:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.590+0000 7fa291926740 1 -- 172.21.15.6:0/1710698607 wait complete. 2024-09-21T08:09:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.590+0000 7fa291926740 1 -- start start 2024-09-21T08:09:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.591+0000 7fa291926740 1 Processor -- start 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa291926740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa291926740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ecf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa291926740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa291926740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558da4c8a700 con 0x558da4b1c070 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa28994f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa28994f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39620/0 (socket says 172.21.15.6:39620) 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa28994f640 1 -- 172.21.15.6:0/1833980163 learned_addr learned my addr 172.21.15.6:0/1833980163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.592+0000 7fa28914e640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.593+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558da4dc4110 con 0x558da4afb390 2024-09-21T08:09:45.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.593+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558da4ed1f90 con 0x558da4af31b0 2024-09-21T08:09:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.596+0000 7fa28894d640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ecf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.599+0000 7fa291926740 10 client.0 _ll_register_callbacks cb 0x558da4ddd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28994f640 1 -- 172.21.15.6:0/1833980163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 msgr2=0x558da4ecef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28994f640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28994f640 1 -- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 msgr2=0x558da4ecf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28994f640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ecf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28994f640 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da4df1c40 con 0x558da4b1c070 2024-09-21T08:09:45.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.601+0000 7fa28894d640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ecf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:45.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.602+0000 7fa28994f640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa27c030e40 tx=0x7fa27c030f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4493ff358e98121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.602+0000 7fa26cff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:09:45.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.602+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c059070 con 0x558da4b1c070 2024-09-21T08:09:45.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.602+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa27c004030 con 0x558da4b1c070 2024-09-21T08:09:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.603+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27c003e00 con 0x558da4b1c070 2024-09-21T08:09:45.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.604+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa27c036040 con 0x558da4b1c070 2024-09-21T08:09:45.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.605+0000 7fa291926740 10 client.16797 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:45.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.605+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558da4eddca0 con 0x558da4b1c070 2024-09-21T08:09:45.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa27c030c60 con 0x558da4b1c070 2024-09-21T08:09:45.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa27c066020 con 0x558da4b1c070 2024-09-21T08:09:45.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 10 client.16797 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 20 client.16797 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4ada9f0 0x558da4ee1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 4 client.16797 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:45.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.607+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa27c003e00 con 0x558da4ada9f0 2024-09-21T08:09:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.609+0000 7fa28914e640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4ada9f0 0x558da4ee1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.610+0000 7fa28914e640 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4ada9f0 0x558da4ee1000 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b562e97a0c2b4a3 server_cookie=b9117faa7365f1cf in_seq=0 out_seq=0 2024-09-21T08:09:45.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.610+0000 7fa26cff9640 10 client.16797 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:45.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.614+0000 7fa26cff9640 1 -- 172.21.15.6:0/1833980163 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa27c003e00 con 0x558da4ada9f0 2024-09-21T08:09:45.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.614+0000 7fa26cff9640 10 client.16797 handle_command_reply: tid=0 2024-09-21T08:09:45.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.615+0000 7fa291926740 1 client.16797 shutdown 2024-09-21T08:09:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 msgr2=0x558da4edb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa27c030e40 tx=0x7fa27c030f10 comp rx=0 tx=0).stop 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 shutdown_connections 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4ada9f0 0x558da4ee1000 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4edb280 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ecf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 --2- 172.21.15.6:0/1833980163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 >> 172.21.15.6:0/1833980163 conn(0x558da4b10460 msgr2=0x558da4ec69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa26cff9640 0 client.16797 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 shutdown_connections 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.616+0000 7fa291926740 1 -- 172.21.15.6:0/1833980163 wait complete. 2024-09-21T08:09:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.617+0000 7fa291926740 20 client.16797 trim_cache size 0 max 16384 2024-09-21T08:09:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.653+0000 7fa291926740 1 Processor -- start 2024-09-21T08:09:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.653+0000 7fa291926740 1 -- start start 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.653+0000 7fa291926740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa291926740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ec6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa28914e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa28914e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48840/0 (socket says 172.21.15.6:48840) 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa28914e640 1 -- 172.21.15.6:0/825578720 learned_addr learned my addr 172.21.15.6:0/825578720 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa291926740 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4ec6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b5290 con 0x558da4b1c070 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa28894d640 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ec6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b7af0 con 0x558da4afb390 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b58e0 con 0x558da4af31b0 2024-09-21T08:09:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.654+0000 7fa28994f640 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4ec6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 -- 172.21.15.6:0/825578720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 msgr2=0x558da4ec6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ec6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 -- 172.21.15.6:0/825578720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 msgr2=0x558da4ec6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4ec6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 -- 172.21.15.6:0/825578720 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da4ecde90 con 0x558da4af31b0 2024-09-21T08:09:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.655+0000 7fa28914e640 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c8f0 tx=0x7fa2740a9480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc59ea4e7521f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.656+0000 7fa26effd640 1 -- 172.21.15.6:0/825578720 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740b2050 con 0x558da4af31b0 2024-09-21T08:09:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.656+0000 7fa26effd640 1 -- 172.21.15.6:0/825578720 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2740b6f90 con 0x558da4af31b0 2024-09-21T08:09:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.656+0000 7fa26effd640 1 -- 172.21.15.6:0/825578720 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740a9120 con 0x558da4af31b0 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 msgr2=0x558da4ecf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c8f0 tx=0x7fa2740a9480 comp rx=0 tx=0).stop 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 shutdown_connections 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4b1c070 0x558da4ec6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4afb390 0x558da4ec6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 --2- 172.21.15.6:0/825578720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4af31b0 0x558da4ecf3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.660+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 >> 172.21.15.6:0/825578720 conn(0x558da4b10460 msgr2=0x558da4ecece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.661+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 shutdown_connections 2024-09-21T08:09:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.661+0000 7fa291926740 1 -- 172.21.15.6:0/825578720 wait complete. 2024-09-21T08:09:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.662+0000 7fa291926740 1 -- start start 2024-09-21T08:09:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.662+0000 7fa291926740 1 Processor -- start 2024-09-21T08:09:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.663+0000 7fa291926740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.663+0000 7fa291926740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 0x558da4ee2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa291926740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4b1c070 0x558da4f4a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28914e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28914e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55460/0 (socket says 172.21.15.6:55460) 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28894d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 0x558da4ee2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28894d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 0x558da4ee2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39636/0 (socket says 172.21.15.6:39636) 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28914e640 1 -- 172.21.15.6:0/2505919931 learned_addr learned my addr 172.21.15.6:0/2505919931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b5fb0 con 0x558da4afb390 2024-09-21T08:09:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b7420 con 0x558da4af31b0 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841b6680 con 0x558da4b1c070 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.664+0000 7fa28994f640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4b1c070 0x558da4f4a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa291926740 10 client.0 _ll_register_callbacks cb 0x7fa2800097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa28914e640 1 -- 172.21.15.6:0/2505919931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4b1c070 msgr2=0x558da4f4a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa28914e640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4b1c070 0x558da4f4a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa28914e640 1 -- 172.21.15.6:0/2505919931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 msgr2=0x558da4ee2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa28914e640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 0x558da4ee2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.665+0000 7fa28914e640 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da4ec60a0 con 0x558da4af31b0 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.666+0000 7fa28914e640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2740a9b40 tx=0x7fa2740a99f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e117357571140bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.666+0000 7fa26cff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.667+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740e5300 con 0x558da4af31b0 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.667+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa2740ac7d0 con 0x558da4af31b0 2024-09-21T08:09:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.668+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2740b6f90 con 0x558da4af31b0 2024-09-21T08:09:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.668+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2740b2050 con 0x558da4af31b0 2024-09-21T08:09:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.668+0000 7fa291926740 10 client.26423 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.669+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558da4f4bdb0 con 0x558da4af31b0 2024-09-21T08:09:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.670+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2740b6f90 con 0x558da4af31b0 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.670+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2740ac240 con 0x558da4af31b0 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 10 client.26423 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 10 client.26423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 20 client.26423 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4aafda0 0x558da4f4e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 4 client.26423 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.671+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558da4e3bda0 con 0x558da4aafda0 2024-09-21T08:09:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.672+0000 7fa28894d640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4aafda0 0x558da4f4e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.674+0000 7fa28894d640 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4aafda0 0x558da4f4e2d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea21a1d1638abd5b server_cookie=e332a995196fff41 in_seq=0 out_seq=0 2024-09-21T08:09:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.674+0000 7fa26cff9640 10 client.26423 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.677+0000 7fa26cff9640 1 -- 172.21.15.6:0/2505919931 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x558da4e3bda0 con 0x558da4aafda0 2024-09-21T08:09:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.677+0000 7fa26cff9640 10 client.26423 handle_command_reply: tid=0 2024-09-21T08:09:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.677+0000 7fa291926740 1 client.26423 shutdown 2024-09-21T08:09:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.678+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 msgr2=0x558da4ee2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.678+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2740a9b40 tx=0x7fa2740a99f0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 shutdown_connections 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558da4aafda0 0x558da4f4e2d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558da4b1c070 0x558da4f4a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa26cff9640 0 client.26423 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558da4afb390 0x558da4ee2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 --2- 172.21.15.6:0/2505919931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558da4af31b0 0x558da4ee2800 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 >> 172.21.15.6:0/2505919931 conn(0x558da4b10460 msgr2=0x558da4ec6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 shutdown_connections 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 1 -- 172.21.15.6:0/2505919931 wait complete. 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.679+0000 7fa291926740 20 client.26423 trim_cache size 0 max 16384 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:09:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:09:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:09:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:09:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:09:45.690 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 msgr2=0x7fa2700b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 0x7fa2700b8d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa27c030500 tx=0x7fa27c02a6e0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 msgr2=0x7fa2841a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c920 tx=0x7fa27400cd20 comp rx=0 tx=0).stop 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 shutdown_connections 2024-09-21T08:09:45.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2700b6870 0x7fa2700b8d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2841092d0 0x7fa2841a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa284109c20 0x7fa2841a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 --2- 172.21.15.6:0/2029848911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa284101d90 0x7fa2841a07e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 >> 172.21.15.6:0/2029848911 conn(0x7fa284077aa0 msgr2=0x7fa284107320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 shutdown_connections 2024-09-21T08:09:45.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:45.681+0000 7fa28a150640 1 -- 172.21.15.6:0/2029848911 wait complete. 2024-09-21T08:09:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:46 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:09:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:46 smithi119 ceph-mon[33564]: pgmap v609: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-21T08:09:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:46 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:09:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:46 smithi145 ceph-mon[34049]: pgmap v609: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-21T08:09:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:46 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:09:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:46 smithi006 ceph-mon[30970]: pgmap v609: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-21T08:09:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 410.0 s, 665.8 tps, lat 150.525 ms stddev 102.506 2024-09-21T08:09:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:48 smithi119 ceph-mon[33564]: pgmap v610: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 7.0 MiB/s wr, 701 op/s 2024-09-21T08:09:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:48 smithi145 ceph-mon[34049]: pgmap v610: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 7.0 MiB/s wr, 701 op/s 2024-09-21T08:09:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:48 smithi006 ceph-mon[30970]: pgmap v610: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 7.0 MiB/s wr, 701 op/s 2024-09-21T08:09:50.067 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:09:50.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:09:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:50.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:50 smithi006 ceph-mon[30970]: pgmap v611: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-21T08:09:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:50 smithi119 ceph-mon[33564]: pgmap v611: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.187+0000 7f438afd8640 1 -- 172.21.15.6:0/1668918573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f438410a9e0 msgr2=0x7f438410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.187+0000 7f438afd8640 1 --2- 172.21.15.6:0/1668918573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f438410a9e0 0x7f438410adf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f437c009ca0 tx=0x7f437c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.188+0000 7f438afd8640 1 -- 172.21.15.6:0/1668918573 shutdown_connections 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.188+0000 7f438afd8640 1 --2- 172.21.15.6:0/1668918573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f438411cc30 0x7f438411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.188+0000 7f438afd8640 1 --2- 172.21.15.6:0/1668918573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f438410a9e0 0x7f438410adf0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f437c009ca0 tx=0x7f437c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.188+0000 7f438afd8640 1 --2- 172.21.15.6:0/1668918573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4384111f40 0x7f438410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.188+0000 7f438afd8640 1 -- 172.21.15.6:0/1668918573 >> 172.21.15.6:0/1668918573 conn(0x7f4384070ec0 msgr2=0x7f43840712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:51.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.190+0000 7f438afd8640 1 -- 172.21.15.6:0/1668918573 shutdown_connections 2024-09-21T08:09:51.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.190+0000 7f438afd8640 1 -- 172.21.15.6:0/1668918573 wait complete. 2024-09-21T08:09:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:50 smithi145 ceph-mon[34049]: pgmap v611: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-21T08:09:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.191+0000 7f438afd8640 1 Processor -- start 2024-09-21T08:09:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.192+0000 7f438afd8640 1 -- start start 2024-09-21T08:09:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.192+0000 7f438afd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.193+0000 7f4388d74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.193+0000 7f438afd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 0x7f43841a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54174/0 (socket says 172.21.15.6:54174) 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f438afd8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43841aeae0 0x7f43841aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f438afd8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43841227b0 con 0x7f438411cc30 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f438afd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4384122630 con 0x7f4384111f40 2024-09-21T08:09:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f438afd8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4384122930 con 0x7f43841aeae0 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 -- 172.21.15.6:0/1578100369 learned_addr learned my addr 172.21.15.6:0/1578100369 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4383fff640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 0x7f43841a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 -- 172.21.15.6:0/1578100369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43841aeae0 msgr2=0x7f43841aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43841aeae0 0x7f43841aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 -- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 msgr2=0x7f43841a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 0x7f43841a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4388d74640 1 -- 172.21.15.6:0/1578100369 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43841af6c0 con 0x7f4384111f40 2024-09-21T08:09:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.194+0000 7f4383fff640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 0x7f43841a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.195+0000 7f4388d74640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e9f0 tx=0x7f436c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.195+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c00cd80 con 0x7f4384111f40 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.195+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f436c0108c0 con 0x7f4384111f40 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.195+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c0187c0 con 0x7f4384111f40 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.195+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43841b5c60 con 0x7f4384111f40 2024-09-21T08:09:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.196+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43841b6000 con 0x7f4384111f40 2024-09-21T08:09:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.198+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43640052c0 con 0x7f4384111f40 2024-09-21T08:09:51.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.200+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f436c010430 con 0x7f4384111f40 2024-09-21T08:09:51.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.202+0000 7f4381ffb640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 0x7f43700b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:51.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.202+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f436c0e7d30 con 0x7f4384111f40 2024-09-21T08:09:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.203+0000 7f4383fff640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 0x7f43700b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.204+0000 7f4383fff640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 0x7f43700b8d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f437c008000 tx=0x7f437c000f40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:51.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.206+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f436c0ade40 con 0x7f4384111f40 2024-09-21T08:09:51.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.654+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4364005880 con 0x7f4384111f40 2024-09-21T08:09:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.656+0000 7f4381ffb640 1 -- 172.21.15.6:0/1578100369 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f436c0b2220 con 0x7f4384111f40 2024-09-21T08:09:51.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:09:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:09:51.659 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:09:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 msgr2=0x7f43700b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 0x7f43700b8d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f437c008000 tx=0x7f437c000f40 comp rx=0 tx=0).stop 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 msgr2=0x7f43841a9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e9f0 tx=0x7f436c00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 shutdown_connections 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f43700b6880 0x7f43700b8d90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43841aeae0 0x7f43841aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438411cc30 0x7f43841a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 --2- 172.21.15.6:0/1578100369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4384111f40 0x7f43841a9360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.661+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 >> 172.21.15.6:0/1578100369 conn(0x7f4384070ec0 msgr2=0x7f4384071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.662+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 shutdown_connections 2024-09-21T08:09:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:51.662+0000 7f438afd8640 1 -- 172.21.15.6:0/1578100369 wait complete. 2024-09-21T08:09:51.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:51 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1578100369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:52.093 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:51 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1578100369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:51 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1578100369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:09:52.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:09:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 415.0 s, 783.3 tps, lat 127.545 ms stddev 52.604 2024-09-21T08:09:52.962 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:53.107 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:52 smithi006 ceph-mon[30970]: pgmap v612: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 7.7 MiB/s wr, 776 op/s 2024-09-21T08:09:53.107 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:52 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:09:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:52 smithi119 ceph-mon[33564]: pgmap v612: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 7.7 MiB/s wr, 776 op/s 2024-09-21T08:09:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:52 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:09:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:52 smithi145 ceph-mon[34049]: pgmap v612: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 7.7 MiB/s wr, 776 op/s 2024-09-21T08:09:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:52 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/136259968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf581083a0 msgr2=0x7fbf581087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/136259968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf581083a0 0x7fbf581087b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009900 tx=0x7fbf4802a400 comp rx=0 tx=0).stop 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/136259968 shutdown_connections 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/136259968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58108cf0 0x7fbf5810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/136259968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf581083a0 0x7fbf581087b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/136259968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf58102a60 0x7fbf58102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/136259968 >> 172.21.15.6:0/136259968 conn(0x7fbf58079730 msgr2=0x7fbf58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/136259968 shutdown_connections 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.569+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/136259968 wait complete. 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.570+0000 7fbf5f4b4640 1 Processor -- start 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 -- start start 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58102a60 0x7fbf5806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 0x7fbf580716e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5806d500 con 0x7fbf58102a60 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5806d380 con 0x7fbf58108cf0 2024-09-21T08:09:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.571+0000 7fbf5f4b4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5806d680 con 0x7fbf581083a0 2024-09-21T08:09:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.573+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.573+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:39064/0 (socket says 172.21.15.6:39064) 2024-09-21T08:09:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.573+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3101933634 learned_addr learned my addr 172.21.15.6:0/3101933634 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.573+0000 7fbf5d250640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58102a60 0x7fbf5806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.573+0000 7fbf5da51640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 0x7fbf580716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.574+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3101933634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 msgr2=0x7fbf580716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.574+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 0x7fbf580716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.574+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58102a60 msgr2=0x7fbf5806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.574+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58102a60 0x7fbf5806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.574+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3101933634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf58071f00 con 0x7fbf581083a0 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf5da51640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 0x7fbf580716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf4802a970 tx=0x7fbf48003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf4e7fc640 1 -- 172.21.15.6:0/3101933634 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4803f070 con 0x7fbf581083a0 2024-09-21T08:09:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf581aef00 con 0x7fbf581083a0 2024-09-21T08:09:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf581af3b0 con 0x7fbf581083a0 2024-09-21T08:09:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf4e7fc640 1 -- 172.21.15.6:0/3101933634 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf4803baf0 con 0x7fbf581083a0 2024-09-21T08:09:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.575+0000 7fbf4e7fc640 1 -- 172.21.15.6:0/3101933634 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48035030 con 0x7fbf581083a0 2024-09-21T08:09:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.581+0000 7fbf4e7fc640 1 -- 172.21.15.6:0/3101933634 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbf48042070 con 0x7fbf581083a0 2024-09-21T08:09:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.583+0000 7fbf4e7fc640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 0x7fbf440b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.583+0000 7fbf5d250640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 0x7fbf440b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.583+0000 7fbf4e7fc640 1 -- 172.21.15.6:0/3101933634 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fbf48107ff0 con 0x7fbf581083a0 2024-09-21T08:09:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.584+0000 7fbf5d250640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 0x7fbf440b8cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf58075390 tx=0x7fbf5400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.585+0000 7fbf65a28740 1 Processor -- start 2024-09-21T08:09:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 -- start start 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b8925c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b8925d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b891d2ea0 con 0x555b88eb5070 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b891c22d0 con 0x555b88e8c1b0 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.586+0000 7fbf65a28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b891c60e0 con 0x555b88e94390 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5d250640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b8925c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54204/0 (socket says 172.21.15.6:54204) 2024-09-21T08:09:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/2822228120 learned_addr learned my addr 172.21.15.6:0/2822228120 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5da51640 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b8925d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/2822228120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 msgr2=0x555b8925d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b8925d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/2822228120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 msgr2=0x555b8925c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b8925c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/2822228120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b88f20650 con 0x555b88e8c1b0 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5da51640 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b8925d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.587+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf480cd7b0 tx=0x7fbf480cd220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189b1bd9fc16f5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.588+0000 7fbf437fe640 1 -- 172.21.15.6:0/2822228120 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48049070 con 0x555b88e8c1b0 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.588+0000 7fbf437fe640 1 -- 172.21.15.6:0/2822228120 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf480d7420 con 0x555b88e8c1b0 2024-09-21T08:09:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.588+0000 7fbf437fe640 1 -- 172.21.15.6:0/2822228120 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48031da0 con 0x555b88e8c1b0 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 -- 172.21.15.6:0/2822228120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 msgr2=0x555b8925cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf480cd7b0 tx=0x7fbf480cd220 comp rx=0 tx=0).stop 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 -- 172.21.15.6:0/2822228120 shutdown_connections 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b8925d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b8925cbe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 --2- 172.21.15.6:0/2822228120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b8925c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 -- 172.21.15.6:0/2822228120 >> 172.21.15.6:0/2822228120 conn(0x555b88ea9460 msgr2=0x555b8925a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 -- 172.21.15.6:0/2822228120 shutdown_connections 2024-09-21T08:09:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.589+0000 7fbf65a28740 1 -- 172.21.15.6:0/2822228120 wait complete. 2024-09-21T08:09:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.590+0000 7fbf65a28740 1 -- start start 2024-09-21T08:09:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.590+0000 7fbf65a28740 1 Processor -- start 2024-09-21T08:09:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b89267dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b89273f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b89023700 con 0x555b88eb5070 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b8915d160 con 0x555b88e8c1b0 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b8926ac40 con 0x555b88e94390 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:39084/0 (socket says 172.21.15.6:39084) 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/1098797883 learned_addr learned my addr 172.21.15.6:0/1098797883 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf65a28740 10 client.0 _ll_register_callbacks cb 0x555b891769e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.591+0000 7fbf5d250640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b89267dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5da51640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b89273f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 msgr2=0x555b89267dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b89267dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/1098797883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 msgr2=0x555b89273f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b89273f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/1098797883 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8918ac90 con 0x555b88e94390 2024-09-21T08:09:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5da51640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b89273f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf480cd760 tx=0x7fbf481057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2168131ee9dec7e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.592+0000 7fbf40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48049070 con 0x555b88e94390 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fbf480d2180 con 0x555b88e94390 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf480d7420 con 0x555b88e94390 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf48031400 con 0x555b88e94390 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf65a28740 10 client.26560 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.593+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b89276950 con 0x555b88e94390 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf480315a0 con 0x555b88e94390 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf480e3bb0 con 0x555b88e94390 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 10 client.26560 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 10 client.26560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 20 client.26560 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88e739f0 0x555b89279cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 4 client.26560 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbf480d7420 con 0x555b88e739f0 2024-09-21T08:09:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.595+0000 7fbf5d250640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88e739f0 0x555b89279cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.596+0000 7fbf5d250640 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88e739f0 0x555b89279cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52dae9a178d688c5 server_cookie=f90316600f5b694f in_seq=0 out_seq=0 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.596+0000 7fbf40ff9640 10 client.26560 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.597+0000 7fbf40ff9640 1 -- 172.21.15.6:0/1098797883 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fbf480d7420 con 0x555b88e739f0 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.597+0000 7fbf40ff9640 10 client.26560 handle_command_reply: tid=0 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 client.26560 shutdown 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 msgr2=0x555b89268300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf480cd760 tx=0x7fbf481057b0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 shutdown_connections 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88e739f0 0x555b89279cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf40ff9640 0 client.26560 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e94390 0x555b89268300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88eb5070 0x555b89273f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 --2- 172.21.15.6:0/1098797883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e8c1b0 0x555b89267dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.598+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 >> 172.21.15.6:0/1098797883 conn(0x555b88ea9460 msgr2=0x555b8925f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.599+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 shutdown_connections 2024-09-21T08:09:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.599+0000 7fbf65a28740 1 -- 172.21.15.6:0/1098797883 wait complete. 2024-09-21T08:09:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.599+0000 7fbf65a28740 20 client.26560 trim_cache size 0 max 16384 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.625+0000 7fbf65a28740 1 Processor -- start 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.625+0000 7fbf65a28740 1 -- start start 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.625+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b8925dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.625+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8925a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf65a28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c00e0b0 con 0x555b88e8c1b0 2024-09-21T08:09:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf5ca4f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47218/0 (socket says 172.21.15.6:47218) 2024-09-21T08:09:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3936253596 learned_addr learned my addr 172.21.15.6:0/3936253596 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c010910 con 0x555b88e94390 2024-09-21T08:09:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.626+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c00e700 con 0x555b88e739f0 2024-09-21T08:09:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5da51640 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8925a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5d250640 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b8925dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3936253596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 msgr2=0x555b8925dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b8925dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3936253596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 msgr2=0x555b8925a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8925a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 -- 172.21.15.6:0/3936253596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b89269080 con 0x555b88e8c1b0 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.627+0000 7fbf5ca4f640 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fbf480d26a0 tx=0x7fbf4807d0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ca486785863b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.628+0000 7fbf42ffd640 1 -- 172.21.15.6:0/3936253596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480cd5c0 con 0x555b88e8c1b0 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.628+0000 7fbf42ffd640 1 -- 172.21.15.6:0/3936253596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf480d2180 con 0x555b88e8c1b0 2024-09-21T08:09:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.628+0000 7fbf42ffd640 1 -- 172.21.15.6:0/3936253596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480c9510 con 0x555b88e8c1b0 2024-09-21T08:09:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 msgr2=0x555b89259bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fbf480d26a0 tx=0x7fbf4807d0f0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 shutdown_connections 2024-09-21T08:09:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8925a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b89259bc0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 --2- 172.21.15.6:0/3936253596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b8925dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.630+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 >> 172.21.15.6:0/3936253596 conn(0x555b88ea9460 msgr2=0x555b8925d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.631+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 shutdown_connections 2024-09-21T08:09:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.631+0000 7fbf65a28740 1 -- 172.21.15.6:0/3936253596 wait complete. 2024-09-21T08:09:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.632+0000 7fbf65a28740 1 -- start start 2024-09-21T08:09:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.632+0000 7fbf65a28740 1 Processor -- start 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b892706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b8926bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c00edd0 con 0x555b88e8c1b0 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c010240 con 0x555b88e94390 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c00f4a0 con 0x555b88e739f0 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf65a28740 10 client.0 _ll_register_callbacks cb 0x7fbf50009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf5da51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf5da51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54222/0 (socket says 172.21.15.6:54222) 2024-09-21T08:09:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.633+0000 7fbf5da51640 1 -- 172.21.15.6:0/720007493 learned_addr learned my addr 172.21.15.6:0/720007493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5d250640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b892706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 -- 172.21.15.6:0/720007493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 msgr2=0x555b892706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b892706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 -- 172.21.15.6:0/720007493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 msgr2=0x555b8926bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b8926bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 -- 172.21.15.6:0/720007493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8926c870 con 0x555b88e94390 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf5da51640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf50010ee0 tx=0x7fbf5000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e596be5281118a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.634+0000 7fbf40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.635+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50020df0 con 0x555b88e94390 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.635+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf480d2180 con 0x555b88e94390 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.635+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fbf50003970 con 0x555b88e94390 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.635+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf50031050 con 0x555b88e94390 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.636+0000 7fbf65a28740 10 client.26447 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.636+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b892e4570 con 0x555b88e94390 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.636+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf480d2180 con 0x555b88e94390 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.636+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf50029420 con 0x555b88e94390 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 10 client.26447 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 10 client.26447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 20 client.26447 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88eb5070 0x555b892e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 4 client.26447 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.637+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b891d4df0 con 0x555b88eb5070 2024-09-21T08:09:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.638+0000 7fbf5d250640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88eb5070 0x555b892e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.640+0000 7fbf5d250640 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88eb5070 0x555b892e6d90 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f515b4aef606fc server_cookie=7560517fb78dcfa5 in_seq=0 out_seq=0 2024-09-21T08:09:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.640+0000 7fbf40ff9640 10 client.26447 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.642+0000 7fbf40ff9640 1 -- 172.21.15.6:0/720007493 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b891d4df0 con 0x555b88eb5070 2024-09-21T08:09:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.642+0000 7fbf40ff9640 10 client.26447 handle_command_reply: tid=0 2024-09-21T08:09:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.642+0000 7fbf65a28740 1 client.26447 shutdown 2024-09-21T08:09:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 msgr2=0x555b8926c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf50010ee0 tx=0x7fbf5000f790 comp rx=0 tx=0).stop 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 shutdown_connections 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b88eb5070 0x555b892e6d90 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b88e94390 0x555b8926c0e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b88e8c1b0 0x555b8926bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 --2- 172.21.15.6:0/720007493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b88e739f0 0x555b892706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 >> 172.21.15.6:0/720007493 conn(0x555b88ea9460 msgr2=0x555b8925e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.644+0000 7fbf40ff9640 0 client.26447 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.645+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 shutdown_connections 2024-09-21T08:09:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.646+0000 7fbf65a28740 1 -- 172.21.15.6:0/720007493 wait complete. 2024-09-21T08:09:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.647+0000 7fbf65a28740 20 client.26447 trim_cache size 0 max 16384 2024-09-21T08:09:53.650 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:09:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 msgr2=0x7fbf440b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 0x7fbf440b8cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf58075390 tx=0x7fbf5400b390 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 msgr2=0x7fbf58071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf4802a970 tx=0x7fbf48003c00 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 shutdown_connections 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbf440b67b0 0x7fbf440b8cc0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf58075390 tx=0x7fbf5400b390 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf581083a0 0x7fbf58071120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf58108cf0 0x7fbf580716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 --2- 172.21.15.6:0/3101933634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf58102a60 0x7fbf5806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 >> 172.21.15.6:0/3101933634 conn(0x7fbf58079730 msgr2=0x7fbf581044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 shutdown_connections 2024-09-21T08:09:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:53.649+0000 7fbf5f4b4640 1 -- 172.21.15.6:0/3101933634 wait complete. 2024-09-21T08:09:53.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:09:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:09:53.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:09:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:09:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:09:54.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:09:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:09:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:09:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:09:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:54 smithi119 ceph-mon[33564]: pgmap v613: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 7.6 MiB/s wr, 752 op/s 2024-09-21T08:09:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:54 smithi145 ceph-mon[34049]: pgmap v613: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 7.6 MiB/s wr, 752 op/s 2024-09-21T08:09:55.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:54 smithi006 ceph-mon[30970]: pgmap v613: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 7.6 MiB/s wr, 752 op/s 2024-09-21T08:09:55.601 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:09:55.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:09:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:56.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.718+0000 7ff57525e640 1 -- 172.21.15.6:0/2812705088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701081e0 msgr2=0x7ff5701085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.718+0000 7ff57525e640 1 --2- 172.21.15.6:0/2812705088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701081e0 0x7ff5701085f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff558009900 tx=0x7ff55802a400 comp rx=0 tx=0).stop 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 -- 172.21.15.6:0/2812705088 shutdown_connections 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 --2- 172.21.15.6:0/2812705088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 0x7ff57010f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 --2- 172.21.15.6:0/2812705088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701081e0 0x7ff5701085f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 --2- 172.21.15.6:0/2812705088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701028a0 0x7ff570102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 -- 172.21.15.6:0/2812705088 >> 172.21.15.6:0/2812705088 conn(0x7ff5700fe2f0 msgr2=0x7ff570100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.719+0000 7ff57525e640 1 -- 172.21.15.6:0/2812705088 shutdown_connections 2024-09-21T08:09:56.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.721+0000 7ff57525e640 1 -- 172.21.15.6:0/2812705088 wait complete. 2024-09-21T08:09:56.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.722+0000 7ff57525e640 1 Processor -- start 2024-09-21T08:09:56.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.724+0000 7ff57525e640 1 -- start start 2024-09-21T08:09:56.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.724+0000 7ff57525e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701028a0 0x7ff57019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.724+0000 7ff57525e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff57525e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 0x7ff570198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff57525e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701115e0 con 0x7ff570108b30 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff57525e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff570111460 con 0x7ff5701028a0 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff57525e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff570111760 con 0x7ff5701081e0 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:34934/0 (socket says 172.21.15.6:34934) 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 -- 172.21.15.6:0/4227562159 learned_addr learned my addr 172.21.15.6:0/4227562159 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701028a0 0x7ff57019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56f59e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 0x7ff570198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 -- 172.21.15.6:0/4227562159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701028a0 msgr2=0x7ff57019bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701028a0 0x7ff57019bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 -- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 msgr2=0x7ff570198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 0x7ff570198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.725+0000 7ff56e59c640 1 -- 172.21.15.6:0/4227562159 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5701ac970 con 0x7ff5701081e0 2024-09-21T08:09:56.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff56e59c640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff55802a970 tx=0x7ff558003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff567fff640 1 -- 172.21.15.6:0/4227562159 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55803f070 con 0x7ff5701081e0 2024-09-21T08:09:56.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5701acb40 con 0x7ff5701081e0 2024-09-21T08:09:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5701ad0d0 con 0x7ff5701081e0 2024-09-21T08:09:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff567fff640 1 -- 172.21.15.6:0/4227562159 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff55803baf0 con 0x7ff5701081e0 2024-09-21T08:09:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.726+0000 7ff567fff640 1 -- 172.21.15.6:0/4227562159 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558035030 con 0x7ff5701081e0 2024-09-21T08:09:56.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.730+0000 7ff57b7d2740 1 Processor -- start 2024-09-21T08:09:56.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 -- start start 2024-09-21T08:09:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f3198b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f3199090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b8f310ee60 con 0x55b8f2dc8490 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b8f30fe290 con 0x55b8f2df1350 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b8f31020a0 con 0x55b8f2dd0670 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff56f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.731+0000 7ff56f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:60632/0 (socket says 172.21.15.6:60632) 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 -- 172.21.15.6:0/3942487453 learned_addr learned my addr 172.21.15.6:0/3942487453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff567fff640 1 -- 172.21.15.6:0/4227562159 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff558042070 con 0x7ff5701081e0 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f3198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 -- 172.21.15.6:0/3942487453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 msgr2=0x55b8f3199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f3199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 -- 172.21.15.6:0/3942487453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 msgr2=0x55b8f3198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f3198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56f59e640 1 -- 172.21.15.6:0/3942487453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f2e5c930 con 0x55b8f2df1350 2024-09-21T08:09:56.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.732+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f3198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.733+0000 7ff567fff640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 0x7ff55c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.733+0000 7ff56f59e640 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff560009fc0 tx=0x7ff560010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ebfbe5a01d8cab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.733+0000 7ff567fff640 1 -- 172.21.15.6:0/4227562159 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff558108190 con 0x7ff5701081e0 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.734+0000 7ff5657fa640 1 -- 172.21.15.6:0/3942487453 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560003b70 con 0x55b8f2df1350 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.734+0000 7ff5657fa640 1 -- 172.21.15.6:0/3942487453 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff560003d10 con 0x55b8f2df1350 2024-09-21T08:09:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.734+0000 7ff5657fa640 1 -- 172.21.15.6:0/3942487453 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560011980 con 0x55b8f2df1350 2024-09-21T08:09:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 0x7ff55c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 -- 172.21.15.6:0/3942487453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 msgr2=0x55b8f3198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff560009fc0 tx=0x7ff560010860 comp rx=0 tx=0).stop 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 -- 172.21.15.6:0/3942487453 shutdown_connections 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 0x7ff55c0b8c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55b8f3197290 tx=0x7ff568005f50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f3199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f3198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/3942487453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2df1350 0x55b8f3198610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.735+0000 7ff57b7d2740 1 -- 172.21.15.6:0/3942487453 >> 172.21.15.6:0/3942487453 conn(0x55b8f2de5740 msgr2=0x55b8f3196500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.736+0000 7ff57b7d2740 1 -- 172.21.15.6:0/3942487453 shutdown_connections 2024-09-21T08:09:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.736+0000 7ff57b7d2740 1 -- 172.21.15.6:0/3942487453 wait complete. 2024-09-21T08:09:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.736+0000 7ff57b7d2740 1 -- start start 2024-09-21T08:09:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.736+0000 7ff57b7d2740 1 Processor -- start 2024-09-21T08:09:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 0x55b8f31a4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2df1350 0x55b8f31b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b8f2f5f890 con 0x55b8f2dc8490 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b8f3098d40 con 0x55b8f2dd0670 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b8f31a6df0 con 0x55b8f2df1350 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58118/0 (socket says 172.21.15.6:58118) 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff56ed9d640 1 -- 172.21.15.6:0/325385937 learned_addr learned my addr 172.21.15.6:0/325385937 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff56f59e640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2df1350 0x55b8f31b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.737+0000 7ff56e59c640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 0x55b8f31a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff57b7d2740 10 client.0 _ll_register_callbacks cb 0x55b8f30fcc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff56e59c640 1 -- 172.21.15.6:0/325385937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2df1350 msgr2=0x55b8f31b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff56e59c640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2df1350 0x55b8f31b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff56e59c640 1 -- 172.21.15.6:0/325385937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 msgr2=0x55b8f31a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff56e59c640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.738+0000 7ff56e59c640 1 -- 172.21.15.6:0/325385937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f31b07b0 con 0x55b8f2dd0670 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff56e59c640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 0x55b8f31a4830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff558105470 tx=0x7ff5580c9b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f977c6b867651d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff5567fc640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:09:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558049070 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff558105720 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff560003d10 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff5580cd310 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff57b7d2740 10 client.26459 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.739+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b8f31b3050 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff560003d10 con 0x55b8f2dd0670 2024-09-21T08:09:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff5580efbb0 con 0x55b8f2dd0670 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 10 client.26459 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 10 client.26459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 20 client.26459 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2dafcd0 0x55b8f31b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 4 client.26459 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:09:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.740+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f3110db0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.741+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2dafcd0 0x55b8f31b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.742+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2dafcd0 0x55b8f31b64f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=105f948da4a5abd9 server_cookie=c262f0efd1e78b9c in_seq=0 out_seq=0 2024-09-21T08:09:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.742+0000 7ff5567fc640 10 client.26459 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.743+0000 7ff5567fc640 1 -- 172.21.15.6:0/325385937 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8f3110db0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.743+0000 7ff5567fc640 10 client.26459 handle_command_reply: tid=0 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.743+0000 7ff57b7d2740 1 client.26459 shutdown 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 msgr2=0x55b8f31a4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 0x55b8f31a4830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff558105470 tx=0x7ff5580c9b70 comp rx=0 tx=0).stop 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 shutdown_connections 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2dafcd0 0x55b8f31b64f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff5567fc640 0 client.26459 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2df1350 0x55b8f31b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dd0670 0x55b8f31a4830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/325385937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 >> 172.21.15.6:0/325385937 conn(0x55b8f2de5740 msgr2=0x55b8f319b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 shutdown_connections 2024-09-21T08:09:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.744+0000 7ff57b7d2740 1 -- 172.21.15.6:0/325385937 wait complete. 2024-09-21T08:09:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.745+0000 7ff57b7d2740 20 client.26459 trim_cache size 0 max 16384 2024-09-21T08:09:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.779+0000 7ff57b7d2740 1 Processor -- start 2024-09-21T08:09:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.779+0000 7ff57b7d2740 1 -- start start 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 0x55b8f319de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f31a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff55000e0f0 con 0x55b8f2dc8490 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff550010950 con 0x55b8f2dafcd0 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff57b7d2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff55000e740 con 0x55b8f2dd0670 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58124/0 (socket says 172.21.15.6:58124) 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 0x55b8f319de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56e59c640 1 -- 172.21.15.6:0/4169873361 learned_addr learned my addr 172.21.15.6:0/4169873361 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56f59e640 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f31a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 -- 172.21.15.6:0/4169873361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 msgr2=0x55b8f31a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f31a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 -- 172.21.15.6:0/4169873361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 msgr2=0x55b8f31a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.780+0000 7ff56ed9d640 1 -- 172.21.15.6:0/4169873361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f31a5130 con 0x55b8f2dafcd0 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.781+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 0x55b8f319de30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b8f31b6c00 tx=0x7ff568016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7616c3e2c8d389fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.782+0000 7ff564ff9640 1 -- 172.21.15.6:0/4169873361 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5680217c0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.782+0000 7ff564ff9640 1 -- 172.21.15.6:0/4169873361 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff568021df0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.782+0000 7ff564ff9640 1 -- 172.21.15.6:0/4169873361 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56801f420 con 0x55b8f2dafcd0 2024-09-21T08:09:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.783+0000 7ff57b7d2740 1 -- 172.21.15.6:0/4169873361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 msgr2=0x55b8f319de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.783+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 0x55b8f319de30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b8f31b6c00 tx=0x7ff568016000 comp rx=0 tx=0).stop 2024-09-21T08:09:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.785+0000 7ff57b7d2740 1 -- 172.21.15.6:0/4169873361 shutdown_connections 2024-09-21T08:09:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.785+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dd0670 0x55b8f31a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.785+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dc8490 0x55b8f31a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.785+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/4169873361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dafcd0 0x55b8f319de30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.785+0000 7ff57b7d2740 1 -- 172.21.15.6:0/4169873361 >> 172.21.15.6:0/4169873361 conn(0x55b8f2de5740 msgr2=0x55b8f319d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.786+0000 7ff57b7d2740 1 -- 172.21.15.6:0/4169873361 shutdown_connections 2024-09-21T08:09:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.786+0000 7ff57b7d2740 1 -- 172.21.15.6:0/4169873361 wait complete. 2024-09-21T08:09:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.786+0000 7ff57b7d2740 1 -- start start 2024-09-21T08:09:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.787+0000 7ff57b7d2740 1 Processor -- start 2024-09-21T08:09:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.787+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff57b7d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dc8490 0x55b8f31a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:34968/0 (socket says 172.21.15.6:34968) 2024-09-21T08:09:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff56ed9d640 1 -- 172.21.15.6:0/347149002 learned_addr learned my addr 172.21.15.6:0/347149002 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff56e59c640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dc8490 0x55b8f31a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dd0670 0x55b8f31a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff55000ee10 con 0x55b8f2dd0670 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.788+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff550010280 con 0x55b8f2dc8490 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff55000f4e0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56f59e640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dd0670 0x55b8f31a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff57b7d2740 10 client.0 _ll_register_callbacks cb 0x7ff558005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56ed9d640 1 -- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dc8490 msgr2=0x55b8f31a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dc8490 0x55b8f31a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56ed9d640 1 -- 172.21.15.6:0/347149002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dd0670 msgr2=0x55b8f31a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dd0670 0x55b8f31a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.789+0000 7ff56ed9d640 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f31a9500 con 0x55b8f2dafcd0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff56ed9d640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff568029cf0 tx=0x7ff56800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcefd42b57252cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff568021df0 con 0x55b8f2dafcd0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff5567fc640 10 client.26581 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff5567fc640 1 -- 172.21.15.6:0/347149002 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568041060 con 0x55b8f2dafcd0 2024-09-21T08:09:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff5567fc640 1 -- 172.21.15.6:0/347149002 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff568029600 con 0x55b8f2dafcd0 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff5567fc640 1 -- 172.21.15.6:0/347149002 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff568029860 con 0x55b8f2dafcd0 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff57b7d2740 10 client.26581 fetch_fsmap learned FSMap version 21 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.790+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55b8f3221a30 con 0x55b8f2dafcd0 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff5567fc640 1 -- 172.21.15.6:0/347149002 <== mon.1 v2:172.21.15.145:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff56800f040 con 0x55b8f2dafcd0 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 10 client.26581 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 10 client.26581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 20 client.26581 populate_metadata read hostname 'smithi006' 2024-09-21T08:09:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2df1350 0x55b8f3223fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:09:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 4 client.26581 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:09:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b8f310c860 con 0x55b8f2df1350 2024-09-21T08:09:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.791+0000 7ff56e59c640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2df1350 0x55b8f3223fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:09:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.792+0000 7ff56e59c640 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2df1350 0x55b8f3223fe0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f7f29b86d1d43db server_cookie=a8d9b435b628325a in_seq=0 out_seq=0 2024-09-21T08:09:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.792+0000 7ff5567fc640 10 client.26581 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff5567fc640 1 -- 172.21.15.6:0/347149002 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b8f310c860 con 0x55b8f2df1350 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff5567fc640 10 client.26581 handle_command_reply: tid=0 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 client.26581 shutdown 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 msgr2=0x55b8f31ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff568029cf0 tx=0x7ff56800bf10 comp rx=0 tx=0).stop 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 shutdown_connections 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55b8f2df1350 0x55b8f3223fe0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8f2dd0670 0x55b8f31a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8f2dc8490 0x55b8f31a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff5567fc640 0 client.26581 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:09:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 --2- 172.21.15.6:0/347149002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b8f2dafcd0 0x55b8f31ac5c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.794+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 >> 172.21.15.6:0/347149002 conn(0x55b8f2de5740 msgr2=0x55b8f31a5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.795+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 shutdown_connections 2024-09-21T08:09:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.795+0000 7ff57b7d2740 1 -- 172.21.15.6:0/347149002 wait complete. 2024-09-21T08:09:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.795+0000 7ff57b7d2740 20 client.26581 trim_cache size 0 max 16384 2024-09-21T08:09:56.799 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:09:56.799 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:09:56.799 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "ce57228e-95cc-4ed1-83e0-d39f9663882b", 2024-09-21T08:09:56.799 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:09:56.800 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:09:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.796+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 msgr2=0x7ff55c0b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 0x7ff55c0b8c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55b8f3197290 tx=0x7ff568005f50 comp rx=0 tx=0).stop 2024-09-21T08:09:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 msgr2=0x7ff570197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff55802a970 tx=0x7ff558003c00 comp rx=0 tx=0).stop 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 shutdown_connections 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff55c0b6740 0x7ff55c0b8c50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5701081e0 0x7ff570197e20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff570108b30 0x7ff570198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 --2- 172.21.15.6:0/4227562159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5701028a0 0x7ff57019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.797+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 >> 172.21.15.6:0/4227562159 conn(0x7ff5700fe2f0 msgr2=0x7ff570100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:09:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.798+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 shutdown_connections 2024-09-21T08:09:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:56.798+0000 7ff57525e640 1 -- 172.21.15.6:0/4227562159 wait complete. 2024-09-21T08:09:57.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:56 smithi119 ceph-mon[33564]: pgmap v614: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.9 MiB/s wr, 694 op/s 2024-09-21T08:09:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:56 smithi145 ceph-mon[34049]: pgmap v614: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.9 MiB/s wr, 694 op/s 2024-09-21T08:09:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:56 smithi006 ceph-mon[30970]: pgmap v614: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.9 MiB/s wr, 694 op/s 2024-09-21T08:09:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 420.0 s, 844.1 tps, lat 118.398 ms stddev 41.232 2024-09-21T08:09:57.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:09:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:09:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:57 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:09:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:57 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:58.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:57 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:09:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:57 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:09:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:57 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:58.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:57 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:09:58.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:57 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:09:58.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:57 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:58.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:57 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:09:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:58 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:59.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:09:58 smithi119 ceph-mon[33564]: pgmap v615: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-09-21T08:09:59.193 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:58 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:59.193 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:09:58 smithi006 ceph-mon[30970]: pgmap v615: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-09-21T08:09:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:58 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:09:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:09:58 smithi145 ceph-mon[34049]: pgmap v615: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.7 MiB/s wr, 781 op/s 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 -- 172.21.15.6:0/1414233800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58881094c0 msgr2=0x7f58881098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 --2- 172.21.15.6:0/1414233800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58881094c0 0x7f58881098d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f587c009900 tx=0x7f587c02a410 comp rx=0 tx=0).stop 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 -- 172.21.15.6:0/1414233800 shutdown_connections 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 --2- 172.21.15.6:0/1414233800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888109e10 0x7f5888110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 --2- 172.21.15.6:0/1414233800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58881094c0 0x7f58881098d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 --2- 172.21.15.6:0/1414233800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5888103b80 0x7f5888103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 -- 172.21.15.6:0/1414233800 >> 172.21.15.6:0/1414233800 conn(0x7f58880ff5d0 msgr2=0x7f5888101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 -- 172.21.15.6:0/1414233800 shutdown_connections 2024-09-21T08:10:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.307+0000 7f588f1a9640 1 -- 172.21.15.6:0/1414233800 wait complete. 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 Processor -- start 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 -- start start 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 0x7f588819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58881094c0 0x7f588819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 0x7f588819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113980 con 0x7f5888109e10 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113800 con 0x7f5888103b80 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.308+0000 7f588f1a9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113b00 con 0x7f58881094c0 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588d746640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 0x7f588819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 0x7f588819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588d746640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 0x7f588819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58146/0 (socket says 172.21.15.6:58146) 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588d746640 1 -- 172.21.15.6:0/756989833 learned_addr learned my addr 172.21.15.6:0/756989833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f5887fff640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58881094c0 0x7f588819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 -- 172.21.15.6:0/756989833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58881094c0 msgr2=0x7f588819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58881094c0 0x7f588819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 -- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 msgr2=0x7f588819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 0x7f588819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 -- 172.21.15.6:0/756989833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58881a0340 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588cf45640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 0x7f588819a3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f587800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f5885ffb640 1 -- 172.21.15.6:0/756989833 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878009c30 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.309+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58881a0630 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.310+0000 7f5885ffb640 1 -- 172.21.15.6:0/756989833 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58780044c0 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.310+0000 7f5885ffb640 1 -- 172.21.15.6:0/756989833 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878020060 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.310+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881a6d90 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.312+0000 7f5885ffb640 1 -- 172.21.15.6:0/756989833 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5878003d10 con 0x7f5888103b80 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.312+0000 7f589571d740 1 Processor -- start 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.312+0000 7f589571d740 1 -- start start 2024-09-21T08:10:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cc8eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55652cc04e50 con 0x55652c8c6390 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55652cbf4280 con 0x55652c8be1b0 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f589571d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55652cbf8090 con 0x55652c8e7070 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f5887fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588cf45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cc8eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:34992/0 (socket says 172.21.15.6:34992) 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 -- 172.21.15.6:0/931011928 learned_addr learned my addr 172.21.15.6:0/931011928 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 -- 172.21.15.6:0/931011928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 msgr2=0x55652cc8eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cc8eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 -- 172.21.15.6:0/931011928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 msgr2=0x55652cc8f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc8f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 -- 172.21.15.6:0/931011928 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55652c952650 con 0x55652c8e7070 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f5885ffb640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 0x7f58700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.313+0000 7f588d746640 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5880011470 tx=0x7f5880011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d81ce035bf17dfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.314+0000 7f588cf45640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 0x7f58700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.314+0000 7f586effd640 1 -- 172.21.15.6:0/931011928 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880004b20 con 0x55652c8e7070 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.314+0000 7f5885ffb640 1 -- 172.21.15.6:0/756989833 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f58780e7300 con 0x7f5888103b80 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.314+0000 7f586effd640 1 -- 172.21.15.6:0/931011928 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5880004cc0 con 0x55652c8e7070 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.314+0000 7f586effd640 1 -- 172.21.15.6:0/931011928 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800052b0 con 0x55652c8e7070 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- 172.21.15.6:0/931011928 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 msgr2=0x55652cc8e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f588cf45640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 0x7f58700b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55652cc8d2d0 tx=0x7f58780eadb0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5880011470 tx=0x7f5880011930 comp rx=0 tx=0).stop 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- 172.21.15.6:0/931011928 shutdown_connections 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc8f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cc8eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 --2- 172.21.15.6:0/931011928 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc8e650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- 172.21.15.6:0/931011928 >> 172.21.15.6:0/931011928 conn(0x55652c8db460 msgr2=0x55652cc8c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- 172.21.15.6:0/931011928 shutdown_connections 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- 172.21.15.6:0/931011928 wait complete. 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 -- start start 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.315+0000 7f589571d740 1 Processor -- start 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8be1b0 0x55652cc99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8e7070 0x55652cc9a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55652ca55700 con 0x55652c8c6390 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55652cb8f110 con 0x55652c8e7070 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55652cc9ce30 con 0x55652c8be1b0 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f589571d740 10 client.0 _ll_register_callbacks cb 0x55652cba8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58168/0 (socket says 172.21.15.6:58168) 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 -- 172.21.15.6:0/575108696 learned_addr learned my addr 172.21.15.6:0/575108696 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f588d746640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8be1b0 0x55652cc99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f588d746640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8e7070 0x55652cc9a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 -- 172.21.15.6:0/575108696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8be1b0 msgr2=0x55652cc99c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8be1b0 0x55652cc99c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 -- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8e7070 msgr2=0x55652cc9a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8e7070 0x55652cc9a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 -- 172.21.15.6:0/575108696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55652cbbcc40 con 0x55652c8c6390 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5887fff640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f587c000c00 tx=0x7f587c031e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290fd54278b55a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.316+0000 7f5867fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c035040 con 0x55652c8c6390 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f587c0316c0 con 0x55652c8c6390 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5880004cc0 con 0x55652c8c6390 2024-09-21T08:10:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f587c004040 con 0x55652c8c6390 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 10 client.16848 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55652cca8ad0 con 0x55652c8c6390 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5880004cc0 con 0x55652c8c6390 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f587c003cb0 con 0x55652c8c6390 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 10 client.16848 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 20 client.16848 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c8a59f0 0x55652ccac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 4 client.16848 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.317+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55652cc06da0 con 0x55652c8a59f0 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.318+0000 7f588d746640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c8a59f0 0x55652ccac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.318+0000 7f588d746640 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c8a59f0 0x55652ccac080 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593b5f75ad045c3d server_cookie=8a507927a9449556 in_seq=0 out_seq=0 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.318+0000 7f5867fff640 10 client.16848 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f5867fff640 1 -- 172.21.15.6:0/575108696 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55652cc06da0 con 0x55652c8a59f0 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f5867fff640 10 client.16848 handle_command_reply: tid=0 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 client.16848 shutdown 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 msgr2=0x55652cc9a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f587c000c00 tx=0x7f587c031e00 comp rx=0 tx=0).stop 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 shutdown_connections 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c8a59f0 0x55652ccac080 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8e7070 0x55652cc9a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8c6390 0x55652cc9a180 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f5867fff640 0 client.16848 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 --2- 172.21.15.6:0/575108696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8be1b0 0x55652cc99c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 >> 172.21.15.6:0/575108696 conn(0x55652c8db460 msgr2=0x55652cc917e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 shutdown_connections 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 1 -- 172.21.15.6:0/575108696 wait complete. 2024-09-21T08:10:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.319+0000 7f589571d740 20 client.16848 trim_cache size 0 max 16384 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 Processor -- start 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 -- start start 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 0x55652cc9b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc96e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58881aeee0 con 0x55652c8be1b0 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58881b1740 con 0x55652c8c6390 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f589571d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58881af530 con 0x55652c8e7070 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.337+0000 7f588d746640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58176/0 (socket says 172.21.15.6:58176) 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 -- 172.21.15.6:0/58056742 learned_addr learned my addr 172.21.15.6:0/58056742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc96e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f5887fff640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 0x55652cc9b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 -- 172.21.15.6:0/58056742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 msgr2=0x55652cc96e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc96e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 -- 172.21.15.6:0/58056742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 msgr2=0x55652cc9b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 0x55652cc9b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 -- 172.21.15.6:0/58056742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55652cc98140 con 0x55652c8be1b0 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f5887fff640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 0x55652cc9b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f588d746640 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5880011440 tx=0x7f588000fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760889ebfd0d6389 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f586e7fc640 1 -- 172.21.15.6:0/58056742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588000f5c0 con 0x55652c8be1b0 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f586e7fc640 1 -- 172.21.15.6:0/58056742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f588002c030 con 0x55652c8be1b0 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.338+0000 7f586e7fc640 1 -- 172.21.15.6:0/58056742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800288a0 con 0x55652c8be1b0 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 -- 172.21.15.6:0/58056742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 msgr2=0x55652cc90040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5880011440 tx=0x7f588000fed0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 -- 172.21.15.6:0/58056742 shutdown_connections 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8e7070 0x55652cc96e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8c6390 0x55652cc9b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 --2- 172.21.15.6:0/58056742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8be1b0 0x55652cc90040 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 -- 172.21.15.6:0/58056742 >> 172.21.15.6:0/58056742 conn(0x55652c8db460 msgr2=0x55652cc9b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 -- 172.21.15.6:0/58056742 shutdown_connections 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.339+0000 7f589571d740 1 -- 172.21.15.6:0/58056742 wait complete. 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 -- start start 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 Processor -- start 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cca2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 0x55652cc9de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8e7070 0x55652cc9e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58881afc00 con 0x55652c8e7070 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58881b1070 con 0x55652c8be1b0 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58881b02d0 con 0x55652c8c6390 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.340+0000 7f589571d740 10 client.0 _ll_register_callbacks cb 0x7f587c031a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f5887fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 0x55652cc9de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f5887fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 0x55652cc9de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:35008/0 (socket says 172.21.15.6:35008) 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f5887fff640 1 -- 172.21.15.6:0/3625920269 learned_addr learned my addr 172.21.15.6:0/3625920269 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cca2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8e7070 0x55652cc9e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 -- 172.21.15.6:0/3625920269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 msgr2=0x55652cc9de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 0x55652cc9de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 -- 172.21.15.6:0/3625920269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8e7070 msgr2=0x55652cc9e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8e7070 0x55652cc9e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.341+0000 7f588d746640 1 -- 172.21.15.6:0/3625920269 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55652cc9eca0 con 0x55652c8be1b0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f588d746640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cca2990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f58800286c0 tx=0x7f58800049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153a9c972112e013 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f5867fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588000fb00 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f588002c030 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f5880028720 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.342+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5880028920 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 10 client.26483 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55652cd1aec0 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f588003a480 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5880038070 con 0x55652c8be1b0 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 10 client.26483 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 10 client.26483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 20 client.26483 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c87ada0 0x55652cd1d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 4 client.26483 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:10:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f588002c030 con 0x55652c87ada0 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.343+0000 7f5887fff640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c87ada0 0x55652cd1d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f5867fff640 10 client.26483 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f5887fff640 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c87ada0 0x55652cd1d400 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a8cc14e739bcb8c server_cookie=aa66be4a55159b5e in_seq=0 out_seq=0 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f5867fff640 1 -- 172.21.15.6:0/3625920269 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x7f588002c030 con 0x55652c87ada0 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f5867fff640 10 client.26483 handle_command_reply: tid=0 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f589571d740 1 client.26483 shutdown 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 msgr2=0x55652cca2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.344+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cca2990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f58800286c0 tx=0x7f58800049d0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 shutdown_connections 2024-09-21T08:10:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55652c87ada0 0x55652cd1d400 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "ce57228e-95cc-4ed1-83e0-d39f9663882b", 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:10:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:10:00.689 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.691 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.693 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:00.694 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55652c8c6390 0x55652cc9de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55652c8e7070 0x55652cc9e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 --2- 172.21.15.6:0/3625920269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55652c8be1b0 0x55652cca2990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 >> 172.21.15.6:0/3625920269 conn(0x55652c8db460 msgr2=0x55652cca59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f5867fff640 0 client.26483 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 shutdown_connections 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 1 -- 172.21.15.6:0/3625920269 wait complete. 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.345+0000 7f589571d740 20 client.26483 trim_cache size 0 max 16384 2024-09-21T08:10:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.346+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 msgr2=0x7f58700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.346+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 0x7f58700b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55652cc8d2d0 tx=0x7f58780eadb0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 msgr2=0x7f588819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 0x7f588819a3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f587800dde0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 shutdown_connections 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58700b6680 0x7f58700b8b90 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55652cc8d2d0 tx=0x7f58780eadb0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f58881094c0 0x7f588819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5888109e10 0x7f588819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 --2- 172.21.15.6:0/756989833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5888103b80 0x7f588819a3d0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f587800dde0 comp rx=0 tx=0).stop 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 >> 172.21.15.6:0/756989833 conn(0x7f58880ff5d0 msgr2=0x7f58881019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.347+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 shutdown_connections 2024-09-21T08:10:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:09:59.348+0000 7f588f1a9640 1 -- 172.21.15.6:0/756989833 wait complete. 2024-09-21T08:10:00.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:00 smithi006 ceph-mon[30970]: pgmap v616: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-09-21T08:10:00.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:00 smithi006 ceph-mon[30970]: overall HEALTH_OK 2024-09-21T08:10:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:00 smithi119 ceph-mon[33564]: pgmap v616: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-09-21T08:10:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:00 smithi119 ceph-mon[33564]: overall HEALTH_OK 2024-09-21T08:10:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:00 smithi145 ceph-mon[34049]: pgmap v616: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-09-21T08:10:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:00 smithi145 ceph-mon[34049]: overall HEALTH_OK 2024-09-21T08:10:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:01 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:10:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:01 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:10:02.354 INFO:tasks.cephfs.filesystem:scrub status for tag:ce57228e-95cc-4ed1-83e0-d39f9663882b - {'path': '/', 'tag': 'ce57228e-95cc-4ed1-83e0-d39f9663882b', 'options': 'recursive,force'} 2024-09-21T08:10:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:01 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:10:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 425.0 s, 773.8 tps, lat 129.064 ms stddev 86.254 2024-09-21T08:10:03.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:02 smithi119 ceph-mon[33564]: pgmap v617: 129 pgs: 129 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T08:10:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:02 smithi145 ceph-mon[34049]: pgmap v617: 129 pgs: 129 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T08:10:03.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:02 smithi006 ceph-mon[30970]: pgmap v617: 129 pgs: 129 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T08:10:05.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:04 smithi145 ceph-mon[34049]: pgmap v618: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 798 op/s 2024-09-21T08:10:05.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:04 smithi006 ceph-mon[30970]: pgmap v618: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 798 op/s 2024-09-21T08:10:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:04 smithi119 ceph-mon[33564]: pgmap v618: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 798 op/s 2024-09-21T08:10:07.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:06 smithi145 ceph-mon[34049]: pgmap v619: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T08:10:07.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:06 smithi145 ceph-mon[34049]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T08:10:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:06 smithi006 ceph-mon[30970]: pgmap v619: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T08:10:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:06 smithi006 ceph-mon[30970]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T08:10:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:06 smithi119 ceph-mon[33564]: pgmap v619: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T08:10:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:06 smithi119 ceph-mon[33564]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T08:10:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 430.0 s, 832.6 tps, lat 119.889 ms stddev 74.714 2024-09-21T08:10:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:09 smithi145 ceph-mon[34049]: pgmap v621: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 827 op/s 2024-09-21T08:10:09.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:09 smithi006 ceph-mon[30970]: pgmap v621: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 827 op/s 2024-09-21T08:10:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:09 smithi119 ceph-mon[33564]: pgmap v621: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 827 op/s 2024-09-21T08:10:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:11 smithi145 ceph-mon[34049]: pgmap v622: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-09-21T08:10:11.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:11 smithi006 ceph-mon[30970]: pgmap v622: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-09-21T08:10:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:11 smithi119 ceph-mon[33564]: pgmap v622: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-09-21T08:10:12.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 435.0 s, 923.6 tps, lat 108.532 ms stddev 58.585 2024-09-21T08:10:13.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:13 smithi006 ceph-mon[30970]: pgmap v623: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.5 MiB/s wr, 812 op/s 2024-09-21T08:10:13.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:13 smithi006 ceph-mon[30970]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T08:10:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:13 smithi119 ceph-mon[33564]: pgmap v623: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.5 MiB/s wr, 812 op/s 2024-09-21T08:10:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:13 smithi119 ceph-mon[33564]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T08:10:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:13 smithi145 ceph-mon[34049]: pgmap v623: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.5 MiB/s wr, 812 op/s 2024-09-21T08:10:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:13 smithi145 ceph-mon[34049]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T08:10:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:15 smithi006 ceph-mon[30970]: pgmap v625: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-21T08:10:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:15 smithi119 ceph-mon[33564]: pgmap v625: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-21T08:10:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:15 smithi145 ceph-mon[34049]: pgmap v625: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-21T08:10:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 440.0 s, 894.2 tps, lat 112.054 ms stddev 39.883 2024-09-21T08:10:17.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:17 smithi006 ceph-mon[30970]: pgmap v626: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-09-21T08:10:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:17 smithi119 ceph-mon[33564]: pgmap v626: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-09-21T08:10:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:17 smithi145 ceph-mon[34049]: pgmap v626: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 8.0 MiB/s wr, 828 op/s 2024-09-21T08:10:19.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:19 smithi006 ceph-mon[30970]: pgmap v627: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.2 MiB/s wr, 849 op/s 2024-09-21T08:10:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:19 smithi119 ceph-mon[33564]: pgmap v627: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.2 MiB/s wr, 849 op/s 2024-09-21T08:10:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:19 smithi145 ceph-mon[34049]: pgmap v627: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 8.2 MiB/s wr, 849 op/s 2024-09-21T08:10:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:21 smithi119 ceph-mon[33564]: pgmap v628: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.2 MiB/s wr, 843 op/s 2024-09-21T08:10:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:21 smithi145 ceph-mon[34049]: pgmap v628: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.2 MiB/s wr, 843 op/s 2024-09-21T08:10:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:21 smithi006 ceph-mon[30970]: pgmap v628: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.2 MiB/s wr, 843 op/s 2024-09-21T08:10:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 445.0 s, 906.2 tps, lat 110.267 ms stddev 38.138 2024-09-21T08:10:23.744 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:23 smithi145 ceph-mon[34049]: pgmap v629: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-21T08:10:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:23 smithi119 ceph-mon[33564]: pgmap v629: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-21T08:10:23.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:23 smithi006 ceph-mon[30970]: pgmap v629: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-21T08:10:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:25 smithi119 ceph-mon[33564]: pgmap v630: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 814 op/s 2024-09-21T08:10:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:25 smithi145 ceph-mon[34049]: pgmap v630: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 814 op/s 2024-09-21T08:10:25.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:25 smithi006 ceph-mon[30970]: pgmap v630: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 814 op/s 2024-09-21T08:10:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 450.0 s, 844.6 tps, lat 118.535 ms stddev 72.638 2024-09-21T08:10:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:27 smithi119 ceph-mon[33564]: pgmap v631: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.7 MiB/s wr, 816 op/s 2024-09-21T08:10:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:27 smithi145 ceph-mon[34049]: pgmap v631: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.7 MiB/s wr, 816 op/s 2024-09-21T08:10:27.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:27 smithi006 ceph-mon[30970]: pgmap v631: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.7 MiB/s wr, 816 op/s 2024-09-21T08:10:28.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:28 smithi119 ceph-mon[33564]: pgmap v632: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.6 MiB/s wr, 905 op/s 2024-09-21T08:10:28.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:28 smithi145 ceph-mon[34049]: pgmap v632: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.6 MiB/s wr, 905 op/s 2024-09-21T08:10:28.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:28 smithi006 ceph-mon[30970]: pgmap v632: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.6 MiB/s wr, 905 op/s 2024-09-21T08:10:31.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:30 smithi119 ceph-mon[33564]: pgmap v633: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 7.4 MiB/s wr, 798 op/s 2024-09-21T08:10:31.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:30 smithi145 ceph-mon[34049]: pgmap v633: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 7.4 MiB/s wr, 798 op/s 2024-09-21T08:10:31.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:30 smithi006 ceph-mon[30970]: pgmap v633: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 7.4 MiB/s wr, 798 op/s 2024-09-21T08:10:32.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:10:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 455.0 s, 878.4 tps, lat 113.378 ms stddev 36.096 2024-09-21T08:10:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:33.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:32 smithi119 ceph-mon[33564]: pgmap v634: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T08:10:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:32 smithi145 ceph-mon[34049]: pgmap v634: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T08:10:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:32 smithi006 ceph-mon[30970]: pgmap v634: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T08:10:35.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:34 smithi119 ceph-mon[33564]: pgmap v635: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-09-21T08:10:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:34 smithi145 ceph-mon[34049]: pgmap v635: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-09-21T08:10:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:34 smithi006 ceph-mon[30970]: pgmap v635: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-09-21T08:10:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:36 smithi119 ceph-mon[33564]: pgmap v636: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.6 MiB/s wr, 803 op/s 2024-09-21T08:10:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:36 smithi145 ceph-mon[34049]: pgmap v636: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.6 MiB/s wr, 803 op/s 2024-09-21T08:10:37.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:36 smithi006 ceph-mon[30970]: pgmap v636: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.6 MiB/s wr, 803 op/s 2024-09-21T08:10:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 460.0 s, 750.2 tps, lat 133.428 ms stddev 77.275 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 -- 172.21.15.6:0/366113046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 msgr2=0x7f181010fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 --2- 172.21.15.6:0/366113046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010fc80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1800009ca0 tx=0x7f180002a960 comp rx=0 tx=0).stop 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 -- 172.21.15.6:0/366113046 shutdown_connections 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 --2- 172.21.15.6:0/366113046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18101101c0 0x7f18101125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 --2- 172.21.15.6:0/366113046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010fc80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 --2- 172.21.15.6:0/366113046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f1810102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.036+0000 7f18161c4640 1 -- 172.21.15.6:0/366113046 >> 172.21.15.6:0/366113046 conn(0x7f18100797e0 msgr2=0x7f1810079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.037+0000 7f18161c4640 1 -- 172.21.15.6:0/366113046 shutdown_connections 2024-09-21T08:10:38.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.037+0000 7f18161c4640 1 -- 172.21.15.6:0/366113046 wait complete. 2024-09-21T08:10:38.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.038+0000 7f18161c4640 1 Processor -- start 2024-09-21T08:10:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.038+0000 7f18161c4640 1 -- start start 2024-09-21T08:10:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.039+0000 7f18161c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f181010ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.039+0000 7f18161c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.039+0000 7f18161c4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18101101c0 0x7f18101a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f18161c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18101058d0 con 0x7f1810102610 2024-09-21T08:10:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f18161c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1810105750 con 0x7f1810102f60 2024-09-21T08:10:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f18161c4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1810105a50 con 0x7f18101101c0 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38690/0 (socket says 172.21.15.6:38690) 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 -- 172.21.15.6:0/2753475890 learned_addr learned my addr 172.21.15.6:0/2753475890 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f181010ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 -- 172.21.15.6:0/2753475890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18101101c0 msgr2=0x7f18101a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18101101c0 0x7f18101a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 -- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 msgr2=0x7f181010ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f181010ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180effd640 1 -- 172.21.15.6:0/2753475890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18101a48a0 con 0x7f1810102f60 2024-09-21T08:10:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.040+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f181010ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:10:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.041+0000 7f180effd640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f180002af50 tx=0x7f180002fad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.041+0000 7f180cff9640 1 -- 172.21.15.6:0/2753475890 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800034030 con 0x7f1810102f60 2024-09-21T08:10:38.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.041+0000 7f180cff9640 1 -- 172.21.15.6:0/2753475890 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1800030cf0 con 0x7f1810102f60 2024-09-21T08:10:38.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.041+0000 7f180cff9640 1 -- 172.21.15.6:0/2753475890 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800039420 con 0x7f1810102f60 2024-09-21T08:10:38.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.041+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18101a4b30 con 0x7f1810102f60 2024-09-21T08:10:38.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.042+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101ad4e0 con 0x7f1810102f60 2024-09-21T08:10:38.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.046+0000 7f180cff9640 1 -- 172.21.15.6:0/2753475890 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1800037020 con 0x7f1810102f60 2024-09-21T08:10:38.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.048+0000 7f180cff9640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 0x7f17fc0b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.048+0000 7f180cff9640 1 -- 172.21.15.6:0/2753475890 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f1800108940 con 0x7f1810102f60 2024-09-21T08:10:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.048+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 0x7f17fc0b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.050+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 0x7f17fc0b8d10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.221+0000 7f181c738740 1 Processor -- start 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.221+0000 7f181c738740 1 -- start start 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.221+0000 7f181c738740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d7816a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.221+0000 7f181c738740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7816ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.221+0000 7f181c738740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d7816b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d7816a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d7816a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38702/0 (socket says 172.21.15.6:38702) 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180f7fe640 1 -- 172.21.15.6:0/3561434554 learned_addr learned my addr 172.21.15.6:0/3561434554 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559d780e0e50 con 0x559d77d9a1b0 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559d780d0280 con 0x559d77dc3070 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559d780d4090 con 0x559d77da2390 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d7816b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 -- 172.21.15.6:0/3561434554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 msgr2=0x559d7816a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d7816a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 -- 172.21.15.6:0/3561434554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 msgr2=0x559d7816ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7816ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.222+0000 7f180ffff640 1 -- 172.21.15.6:0/3561434554 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d77e2e650 con 0x559d77da2390 2024-09-21T08:10:38.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.223+0000 7f180ffff640 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d7816b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17f80096a0 tx=0x7f17f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7742343859ddc468 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.224+0000 7f1805ffb640 1 -- 172.21.15.6:0/3561434554 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8015020 con 0x559d77da2390 2024-09-21T08:10:38.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.224+0000 7f1805ffb640 1 -- 172.21.15.6:0/3561434554 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17f800bd50 con 0x559d77da2390 2024-09-21T08:10:38.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.224+0000 7f1805ffb640 1 -- 172.21.15.6:0/3561434554 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8010380 con 0x559d77da2390 2024-09-21T08:10:38.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.226+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 msgr2=0x559d7816b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.226+0000 7f181c738740 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d7816b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17f80096a0 tx=0x7f17f8009b60 comp rx=0 tx=0).stop 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.226+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 shutdown_connections 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.226+0000 7f181c738740 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d7816b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.226+0000 7f181c738740 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7816ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.227+0000 7f181c738740 1 --2- 172.21.15.6:0/3561434554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d7816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.227+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 >> 172.21.15.6:0/3561434554 conn(0x559d77db7460 msgr2=0x559d78168540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.227+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 shutdown_connections 2024-09-21T08:10:38.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.227+0000 7f181c738740 1 -- 172.21.15.6:0/3561434554 wait complete. 2024-09-21T08:10:38.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.228+0000 7f181c738740 1 -- start start 2024-09-21T08:10:38.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.229+0000 7f181c738740 1 Processor -- start 2024-09-21T08:10:38.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.230+0000 7f181c738740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d78175e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.230+0000 7f181c738740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d78176350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.230+0000 7f181c738740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78182150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.230+0000 7f181c738740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559d77f31700 con 0x559d77d9a1b0 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.230+0000 7f181c738740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559d7806b110 con 0x559d77dc3070 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f181c738740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559d78178e30 con 0x559d77da2390 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f181c738740 10 client.0 _ll_register_callbacks cb 0x559d78084990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d78175e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f180ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78182150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d78175e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54378/0 (socket says 172.21.15.6:54378) 2024-09-21T08:10:38.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.231+0000 7f180f7fe640 1 -- 172.21.15.6:0/826520281 learned_addr learned my addr 172.21.15.6:0/826520281 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:38.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 -- 172.21.15.6:0/826520281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 msgr2=0x559d78176350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:10:38.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d78176350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 -- 172.21.15.6:0/826520281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 msgr2=0x559d78175e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d78175e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 -- 172.21.15.6:0/826520281 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d78098c40 con 0x559d77dc3070 2024-09-21T08:10:38.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.232+0000 7f180ffff640 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78182150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17f8011a60 tx=0x7f17f8011650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b1ea73bc687dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.234+0000 7f17eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.234+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8020070 con 0x559d77dc3070 2024-09-21T08:10:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.234+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f17f800b6c0 con 0x559d77dc3070 2024-09-21T08:10:38.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.235+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f800bd50 con 0x559d77dc3070 2024-09-21T08:10:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.235+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f17f800b8c0 con 0x559d77dc3070 2024-09-21T08:10:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.235+0000 7f181c738740 10 client.26495 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.235+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559d78184c10 con 0x559d77dc3070 2024-09-21T08:10:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17f80044b0 con 0x559d77dc3070 2024-09-21T08:10:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f17f8003ae0 con 0x559d77dc3070 2024-09-21T08:10:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 10 client.26495 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 10 client.26495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 20 client.26495 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d819f0 0x559d781883d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 4 client.26495 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.236+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17f800bd50 con 0x559d77d819f0 2024-09-21T08:10:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.237+0000 7f180f7fe640 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d819f0 0x559d781883d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.238+0000 7f180f7fe640 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d819f0 0x559d781883d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af15cbc4c3bae77 server_cookie=79ed2a531b38bbf3 in_seq=0 out_seq=0 2024-09-21T08:10:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.239+0000 7f17eeffd640 10 client.26495 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f17eeffd640 1 -- 172.21.15.6:0/826520281 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f17f800bd50 con 0x559d77d819f0 2024-09-21T08:10:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f17eeffd640 10 client.26495 handle_command_reply: tid=0 2024-09-21T08:10:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 client.26495 shutdown 2024-09-21T08:10:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 msgr2=0x559d78182150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78182150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17f8011a60 tx=0x7f17f8011650 comp rx=0 tx=0).stop 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 shutdown_connections 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d819f0 0x559d781883d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77da2390 0x559d78176350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78182150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 --2- 172.21.15.6:0/826520281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d78175e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.240+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 >> 172.21.15.6:0/826520281 conn(0x559d77db7460 msgr2=0x559d7816d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.241+0000 7f17eeffd640 0 client.26495 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.241+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 shutdown_connections 2024-09-21T08:10:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.241+0000 7f181c738740 1 -- 172.21.15.6:0/826520281 wait complete. 2024-09-21T08:10:38.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.243+0000 7f181c738740 20 client.26495 trim_cache size 0 max 16384 2024-09-21T08:10:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.276+0000 7f181c738740 1 Processor -- start 2024-09-21T08:10:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.276+0000 7f181c738740 1 -- start start 2024-09-21T08:10:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77da2390 0x559d78182260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78175bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b5660 con 0x559d77da2390 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b7ec0 con 0x559d77dc3070 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f181c738740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b5cb0 con 0x559d77d9a1b0 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:39846/0 (socket says 172.21.15.6:39846) 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 -- 172.21.15.6:0/2382984502 learned_addr learned my addr 172.21.15.6:0/2382984502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180effd640 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77da2390 0x559d78182260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180ffff640 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78175bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 -- 172.21.15.6:0/2382984502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 msgr2=0x559d78175bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78175bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.277+0000 7f180f7fe640 1 -- 172.21.15.6:0/2382984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77da2390 msgr2=0x559d78182260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77da2390 0x559d78182260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f180f7fe640 1 -- 172.21.15.6:0/2382984502 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d78174d70 con 0x559d77d9a1b0 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f180800afd0 tx=0x7f1808012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f90e6ed8615fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f18057fa640 1 -- 172.21.15.6:0/2382984502 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180802d070 con 0x559d77d9a1b0 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f18057fa640 1 -- 172.21.15.6:0/2382984502 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808013a30 con 0x559d77d9a1b0 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.278+0000 7f18057fa640 1 -- 172.21.15.6:0/2382984502 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808021770 con 0x559d77d9a1b0 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.280+0000 7f181c738740 1 -- 172.21.15.6:0/2382984502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 msgr2=0x559d7816de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.280+0000 7f181c738740 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f180800afd0 tx=0x7f1808012000 comp rx=0 tx=0).stop 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.281+0000 7f181c738740 1 -- 172.21.15.6:0/2382984502 shutdown_connections 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.281+0000 7f181c738740 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77dc3070 0x559d78175bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.282+0000 7f181c738740 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77da2390 0x559d78182260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.282+0000 7f181c738740 1 --2- 172.21.15.6:0/2382984502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77d9a1b0 0x559d7816de60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.282+0000 7f181c738740 1 -- 172.21.15.6:0/2382984502 >> 172.21.15.6:0/2382984502 conn(0x559d77db7460 msgr2=0x559d7816d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.282+0000 7f181c738740 1 -- 172.21.15.6:0/2382984502 shutdown_connections 2024-09-21T08:10:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.282+0000 7f181c738740 1 -- 172.21.15.6:0/2382984502 wait complete. 2024-09-21T08:10:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.283+0000 7f181c738740 1 -- start start 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.283+0000 7f181c738740 1 Processor -- start 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.284+0000 7f181c738740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7817e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.284+0000 7f181c738740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.284+0000 7f181c738740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 0x559d78179ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.284+0000 7f180effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.284+0000 7f180effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38716/0 (socket says 172.21.15.6:38716) 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f180effd640 1 -- 172.21.15.6:0/2852399732 learned_addr learned my addr 172.21.15.6:0/2852399732 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f180ffff640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 0x559d78179ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b6380 con 0x559d77d9a1b0 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b77f0 con 0x559d77da2390 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f18101b6a50 con 0x559d77dc3070 2024-09-21T08:10:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.285+0000 7f181c738740 10 client.0 _ll_register_callbacks cb 0x7f17f8007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7817e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 -- 172.21.15.6:0/2852399732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 msgr2=0x559d78179ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 0x559d78179ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 -- 172.21.15.6:0/2852399732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 msgr2=0x559d7817e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7817e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7817a260 con 0x559d77da2390 2024-09-21T08:10:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180ffff640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 0x559d78179ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f180effd640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18001062b0 tx=0x7f18000ce240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c96b3a9b17ffa0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.286+0000 7f17eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.287+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18000b9020 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.287+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f1800030a60 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.287+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1808013a30 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.287+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f18000ceab0 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.288+0000 7f181c738740 10 client.26498 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.288+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559d781f2940 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.288+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808013a30 con 0x559d77da2390 2024-09-21T08:10:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1800041070 con 0x559d77da2390 2024-09-21T08:10:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 10 client.26498 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 20 client.26498 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d56da0 0x559d781f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 4 client.26498 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d780e2da0 con 0x559d77d56da0 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.289+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d56da0 0x559d781f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.290+0000 7f17eeffd640 10 client.26498 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.290+0000 7f180f7fe640 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d56da0 0x559d781f5080 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b30ffaf4f168ee server_cookie=5215805c3ae7cb09 in_seq=0 out_seq=0 2024-09-21T08:10:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.290+0000 7f17eeffd640 1 -- 172.21.15.6:0/2852399732 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x559d780e2da0 con 0x559d77d56da0 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.290+0000 7f17eeffd640 10 client.26498 handle_command_reply: tid=0 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.290+0000 7f181c738740 1 client.26498 shutdown 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 msgr2=0x559d7817ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18001062b0 tx=0x7f18000ce240 comp rx=0 tx=0).stop 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 shutdown_connections 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559d77d56da0 0x559d781f5080 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559d77dc3070 0x559d78179ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d77da2390 0x559d7817ea80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 --2- 172.21.15.6:0/2852399732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559d77d9a1b0 0x559d7817e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 >> 172.21.15.6:0/2852399732 conn(0x559d77db7460 msgr2=0x559d7816d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f17eeffd640 0 client.26498 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 shutdown_connections 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 1 -- 172.21.15.6:0/2852399732 wait complete. 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.291+0000 7f181c738740 20 client.26498 trim_cache size 0 max 16384 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:10:38.295 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:10:38.298 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.300 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:10:38.301 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:10:38.302 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:10:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:38.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 msgr2=0x7f17fc0b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 0x7f17fc0b8d10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).stop 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 msgr2=0x7f181010f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f180002af50 tx=0x7f180002fad0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 shutdown_connections 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f17fc0b6800 0x7f17fc0b8d10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f18101101c0 0x7f18101a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1810102f60 0x7f181010f1a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 --2- 172.21.15.6:0/2753475890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810102610 0x7f181010ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 >> 172.21.15.6:0/2753475890 conn(0x7f18100797e0 msgr2=0x7f1810100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 shutdown_connections 2024-09-21T08:10:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:38.293+0000 7f18161c4640 1 -- 172.21.15.6:0/2753475890 wait complete. 2024-09-21T08:10:39.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:38 smithi119 ceph-mon[33564]: pgmap v637: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 835 op/s 2024-09-21T08:10:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:38 smithi145 ceph-mon[34049]: pgmap v637: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 835 op/s 2024-09-21T08:10:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:38 smithi006 ceph-mon[30970]: pgmap v637: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 835 op/s 2024-09-21T08:10:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:40 smithi119 ceph-mon[33564]: pgmap v638: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 783 op/s 2024-09-21T08:10:41.177 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:40 smithi006 ceph-mon[30970]: pgmap v638: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 783 op/s 2024-09-21T08:10:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:40 smithi145 ceph-mon[34049]: pgmap v638: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 783 op/s 2024-09-21T08:10:41.951 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:10:41.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:10:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:42.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 465.0 s, 754.4 tps, lat 132.722 ms stddev 76.884 2024-09-21T08:10:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.022+0000 7f8057bb5640 1 -- 172.21.15.6:0/45221238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8050102080 msgr2=0x7f8050102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.022+0000 7f8057bb5640 1 --2- 172.21.15.6:0/45221238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8050102080 0x7f8050102490 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8048009ca0 tx=0x7f804802a980 comp rx=0 tx=0).stop 2024-09-21T08:10:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 -- 172.21.15.6:0/45221238 shutdown_connections 2024-09-21T08:10:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 --2- 172.21.15.6:0/45221238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501144c0 0x7f80501169d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 --2- 172.21.15.6:0/45221238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80501029d0 0x7f8050113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 --2- 172.21.15.6:0/45221238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8050102080 0x7f8050102490 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 -- 172.21.15.6:0/45221238 >> 172.21.15.6:0/45221238 conn(0x7f8050079ec0 msgr2=0x7f805007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 -- 172.21.15.6:0/45221238 shutdown_connections 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.025+0000 7f8057bb5640 1 -- 172.21.15.6:0/45221238 wait complete. 2024-09-21T08:10:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.026+0000 7f8057bb5640 1 Processor -- start 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.026+0000 7f8057bb5640 1 -- start start 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501029d0 0x7f805006e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80501144c0 0x7f805006e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f805011a030 con 0x7f80501144c0 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8050119eb0 con 0x7f8050102080 2024-09-21T08:10:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8057bb5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f805011a1b0 con 0x7f80501029d0 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8055951640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8055951640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38744/0 (socket says 172.21.15.6:38744) 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8055951640 1 -- 172.21.15.6:0/3335031502 learned_addr learned my addr 172.21.15.6:0/3335031502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.027+0000 7f8055150640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501029d0 0x7f805006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 -- 172.21.15.6:0/3335031502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501029d0 msgr2=0x7f805006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501029d0 0x7f805006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 -- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80501144c0 msgr2=0x7f805006e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80501144c0 0x7f805006e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 -- 172.21.15.6:0/3335031502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805006ee30 con 0x7f8050102080 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.028+0000 7f8055951640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f804802af70 tx=0x7f804802fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.029+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048034030 con 0x7f8050102080 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.029+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8048030cf0 con 0x7f8050102080 2024-09-21T08:10:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.029+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048039420 con 0x7f8050102080 2024-09-21T08:10:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.031+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8050073ac0 con 0x7f8050102080 2024-09-21T08:10:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.031+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8050073f20 con 0x7f8050102080 2024-09-21T08:10:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.032+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8050102e00 con 0x7f8050102080 2024-09-21T08:10:43.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.035+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8048037020 con 0x7f8050102080 2024-09-21T08:10:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.036+0000 7f8046ffd640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 0x7f803c0b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.036+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f8048108e70 con 0x7f8050102080 2024-09-21T08:10:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.037+0000 7f8055150640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 0x7f803c0b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.038+0000 7f8055150640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 0x7f803c0b8d10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8050108790 tx=0x7f804000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.039+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80480cf000 con 0x7f8050102080 2024-09-21T08:10:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:42 smithi119 ceph-mon[33564]: pgmap v639: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 7.7 MiB/s wr, 835 op/s 2024-09-21T08:10:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:42 smithi145 ceph-mon[34049]: pgmap v639: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 7.7 MiB/s wr, 835 op/s 2024-09-21T08:10:43.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:42 smithi006 ceph-mon[30970]: pgmap v639: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 7.7 MiB/s wr, 835 op/s 2024-09-21T08:10:43.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.480+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8050102490 con 0x7f8050102080 2024-09-21T08:10:43.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.481+0000 7f8046ffd640 1 -- 172.21.15.6:0/3335031502 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f80480d33e0 con 0x7f8050102080 2024-09-21T08:10:43.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:10:43.483 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:10:43.483 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:10:43.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 msgr2=0x7f803c0b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:43.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 0x7f803c0b8d10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8050108790 tx=0x7f804000a2d0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 msgr2=0x7f8050074e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f804802af70 tx=0x7f804802fb10 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 shutdown_connections 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f803c0b6800 0x7f803c0b8d10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80501029d0 0x7f805006e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80501144c0 0x7f805006e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 --2- 172.21.15.6:0/3335031502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8050102080 0x7f8050074e50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.485+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 >> 172.21.15.6:0/3335031502 conn(0x7f8050079ec0 msgr2=0x7f8050111d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.486+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 shutdown_connections 2024-09-21T08:10:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:43.487+0000 7f8057bb5640 1 -- 172.21.15.6:0/3335031502 wait complete. 2024-09-21T08:10:44.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:43 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3335031502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:44.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3335031502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:44.192 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3335031502' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:44.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:10:44.730 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:44 smithi119 ceph-mon[33564]: pgmap v640: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-21T08:10:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:44 smithi145 ceph-mon[34049]: pgmap v640: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-21T08:10:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:44 smithi006 ceph-mon[30970]: pgmap v640: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-21T08:10:47.155 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:46 smithi006 ceph-mon[30970]: pgmap v641: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-21T08:10:47.157 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:46 smithi119 ceph-mon[33564]: pgmap v641: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-21T08:10:47.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:46 smithi145 ceph-mon[34049]: pgmap v641: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 7.0 MiB/s wr, 747 op/s 2024-09-21T08:10:47.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.223+0000 7f22d276d640 1 -- 172.21.15.6:0/3288178264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc1030f0 msgr2=0x7f22cc107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.223+0000 7f22d276d640 1 --2- 172.21.15.6:0/3288178264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc1030f0 0x7f22cc107620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009900 tx=0x7f22c002a410 comp rx=0 tx=0).stop 2024-09-21T08:10:47.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.225+0000 7f22d276d640 1 -- 172.21.15.6:0/3288178264 shutdown_connections 2024-09-21T08:10:47.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.225+0000 7f22d276d640 1 --2- 172.21.15.6:0/3288178264 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc1030f0 0x7f22cc107620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.225+0000 7f22d276d640 1 --2- 172.21.15.6:0/3288178264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc107be0 0x7f22cc1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.225+0000 7f22d276d640 1 --2- 172.21.15.6:0/3288178264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1027a0 0x7f22cc102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.225+0000 7f22d276d640 1 -- 172.21.15.6:0/3288178264 >> 172.21.15.6:0/3288178264 conn(0x7f22cc079730 msgr2=0x7f22cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.226+0000 7f22d276d640 1 -- 172.21.15.6:0/3288178264 shutdown_connections 2024-09-21T08:10:47.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.226+0000 7f22d276d640 1 -- 172.21.15.6:0/3288178264 wait complete. 2024-09-21T08:10:47.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.227+0000 7f22d276d640 1 Processor -- start 2024-09-21T08:10:47.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.228+0000 7f22d276d640 1 -- start start 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d276d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 0x7f22cc1a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d276d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 0x7f22cc1a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d276d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 0x7f22cc1a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 0x7f22cc1a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47634/0 (socket says 172.21.15.6:47634) 2024-09-21T08:10:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22cb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22cb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57906/0 (socket says 172.21.15.6:57906) 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d0d0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 0x7f22cc1a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d0d0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 0x7f22cc1a6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48378/0 (socket says 172.21.15.6:48378) 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.229+0000 7f22d276d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc119f40 con 0x7f22cc1027a0 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22d276d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc119dc0 con 0x7f22cc1030f0 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22d276d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc11a0c0 con 0x7f22cc107be0 2024-09-21T08:10:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cbfff640 1 -- 172.21.15.6:0/2082163272 learned_addr learned my addr 172.21.15.6:0/2082163272 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cb7fe640 1 -- 172.21.15.6:0/2082163272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 msgr2=0x7f22cc1a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 0x7f22cc1a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cb7fe640 1 -- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 msgr2=0x7f22cc1a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 0x7f22cc1a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.230+0000 7f22cb7fe640 1 -- 172.21.15.6:0/2082163272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc1a6980 con 0x7f22cc1030f0 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.234+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009850 tx=0x7f22c0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.234+0000 7f22c97fa640 1 -- 172.21.15.6:0/2082163272 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c003f070 con 0x7f22cc1030f0 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.234+0000 7f22c97fa640 1 -- 172.21.15.6:0/2082163272 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c003baf0 con 0x7f22cc1030f0 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.234+0000 7f22c97fa640 1 -- 172.21.15.6:0/2082163272 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0035030 con 0x7f22cc1030f0 2024-09-21T08:10:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.234+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc1a6c10 con 0x7f22cc1030f0 2024-09-21T08:10:47.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.235+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc1a6fb0 con 0x7f22cc1030f0 2024-09-21T08:10:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.241+0000 7f22d8ce1740 1 Processor -- start 2024-09-21T08:10:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.242+0000 7f22d8ce1740 1 -- start start 2024-09-21T08:10:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.243+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a7606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.244+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.244+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a761120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.245+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.245+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56249a6d6ea0 con 0x56249a3b9070 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.245+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48394/0 (socket says 172.21.15.6:48394) 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.245+0000 7f22cbfff640 1 -- 172.21.15.6:0/2655922924 learned_addr learned my addr 172.21.15.6:0/2655922924 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.246+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56249a6c62d0 con 0x56249a398390 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.246+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56249a6ca0e0 con 0x56249a3901b0 2024-09-21T08:10:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.246+0000 7f22c97fa640 1 -- 172.21.15.6:0/2082163272 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f22c0042070 con 0x7f22cc1030f0 2024-09-21T08:10:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.246+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a761120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.246+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a7606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 -- 172.21.15.6:0/2655922924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 msgr2=0x56249a761120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a761120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 -- 172.21.15.6:0/2655922924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 msgr2=0x56249a7606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a7606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 -- 172.21.15.6:0/2655922924 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56249a424650 con 0x56249a3901b0 2024-09-21T08:10:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22cbfff640 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00bd90 tx=0x7f22bc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59db109492d02b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.247+0000 7f22b27fc640 1 -- 172.21.15.6:0/2655922924 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc004220 con 0x56249a3901b0 2024-09-21T08:10:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.248+0000 7f22b27fc640 1 -- 172.21.15.6:0/2655922924 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22bc0043c0 con 0x56249a3901b0 2024-09-21T08:10:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.248+0000 7f22b27fc640 1 -- 172.21.15.6:0/2655922924 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011730 con 0x56249a3901b0 2024-09-21T08:10:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.248+0000 7f22c97fa640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 0x7f22b40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.248+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 0x7f22b40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.248+0000 7f22c97fa640 1 -- 172.21.15.6:0/2082163272 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f22c0107f90 con 0x7f22cc1030f0 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 msgr2=0x56249a760be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00bd90 tx=0x7f22bc0107a0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 shutdown_connections 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a760be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a761120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/2655922924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a7606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.249+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 >> 172.21.15.6:0/2655922924 conn(0x56249a3ad460 msgr2=0x56249a75e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.251+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 0x7f22b40b8d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f22c4005fd0 tx=0x7f22c4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.251+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 shutdown_connections 2024-09-21T08:10:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.251+0000 7f22d8ce1740 1 -- 172.21.15.6:0/2655922924 wait complete. 2024-09-21T08:10:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.251+0000 7f22d8ce1740 1 -- start start 2024-09-21T08:10:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.252+0000 7f22d8ce1740 1 Processor -- start 2024-09-21T08:10:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.252+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a76c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48396/0 (socket says 172.21.15.6:48396) 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22cbfff640 1 -- 172.21.15.6:0/339606342 learned_addr learned my addr 172.21.15.6:0/339606342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a778200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a76c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56249a527700 con 0x56249a3b9070 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56249a661160 con 0x56249a398390 2024-09-21T08:10:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.253+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56249a76ee80 con 0x56249a3901b0 2024-09-21T08:10:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a778200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cbfff640 1 -- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 msgr2=0x56249a76c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cbfff640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a76c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cbfff640 1 -- 172.21.15.6:0/339606342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 msgr2=0x56249a778200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cbfff640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a778200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cbfff640 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249a68ec90 con 0x56249a3901b0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.254+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a76c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22cbfff640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003f30 tx=0x7f22bc0041c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c78da0c3284e2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22d8ce1740 10 client.0 _ll_register_callbacks cb 0x56249a67a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22ab7fe640 1 -- 172.21.15.6:0/339606342 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc029060 con 0x56249a3901b0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22ab7fe640 1 -- 172.21.15.6:0/339606342 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f22bc003a00 con 0x56249a3901b0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22bc0043c0 con 0x56249a3901b0 2024-09-21T08:10:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22ab7fe640 1 -- 172.21.15.6:0/339606342 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f22bc030050 con 0x56249a3901b0 2024-09-21T08:10:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22d8ce1740 10 client.26623 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.255+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({fsmap=21}) -- 0x56249a77a990 con 0x56249a3901b0 2024-09-21T08:10:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22ab7fe640 1 -- 172.21.15.6:0/339606342 <== mon.1 v2:172.21.15.145:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f22bc023030 con 0x56249a3901b0 2024-09-21T08:10:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 10 client.26623 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 10 client.26623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 20 client.26623 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a3779f0 0x56249a77e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 4 client.26623 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.256+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56249a6d8df0 con 0x56249a3779f0 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.257+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a3779f0 0x56249a77e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.258+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a3779f0 0x56249a77e3a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83eccbe44ef22b0 server_cookie=f80cb7efb5d0cbf3 in_seq=0 out_seq=0 2024-09-21T08:10:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.258+0000 7f22ab7fe640 10 client.26623 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.259+0000 7f22ab7fe640 1 -- 172.21.15.6:0/339606342 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56249a6d8df0 con 0x56249a3779f0 2024-09-21T08:10:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.259+0000 7f22ab7fe640 10 client.26623 handle_command_reply: tid=0 2024-09-21T08:10:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.259+0000 7f22d8ce1740 1 client.26623 shutdown 2024-09-21T08:10:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 msgr2=0x56249a76bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003f30 tx=0x7f22bc0041c0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 shutdown_connections 2024-09-21T08:10:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a3779f0 0x56249a77e3a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a778200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a398390 0x56249a76c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/339606342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a3901b0 0x56249a76bd90 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003f30 tx=0x7f22bc0041c0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 >> 172.21.15.6:0/339606342 conn(0x56249a3ad460 msgr2=0x56249a763830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.260+0000 7f22ab7fe640 0 client.26623 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.262+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 shutdown_connections 2024-09-21T08:10:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.262+0000 7f22d8ce1740 1 -- 172.21.15.6:0/339606342 wait complete. 2024-09-21T08:10:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.262+0000 7f22d8ce1740 20 client.26623 trim_cache size 0 max 16384 2024-09-21T08:10:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.287+0000 7f22d8ce1740 1 Processor -- start 2024-09-21T08:10:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 -- start start 2024-09-21T08:10:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a75dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 0x56249a75e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22b800e090 con 0x56249a3b9070 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22b80108f0 con 0x56249a34cda0 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.288+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22b800e6e0 con 0x56249a398390 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48402/0 (socket says 172.21.15.6:48402) 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 -- 172.21.15.6:0/78792522 learned_addr learned my addr 172.21.15.6:0/78792522 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 0x56249a75e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 -- 172.21.15.6:0/78792522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 msgr2=0x56249a75e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 0x56249a75e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 -- 172.21.15.6:0/78792522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 msgr2=0x56249a75dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a75dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 -- 172.21.15.6:0/78792522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56249a763500 con 0x56249a398390 2024-09-21T08:10:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 0x56249a75e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.289+0000 7f22cbfff640 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f22bc000c00 tx=0x7f22bc01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72ea80c937e6653 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.290+0000 7f22b1ffb640 1 -- 172.21.15.6:0/78792522 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc038070 con 0x56249a398390 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.290+0000 7f22b1ffb640 1 -- 172.21.15.6:0/78792522 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22bc0043c0 con 0x56249a398390 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.290+0000 7f22b1ffb640 1 -- 172.21.15.6:0/78792522 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc029050 con 0x56249a398390 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 -- 172.21.15.6:0/78792522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 msgr2=0x56249a778100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f22bc000c00 tx=0x7f22bc01c000 comp rx=0 tx=0).stop 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 -- 172.21.15.6:0/78792522 shutdown_connections 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a34cda0 0x56249a75e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a3b9070 0x56249a75dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/78792522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a778100 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 -- 172.21.15.6:0/78792522 >> 172.21.15.6:0/78792522 conn(0x56249a3ad460 msgr2=0x56249a76a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 -- 172.21.15.6:0/78792522 shutdown_connections 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.291+0000 7f22d8ce1740 1 -- 172.21.15.6:0/78792522 wait complete. 2024-09-21T08:10:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.292+0000 7f22d8ce1740 1 -- start start 2024-09-21T08:10:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.292+0000 7f22d8ce1740 1 Processor -- start 2024-09-21T08:10:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a7700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 0x56249a773fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22b800edb0 con 0x56249a34cda0 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8010220 con 0x56249a3b9070 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47662/0 (socket says 172.21.15.6:47662) 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22cbfff640 1 -- 172.21.15.6:0/369198285 learned_addr learned my addr 172.21.15.6:0/369198285 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.293+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22b800f480 con 0x56249a398390 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22d8ce1740 10 client.0 _ll_register_callbacks cb 0x7f22bc00bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 0x56249a773fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a7700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 -- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 msgr2=0x56249a773fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 0x56249a773fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 -- 172.21.15.6:0/369198285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 msgr2=0x56249a76fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cb7fe640 1 -- 172.21.15.6:0/369198285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249a774620 con 0x56249a398390 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22cbfff640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.294+0000 7f22d0d0a640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 0x56249a773fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.295+0000 7f22cb7fe640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a7700c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f22c01052a0 tx=0x7f22c00c9a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab43398667e1313e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.295+0000 7f22ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:10:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.295+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0049040 con 0x56249a398390 2024-09-21T08:10:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.295+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f22c00d7130 con 0x56249a398390 2024-09-21T08:10:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.295+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22bc0043c0 con 0x56249a398390 2024-09-21T08:10:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.296+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f22c00cd110 con 0x56249a398390 2024-09-21T08:10:47.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.297+0000 7f22d8ce1740 10 client.26629 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:47.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.297+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56249a7e8800 con 0x56249a398390 2024-09-21T08:10:47.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.298+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c00b7020 con 0x56249a398390 2024-09-21T08:10:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f22c010b020 con 0x56249a398390 2024-09-21T08:10:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 10 client.26629 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 10 client.26629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 20 client.26629 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a7e8f80 0x56249a7eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 4 client.26629 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.299+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f22bc0043c0 con 0x56249a7e8f80 2024-09-21T08:10:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.300+0000 7f22cbfff640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a7e8f80 0x56249a7eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.300+0000 7f22cbfff640 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a7e8f80 0x56249a7eb3a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a118ef66d3b95990 server_cookie=9a4cdc32eee8298f in_seq=0 out_seq=0 2024-09-21T08:10:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.301+0000 7f22ab7fe640 10 client.26629 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.301+0000 7f22ab7fe640 1 -- 172.21.15.6:0/369198285 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f22bc0043c0 con 0x56249a7e8f80 2024-09-21T08:10:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.301+0000 7f22ab7fe640 10 client.26629 handle_command_reply: tid=0 2024-09-21T08:10:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.303+0000 7f22d8ce1740 1 client.26629 shutdown 2024-09-21T08:10:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 msgr2=0x56249a7700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a7700c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f22c01052a0 tx=0x7f22c00c9a00 comp rx=0 tx=0).stop 2024-09-21T08:10:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 shutdown_connections 2024-09-21T08:10:47.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56249a7e8f80 0x56249a7eb3a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56249a398390 0x56249a7700c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56249a3b9070 0x56249a773fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 --2- 172.21.15.6:0/369198285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56249a34cda0 0x56249a76fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 >> 172.21.15.6:0/369198285 conn(0x56249a3ad460 msgr2=0x56249a76d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22ab7fe640 0 client.26629 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.304+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 shutdown_connections 2024-09-21T08:10:47.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.305+0000 7f22d8ce1740 1 -- 172.21.15.6:0/369198285 wait complete. 2024-09-21T08:10:47.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.305+0000 7f22d8ce1740 20 client.26629 trim_cache size 0 max 16384 2024-09-21T08:10:47.307 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:10:47.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.306+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 msgr2=0x7f22b40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.306+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 0x7f22b40b8d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f22c4005fd0 tx=0x7f22c4009500 comp rx=0 tx=0).stop 2024-09-21T08:10:47.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.306+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 msgr2=0x7f22cc1a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:47.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.306+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009850 tx=0x7f22c0003b90 comp rx=0 tx=0).stop 2024-09-21T08:10:47.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 shutdown_connections 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f22b40b6880 0x7f22b40b8d90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22cc107be0 0x7f22cc1a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc1030f0 0x7f22cc1a0fb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 --2- 172.21.15.6:0/2082163272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22cc1027a0 0x7f22cc1a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 >> 172.21.15.6:0/2082163272 conn(0x7f22cc079730 msgr2=0x7f22cc1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 shutdown_connections 2024-09-21T08:10:47.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:47.309+0000 7f22d276d640 1 -- 172.21.15.6:0/2082163272 wait complete. 2024-09-21T08:10:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 470.0 s, 824.8 tps, lat 120.498 ms stddev 51.391 2024-09-21T08:10:48.257 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:10:48.258 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T08:10:48.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:10:48.814 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:49.078 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:10:49.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:10:49.148 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:48 smithi006 ceph-mon[30970]: pgmap v642: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-21T08:10:49.157 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:48 smithi119 ceph-mon[33564]: pgmap v642: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-21T08:10:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:48 smithi145 ceph-mon[34049]: pgmap v642: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-21T08:10:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.581+0000 7f412cbad640 1 -- 172.21.15.6:0/747775912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41281083d0 msgr2=0x7f41281087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 --2- 172.21.15.6:0/747775912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41281083d0 0x7f41281087e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4114009900 tx=0x7f411402a420 comp rx=0 tx=0).stop 2024-09-21T08:10:49.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 -- 172.21.15.6:0/747775912 shutdown_connections 2024-09-21T08:10:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 --2- 172.21.15.6:0/747775912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4128108d20 0x7f412810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 --2- 172.21.15.6:0/747775912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41281083d0 0x7f41281087e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 --2- 172.21.15.6:0/747775912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f4128102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.582+0000 7f412cbad640 1 -- 172.21.15.6:0/747775912 >> 172.21.15.6:0/747775912 conn(0x7f41280797b0 msgr2=0x7f4128079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.584+0000 7f412cbad640 1 -- 172.21.15.6:0/747775912 shutdown_connections 2024-09-21T08:10:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.584+0000 7f412cbad640 1 -- 172.21.15.6:0/747775912 wait complete. 2024-09-21T08:10:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 Processor -- start 2024-09-21T08:10:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 -- start start 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f412810ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41281083d0 0x7f412810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 0x7f412810c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f412810ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f412810ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47684/0 (socket says 172.21.15.6:47684) 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412659c640 1 -- 172.21.15.6:0/3809788214 learned_addr learned my addr 172.21.15.6:0/3809788214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f4125d9b640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41281083d0 0x7f412810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41281117d0 con 0x7f4128102ae0 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4128111650 con 0x7f4128108d20 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4128111950 con 0x7f41281083d0 2024-09-21T08:10:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.585+0000 7f4126d9d640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 0x7f412810c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.586+0000 7f4126d9d640 1 -- 172.21.15.6:0/3809788214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41281083d0 msgr2=0x7f412810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.586+0000 7f4126d9d640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41281083d0 0x7f412810bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.586+0000 7f4126d9d640 1 -- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 msgr2=0x7f412810ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.586+0000 7f4126d9d640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f412810ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.586+0000 7f4126d9d640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281ac8a0 con 0x7f4128108d20 2024-09-21T08:10:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f4126d9d640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 0x7f412810c4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f412000e940 tx=0x7f412000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120004d20 con 0x7f4128108d20 2024-09-21T08:10:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4120005020 con 0x7f4128108d20 2024-09-21T08:10:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200116d0 con 0x7f4128108d20 2024-09-21T08:10:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281acb90 con 0x7f4128108d20 2024-09-21T08:10:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.587+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281acff0 con 0x7f4128108d20 2024-09-21T08:10:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.589+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412810cd50 con 0x7f4128108d20 2024-09-21T08:10:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.591+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f412000cb20 con 0x7f4128108d20 2024-09-21T08:10:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.593+0000 7f411f7fe640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 0x7f410c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.593+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f41200e7b00 con 0x7f4128108d20 2024-09-21T08:10:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.593+0000 7f412659c640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 0x7f410c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.594+0000 7f412659c640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 0x7f410c0b8d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f411800b480 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:49.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.598+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4120016030 con 0x7f4128108d20 2024-09-21T08:10:49.602 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.969+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41281ad2b0 con 0x7f4128108d20 2024-09-21T08:10:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.970+0000 7f411f7fe640 1 -- 172.21.15.6:0/3809788214 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f412000ce10 con 0x7f4128108d20 2024-09-21T08:10:49.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:10:49.971 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:10:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:10:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 msgr2=0x7f410c0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 0x7f410c0b8d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f411800b480 comp rx=0 tx=0).stop 2024-09-21T08:10:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 msgr2=0x7f412810c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 0x7f412810c4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f412000e940 tx=0x7f412000ee00 comp rx=0 tx=0).stop 2024-09-21T08:10:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 shutdown_connections 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f410c0b6880 0x7f410c0b8d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41281083d0 0x7f412810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4128108d20 0x7f412810c4d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 --2- 172.21.15.6:0/3809788214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4128102ae0 0x7f412810ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 >> 172.21.15.6:0/3809788214 conn(0x7f41280797b0 msgr2=0x7f41281042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 shutdown_connections 2024-09-21T08:10:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:49.972+0000 7f412cbad640 1 -- 172.21.15.6:0/3809788214 wait complete. 2024-09-21T08:10:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:50 smithi119 ceph-mon[33564]: pgmap v643: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 730 op/s 2024-09-21T08:10:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:50 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3809788214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:50 smithi145 ceph-mon[34049]: pgmap v643: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 730 op/s 2024-09-21T08:10:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:50 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3809788214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:51.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:50 smithi006 ceph-mon[30970]: pgmap v643: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 730 op/s 2024-09-21T08:10:51.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:50 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3809788214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:10:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 475.0 s, 620.8 tps, lat 157.195 ms stddev 127.680 2024-09-21T08:10:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:52 smithi119 ceph-mon[33564]: pgmap v644: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.2 MiB/s wr, 791 op/s 2024-09-21T08:10:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:52 smithi145 ceph-mon[34049]: pgmap v644: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.2 MiB/s wr, 791 op/s 2024-09-21T08:10:53.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:52 smithi006 ceph-mon[30970]: pgmap v644: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.2 MiB/s wr, 791 op/s 2024-09-21T08:10:54.179 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:53 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:10:54.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:53 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:10:54.241 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T08:10:54.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T08:10:54.243 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:53 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:10:54.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.492+0000 7f685906b640 1 -- 172.21.15.6:0/1738717254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685411cba0 msgr2=0x7f685411efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.492+0000 7f685906b640 1 --2- 172.21.15.6:0/1738717254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685411cba0 0x7f685411efc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6848009900 tx=0x7f684802a440 comp rx=0 tx=0).stop 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 -- 172.21.15.6:0/1738717254 shutdown_connections 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 --2- 172.21.15.6:0/1738717254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f685410dbf0 0x7f685410e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 --2- 172.21.15.6:0/1738717254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685411cba0 0x7f685411efc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 --2- 172.21.15.6:0/1738717254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6854111cd0 0x7f685410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 -- 172.21.15.6:0/1738717254 >> 172.21.15.6:0/1738717254 conn(0x7f685406e9f0 msgr2=0x7f685406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 -- 172.21.15.6:0/1738717254 shutdown_connections 2024-09-21T08:10:54.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.493+0000 7f685906b640 1 -- 172.21.15.6:0/1738717254 wait complete. 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.494+0000 7f685906b640 1 Processor -- start 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.495+0000 7f685906b640 1 -- start start 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.495+0000 7f685906b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685410dbf0 0x7f68541a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.495+0000 7f685906b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48458/0 (socket says 172.21.15.6:48458) 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f685906b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f685411cba0 0x7f68541ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 -- 172.21.15.6:0/866558579 learned_addr learned my addr 172.21.15.6:0/866558579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68541225d0 con 0x7f685411cba0 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6854122450 con 0x7f685410dbf0 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6854122750 con 0x7f6854111cd0 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f685886a640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f685411cba0 0x7f68541ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 -- 172.21.15.6:0/866558579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685410dbf0 msgr2=0x7f68541a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685410dbf0 0x7f68541a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 -- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f685411cba0 msgr2=0x7f68541ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f685411cba0 0x7f68541ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.496+0000 7f68537fe640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68541aeef0 con 0x7f6854111cd0 2024-09-21T08:10:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.497+0000 7f68537fe640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f684400d740 tx=0x7f684400dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.497+0000 7f68517fa640 1 -- 172.21.15.6:0/866558579 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844017070 con 0x7f6854111cd0 2024-09-21T08:10:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.497+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68541af1e0 con 0x7f6854111cd0 2024-09-21T08:10:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.497+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68541b5940 con 0x7f6854111cd0 2024-09-21T08:10:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.498+0000 7f68517fa640 1 -- 172.21.15.6:0/866558579 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f684400de50 con 0x7f6854111cd0 2024-09-21T08:10:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.498+0000 7f68517fa640 1 -- 172.21.15.6:0/866558579 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684400f620 con 0x7f6854111cd0 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.502+0000 7f6860841740 1 Processor -- start 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.502+0000 7f6860841740 1 -- start start 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 0x555b5c9e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b5c957e60 con 0x555b5c619670 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b5c947290 con 0x555b5c63a350 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.503+0000 7f6860841740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b5c94b0a0 con 0x555b5c611490 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.504+0000 7f68517fa640 1 -- 172.21.15.6:0/866558579 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f684401a070 con 0x7f6854111cd0 2024-09-21T08:10:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.505+0000 7f68517fa640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 0x7f683c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.505+0000 7f68517fa640 1 -- 172.21.15.6:0/866558579 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f68440e72d0 con 0x7f6854111cd0 2024-09-21T08:10:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.505+0000 7f68537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 0x555b5c9e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.506+0000 7f68537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 0x555b5c9e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47690/0 (socket says 172.21.15.6:47690) 2024-09-21T08:10:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.506+0000 7f68537fe640 1 -- 172.21.15.6:0/229167141 learned_addr learned my addr 172.21.15.6:0/229167141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.506+0000 7f685886a640 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f6853fff640 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 0x7f683c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 -- 172.21.15.6:0/229167141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 msgr2=0x555b5c9e1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 -- 172.21.15.6:0/229167141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 msgr2=0x555b5c9e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 0x555b5c9e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.507+0000 7f685886a640 1 -- 172.21.15.6:0/229167141 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5c6a5930 con 0x555b5c63a350 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.508+0000 7f685886a640 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e1610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6848005ab0 tx=0x7f6848005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969fe933de916b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.509+0000 7f685886a640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 0x7f683c0b8c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f684803c000 tx=0x7f6848048000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.510+0000 7f683a7fc640 1 -- 172.21.15.6:0/229167141 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848035020 con 0x555b5c63a350 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.510+0000 7f683a7fc640 1 -- 172.21.15.6:0/229167141 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f684804e070 con 0x555b5c63a350 2024-09-21T08:10:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.510+0000 7f683a7fc640 1 -- 172.21.15.6:0/229167141 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848031dd0 con 0x555b5c63a350 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 -- 172.21.15.6:0/229167141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 msgr2=0x555b5c9e1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e1610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6848005ab0 tx=0x7f6848005710 comp rx=0 tx=0).stop 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 -- 172.21.15.6:0/229167141 shutdown_connections 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9e1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c619670 0x555b5c9e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 --2- 172.21.15.6:0/229167141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e1610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.511+0000 7f6860841740 1 -- 172.21.15.6:0/229167141 >> 172.21.15.6:0/229167141 conn(0x555b5c62e740 msgr2=0x555b5c9df500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.512+0000 7f6860841740 1 -- 172.21.15.6:0/229167141 shutdown_connections 2024-09-21T08:10:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.512+0000 7f6860841740 1 -- 172.21.15.6:0/229167141 wait complete. 2024-09-21T08:10:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.513+0000 7f6860841740 1 -- start start 2024-09-21T08:10:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.513+0000 7f6860841740 1 Processor -- start 2024-09-21T08:10:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.513+0000 7f6860841740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x555b5c7a8890 con 0x555b5c611490 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b5c8e1d40 con 0x555b5c63a350 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b5c9efd90 con 0x555b5c619670 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f6860841740 10 client.0 _ll_register_callbacks cb 0x555b5c945c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f685886a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f685886a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58006/0 (socket says 172.21.15.6:58006) 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.514+0000 7f685886a640 1 -- 172.21.15.6:0/4081526683 learned_addr learned my addr 172.21.15.6:0/4081526683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.515+0000 7f685886a640 1 -- 172.21.15.6:0/4081526683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 msgr2=0x555b5c9ed880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.515+0000 7f685886a640 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9ed880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.515+0000 7f685886a640 1 -- 172.21.15.6:0/4081526683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 msgr2=0x555b5c9ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.515+0000 7f685886a640 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.515+0000 7f685886a640 1 -- 172.21.15.6:0/4081526683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5c9f9750 con 0x555b5c63a350 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.516+0000 7f685886a640 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68480045f0 tx=0x7f6848009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbc2cf14f64b6f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.516+0000 7f68337fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.516+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848035030 con 0x555b5c63a350 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.516+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f684804e070 con 0x555b5c63a350 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.517+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f6848031840 con 0x555b5c63a350 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.517+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6848061050 con 0x555b5c63a350 2024-09-21T08:10:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.517+0000 7f6860841740 10 client.26534 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.517+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b5c9fc060 con 0x555b5c63a350 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f684804e070 con 0x555b5c63a350 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f684803a040 con 0x555b5c63a350 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 10 client.26534 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 20 client.26534 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5f8cd0 0x555b5c9ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 4 client.26534 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.518+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b5c959db0 con 0x555b5c5f8cd0 2024-09-21T08:10:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.522+0000 7f6853fff640 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5f8cd0 0x555b5c9ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.523+0000 7f6853fff640 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5f8cd0 0x555b5c9ff700 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3bd70c885956ca server_cookie=2e52d67f47b5f22c in_seq=0 out_seq=0 2024-09-21T08:10:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.523+0000 7f68337fe640 10 client.26534 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.524+0000 7f68337fe640 1 -- 172.21.15.6:0/4081526683 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b5c959db0 con 0x555b5c5f8cd0 2024-09-21T08:10:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.524+0000 7f68337fe640 10 client.26534 handle_command_reply: tid=0 2024-09-21T08:10:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.524+0000 7f6860841740 1 client.26534 shutdown 2024-09-21T08:10:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 msgr2=0x555b5c9f90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68480045f0 tx=0x7f6848009260 comp rx=0 tx=0).stop 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 shutdown_connections 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5f8cd0 0x555b5c9ff700 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9f90e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 --2- 172.21.15.6:0/4081526683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 >> 172.21.15.6:0/4081526683 conn(0x555b5c62e740 msgr2=0x555b5c9e47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.525+0000 7f68337fe640 0 client.26534 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.526+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 shutdown_connections 2024-09-21T08:10:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.526+0000 7f6860841740 1 -- 172.21.15.6:0/4081526683 wait complete. 2024-09-21T08:10:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.526+0000 7f6860841740 20 client.26534 trim_cache size 0 max 16384 2024-09-21T08:10:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.560+0000 7f6860841740 1 Processor -- start 2024-09-21T08:10:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.560+0000 7f6860841740 1 -- start start 2024-09-21T08:10:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.561+0000 7f6860841740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.561+0000 7f6860841740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c619670 0x555b5c9e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.561+0000 7f6853fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.561+0000 7f6853fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48474/0 (socket says 172.21.15.6:48474) 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f6853fff640 1 -- 172.21.15.6:0/619713071 learned_addr learned my addr 172.21.15.6:0/619713071 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f6860841740 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c63a350 0x555b5c9f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f684000e130 con 0x555b5c63a350 2024-09-21T08:10:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6840010990 con 0x555b5c619670 2024-09-21T08:10:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f684000e780 con 0x555b5c611490 2024-09-21T08:10:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f68537fe640 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c619670 0x555b5c9e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.562+0000 7f685886a640 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c63a350 0x555b5c9f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 -- 172.21.15.6:0/619713071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c619670 msgr2=0x555b5c9e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c619670 0x555b5c9e1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 -- 172.21.15.6:0/619713071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c63a350 msgr2=0x555b5c9f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c63a350 0x555b5c9f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 -- 172.21.15.6:0/619713071 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5c9ee160 con 0x555b5c611490 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.563+0000 7f6853fff640 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6854110950 tx=0x7f684c009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7087e8f813d3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.564+0000 7f6839ffb640 1 -- 172.21.15.6:0/619713071 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c01d070 con 0x555b5c611490 2024-09-21T08:10:54.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.564+0000 7f6839ffb640 1 -- 172.21.15.6:0/619713071 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f684c011e40 con 0x555b5c611490 2024-09-21T08:10:54.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.564+0000 7f6839ffb640 1 -- 172.21.15.6:0/619713071 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c010860 con 0x555b5c611490 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 msgr2=0x555b5c9ec950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6854110950 tx=0x7f684c009400 comp rx=0 tx=0).stop 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 shutdown_connections 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c63a350 0x555b5c9f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c619670 0x555b5c9e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 --2- 172.21.15.6:0/619713071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c611490 0x555b5c9ec950 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 >> 172.21.15.6:0/619713071 conn(0x555b5c62e740 msgr2=0x555b5c9ee5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 shutdown_connections 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.566+0000 7f6860841740 1 -- 172.21.15.6:0/619713071 wait complete. 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.567+0000 7f6860841740 1 -- start start 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.567+0000 7f6860841740 1 Processor -- start 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f684000ee50 con 0x555b5c611490 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f68400102c0 con 0x555b5c63a350 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f684000f520 con 0x555b5c619670 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f6860841740 10 client.0 _ll_register_callbacks cb 0x7f6844010eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f68537fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f685886a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f68537fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:48486/0 (socket says 172.21.15.6:48486) 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f685886a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58024/0 (socket says 172.21.15.6:58024) 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.568+0000 7f68537fe640 1 -- 172.21.15.6:0/3991225740 learned_addr learned my addr 172.21.15.6:0/3991225740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 -- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 msgr2=0x555b5c9e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 -- 172.21.15.6:0/3991225740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 msgr2=0x555b5c9f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 -- 172.21.15.6:0/3991225740 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5c9e2ab0 con 0x555b5c619670 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68537fe640 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68440ac9e0 tx=0x7f6844010f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3728cf87d43b52f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68337fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844021040 con 0x555b5c619670 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.569+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f68440d00c0 con 0x555b5c619670 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b5c955860 con 0x555b5c619670 2024-09-21T08:10:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f68440ac450 con 0x555b5c619670 2024-09-21T08:10:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f6860841740 10 client.26647 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b5c9f3ce0 con 0x555b5c619670 2024-09-21T08:10:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555b5c955860 con 0x555b5c619670 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.570+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f68440abf40 con 0x555b5c619670 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 10 client.26647 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 10 client.26647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 20 client.26647 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5ce080 0x555b5ca6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 4 client.26647 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.571+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555b5c952c90 con 0x555b5c5ce080 2024-09-21T08:10:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.572+0000 7f6853fff640 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5ce080 0x555b5ca6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.573+0000 7f6853fff640 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5ce080 0x555b5ca6c570 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c645e07914650e server_cookie=46ad48d29a5c1371 in_seq=0 out_seq=0 2024-09-21T08:10:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.574+0000 7f68337fe640 10 client.26647 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:54.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.577+0000 7f68337fe640 1 -- 172.21.15.6:0/3991225740 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555b5c952c90 con 0x555b5c5ce080 2024-09-21T08:10:54.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.577+0000 7f68337fe640 10 client.26647 handle_command_reply: tid=0 2024-09-21T08:10:54.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 client.26647 shutdown 2024-09-21T08:10:54.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 msgr2=0x555b5c9e2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68440ac9e0 tx=0x7f6844010f60 comp rx=0 tx=0).stop 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "a7d87064-fb7e-4e69-baad-1d3cfe5955e9", 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:10:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 shutdown_connections 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x555b5c5ce080 0x555b5ca6c570 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b5c619670 0x555b5c9e2030 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b5c63a350 0x555b5c9e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 --2- 172.21.15.6:0/3991225740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b5c611490 0x555b5c9f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 >> 172.21.15.6:0/3991225740 conn(0x555b5c62e740 msgr2=0x555b5c9ee380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f68337fe640 0 client.26647 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.578+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 shutdown_connections 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.579+0000 7f6860841740 1 -- 172.21.15.6:0/3991225740 wait complete. 2024-09-21T08:10:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.579+0000 7f6860841740 20 client.26647 trim_cache size 0 max 16384 2024-09-21T08:10:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.583+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 msgr2=0x7f683c0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.583+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 0x7f683c0b8c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f684803c000 tx=0x7f6848048000 comp rx=0 tx=0).stop 2024-09-21T08:10:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.583+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 msgr2=0x7f68541a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.583+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f684400d740 tx=0x7f684400dc00 comp rx=0 tx=0).stop 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.585+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 shutdown_connections 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.585+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f683c0b6780 0x7f683c0b8c90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.585+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6854111cd0 0x7f68541a9520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.585+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f685411cba0 0x7f68541ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.585+0000 7f685906b640 1 --2- 172.21.15.6:0/866558579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f685410dbf0 0x7f68541a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:54.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.586+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 >> 172.21.15.6:0/866558579 conn(0x7f685406e9f0 msgr2=0x7f6854110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:54.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.587+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 shutdown_connections 2024-09-21T08:10:54.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:54.587+0000 7f685906b640 1 -- 172.21.15.6:0/866558579 wait complete. 2024-09-21T08:10:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:54 smithi145 ceph-mon[34049]: pgmap v645: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.9 MiB/s wr, 759 op/s 2024-09-21T08:10:55.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:54 smithi006 ceph-mon[30970]: pgmap v645: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.9 MiB/s wr, 759 op/s 2024-09-21T08:10:55.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:10:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:54 smithi119 ceph-mon[33564]: pgmap v645: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.9 MiB/s wr, 759 op/s 2024-09-21T08:10:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:56.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:10:56.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:56.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:10:56.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:55 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:10:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:56.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:10:56.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:55 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:55 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:10:56.611 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:10:56.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.732+0000 7f9675ffb640 1 -- 172.21.15.6:0/3283467755 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668031770 con 0x7f9678109350 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.732+0000 7f967d3d7640 1 -- 172.21.15.6:0/3283467755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109350 msgr2=0x7f9678109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.732+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3283467755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109350 0x7f9678109760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f966802a420 comp rx=0 tx=0).stop 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.733+0000 7f967d3d7640 1 -- 172.21.15.6:0/3283467755 shutdown_connections 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.733+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3283467755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678109ca0 0x7f96781104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.733+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3283467755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109350 0x7f9678109760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.733+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3283467755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678103a10 0x7f9678103e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.733+0000 7f967d3d7640 1 -- 172.21.15.6:0/3283467755 >> 172.21.15.6:0/3283467755 conn(0x7f96780ff4a0 msgr2=0x7f96781018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.735+0000 7f967d3d7640 1 -- 172.21.15.6:0/3283467755 shutdown_connections 2024-09-21T08:10:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.738+0000 7f967d3d7640 1 -- 172.21.15.6:0/3283467755 wait complete. 2024-09-21T08:10:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.739+0000 7f967d3d7640 1 Processor -- start 2024-09-21T08:10:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.739+0000 7f967d3d7640 1 -- start start 2024-09-21T08:10:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.739+0000 7f967d3d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678103a10 0x7f96781a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f967d3d7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678109350 0x7f96781a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f967d3d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f967d3d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9678113860 con 0x7f9678103a10 2024-09-21T08:10:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f967d3d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96781136e0 con 0x7f9678109ca0 2024-09-21T08:10:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f967d3d7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96781139e0 con 0x7f9678109350 2024-09-21T08:10:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44302/0 (socket says 172.21.15.6:44302) 2024-09-21T08:10:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 -- 172.21.15.6:0/3960157992 learned_addr learned my addr 172.21.15.6:0/3960157992 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 -- 172.21.15.6:0/3960157992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678109350 msgr2=0x7f96781a1a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:10:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678109350 0x7f96781a1a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 -- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678103a10 msgr2=0x7f96781a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678103a10 0x7f96781a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.740+0000 7f96777fe640 1 -- 172.21.15.6:0/3960157992 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96781acaa0 con 0x7f9678109ca0 2024-09-21T08:10:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.741+0000 7f96777fe640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f967000eaa0 tx=0x7f967000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.741+0000 7f965ffff640 1 -- 172.21.15.6:0/3960157992 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967000cdb0 con 0x7f9678109ca0 2024-09-21T08:10:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.741+0000 7f965ffff640 1 -- 172.21.15.6:0/3960157992 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9670005020 con 0x7f9678109ca0 2024-09-21T08:10:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.741+0000 7f965ffff640 1 -- 172.21.15.6:0/3960157992 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700116d0 con 0x7f9678109ca0 2024-09-21T08:10:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.742+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96781acc70 con 0x7f9678109ca0 2024-09-21T08:10:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.742+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96781ad100 con 0x7f9678109ca0 2024-09-21T08:10:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.746+0000 7f968394b740 1 Processor -- start 2024-09-21T08:10:56.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.748+0000 7f965ffff640 1 -- 172.21.15.6:0/3960157992 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f96700051d0 con 0x7f9678109ca0 2024-09-21T08:10:56.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 -- start start 2024-09-21T08:10:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c047840 0x561f5c3ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561f5c364b90 con 0x561f5c01e980 2024-09-21T08:10:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f5c353fc0 con 0x561f5c026b60 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f968394b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561f5c357dd0 con 0x561f5c047840 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f96767fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c047840 0x561f5c3ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.749+0000 7f96767fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44318/0 (socket says 172.21.15.6:44318) 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 -- 172.21.15.6:0/1113120791 learned_addr learned my addr 172.21.15.6:0/1113120791 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 -- 172.21.15.6:0/1113120791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c047840 msgr2=0x561f5c3ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c047840 0x561f5c3ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 -- 172.21.15.6:0/1113120791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 msgr2=0x561f5c3eed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:10:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3eed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.750+0000 7f96767fc640 1 -- 172.21.15.6:0/1113120791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c2db060 con 0x561f5c026b60 2024-09-21T08:10:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.751+0000 7f965ffff640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 0x7f96600b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.751+0000 7f965ffff640 1 -- 172.21.15.6:0/3960157992 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f96700e7be0 con 0x7f9678109ca0 2024-09-21T08:10:56.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.753+0000 7f96767fc640 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f966802a940 tx=0x7f9668009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe915f8479ea410f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.757+0000 7f9676ffd640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 0x7f96600b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.758+0000 7f965d7fa640 1 -- 172.21.15.6:0/1113120791 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668035030 con 0x561f5c026b60 2024-09-21T08:10:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.758+0000 7f9676ffd640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 0x7f96600b8cd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f966c0058c0 tx=0x7f966c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.758+0000 7f965d7fa640 1 -- 172.21.15.6:0/1113120791 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9668004230 con 0x561f5c026b60 2024-09-21T08:10:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.758+0000 7f965d7fa640 1 -- 172.21.15.6:0/1113120791 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680035f0 con 0x561f5c026b60 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 -- 172.21.15.6:0/1113120791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 msgr2=0x561f5c3ef240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f966802a940 tx=0x7f9668009260 comp rx=0 tx=0).stop 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 -- 172.21.15.6:0/1113120791 shutdown_connections 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c026b60 0x561f5c3ef240 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f966802a940 tx=0x7f9668009260 comp rx=0 tx=0).stop 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 --2- 172.21.15.6:0/1113120791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c047840 0x561f5c3ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 -- 172.21.15.6:0/1113120791 >> 172.21.15.6:0/1113120791 conn(0x561f5c03b990 msgr2=0x561f5c3ec6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 -- 172.21.15.6:0/1113120791 shutdown_connections 2024-09-21T08:10:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.760+0000 7f968394b740 1 -- 172.21.15.6:0/1113120791 wait complete. 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 -- start start 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 Processor -- start 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3fa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c4002a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561f5c1b57a0 con 0x561f5c01e980 2024-09-21T08:10:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f5c2f90a0 con 0x561f5c047840 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.761+0000 7f968394b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561f5c3fcf40 con 0x561f5c0061c0 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f968394b740 10 client.0 _ll_register_callbacks cb 0x561f5c2d63c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44324/0 (socket says 172.21.15.6:44324) 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 -- 172.21.15.6:0/2989111079 learned_addr learned my addr 172.21.15.6:0/2989111079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96777fe640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c4002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 -- 172.21.15.6:0/2989111079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 msgr2=0x561f5c4002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c4002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 -- 172.21.15.6:0/2989111079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 msgr2=0x561f5c3fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 -- 172.21.15.6:0/2989111079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5c2e7880 con 0x561f5c047840 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.762+0000 7f96767fc640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f9668004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fdbd50ed393fe52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.763+0000 7f965aff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.763+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668004ad0 con 0x561f5c047840 2024-09-21T08:10:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.763+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f96680314d0 con 0x561f5c047840 2024-09-21T08:10:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.764+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9668004230 con 0x561f5c047840 2024-09-21T08:10:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.764+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f96680316d0 con 0x561f5c047840 2024-09-21T08:10:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.768+0000 7f968394b740 10 client.26552 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.768+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f5c0c1b90 con 0x561f5c047840 2024-09-21T08:10:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.768+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9668004230 con 0x561f5c047840 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f966803a040 con 0x561f5c047840 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 10 client.26552 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 10 client.26552 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 20 client.26552 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5bfdb570 0x561f5c40c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 4 client.26552 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.771+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f5c366ae0 con 0x561f5bfdb570 2024-09-21T08:10:56.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.774+0000 7f9676ffd640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5bfdb570 0x561f5c40c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.776+0000 7f965aff5640 10 client.26552 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.776+0000 7f9676ffd640 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5bfdb570 0x561f5c40c290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c0643b1ae88bb0 server_cookie=2b15035934ca3237 in_seq=0 out_seq=0 2024-09-21T08:10:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.777+0000 7f965aff5640 1 -- 172.21.15.6:0/2989111079 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f5c366ae0 con 0x561f5bfdb570 2024-09-21T08:10:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.777+0000 7f965aff5640 10 client.26552 handle_command_reply: tid=0 2024-09-21T08:10:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.779+0000 7f968394b740 1 client.26552 shutdown 2024-09-21T08:10:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 msgr2=0x561f5c3fab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f9668004610 comp rx=0 tx=0).stop 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 shutdown_connections 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5bfdb570 0x561f5c40c290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c4002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c3fab00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 --2- 172.21.15.6:0/2989111079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c3fa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f965aff5640 0 client.26552 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 >> 172.21.15.6:0/2989111079 conn(0x561f5c03b990 msgr2=0x561f5c3ead30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 shutdown_connections 2024-09-21T08:10:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 1 -- 172.21.15.6:0/2989111079 wait complete. 2024-09-21T08:10:56.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.785+0000 7f968394b740 20 client.26552 trim_cache size 0 max 16384 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.819+0000 7f968394b740 1 Processor -- start 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.819+0000 7f968394b740 1 -- start start 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c3ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c01e980 0x561f5c4001a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b5430 con 0x561f5c047840 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b7c90 con 0x561f5c01e980 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.820+0000 7f968394b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b5a80 con 0x561f5c0061c0 2024-09-21T08:10:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45322/0 (socket says 172.21.15.6:45322) 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 -- 172.21.15.6:0/2938799586 learned_addr learned my addr 172.21.15.6:0/2938799586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 -- 172.21.15.6:0/2938799586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 msgr2=0x561f5c3ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c3ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 -- 172.21.15.6:0/2938799586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c01e980 msgr2=0x561f5c4001a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c01e980 0x561f5c4001a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.821+0000 7f96777fe640 1 -- 172.21.15.6:0/2938799586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c3eb810 con 0x561f5c047840 2024-09-21T08:10:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.822+0000 7f96777fe640 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad350 tx=0x7f96700ade10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbeccc51bf1564a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.822+0000 7f965cff9640 1 -- 172.21.15.6:0/2938799586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967001f040 con 0x561f5c047840 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.822+0000 7f965cff9640 1 -- 172.21.15.6:0/2938799586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96700b7070 con 0x561f5c047840 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.822+0000 7f965cff9640 1 -- 172.21.15.6:0/2938799586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700ac320 con 0x561f5c047840 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.823+0000 7f968394b740 1 -- 172.21.15.6:0/2938799586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 msgr2=0x561f5c3f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.823+0000 7f968394b740 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad350 tx=0x7f96700ade10 comp rx=0 tx=0).stop 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.824+0000 7f968394b740 1 -- 172.21.15.6:0/2938799586 shutdown_connections 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.824+0000 7f968394b740 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c047840 0x561f5c3f38d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.824+0000 7f968394b740 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c01e980 0x561f5c4001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.824+0000 7f968394b740 1 --2- 172.21.15.6:0/2938799586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c3ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.824+0000 7f968394b740 1 -- 172.21.15.6:0/2938799586 >> 172.21.15.6:0/2938799586 conn(0x561f5c03b990 msgr2=0x561f5c3ec0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.825+0000 7f968394b740 1 -- 172.21.15.6:0/2938799586 shutdown_connections 2024-09-21T08:10:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.826+0000 7f968394b740 1 -- 172.21.15.6:0/2938799586 wait complete. 2024-09-21T08:10:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.826+0000 7f968394b740 1 -- start start 2024-09-21T08:10:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.826+0000 7f968394b740 1 Processor -- start 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c406920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c404e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c405340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b6150 con 0x561f5c01e980 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b75c0 con 0x561f5c047840 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96781b6820 con 0x561f5c0061c0 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.827+0000 7f968394b740 10 client.0 _ll_register_callbacks cb 0x7f9668009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.828+0000 7f9676ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c406920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.828+0000 7f9676ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c406920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:54676/0 (socket says 172.21.15.6:54676) 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.828+0000 7f9676ffd640 1 -- 172.21.15.6:0/1100646204 learned_addr learned my addr 172.21.15.6:0/1100646204 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.828+0000 7f96777fe640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c405340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.828+0000 7f96777fe640 1 -- 172.21.15.6:0/1100646204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 msgr2=0x561f5c406920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96777fe640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c406920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96767fc640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c404e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96777fe640 1 -- 172.21.15.6:0/1100646204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 msgr2=0x561f5c404e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96777fe640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c404e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96777fe640 1 -- 172.21.15.6:0/1100646204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5c405ab0 con 0x561f5c047840 2024-09-21T08:10:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.829+0000 7f96777fe640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c405340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561f5c3f14d0 tx=0x7f96700b6270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59215814d3b79718 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.830+0000 7f96767fc640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c404e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:10:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.831+0000 7f965aff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:10:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.831+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700d4070 con 0x561f5c047840 2024-09-21T08:10:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.831+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f96700ac320 con 0x561f5c047840 2024-09-21T08:10:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.831+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96700b7070 con 0x561f5c047840 2024-09-21T08:10:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.832+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f967001f070 con 0x561f5c047840 2024-09-21T08:10:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.832+0000 7f968394b740 10 client.26555 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.832+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f5c488930 con 0x561f5c047840 2024-09-21T08:10:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96700b7070 con 0x561f5c047840 2024-09-21T08:10:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f967000f040 con 0x561f5c047840 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 10 client.26555 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 10 client.26555 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 20 client.26555 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5c489010 0x561f5c48b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 4 client.26555 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T08:10:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.835+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x561f5c362590 con 0x561f5c489010 2024-09-21T08:10:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.837+0000 7f9676ffd640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5c489010 0x561f5c48b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.839+0000 7f965aff5640 10 client.26555 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:56.839+0000 7f9676ffd640 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5c489010 0x561f5c48b430 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4871845f07c3050 server_cookie=28f3e404a42ee41b in_seq=0 out_seq=0 2024-09-21T08:10:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:56 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:56 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:10:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:56 smithi145 ceph-mon[34049]: pgmap v646: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.1 MiB/s wr, 748 op/s 2024-09-21T08:10:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f965aff5640 1 -- 172.21.15.6:0/1100646204 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561f5c362590 con 0x561f5c489010 2024-09-21T08:10:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f965aff5640 10 client.26555 handle_command_reply: tid=0 2024-09-21T08:10:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 client.26555 shutdown 2024-09-21T08:10:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:56 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:56 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:10:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:56 smithi006 ceph-mon[30970]: pgmap v646: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.1 MiB/s wr, 748 op/s 2024-09-21T08:10:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 msgr2=0x561f5c405340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c405340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561f5c3f14d0 tx=0x7f96700b6270 comp rx=0 tx=0).stop 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 shutdown_connections 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561f5c489010 0x561f5c48b430 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f5c047840 0x561f5c405340 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f5c01e980 0x561f5c404e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 --2- 172.21.15.6:0/1100646204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f5c0061c0 0x561f5c406920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 >> 172.21.15.6:0/1100646204 conn(0x561f5c03b990 msgr2=0x561f5c3f38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.208+0000 7f965aff5640 0 client.26555 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 shutdown_connections 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f968394b740 1 -- 172.21.15.6:0/1100646204 wait complete. 2024-09-21T08:10:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f968394b740 20 client.26555 trim_cache size 0 max 16384 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 38, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "bf194f93": { 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 38, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:10:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 144.5, 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 msgr2=0x7f96600b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 0x7f96600b8cd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f966c0058c0 tx=0x7f966c005850 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 msgr2=0x7f96781ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f967000eaa0 tx=0x7f967000ef60 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 shutdown_connections 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96600b67c0 0x7f96600b8cd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678109350 0x7f96781a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678109ca0 0x7f96781ac560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 --2- 172.21.15.6:0/3960157992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678103a10 0x7f96781a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.209+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 >> 172.21.15.6:0/3960157992 conn(0x7f96780ff4a0 msgr2=0x7f96781069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.210+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 shutdown_connections 2024-09-21T08:10:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:57.210+0000 7f967d3d7640 1 -- 172.21.15.6:0/3960157992 wait complete. 2024-09-21T08:10:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:56 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:10:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:56 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:10:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:56 smithi119 ceph-mon[33564]: pgmap v646: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.1 MiB/s wr, 748 op/s 2024-09-21T08:10:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 480.0 s, 645.3 tps, lat 136.670 ms stddev 102.721 2024-09-21T08:10:59.057 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:10:58 smithi006 ceph-mon[30970]: pgmap v647: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.0 MiB/s wr, 748 op/s 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 -- 172.21.15.6:0/99026213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4108d00 msgr2=0x7f99b410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/99026213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4108d00 0x7f99b410f530 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009ca0 tx=0x7f99ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 -- 172.21.15.6:0/99026213 shutdown_connections 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/99026213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b41083b0 0x7f99b41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/99026213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4108d00 0x7f99b410f530 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/99026213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b4102a70 0x7f99b4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.171+0000 7f99b8fd3640 1 -- 172.21.15.6:0/99026213 >> 172.21.15.6:0/99026213 conn(0x7f99b4079710 msgr2=0x7f99b4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.172+0000 7f99b8fd3640 1 -- 172.21.15.6:0/99026213 shutdown_connections 2024-09-21T08:10:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.172+0000 7f99b8fd3640 1 -- 172.21.15.6:0/99026213 wait complete. 2024-09-21T08:10:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.172+0000 7f99b8fd3640 1 Processor -- start 2024-09-21T08:10:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 -- start start 2024-09-21T08:10:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b41083b0 0x7f99b41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b4108d00 0x7f99b419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41128c0 con 0x7f99b4102a70 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4112740 con 0x7f99b41083b0 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b8fd3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4112a40 con 0x7f99b4108d00 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45346/0 (socket says 172.21.15.6:45346) 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b259c640 1 -- 172.21.15.6:0/3820740832 learned_addr learned my addr 172.21.15.6:0/3820740832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99abfff640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b41083b0 0x7f99b41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.173+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b4108d00 0x7f99b419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 -- 172.21.15.6:0/3820740832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b4108d00 msgr2=0x7f99b419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b4108d00 0x7f99b419ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 -- 172.21.15.6:0/3820740832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b41083b0 msgr2=0x7f99b41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b41083b0 0x7f99b41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 -- 172.21.15.6:0/3820740832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b419f1a0 con 0x7f99b4102a70 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b259c640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f99a400d950 tx=0x7f99a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99ab7fe640 1 -- 172.21.15.6:0/3820740832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4017070 con 0x7f99b4102a70 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99ab7fe640 1 -- 172.21.15.6:0/3820740832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a4009c30 con 0x7f99b4102a70 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99ab7fe640 1 -- 172.21.15.6:0/3820740832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a400f620 con 0x7f99b4102a70 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b419f490 con 0x7f99b4102a70 2024-09-21T08:10:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.174+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b406bb80 con 0x7f99b4102a70 2024-09-21T08:10:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.177+0000 7f99ab7fe640 1 -- 172.21.15.6:0/3820740832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f99a4010460 con 0x7f99b4102a70 2024-09-21T08:10:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.178+0000 7f99bf547740 1 Processor -- start 2024-09-21T08:10:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.178+0000 7f99bf547740 1 -- start start 2024-09-21T08:10:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.178+0000 7f99ab7fe640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 0x7f99a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 0x7f99a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55abb391ce50 con 0x55abb35de390 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abb390c280 con 0x55abb35d61b0 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99bf547740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55abb3910090 con 0x55abb35ff070 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99ab7fe640 1 -- 172.21.15.6:0/3820740832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f99a40e7730 con 0x7f99b4102a70 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44356/0 (socket says 172.21.15.6:44356) 2024-09-21T08:10:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 -- 172.21.15.6:0/3517753819 learned_addr learned my addr 172.21.15.6:0/3517753819 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99b259c640 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 -- 172.21.15.6:0/3517753819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 msgr2=0x55abb39a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 -- 172.21.15.6:0/3517753819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 msgr2=0x55abb39a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.179+0000 7f99abfff640 1 -- 172.21.15.6:0/3517753819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb366a650 con 0x55abb35d61b0 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.180+0000 7f99abfff640 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f999c00dd80 tx=0x7f999c009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555bc72ea3757b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.180+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 0x7f99a00b8b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006010 tx=0x7f99ac0093d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.180+0000 7f99a8ff9640 1 -- 172.21.15.6:0/3517753819 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c004050 con 0x55abb35d61b0 2024-09-21T08:10:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.180+0000 7f99a8ff9640 1 -- 172.21.15.6:0/3517753819 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f999c005020 con 0x55abb35d61b0 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.180+0000 7f99a8ff9640 1 -- 172.21.15.6:0/3517753819 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0049e0 con 0x55abb35d61b0 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 -- 172.21.15.6:0/3517753819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 msgr2=0x55abb39a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f999c00dd80 tx=0x7f999c009670 comp rx=0 tx=0).stop 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 -- 172.21.15.6:0/3517753819 shutdown_connections 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35d61b0 0x55abb39a6b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 --2- 172.21.15.6:0/3517753819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 -- 172.21.15.6:0/3517753819 >> 172.21.15.6:0/3517753819 conn(0x55abb35f3460 msgr2=0x55abb39a4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.181+0000 7f99bf547740 1 -- 172.21.15.6:0/3517753819 shutdown_connections 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.182+0000 7f99bf547740 1 -- 172.21.15.6:0/3517753819 wait complete. 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.182+0000 7f99bf547740 1 -- start start 2024-09-21T08:10:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.182+0000 7f99bf547740 1 Processor -- start 2024-09-21T08:10:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55abb376d700 con 0x55abb35d61b0 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abb38a7110 con 0x55abb35de390 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55abb39b90d0 con 0x55abb35ff070 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99bf547740 10 client.0 _ll_register_callbacks cb 0x55abb38c0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45362/0 (socket says 172.21.15.6:45362) 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b259c640 1 -- 172.21.15.6:0/3835153057 learned_addr learned my addr 172.21.15.6:0/3835153057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99abfff640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 -- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 msgr2=0x55abb39b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 -- 172.21.15.6:0/3835153057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 msgr2=0x55abb39b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b2d9d640 1 -- 172.21.15.6:0/3835153057 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb38d4c40 con 0x55abb35ff070 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.183+0000 7f99b259c640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.184+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39b6b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99ac031040 tx=0x7f99ac048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564f75e89c4f6dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.184+0000 7f9999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.184+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac050030 con 0x55abb35ff070 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.184+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c005020 con 0x55abb35ff070 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.184+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f99ac047040 con 0x55abb35ff070 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f99ac05d050 con 0x55abb35ff070 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 10 client.26671 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55abb39c4d60 con 0x55abb35ff070 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f999c005020 con 0x55abb35ff070 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f99ac04b070 con 0x55abb35ff070 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 10 client.26671 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 10 client.26671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 20 client.26671 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb35bd9f0 0x55abb39c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 4 client.26671 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:10:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.185+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abb391eda0 con 0x55abb35bd9f0 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.186+0000 7f99b259c640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb35bd9f0 0x55abb39c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.186+0000 7f99b259c640 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb35bd9f0 0x55abb39c8230 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c13222b88045c97e server_cookie=2d029aad57e8f52 in_seq=0 out_seq=0 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.186+0000 7f9999ffb640 10 client.26671 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f9999ffb640 1 -- 172.21.15.6:0/3835153057 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abb391eda0 con 0x55abb35bd9f0 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f9999ffb640 10 client.26671 handle_command_reply: tid=0 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 client.26671 shutdown 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 msgr2=0x55abb39b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39b6b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99ac031040 tx=0x7f99ac048000 comp rx=0 tx=0).stop 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 shutdown_connections 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb35bd9f0 0x55abb39c8230 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39b6b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.187+0000 7f99bf547740 1 --2- 172.21.15.6:0/3835153057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.188+0000 7f9999ffb640 0 client.26671 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.188+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 >> 172.21.15.6:0/3835153057 conn(0x55abb35f3460 msgr2=0x55abb39a8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.188+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 shutdown_connections 2024-09-21T08:10:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.188+0000 7f99bf547740 1 -- 172.21.15.6:0/3835153057 wait complete. 2024-09-21T08:10:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.188+0000 7f99bf547740 20 client.26671 trim_cache size 0 max 16384 2024-09-21T08:10:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:10:58 smithi145 ceph-mon[34049]: pgmap v647: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.0 MiB/s wr, 748 op/s 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.205+0000 7f99bf547740 1 Processor -- start 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.205+0000 7f99bf547740 1 -- start start 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41acc50 con 0x55abb35d61b0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41af4b0 con 0x55abb35de390 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99bf547740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ad2a0 con 0x55abb35ff070 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45376/0 (socket says 172.21.15.6:45376) 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 -- 172.21.15.6:0/75023782 learned_addr learned my addr 172.21.15.6:0/75023782 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99abfff640 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 -- 172.21.15.6:0/75023782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 msgr2=0x55abb39cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 -- 172.21.15.6:0/75023782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 msgr2=0x55abb39cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 -- 172.21.15.6:0/75023782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb39b6e40 con 0x55abb35d61b0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.206+0000 7f99b259c640 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f99a400dfe0 tx=0x7f99a4094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11993ffc8249172 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.207+0000 7f999bfff640 1 -- 172.21.15.6:0/75023782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4020040 con 0x55abb35d61b0 2024-09-21T08:10:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.207+0000 7f999bfff640 1 -- 172.21.15.6:0/75023782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a4098070 con 0x55abb35d61b0 2024-09-21T08:10:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.207+0000 7f999bfff640 1 -- 172.21.15.6:0/75023782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4098480 con 0x55abb35d61b0 2024-09-21T08:10:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- 172.21.15.6:0/75023782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 msgr2=0x55abb39b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f99a400dfe0 tx=0x7f99a4094040 comp rx=0 tx=0).stop 2024-09-21T08:10:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- 172.21.15.6:0/75023782 shutdown_connections 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35ff070 0x55abb39cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35de390 0x55abb39cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 --2- 172.21.15.6:0/75023782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35d61b0 0x55abb39b3b90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- 172.21.15.6:0/75023782 >> 172.21.15.6:0/75023782 conn(0x55abb35f3460 msgr2=0x55abb39b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- 172.21.15.6:0/75023782 shutdown_connections 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- 172.21.15.6:0/75023782 wait complete. 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 -- start start 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.208+0000 7f99bf547740 1 Processor -- start 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 0x55abb39bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35ff070 0x55abb39ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ad970 con 0x55abb35de390 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41aede0 con 0x55abb35ff070 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ae040 con 0x55abb35d61b0 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99bf547740 10 client.0 _ll_register_callbacks cb 0x7f99ac0318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45390/0 (socket says 172.21.15.6:45390) 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 -- 172.21.15.6:0/2464303514 learned_addr learned my addr 172.21.15.6:0/2464303514 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99b2d9d640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35ff070 0x55abb39ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99b259c640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 0x55abb39bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 -- 172.21.15.6:0/2464303514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 msgr2=0x55abb39bead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 0x55abb39bead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 -- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35ff070 msgr2=0x55abb39ba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35ff070 0x55abb39ba4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 -- 172.21.15.6:0/2464303514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb39babd0 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99b259c640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 0x55abb39bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f99abfff640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f999c00d440 tx=0x7f999c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d22c71237f59dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f9999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.209+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0055f0 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f999c0035f0 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a4098070 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f999c003810 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 10 client.16920 fetch_fsmap learned FSMap version 21 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55abb3a32ac0 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a4098070 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f999c024430 con 0x55abb35de390 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 10 client.16920 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:10:59.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 20 client.16920 populate_metadata read hostname 'smithi006' 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb3592da0 0x55abb3a35020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 4 client.16920 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.210+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55abb391a850 con 0x55abb3592da0 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f99b259c640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb3592da0 0x55abb3a35020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f9999ffb640 10 client.16920 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f99b259c640 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb3592da0 0x55abb3a35020 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=434dd55ec8b05473 server_cookie=69cf5e98335ad4b7 in_seq=0 out_seq=0 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f9999ffb640 1 -- 172.21.15.6:0/2464303514 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55abb391a850 con 0x55abb3592da0 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f9999ffb640 10 client.16920 handle_command_reply: tid=0 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f99bf547740 1 client.16920 shutdown 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 msgr2=0x55abb39b9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.211+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f999c00d440 tx=0x7f999c005270 comp rx=0 tx=0).stop 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 shutdown_connections 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55abb3592da0 0x55abb3a35020 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abb35ff070 0x55abb39ba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abb35de390 0x55abb39b9f80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 --2- 172.21.15.6:0/2464303514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55abb35d61b0 0x55abb39bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f9999ffb640 0 client.16920 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 >> 172.21.15.6:0/2464303514 conn(0x55abb35f3460 msgr2=0x55abb39a7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 shutdown_connections 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 1 -- 172.21.15.6:0/2464303514 wait complete. 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99bf547740 20 client.16920 trim_cache size 0 max 16384 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:10:59.218 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:10:59.220 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:10:59.223 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:10:59.226 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:59.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 msgr2=0x7f99a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 0x7f99a00b8b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006010 tx=0x7f99ac0093d0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 msgr2=0x7f99b4199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f99a400d950 tx=0x7f99a400de10 comp rx=0 tx=0).stop 2024-09-21T08:10:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 shutdown_connections 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f99a00b6680 0x7f99a00b8b90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99b4108d00 0x7f99b419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b41083b0 0x7f99b41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 --2- 172.21.15.6:0/3820740832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b4102a70 0x7f99b4199230 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.212+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 >> 172.21.15.6:0/3820740832 conn(0x7f99b4079710 msgr2=0x7f99b4106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.213+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 shutdown_connections 2024-09-21T08:10:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:10:59.213+0000 7f99b8fd3640 1 -- 172.21.15.6:0/3820740832 wait complete. 2024-09-21T08:10:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:10:58 smithi119 ceph-mon[33564]: pgmap v647: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 7.0 MiB/s wr, 748 op/s 2024-09-21T08:10:59.708 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf194f93', quiesce took 11.4 seconds. Will release after: 13.1 2024-09-21T08:11:00.431 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:11:00.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:11:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:00 smithi145 ceph-mon[34049]: pgmap v648: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.3 MiB/s wr, 667 op/s 2024-09-21T08:11:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:00 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:00 smithi006 ceph-mon[30970]: pgmap v648: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.3 MiB/s wr, 667 op/s 2024-09-21T08:11:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:00 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 -- 172.21.15.6:0/591819395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c103c30 msgr2=0x7fe74c104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 --2- 172.21.15.6:0/591819395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c103c30 0x7fe74c104040 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009900 tx=0x7fe73c02a410 comp rx=0 tx=0).stop 2024-09-21T08:11:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 -- 172.21.15.6:0/591819395 shutdown_connections 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 --2- 172.21.15.6:0/591819395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c1106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 --2- 172.21.15.6:0/591819395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c109570 0x7fe74c109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.387+0000 7fe751948640 1 --2- 172.21.15.6:0/591819395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c103c30 0x7fe74c104040 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.388+0000 7fe751948640 1 -- 172.21.15.6:0/591819395 >> 172.21.15.6:0/591819395 conn(0x7fe74c07b8d0 msgr2=0x7fe74c07bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.388+0000 7fe751948640 1 -- 172.21.15.6:0/591819395 shutdown_connections 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.388+0000 7fe751948640 1 -- 172.21.15.6:0/591819395 wait complete. 2024-09-21T08:11:01.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.388+0000 7fe751948640 1 Processor -- start 2024-09-21T08:11:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 -- start start 2024-09-21T08:11:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 0x7fe74c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c109570 0x7fe74c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c113990 con 0x7fe74c109570 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c113810 con 0x7fe74c103c30 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe751948640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c113b10 con 0x7fe74c109ec0 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 0x7fe74c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c109570 0x7fe74c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:54754/0 (socket says 172.21.15.6:54754) 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 0x7fe74c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:44404/0 (socket says 172.21.15.6:44404) 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 -- 172.21.15.6:0/657483915 learned_addr learned my addr 172.21.15.6:0/657483915 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 -- 172.21.15.6:0/657483915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 msgr2=0x7fe74c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 0x7fe74c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 -- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c109570 msgr2=0x7fe74c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c109570 0x7fe74c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.389+0000 7fe74b7fe640 1 -- 172.21.15.6:0/657483915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c1a8680 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe74b7fe640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe74400eb10 tx=0x7fe74400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744004b20 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe744004cc0 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744010690 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c1a8970 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.390+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c1a8eb0 con 0x7fe74c109ec0 2024-09-21T08:11:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.391+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c104040 con 0x7fe74c109ec0 2024-09-21T08:11:01.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.393+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe744005000 con 0x7fe74c109ec0 2024-09-21T08:11:01.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.394+0000 7fe750946640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 0x7fe7340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:01.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.394+0000 7fe74affd640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 0x7fe7340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:01.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.394+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fe7440e82a0 con 0x7fe74c109ec0 2024-09-21T08:11:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.395+0000 7fe74affd640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 0x7fe7340b8c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe74c077160 tx=0x7fe73c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:01.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.397+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe744056710 con 0x7fe74c109ec0 2024-09-21T08:11:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:00 smithi119 ceph-mon[33564]: pgmap v648: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.3 MiB/s wr, 667 op/s 2024-09-21T08:11:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:00 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.628+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe74c076a10 con 0x7fe74c109ec0 2024-09-21T08:11:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.629+0000 7fe750946640 1 -- 172.21.15.6:0/657483915 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fe74c076a10 con 0x7fe74c109ec0 2024-09-21T08:11:01.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:11:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:11:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:11:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 msgr2=0x7fe7340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 0x7fe7340b8c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe74c077160 tx=0x7fe73c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 msgr2=0x7fe74c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe74400eb10 tx=0x7fe74400c2d0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 shutdown_connections 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe7340b6700 0x7fe7340b8c10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe74c109ec0 0x7fe74c076190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe74c109570 0x7fe74c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 --2- 172.21.15.6:0/657483915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c103c30 0x7fe74c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 >> 172.21.15.6:0/657483915 conn(0x7fe74c07b8d0 msgr2=0x7fe74c107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 shutdown_connections 2024-09-21T08:11:01.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:01.631+0000 7fe751948640 1 -- 172.21.15.6:0/657483915 wait complete. 2024-09-21T08:11:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:11:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:11:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:01 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/657483915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:11:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:11:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:01 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/657483915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:02.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:11:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:11:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:11:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:11:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:01 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/657483915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 -- 172.21.15.6:0/3876951263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b4108cf0 msgr2=0x7f63b410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 --2- 172.21.15.6:0/3876951263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b4108cf0 0x7f63b410f520 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009900 tx=0x7f63ac02a410 comp rx=0 tx=0).stop 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 -- 172.21.15.6:0/3876951263 shutdown_connections 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 --2- 172.21.15.6:0/3876951263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b4108cf0 0x7f63b410f520 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 --2- 172.21.15.6:0/3876951263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b41083a0 0x7f63b41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 --2- 172.21.15.6:0/3876951263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4102a60 0x7f63b4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 -- 172.21.15.6:0/3876951263 >> 172.21.15.6:0/3876951263 conn(0x7f63b4079730 msgr2=0x7f63b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 -- 172.21.15.6:0/3876951263 shutdown_connections 2024-09-21T08:11:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.097+0000 7f63bb63f640 1 -- 172.21.15.6:0/3876951263 wait complete. 2024-09-21T08:11:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 Processor -- start 2024-09-21T08:11:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 -- start start 2024-09-21T08:11:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b4102a60 0x7f63b419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4108cf0 0x7f63b41a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4112810 con 0x7f63b41083a0 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4112690 con 0x7f63b4102a60 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63bb63f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4112990 con 0x7f63b4108cf0 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63b8bda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63b8bda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45432/0 (socket says 172.21.15.6:45432) 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63b8bda640 1 -- 172.21.15.6:0/4084293694 learned_addr learned my addr 172.21.15.6:0/4084293694 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.098+0000 7f63b93db640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b4102a60 0x7f63b419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4108cf0 0x7f63b41a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 -- 172.21.15.6:0/4084293694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4108cf0 msgr2=0x7f63b41a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4108cf0 0x7f63b41a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 -- 172.21.15.6:0/4084293694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b4102a60 msgr2=0x7f63b419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b4102a60 0x7f63b419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 -- 172.21.15.6:0/4084293694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b41a2510 con 0x7f63b41083a0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b8bda640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b27fc640 1 -- 172.21.15.6:0/4084293694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8017070 con 0x7f63b41083a0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b41a2800 con 0x7f63b41083a0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b27fc640 1 -- 172.21.15.6:0/4084293694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63a8009c30 con 0x7f63b41083a0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63b27fc640 1 -- 172.21.15.6:0/4084293694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8003c70 con 0x7f63b41083a0 2024-09-21T08:11:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.099+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b41a8f60 con 0x7f63b41083a0 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 Processor -- start 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 -- start start 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63b27fc640 1 -- 172.21.15.6:0/4084293694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f63a8003e10 con 0x7f63b41083a0 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb2f070 0x562a5fed66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562a5fe4cea0 con 0x562a5fb061b0 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562a5fe3c2d0 con 0x562a5fb2f070 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562a5fe400e0 con 0x562a5fb0e390 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63b93db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63b93db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45434/0 (socket says 172.21.15.6:45434) 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.102+0000 7f63b93db640 1 -- 172.21.15.6:0/3110651349 learned_addr learned my addr 172.21.15.6:0/3110651349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb2f070 0x562a5fed66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b8bda640 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 -- 172.21.15.6:0/3110651349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 msgr2=0x562a5fed7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 -- 172.21.15.6:0/3110651349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb2f070 msgr2=0x562a5fed66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb2f070 0x562a5fed66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 -- 172.21.15.6:0/3110651349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5fb9a650 con 0x562a5fb061b0 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b27fc640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 0x7f639c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 0x7f639c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b93db640 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f63a40114f0 tx=0x7f63a40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab1614b9c138532 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f63b27fc640 1 -- 172.21.15.6:0/4084293694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f63a80e7700 con 0x7f63b41083a0 2024-09-21T08:11:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.103+0000 7f639b7fe640 1 -- 172.21.15.6:0/3110651349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4004d20 con 0x562a5fb061b0 2024-09-21T08:11:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f639b7fe640 1 -- 172.21.15.6:0/3110651349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63a4004050 con 0x562a5fb061b0 2024-09-21T08:11:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f639b7fe640 1 -- 172.21.15.6:0/3110651349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a400f780 con 0x562a5fb061b0 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 -- 172.21.15.6:0/3110651349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 msgr2=0x562a5fed6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 0x7f639c0b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63ac005940 tx=0x7f63ac0058b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f63a40114f0 tx=0x7f63a40119b0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 -- 172.21.15.6:0/3110651349 shutdown_connections 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb061b0 0x562a5fed6be0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/3110651349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb2f070 0x562a5fed66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.104+0000 7f63c1bb3740 1 -- 172.21.15.6:0/3110651349 >> 172.21.15.6:0/3110651349 conn(0x562a5fb23460 msgr2=0x562a5fed4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.105+0000 7f63c1bb3740 1 -- 172.21.15.6:0/3110651349 shutdown_connections 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.105+0000 7f63c1bb3740 1 -- 172.21.15.6:0/3110651349 wait complete. 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.105+0000 7f63c1bb3740 1 -- start start 2024-09-21T08:11:03.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.105+0000 7f63c1bb3740 1 Processor -- start 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb061b0 0x562a5fee1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 0x562a5fee2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562a5fc9d700 con 0x562a5fb2f070 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562a5fdd7160 con 0x562a5fb0e390 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562a5fee4e80 con 0x562a5fb061b0 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63c1bb3740 10 client.0 _ll_register_callbacks cb 0x562a5fdf09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45448/0 (socket says 172.21.15.6:45448) 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 -- 172.21.15.6:0/63988131 learned_addr learned my addr 172.21.15.6:0/63988131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b93db640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb061b0 0x562a5fee1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b8bda640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 0x562a5fee2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 -- 172.21.15.6:0/63988131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb061b0 msgr2=0x562a5fee1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb061b0 0x562a5fee1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 -- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 msgr2=0x562a5fee2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 0x562a5fee2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 -- 172.21.15.6:0/63988131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5fe04c90 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b8bda640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 0x562a5fee2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009900 tx=0x7f63ac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3ed7fcb0b24e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f6398ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.106+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac04c070 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f63ac005460 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a4004050 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f63ac058050 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 10 client.16938 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562a5fef0b50 con 0x562a5fb2f070 2024-09-21T08:11:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63a4004050 con 0x562a5fb2f070 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63ac0035f0 con 0x562a5fb2f070 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 10 client.16938 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 20 client.16938 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5faed9f0 0x562a5fef40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 4 client.16938 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.107+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a5fe4edf0 con 0x562a5faed9f0 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.108+0000 7f63b93db640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5faed9f0 0x562a5fef40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.108+0000 7f63b93db640 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5faed9f0 0x562a5fef40c0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bebc60018797976b server_cookie=a4bbdb413f8259f4 in_seq=0 out_seq=0 2024-09-21T08:11:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.108+0000 7f6398ff9640 10 client.16938 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:03.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f6398ff9640 1 -- 172.21.15.6:0/63988131 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a5fe4edf0 con 0x562a5faed9f0 2024-09-21T08:11:03.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f6398ff9640 10 client.16938 handle_command_reply: tid=0 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 client.16938 shutdown 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 msgr2=0x562a5fee2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009900 tx=0x7f63ac009260 comp rx=0 tx=0).stop 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 shutdown_connections 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5faed9f0 0x562a5fef40c0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fee2800 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb0e390 0x562a5fee2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/63988131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb061b0 0x562a5fee1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 >> 172.21.15.6:0/63988131 conn(0x562a5fb23460 msgr2=0x562a5fed9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.109+0000 7f6398ff9640 0 client.16938 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.110+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 shutdown_connections 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.110+0000 7f63c1bb3740 1 -- 172.21.15.6:0/63988131 wait complete. 2024-09-21T08:11:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.110+0000 7f63c1bb3740 20 client.16938 trim_cache size 0 max 16384 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 Processor -- start 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 -- start start 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b1150 con 0x562a5fb2f070 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b39b0 con 0x562a5fb061b0 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b17a0 con 0x562a5fb0e390 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.123+0000 7f63b9bdc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45462/0 (socket says 172.21.15.6:45462) 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 -- 172.21.15.6:0/1208789304 learned_addr learned my addr 172.21.15.6:0/1208789304 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b8bda640 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b93db640 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 -- 172.21.15.6:0/1208789304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 msgr2=0x562a5fed7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 -- 172.21.15.6:0/1208789304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 msgr2=0x562a5fee3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 -- 172.21.15.6:0/1208789304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5fee3000 con 0x562a5fb2f070 2024-09-21T08:11:03.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f63ac032ce0 tx=0x7f63ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dcbe328724933d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f639affd640 1 -- 172.21.15.6:0/1208789304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac04c070 con 0x562a5fb2f070 2024-09-21T08:11:03.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f639affd640 1 -- 172.21.15.6:0/1208789304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63ac0035f0 con 0x562a5fb2f070 2024-09-21T08:11:03.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.124+0000 7f639affd640 1 -- 172.21.15.6:0/1208789304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac035040 con 0x562a5fb2f070 2024-09-21T08:11:03.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 -- 172.21.15.6:0/1208789304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 msgr2=0x562a5fedef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f63ac032ce0 tx=0x7f63ac02a410 comp rx=0 tx=0).stop 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 -- 172.21.15.6:0/1208789304 shutdown_connections 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb0e390 0x562a5fed7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb2f070 0x562a5fedef30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/1208789304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 -- 172.21.15.6:0/1208789304 >> 172.21.15.6:0/1208789304 conn(0x562a5fb23460 msgr2=0x562a5fed76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 -- 172.21.15.6:0/1208789304 shutdown_connections 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.125+0000 7f63c1bb3740 1 -- 172.21.15.6:0/1208789304 wait complete. 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 -- start start 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 Processor -- start 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb2f070 0x562a5ff5dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b1e70 con 0x562a5fb0e390 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b32e0 con 0x562a5fb061b0 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41b2540 con 0x562a5fb2f070 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63c1bb3740 10 client.0 _ll_register_callbacks cb 0x7f63ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63b8bda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63b8bda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45468/0 (socket says 172.21.15.6:45468) 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.126+0000 7f63b8bda640 1 -- 172.21.15.6:0/2233220479 learned_addr learned my addr 172.21.15.6:0/2233220479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b93db640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b9bdc640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb2f070 0x562a5ff5dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 -- 172.21.15.6:0/2233220479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb2f070 msgr2=0x562a5ff5dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb2f070 0x562a5ff5dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 -- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 msgr2=0x562a5fee6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:03.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 -- 172.21.15.6:0/2233220479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5ff5e000 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63b8bda640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f63a80e5070 tx=0x7f63a80a9610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e936d60bf965c4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f6398ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80035f0 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f63a80e7bb0 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ac0035f0 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f63a80acc80 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63c1bb3740 10 client.16944 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.127+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562a5ff5f210 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63ac0035f0 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63a80d0af0 con 0x562a5fb0e390 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 10 client.16944 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:03.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 20 client.16944 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5fac2da0 0x562a5ff61900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 4 client.16944 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:11:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a5fe4a8a0 con 0x562a5fac2da0 2024-09-21T08:11:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63b93db640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5fac2da0 0x562a5ff61900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f63b93db640 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5fac2da0 0x562a5ff61900 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d078be460c50f0a server_cookie=755b80f53f72a817 in_seq=0 out_seq=0 2024-09-21T08:11:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.128+0000 7f6398ff9640 10 client.16944 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f6398ff9640 1 -- 172.21.15.6:0/2233220479 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a5fe4a8a0 con 0x562a5fac2da0 2024-09-21T08:11:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f6398ff9640 10 client.16944 handle_command_reply: tid=0 2024-09-21T08:11:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 client.16944 shutdown 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 msgr2=0x562a5fee6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f63a80e5070 tx=0x7f63a80a9610 comp rx=0 tx=0).stop 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 shutdown_connections 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562a5fac2da0 0x562a5ff61900 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562a5fb2f070 0x562a5ff5dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a5fb0e390 0x562a5fee6b20 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f6398ff9640 0 client.16944 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 --2- 172.21.15.6:0/2233220479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5fb061b0 0x562a5fee6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 >> 172.21.15.6:0/2233220479 conn(0x562a5fb23460 msgr2=0x562a5fee3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 shutdown_connections 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 1 -- 172.21.15.6:0/2233220479 wait complete. 2024-09-21T08:11:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.129+0000 7f63c1bb3740 20 client.16944 trim_cache size 0 max 16384 2024-09-21T08:11:03.136 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:11:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 msgr2=0x7f639c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 0x7f639c0b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63ac005940 tx=0x7f63ac0058b0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 msgr2=0x7f63b419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a800dde0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 shutdown_connections 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f639c0b6680 0x7f639c0b8b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63b4108cf0 0x7f63b41a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b41083a0 0x7f63b419cb40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 --2- 172.21.15.6:0/4084293694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63b4102a60 0x7f63b419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 >> 172.21.15.6:0/4084293694 conn(0x7f63b4079730 msgr2=0x7f63b406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 shutdown_connections 2024-09-21T08:11:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:03.130+0000 7f63bb63f640 1 -- 172.21.15.6:0/4084293694 wait complete. 2024-09-21T08:11:03.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:03 smithi119 ceph-mon[33564]: pgmap v649: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-21T08:11:03.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:03 smithi145 ceph-mon[34049]: pgmap v649: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-21T08:11:03.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:03 smithi006 ceph-mon[30970]: pgmap v649: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-21T08:11:04.965 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:11:04.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:11:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:05.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:05 smithi119 ceph-mon[33564]: pgmap v650: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-21T08:11:05.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:05 smithi145 ceph-mon[34049]: pgmap v650: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-21T08:11:05.695 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:05 smithi006 ceph-mon[30970]: pgmap v650: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.8 MiB/s wr, 507 op/s 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 -- 172.21.15.6:0/375230330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31501049b0 msgr2=0x7f3150104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 --2- 172.21.15.6:0/375230330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31501049b0 0x7f3150104dc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f314c009900 tx=0x7f314c02a410 comp rx=0 tx=0).stop 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 -- 172.21.15.6:0/375230330 shutdown_connections 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 --2- 172.21.15.6:0/375230330 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3150105300 0x7f315010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 --2- 172.21.15.6:0/375230330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315010de10 0x7f3150110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 --2- 172.21.15.6:0/375230330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31501049b0 0x7f3150104dc0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 -- 172.21.15.6:0/375230330 >> 172.21.15.6:0/375230330 conn(0x7f3150079730 msgr2=0x7f3150079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 -- 172.21.15.6:0/375230330 shutdown_connections 2024-09-21T08:11:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.697+0000 7f31576c7640 1 -- 172.21.15.6:0/375230330 wait complete. 2024-09-21T08:11:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 Processor -- start 2024-09-21T08:11:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 -- start start 2024-09-21T08:11:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 0x7f315019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 0x7f315019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3150113940 con 0x7f3150105300 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31501137c0 con 0x7f31501049b0 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f31576c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3150113ac0 con 0x7f315010de10 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45496/0 (socket says 172.21.15.6:45496) 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.698+0000 7f3154c62640 1 -- 172.21.15.6:0/1281082974 learned_addr learned my addr 172.21.15.6:0/1281082974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3155c64640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 0x7f315019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3155463640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 0x7f315019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 -- 172.21.15.6:0/1281082974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 msgr2=0x7f315019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 0x7f315019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 -- 172.21.15.6:0/1281082974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 msgr2=0x7f315019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 0x7f315019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 -- 172.21.15.6:0/1281082974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31501a03e0 con 0x7f3150105300 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3155c64640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 0x7f315019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3155463640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 0x7f315019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f3154c62640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9c0 tx=0x7f314000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f31467fc640 1 -- 172.21.15.6:0/1281082974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000ccc0 con 0x7f3150105300 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31501a06d0 con 0x7f3150105300 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f31467fc640 1 -- 172.21.15.6:0/1281082974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31400054b0 con 0x7f3150105300 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f31467fc640 1 -- 172.21.15.6:0/1281082974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140010430 con 0x7f3150105300 2024-09-21T08:11:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.699+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501a6e30 con 0x7f3150105300 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 Processor -- start 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 -- start start 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f31467fc640 1 -- 172.21.15.6:0/1281082974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3140004f20 con 0x7f3150105300 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dbff430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dbffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559e9db75e60 con 0x559e9d82f490 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559e9db65290 con 0x559e9d837670 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f315dc3b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559e9db690a0 con 0x559e9d858350 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f3155463640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f3155463640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45500/0 (socket says 172.21.15.6:45500) 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.702+0000 7f3155463640 1 -- 172.21.15.6:0/1979693313 learned_addr learned my addr 172.21.15.6:0/1979693313 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155c64640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dbff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3154c62640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dbffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 -- 172.21.15.6:0/1979693313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 msgr2=0x559e9dbff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dbff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 -- 172.21.15.6:0/1979693313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 msgr2=0x559e9dbffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dbffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 -- 172.21.15.6:0/1979693313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9d8c3930 con 0x559e9d82f490 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3154c62640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dbffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f31467fc640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 0x7f313c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155463640 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f314c006010 tx=0x7f314c032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4913754914a593a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f3155c64640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 0x7f313c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f31467fc640 1 -- 172.21.15.6:0/1281082974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f31400e7fd0 con 0x7f3150105300 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f313b7fe640 1 -- 172.21.15.6:0/1979693313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c03f070 con 0x559e9d82f490 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f313b7fe640 1 -- 172.21.15.6:0/1979693313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f314c0044c0 con 0x559e9d82f490 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.703+0000 7f313b7fe640 1 -- 172.21.15.6:0/1979693313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c035070 con 0x559e9d82f490 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 -- 172.21.15.6:0/1979693313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 msgr2=0x559e9dbff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f314c006010 tx=0x7f314c032b90 comp rx=0 tx=0).stop 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f3155c64640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 0x7f313c0b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3148005fd0 tx=0x7f31480098d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 -- 172.21.15.6:0/1979693313 shutdown_connections 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dbffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dbff970 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 --2- 172.21.15.6:0/1979693313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dbff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 -- 172.21.15.6:0/1979693313 >> 172.21.15.6:0/1979693313 conn(0x559e9d84c740 msgr2=0x559e9dbfd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 -- 172.21.15.6:0/1979693313 shutdown_connections 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.704+0000 7f315dc3b740 1 -- 172.21.15.6:0/1979693313 wait complete. 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 -- start start 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 Processor -- start 2024-09-21T08:11:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dc0b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dc16ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x559e9d9c6890 con 0x559e9d82f490 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559e9daffd40 con 0x559e9d837670 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559e9dc0dbb0 con 0x559e9d858350 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f315dc3b740 10 client.0 _ll_register_callbacks cb 0x559e9db63c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f3155463640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f3155463640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.705+0000 7f3155463640 1 -- 172.21.15.6:0/751408384 learned_addr learned my addr 172.21.15.6:0/751408384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3154c62640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dc0b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155c64640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dc16ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 -- 172.21.15.6:0/751408384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 msgr2=0x559e9dc16ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dc16ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 -- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 msgr2=0x559e9dc0b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dc0b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 -- 172.21.15.6:0/751408384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9dc17460 con 0x559e9d82f490 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3155463640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f314c0092a0 tx=0x7f314c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce092df7c13053df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c035070 con 0x559e9d82f490 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f314c0046c0 con 0x559e9d82f490 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e9db77db0 con 0x559e9d82f490 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f314c055050 con 0x559e9d82f490 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f315dc3b740 10 client.16956 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.706+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559e9dc19ce0 con 0x559e9d82f490 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559e9db77db0 con 0x559e9d82f490 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f314c03b5f0 con 0x559e9d82f490 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 10 client.16956 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 20 client.16956 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d816cd0 0x559e9dc1d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 4 client.16956 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e9db73860 con 0x559e9d816cd0 2024-09-21T08:11:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.707+0000 7f3154c62640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d816cd0 0x559e9dc1d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.708+0000 7f3154c62640 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d816cd0 0x559e9dc1d040 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914174acfba2a18c server_cookie=7f2bfa3b43c49264 in_seq=0 out_seq=0 2024-09-21T08:11:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.708+0000 7f3138ff9640 10 client.16956 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.708+0000 7f3138ff9640 1 -- 172.21.15.6:0/751408384 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e9db73860 con 0x559e9d816cd0 2024-09-21T08:11:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.708+0000 7f3138ff9640 10 client.16956 handle_command_reply: tid=0 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.708+0000 7f315dc3b740 1 client.16956 shutdown 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 msgr2=0x559e9dc0b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f314c0092a0 tx=0x7f314c005f30 comp rx=0 tx=0).stop 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 shutdown_connections 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d816cd0 0x559e9dc1d040 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d858350 0x559e9dc16ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d837670 0x559e9dc0b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 --2- 172.21.15.6:0/751408384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc0b000 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f3138ff9640 0 client.16956 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 >> 172.21.15.6:0/751408384 conn(0x559e9d84c740 msgr2=0x559e9dc025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 shutdown_connections 2024-09-21T08:11:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 1 -- 172.21.15.6:0/751408384 wait complete. 2024-09-21T08:11:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.709+0000 7f315dc3b740 20 client.16956 trim_cache size 0 max 16384 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.726+0000 7f315dc3b740 1 Processor -- start 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.726+0000 7f315dc3b740 1 -- start start 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc16e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc07ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31501aefd0 con 0x559e9d82f490 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31501b1830 con 0x559e9d816cd0 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f315dc3b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31501af620 con 0x559e9d837670 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45522/0 (socket says 172.21.15.6:45522) 2024-09-21T08:11:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 -- 172.21.15.6:0/723195038 learned_addr learned my addr 172.21.15.6:0/723195038 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3155463640 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3155c64640 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc07ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 -- 172.21.15.6:0/723195038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 msgr2=0x559e9dc07ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc07ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 -- 172.21.15.6:0/723195038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 msgr2=0x559e9dc16e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc16e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 -- 172.21.15.6:0/723195038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9dc0c0c0 con 0x559e9d82f490 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.727+0000 7f3154c62640 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f31400ad740 tx=0x7f31400ea4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8a6074855d4624 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f313affd640 1 -- 172.21.15.6:0/723195038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400a91b0 con 0x559e9d82f490 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f313affd640 1 -- 172.21.15.6:0/723195038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31400ad550 con 0x559e9d82f490 2024-09-21T08:11:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f313affd640 1 -- 172.21.15.6:0/723195038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400e55c0 con 0x559e9d82f490 2024-09-21T08:11:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 -- 172.21.15.6:0/723195038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 msgr2=0x559e9dc053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f31400ad740 tx=0x7f31400ea4e0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 -- 172.21.15.6:0/723195038 shutdown_connections 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc07ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc053a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 --2- 172.21.15.6:0/723195038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc16e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.728+0000 7f315dc3b740 1 -- 172.21.15.6:0/723195038 >> 172.21.15.6:0/723195038 conn(0x559e9d84c740 msgr2=0x559e9dc09680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- 172.21.15.6:0/723195038 shutdown_connections 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- 172.21.15.6:0/723195038 wait complete. 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- start start 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 Processor -- start 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc209a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc1e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31501afcf0 con 0x559e9d82f490 2024-09-21T08:11:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31501b1160 con 0x559e9d816cd0 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.729+0000 7f315dc3b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31501b03c0 con 0x559e9d837670 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f315dc3b740 10 client.0 _ll_register_callbacks cb 0x7f314c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45528/0 (socket says 172.21.15.6:45528) 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 -- 172.21.15.6:0/381771855 learned_addr learned my addr 172.21.15.6:0/381771855 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3155463640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3155c64640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc1e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 -- 172.21.15.6:0/381771855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 msgr2=0x559e9dc1e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc1e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 -- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 msgr2=0x559e9dc209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc209a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 -- 172.21.15.6:0/381771855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9dc1ec80 con 0x559e9d82f490 2024-09-21T08:11:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3155c64640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc1e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3155463640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3154c62640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f31400e53f0 tx=0x7f314000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c900ed119397da3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400a91b0 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f31400a9cb0 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31400ad550 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.730+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f31400b2520 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 10 client.16962 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559e9dc87880 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31400ad550 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f31400b2050 con 0x559e9d82f490 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 10 client.16962 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 10 client.16962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 20 client.16962 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d858350 0x559e9dc89ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 4 client.16962 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559e9db70c90 con 0x559e9d858350 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.731+0000 7f3155463640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d858350 0x559e9dc89ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.732+0000 7f3138ff9640 10 client.16962 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:05.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.732+0000 7f3155463640 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d858350 0x559e9dc89ff0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=176d86f3d1ba03d server_cookie=5ad23ed4d6ee8c54 in_seq=0 out_seq=0 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.733+0000 7f3138ff9640 1 -- 172.21.15.6:0/381771855 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559e9db70c90 con 0x559e9d858350 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.733+0000 7f3138ff9640 10 client.16962 handle_command_reply: tid=0 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.733+0000 7f315dc3b740 1 client.16962 shutdown 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.733+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 msgr2=0x559e9dc1de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.733+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f31400e53f0 tx=0x7f314000cf90 comp rx=0 tx=0).stop 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 shutdown_connections 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x559e9d858350 0x559e9dc89ff0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559e9d837670 0x559e9dc1e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e9d82f490 0x559e9dc1de70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 --2- 172.21.15.6:0/381771855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e9d816cd0 0x559e9dc209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 >> 172.21.15.6:0/381771855 conn(0x559e9d84c740 msgr2=0x559e9dc00460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f3138ff9640 0 client.16962 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 shutdown_connections 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 1 -- 172.21.15.6:0/381771855 wait complete. 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f315dc3b740 20 client.16962 trim_cache size 0 max 16384 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:05.739 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:11:05.740 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "9bc13a88-359e-48de-80d4-c29f066ed33a", 2024-09-21T08:11:05.740 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:11:05.740 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:05.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 msgr2=0x7f313c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 0x7f313c0b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3148005fd0 tx=0x7f31480098d0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 msgr2=0x7f315019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9c0 tx=0x7f314000ee80 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 shutdown_connections 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f313c0b6680 0x7f313c0b8b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315010de10 0x7f315019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3150105300 0x7f315019aa10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 --2- 172.21.15.6:0/1281082974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31501049b0 0x7f315019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.734+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 >> 172.21.15.6:0/1281082974 conn(0x7f3150079730 msgr2=0x7f3150100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.735+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 shutdown_connections 2024-09-21T08:11:05.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:05.735+0000 7f31576c7640 1 -- 172.21.15.6:0/1281082974 wait complete. 2024-09-21T08:11:06.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:11:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:06 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:11:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:06 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:06 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:11:06.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:06 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:06.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:06 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:11:06.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:06 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:06.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:06 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:11:06.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:06 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:06 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:11:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:06 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:06 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:11:06.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:06 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 -- 172.21.15.6:0/16163733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5774102a60 msgr2=0x7f5774102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 --2- 172.21.15.6:0/16163733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5774102a60 0x7f5774102e70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5764009900 tx=0x7f576402a410 comp rx=0 tx=0).stop 2024-09-21T08:11:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 -- 172.21.15.6:0/16163733 shutdown_connections 2024-09-21T08:11:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 --2- 172.21.15.6:0/16163733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774108cf0 0x7f577410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 --2- 172.21.15.6:0/16163733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57741083a0 0x7f57741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 --2- 172.21.15.6:0/16163733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5774102a60 0x7f5774102e70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 -- 172.21.15.6:0/16163733 >> 172.21.15.6:0/16163733 conn(0x7f5774079730 msgr2=0x7f5774079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 -- 172.21.15.6:0/16163733 shutdown_connections 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.148+0000 7f577a260640 1 -- 172.21.15.6:0/16163733 wait complete. 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 Processor -- start 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 -- start start 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774102a60 0x7f577419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774108cf0 0x7f577419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112810 con 0x7f57741083a0 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112690 con 0x7f5774108cf0 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f577a260640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5774112990 con 0x7f5774102a60 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34652/0 (socket says 172.21.15.6:34652) 2024-09-21T08:11:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.149+0000 7f5772ffd640 1 -- 172.21.15.6:0/4087333295 learned_addr learned my addr 172.21.15.6:0/4087333295 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f57737fe640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774102a60 0x7f577419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5773fff640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774108cf0 0x7f577419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 -- 172.21.15.6:0/4087333295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774102a60 msgr2=0x7f577419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774102a60 0x7f577419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 -- 172.21.15.6:0/4087333295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774108cf0 msgr2=0x7f577419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774108cf0 0x7f577419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 -- 172.21.15.6:0/4087333295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57741a02c0 con 0x7f57741083a0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5772ffd640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f576800e9c0 tx=0x7f576800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5770ff9640 1 -- 172.21.15.6:0/4087333295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576800cd80 con 0x7f57741083a0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57741a05b0 con 0x7f57741083a0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5770ff9640 1 -- 172.21.15.6:0/4087333295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57680054b0 con 0x7f57741083a0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f5770ff9640 1 -- 172.21.15.6:0/4087333295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768010430 con 0x7f57741083a0 2024-09-21T08:11:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.150+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57741a6d10 con 0x7f57741083a0 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 Processor -- start 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 -- start start 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f5770ff9640 1 -- 172.21.15.6:0/4087333295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5768004f20 con 0x7f57741083a0 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b77320070 0x557b776c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557b7763de50 con 0x557b772f71b0 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557b7762d280 con 0x557b77320070 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57807d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557b77631090 con 0x557b772ff390 2024-09-21T08:11:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34658/0 (socket says 172.21.15.6:34658) 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.153+0000 7f57737fe640 1 -- 172.21.15.6:0/1543142657 learned_addr learned my addr 172.21.15.6:0/1543142657 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5773fff640 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b77320070 0x557b776c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5772ffd640 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 -- 172.21.15.6:0/1543142657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 msgr2=0x557b776c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 -- 172.21.15.6:0/1543142657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b77320070 msgr2=0x557b776c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b77320070 0x557b776c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 -- 172.21.15.6:0/1543142657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b7738b650 con 0x557b772f71b0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f57737fe640 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f576402a930 tx=0x7f5764031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203d6be33ff6fcfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5770ff9640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 0x7f575c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5773fff640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 0x7f575c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5759ffb640 1 -- 172.21.15.6:0/1543142657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764035030 con 0x557b772f71b0 2024-09-21T08:11:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5770ff9640 1 -- 172.21.15.6:0/4087333295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f57680e80c0 con 0x7f57741083a0 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5759ffb640 1 -- 172.21.15.6:0/1543142657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5764040070 con 0x557b772f71b0 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.154+0000 7f5759ffb640 1 -- 172.21.15.6:0/1543142657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764003850 con 0x557b772f71b0 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 -- 172.21.15.6:0/1543142657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 msgr2=0x557b776c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f5773fff640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 0x7f575c0b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f576c005fd0 tx=0x7f576c009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f576402a930 tx=0x7f5764031a70 comp rx=0 tx=0).stop 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 -- 172.21.15.6:0/1543142657 shutdown_connections 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772f71b0 0x557b776c77b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 --2- 172.21.15.6:0/1543142657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b77320070 0x557b776c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 -- 172.21.15.6:0/1543142657 >> 172.21.15.6:0/1543142657 conn(0x557b77314460 msgr2=0x557b776c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 -- 172.21.15.6:0/1543142657 shutdown_connections 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.155+0000 7f57807d4740 1 -- 172.21.15.6:0/1543142657 wait complete. 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 -- start start 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 Processor -- start 2024-09-21T08:11:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b77320070 0x557b776e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557b7748e700 con 0x557b772ff390 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557b775c8110 con 0x557b772f71b0 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557b776d9da0 con 0x557b77320070 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57807d4740 10 client.0 _ll_register_callbacks cb 0x557b775e1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34666/0 (socket says 172.21.15.6:34666) 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f5772ffd640 1 -- 172.21.15.6:0/3763932 learned_addr learned my addr 172.21.15.6:0/3763932 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f57737fe640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.156+0000 7f5773fff640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b77320070 0x557b776e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 -- 172.21.15.6:0/3763932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b77320070 msgr2=0x557b776e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b77320070 0x557b776e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 -- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 msgr2=0x557b776d6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 -- 172.21.15.6:0/3763932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b775f5c40 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5772ffd640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f57680aada0 tx=0x7f5768005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846131600088028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680ad480 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f57680ea0d0 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5764040070 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57680ad2a0 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f57807d4740 10 client.16974 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.157+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b776e5b20 con 0x557b772ff390 2024-09-21T08:11:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5764040070 con 0x557b772ff390 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f57680e5b80 con 0x557b772ff390 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 10 client.16974 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 20 client.16974 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772de9f0 0x557b776e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 4 client.16974 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b7763fda0 con 0x557b772de9f0 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.158+0000 7f57737fe640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772de9f0 0x557b776e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.159+0000 7f57737fe640 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772de9f0 0x557b776e8fa0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605b6da6a38b90b6 server_cookie=8ec0ba96633350fa in_seq=0 out_seq=0 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.159+0000 7f5752ffd640 10 client.16974 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.159+0000 7f5752ffd640 1 -- 172.21.15.6:0/3763932 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b7763fda0 con 0x557b772de9f0 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.159+0000 7f5752ffd640 10 client.16974 handle_command_reply: tid=0 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.159+0000 7f57807d4740 1 client.16974 shutdown 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 msgr2=0x557b776d72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f57680aada0 tx=0x7f5768005440 comp rx=0 tx=0).stop 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 shutdown_connections 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772de9f0 0x557b776e8fa0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b77320070 0x557b776e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f5752ffd640 0 client.16974 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b772ff390 0x557b776d72b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 --2- 172.21.15.6:0/3763932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 >> 172.21.15.6:0/3763932 conn(0x557b77314460 msgr2=0x557b776c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 shutdown_connections 2024-09-21T08:11:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 1 -- 172.21.15.6:0/3763932 wait complete. 2024-09-21T08:11:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.160+0000 7f57807d4740 20 client.16974 trim_cache size 0 max 16384 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 Processor -- start 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 -- start start 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.177+0000 7f57807d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f57741acc40 con 0x557b77320070 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f57807d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57741af4a0 con 0x557b772f71b0 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f57807d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57741ad290 con 0x557b772ff390 2024-09-21T08:11:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34682/0 (socket says 172.21.15.6:34682) 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 -- 172.21.15.6:0/539302513 learned_addr learned my addr 172.21.15.6:0/539302513 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5772ffd640 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f57737fe640 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 -- 172.21.15.6:0/539302513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 msgr2=0x557b776c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 -- 172.21.15.6:0/539302513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 msgr2=0x557b776d8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 -- 172.21.15.6:0/539302513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b776d5270 con 0x557b77320070 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f5773fff640 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e80 tx=0x7f576c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110fc9fa82ebe510 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.178+0000 7f57597fa640 1 -- 172.21.15.6:0/539302513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c02e070 con 0x557b77320070 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57597fa640 1 -- 172.21.15.6:0/539302513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f576c00fa50 con 0x557b77320070 2024-09-21T08:11:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57597fa640 1 -- 172.21.15.6:0/539302513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c01eab0 con 0x557b77320070 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 -- 172.21.15.6:0/539302513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 msgr2=0x557b776e3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e80 tx=0x7f576c01b000 comp rx=0 tx=0).stop 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 -- 172.21.15.6:0/539302513 shutdown_connections 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b776e3000 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 --2- 172.21.15.6:0/539302513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 -- 172.21.15.6:0/539302513 >> 172.21.15.6:0/539302513 conn(0x557b77314460 msgr2=0x557b776c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 -- 172.21.15.6:0/539302513 shutdown_connections 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.179+0000 7f57807d4740 1 -- 172.21.15.6:0/539302513 wait complete. 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 -- start start 2024-09-21T08:11:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 Processor -- start 2024-09-21T08:11:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f57741ad960 con 0x557b77320070 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57741aedd0 con 0x557b772f71b0 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57741ae030 con 0x557b772ff390 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57807d4740 10 client.0 _ll_register_callbacks cb 0x7f5768004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34686/0 (socket says 172.21.15.6:34686) 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f5773fff640 1 -- 172.21.15.6:0/2338541605 learned_addr learned my addr 172.21.15.6:0/2338541605 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f57737fe640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.180+0000 7f5772ffd640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 -- 172.21.15.6:0/2338541605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 msgr2=0x557b776ddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776ddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 -- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 msgr2=0x557b776dd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776dd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 -- 172.21.15.6:0/2338541605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b7774d020 con 0x557b77320070 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f57737fe640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776dd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5773fff640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f576c02c040 tx=0x7f576c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f3e82a9050a11f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c02e040 con 0x557b77320070 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576c00fa50 con 0x557b77320070 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f576c00fd40 con 0x557b77320070 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f576c040050 con 0x557b77320070 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f57807d4740 10 client.16980 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.181+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b77754350 con 0x557b77320070 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f576c00fa50 con 0x557b77320070 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f576c01e840 con 0x557b77320070 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 10 client.16980 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 10 client.16980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 20 client.16980 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772b3da0 0x557b77756a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 4 client.16980 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b7763b850 con 0x557b772b3da0 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.182+0000 7f57737fe640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772b3da0 0x557b77756a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57737fe640 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772b3da0 0x557b77756a60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69df76e5747183af server_cookie=2ecaadc53d82bd3d in_seq=0 out_seq=0 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f5752ffd640 10 client.16980 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f5752ffd640 1 -- 172.21.15.6:0/2338541605 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x557b7763b850 con 0x557b772b3da0 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f5752ffd640 10 client.16980 handle_command_reply: tid=0 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 client.16980 shutdown 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 msgr2=0x557b7774c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f576c02c040 tx=0x7f576c003c00 comp rx=0 tx=0).stop 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 shutdown_connections 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557b772b3da0 0x557b77756a60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557b772ff390 0x557b776ddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f5752ffd640 0 client.16980 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b77320070 0x557b7774c9b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 --2- 172.21.15.6:0/2338541605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557b772f71b0 0x557b776dd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.183+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 >> 172.21.15.6:0/2338541605 conn(0x557b77314460 msgr2=0x557b776c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 shutdown_connections 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f57807d4740 1 -- 172.21.15.6:0/2338541605 wait complete. 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f57807d4740 20 client.16980 trim_cache size 0 max 16384 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "9bc13a88-359e-48de-80d4-c29f066ed33a", 2024-09-21T08:11:07.191 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:11:07.192 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.194 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.195 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:11:07.196 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.197 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:11:07.199 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:07.201 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:07.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:07.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:07.202 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 msgr2=0x7f575c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 0x7f575c0b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f576c005fd0 tx=0x7f576c009500 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 msgr2=0x7f577419a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f576800e9c0 tx=0x7f576800ee80 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 shutdown_connections 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f575c0b6680 0x7f575c0b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5774108cf0 0x7f577419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57741083a0 0x7f577419a8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 --2- 172.21.15.6:0/4087333295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5774102a60 0x7f577419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 >> 172.21.15.6:0/4087333295 conn(0x7f5774079730 msgr2=0x7f5774101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.184+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 shutdown_connections 2024-09-21T08:11:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:07.185+0000 7f577a260640 1 -- 172.21.15.6:0/4087333295 wait complete. 2024-09-21T08:11:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:07 smithi006 ceph-mon[30970]: pgmap v651: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.8 MiB/s wr, 411 op/s 2024-09-21T08:11:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:07.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:07 smithi119 ceph-mon[33564]: pgmap v651: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.8 MiB/s wr, 411 op/s 2024-09-21T08:11:07.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:07 smithi145 ceph-mon[34049]: pgmap v651: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.8 MiB/s wr, 411 op/s 2024-09-21T08:11:08.082 INFO:tasks.cephfs.filesystem:scrub status for tag:9bc13a88-359e-48de-80d4-c29f066ed33a - {'path': '/', 'tag': '9bc13a88-359e-48de-80d4-c29f066ed33a', 'options': 'recursive,force'} 2024-09-21T08:11:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:09 smithi119 ceph-mon[33564]: pgmap v652: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.8 MiB/s wr, 312 op/s 2024-09-21T08:11:09.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:09 smithi145 ceph-mon[34049]: pgmap v652: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.8 MiB/s wr, 312 op/s 2024-09-21T08:11:09.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:09 smithi006 ceph-mon[30970]: pgmap v652: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.8 MiB/s wr, 312 op/s 2024-09-21T08:11:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:11 smithi119 ceph-mon[33564]: pgmap v653: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 194 op/s 2024-09-21T08:11:11.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:11 smithi145 ceph-mon[34049]: pgmap v653: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 194 op/s 2024-09-21T08:11:11.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:11 smithi006 ceph-mon[30970]: pgmap v653: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 194 op/s 2024-09-21T08:11:12.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:12 smithi119 ceph-mon[33564]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T08:11:12.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:12 smithi145 ceph-mon[34049]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T08:11:12.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:12 smithi006 ceph-mon[30970]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T08:11:12.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:11:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:13.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:13 smithi006 ceph-mon[30970]: pgmap v655: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 605 KiB/s wr, 89 op/s 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 -- 172.21.15.6:0/449599811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6448105300 msgr2=0x7f644810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 --2- 172.21.15.6:0/449599811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6448105300 0x7f644810d850 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6438009900 tx=0x7f643802a410 comp rx=0 tx=0).stop 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 -- 172.21.15.6:0/449599811 shutdown_connections 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 --2- 172.21.15.6:0/449599811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f644810de10 0x7f6448110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 --2- 172.21.15.6:0/449599811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6448105300 0x7f644810d850 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 --2- 172.21.15.6:0/449599811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64481049b0 0x7f6448104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 -- 172.21.15.6:0/449599811 >> 172.21.15.6:0/449599811 conn(0x7f6448079730 msgr2=0x7f6448079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 -- 172.21.15.6:0/449599811 shutdown_connections 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.607+0000 7f644f8eb640 1 -- 172.21.15.6:0/449599811 wait complete. 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 Processor -- start 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 -- start start 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6448105300 0x7f6448102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f644810de10 0x7f6448103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6448113920 con 0x7f64481049b0 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64481137a0 con 0x7f644810de10 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644f8eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6448113aa0 con 0x7f6448105300 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644d687640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644d687640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34714/0 (socket says 172.21.15.6:34714) 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.608+0000 7f644d687640 1 -- 172.21.15.6:0/1112681615 learned_addr learned my addr 172.21.15.6:0/1112681615 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644ce86640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6448105300 0x7f6448102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644de88640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f644810de10 0x7f6448103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 -- 172.21.15.6:0/1112681615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6448105300 msgr2=0x7f6448102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6448105300 0x7f6448102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 -- 172.21.15.6:0/1112681615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f644810de10 msgr2=0x7f6448103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f644810de10 0x7f6448103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 -- 172.21.15.6:0/1112681615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481a86d0 con 0x7f64481049b0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644d687640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f644400d770 tx=0x7f644400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444017070 con 0x7f64481049b0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6444009c30 con 0x7f64481049b0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481a89c0 con 0x7f64481049b0 2024-09-21T08:11:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444003c50 con 0x7f64481049b0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.609+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481a8ed0 con 0x7f64481049b0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.610+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6448104dc0 con 0x7f64481049b0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.612+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6444003df0 con 0x7f64481049b0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.613+0000 7f643e7fc640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 0x7f64340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.613+0000 7f644ce86640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 0x7f64340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.613+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9599+0+0 (secure 0 0 0) 0x7f64440e7510 con 0x7f64481049b0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.613+0000 7f644ce86640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 0x7f64340b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6438005940 tx=0x7f64380058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.617+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64440ad6d0 con 0x7f64481049b0 2024-09-21T08:11:13.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:13 smithi145 ceph-mon[34049]: pgmap v655: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 605 KiB/s wr, 89 op/s 2024-09-21T08:11:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.844+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64481039f0 con 0x7f64481049b0 2024-09-21T08:11:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.845+0000 7f643e7fc640 1 -- 172.21.15.6:0/1112681615 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f64481039f0 con 0x7f64481049b0 2024-09-21T08:11:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:11:13.847 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:11:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:11:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 msgr2=0x7f64340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 0x7f64340b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6438005940 tx=0x7f64380058d0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 msgr2=0x7f64481026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f644400d770 tx=0x7f644400dc30 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 shutdown_connections 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f64340b6680 0x7f64340b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6448105300 0x7f6448102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f644810de10 0x7f6448103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 --2- 172.21.15.6:0/1112681615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64481049b0 0x7f64481026f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 >> 172.21.15.6:0/1112681615 conn(0x7f6448079730 msgr2=0x7f64480ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 shutdown_connections 2024-09-21T08:11:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:13.848+0000 7f644f8eb640 1 -- 172.21.15.6:0/1112681615 wait complete. 2024-09-21T08:11:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:13 smithi119 ceph-mon[33564]: pgmap v655: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 605 KiB/s wr, 89 op/s 2024-09-21T08:11:14.694 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:14 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1112681615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:14.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:14 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1112681615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:14 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1112681615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:15.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:15 smithi145 ceph-mon[34049]: pgmap v656: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 205 KiB/s wr, 27 op/s 2024-09-21T08:11:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:15 smithi006 ceph-mon[30970]: pgmap v656: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 205 KiB/s wr, 27 op/s 2024-09-21T08:11:15.820 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id bf194f93 --release --await' 2024-09-21T08:11:15.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id bf194f93 --release --await 2024-09-21T08:11:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:15 smithi119 ceph-mon[33564]: pgmap v656: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 205 KiB/s wr, 27 op/s 2024-09-21T08:11:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 -- 172.21.15.6:0/1523971559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80108cf0 msgr2=0x7f0d8010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/1523971559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80108cf0 0x7f0d8010f520 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009ca0 tx=0x7f0d7802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 -- 172.21.15.6:0/1523971559 shutdown_connections 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/1523971559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80108cf0 0x7f0d8010f520 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/1523971559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 0x7f0d801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/1523971559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80102a60 0x7f0d80102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 -- 172.21.15.6:0/1523971559 >> 172.21.15.6:0/1523971559 conn(0x7f0d80079730 msgr2=0x7f0d80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 -- 172.21.15.6:0/1523971559 shutdown_connections 2024-09-21T08:11:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.593+0000 7f0d85cf4640 1 -- 172.21.15.6:0/1523971559 wait complete. 2024-09-21T08:11:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.594+0000 7f0d85cf4640 1 Processor -- start 2024-09-21T08:11:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.594+0000 7f0d85cf4640 1 -- start start 2024-09-21T08:11:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.594+0000 7f0d85cf4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.594+0000 7f0d85cf4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 0x7f0d8019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.594+0000 7f0d85cf4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80108cf0 0x7f0d8019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d85cf4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80112860 con 0x7f0d80102a60 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d85cf4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801126e0 con 0x7f0d801083a0 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d85cf4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801129e0 con 0x7f0d80108cf0 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48996/0 (socket says 172.21.15.6:48996) 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 -- 172.21.15.6:0/640398672 learned_addr learned my addr 172.21.15.6:0/640398672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7effd640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 0x7f0d8019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80108cf0 0x7f0d8019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 -- 172.21.15.6:0/640398672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80108cf0 msgr2=0x7f0d8019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80108cf0 0x7f0d8019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 -- 172.21.15.6:0/640398672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 msgr2=0x7f0d8019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 0x7f0d8019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 -- 172.21.15.6:0/640398672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d801a0310 con 0x7f0d80102a60 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7f7fe640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000e9f0 tx=0x7f0d7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7cff9640 1 -- 172.21.15.6:0/640398672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000cd80 con 0x7f0d80102a60 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d801a0600 con 0x7f0d80102a60 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7cff9640 1 -- 172.21.15.6:0/640398672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d700054b0 con 0x7f0d80102a60 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.595+0000 7f0d7cff9640 1 -- 172.21.15.6:0/640398672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70010430 con 0x7f0d80102a60 2024-09-21T08:11:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.596+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d801a6d60 con 0x7f0d80102a60 2024-09-21T08:11:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.598+0000 7f0d8c268740 1 Processor -- start 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.598+0000 7f0d8c268740 1 -- start start 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.598+0000 7f0d7cff9640 1 -- 172.21.15.6:0/640398672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0d700046c0 con 0x7f0d80102a60 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad232a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad232f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a5ad11ddc0 con 0x55a5ace6b840 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a5ad1aa1f0 con 0x55a5ace63660 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d8c268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a5ad199620 con 0x55a5ace8c520 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad232a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:41456/0 (socket says 172.21.15.6:41456) 2024-09-21T08:11:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 -- 172.21.15.6:0/323103712 learned_addr learned my addr 172.21.15.6:0/323103712 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7effd640 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad232f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 -- 172.21.15.6:0/323103712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 msgr2=0x55a5ad232a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad232a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 -- 172.21.15.6:0/323103712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 msgr2=0x55a5ad232f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad232f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7ffff640 1 -- 172.21.15.6:0/323103712 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ad161fd0 con 0x55a5ace8c520 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7effd640 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad232f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.599+0000 7f0d7cff9640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 0x7f0d680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d7f7fe640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 0x7f0d680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d78035000 tx=0x7f0d780314e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1608d7c5e4f9097d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d7cff9640 1 -- 172.21.15.6:0/640398672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9599+0+0 (secure 0 0 0) 0x7f0d700e7fa0 con 0x7f0d80102a60 2024-09-21T08:11:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d65ffb640 1 -- 172.21.15.6:0/323103712 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78031980 con 0x55a5ace8c520 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d65ffb640 1 -- 172.21.15.6:0/323103712 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d78036040 con 0x55a5ace8c520 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.600+0000 7f0d65ffb640 1 -- 172.21.15.6:0/323103712 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78004460 con 0x55a5ace8c520 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- 172.21.15.6:0/323103712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 msgr2=0x55a5ad232510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d7f7fe640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 0x7f0d680b8c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0d700e5370 tx=0x7f0d700ea040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d78035000 tx=0x7f0d780314e0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- 172.21.15.6:0/323103712 shutdown_connections 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad232f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad232a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 --2- 172.21.15.6:0/323103712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad232510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- 172.21.15.6:0/323103712 >> 172.21.15.6:0/323103712 conn(0x55a5ace80910 msgr2=0x55a5ad230400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- 172.21.15.6:0/323103712 shutdown_connections 2024-09-21T08:11:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- 172.21.15.6:0/323103712 wait complete. 2024-09-21T08:11:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.601+0000 7f0d8c268740 1 -- start start 2024-09-21T08:11:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 Processor -- start 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad241fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad242a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55a5ad134300 con 0x55a5ace6b840 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a5ad19d430 con 0x55a5ace63660 2024-09-21T08:11:16.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a5acffabb0 con 0x55a5ace8c520 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d8c268740 10 client.0 _ll_register_callbacks cb 0x55a5ad14e120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49008/0 (socket says 172.21.15.6:49008) 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d7effd640 1 -- 172.21.15.6:0/3156567387 learned_addr learned my addr 172.21.15.6:0/3156567387 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad241fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.602+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad242a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 -- 172.21.15.6:0/3156567387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 msgr2=0x55a5ad242a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad242a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 -- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 msgr2=0x55a5ad241fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad241fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 -- 172.21.15.6:0/3156567387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ad123780 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d7effd640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0d74011730 tx=0x7f0d74011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd295d7f58d01494 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d5effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400fe70 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9599+0+0 (secure 0 0 0) 0x7f0d74005020 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d78036040 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0d74024050 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d8c268740 10 client.16998 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a5acef7b00 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.603+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d78036040 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0d74018030 con 0x55a5ace6b840 2024-09-21T08:11:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 10 client.16998 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 10 client.16998 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 20 client.16998 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace4aea0 0x55a5ad254270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 4 client.16998 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ad1ac140 con 0x55a5ace4aea0 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace4aea0 0x55a5ad254270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d5effd640 10 client.16998 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.604+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace4aea0 0x55a5ad254270 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e04057c3bf8abee server_cookie=b2737c19ade5b01b in_seq=0 out_seq=0 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d5effd640 1 -- 172.21.15.6:0/3156567387 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5ad1ac140 con 0x55a5ace4aea0 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d5effd640 10 client.16998 handle_command_reply: tid=0 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 client.16998 shutdown 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 msgr2=0x55a5ad2424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0d74011730 tx=0x7f0d74011bf0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 shutdown_connections 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace4aea0 0x55a5ad254270 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d5effd640 0 client.16998 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace8c520 0x55a5ad242a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad2424f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 --2- 172.21.15.6:0/3156567387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad241fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.605+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 >> 172.21.15.6:0/3156567387 conn(0x55a5ace80910 msgr2=0x55a5ad22e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.606+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 shutdown_connections 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.606+0000 7f0d8c268740 1 -- 172.21.15.6:0/3156567387 wait complete. 2024-09-21T08:11:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.606+0000 7f0d8c268740 20 client.16998 trim_cache size 0 max 16384 2024-09-21T08:11:16.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 Processor -- start 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 -- start start 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace4aea0 0x55a5ad23fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace63660 0x55a5ad22e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801acdd0 con 0x55a5ace6b840 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801af630 con 0x55a5ace4aea0 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.623+0000 7f0d8c268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801ad420 con 0x55a5ace63660 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49014/0 (socket says 172.21.15.6:49014) 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2518591583 learned_addr learned my addr 172.21.15.6:0/2518591583 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7effd640 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace63660 0x55a5ad22e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace4aea0 0x55a5ad23fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2518591583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace63660 msgr2=0x55a5ad22e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace63660 0x55a5ad22e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2518591583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace4aea0 msgr2=0x55a5ad23fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace4aea0 0x55a5ad23fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2518591583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5acf6e960 con 0x55a5ace6b840 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0d780040b0 tx=0x7f0d78009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3513851e550096c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d657fa640 1 -- 172.21.15.6:0/2518591583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7804a040 con 0x55a5ace6b840 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.624+0000 7f0d657fa640 1 -- 172.21.15.6:0/2518591583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d78036040 con 0x55a5ace6b840 2024-09-21T08:11:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d657fa640 1 -- 172.21.15.6:0/2518591583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d780305c0 con 0x55a5ace6b840 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 -- 172.21.15.6:0/2518591583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 msgr2=0x55a5ad22ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0d780040b0 tx=0x7f0d78009380 comp rx=0 tx=0).stop 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 -- 172.21.15.6:0/2518591583 shutdown_connections 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace63660 0x55a5ad22e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad22ee70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2518591583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace4aea0 0x55a5ad23fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 -- 172.21.15.6:0/2518591583 >> 172.21.15.6:0/2518591583 conn(0x55a5ace80910 msgr2=0x55a5ad23f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 -- 172.21.15.6:0/2518591583 shutdown_connections 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.625+0000 7f0d8c268740 1 -- 172.21.15.6:0/2518591583 wait complete. 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 -- start start 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 Processor -- start 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace4aea0 0x55a5ad24a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad2450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801adaf0 con 0x55a5ace6b840 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801aef60 con 0x55a5ace63660 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801ae1c0 con 0x55a5ace4aea0 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d8c268740 10 client.0 _ll_register_callbacks cb 0x7f0d7400c6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49028/0 (socket says 172.21.15.6:49028) 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2660206595 learned_addr learned my addr 172.21.15.6:0/2660206595 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d7effd640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad2450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.626+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace4aea0 0x55a5ad24a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2660206595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace4aea0 msgr2=0x55a5ad24a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace4aea0 0x55a5ad24a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 msgr2=0x55a5ad2450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad2450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 -- 172.21.15.6:0/2660206595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ad245c40 con 0x55a5ace6b840 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d7ffff640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0d7802aeb0 tx=0x7f0d780095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac25359acd696e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d5effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78004d40 con 0x55a5ace6b840 2024-09-21T08:11:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d78036040 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9599+0+0 (secure 0 0 0) 0x7f0d78031980 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0d78031b80 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d8c268740 10 client.17004 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a5ad2bfa60 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.627+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d78036040 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0d780305c0 con 0x55a5ace6b840 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 10 client.17004 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 10 client.17004 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 20 client.17004 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace8c520 0x55a5ad2c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 4 client.17004 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf194f93", "release": true, "await": true}] 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf194f93", "release": true, "await": true}) -- 0x55a5ad1a7bf0 con 0x55a5ace8c520 2024-09-21T08:11:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d7effd640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace8c520 0x55a5ad2c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d5effd640 10 client.17004 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:16.628+0000 7f0d7effd640 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace8c520 0x55a5ad2c1c40 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d6dd47db57c4643 server_cookie=6b35362ab81b1dff in_seq=0 out_seq=0 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d5effd640 1 -- 172.21.15.6:0/2660206595 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a5ad1a7bf0 con 0x55a5ace8c520 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d5effd640 10 client.17004 handle_command_reply: tid=0 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 client.17004 shutdown 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 msgr2=0x55a5ad245600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0d7802aeb0 tx=0x7f0d780095c0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 shutdown_connections 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55a5ace8c520 0x55a5ad2c1c40 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5ace6b840 0x55a5ad245600 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d5effd640 0 client.17004 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:17.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5ace63660 0x55a5ad2450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 --2- 172.21.15.6:0/2660206595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a5ace4aea0 0x55a5ad24a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 >> 172.21.15.6:0/2660206595 conn(0x55a5ace80910 msgr2=0x55a5ad22e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 shutdown_connections 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.031+0000 7f0d8c268740 1 -- 172.21.15.6:0/2660206595 wait complete. 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d8c268740 20 client.17004 trim_cache size 0 max 16384 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 40, 2024-09-21T08:11:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "bf194f93": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 40, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 144.5, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:11:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:17.036 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 msgr2=0x7f0d680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 0x7f0d680b8c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0d700e5370 tx=0x7f0d700ea040 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 msgr2=0x7f0d8019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000e9f0 tx=0x7f0d7000edf0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 shutdown_connections 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d680b6700 0x7f0d680b8c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d80108cf0 0x7f0d8019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d801083a0 0x7f0d8019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 --2- 172.21.15.6:0/640398672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80102a60 0x7f0d8019a3a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 >> 172.21.15.6:0/640398672 conn(0x7f0d80079730 msgr2=0x7f0d8006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 shutdown_connections 2024-09-21T08:11:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:17.032+0000 7f0d85cf4640 1 -- 172.21.15.6:0/640398672 wait complete. 2024-09-21T08:11:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 500.0 s, 141.5 tps, lat 2931.087 ms stddev 7070.366 2024-09-21T08:11:17.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:17 smithi145 ceph-mon[34049]: pgmap v657: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-21T08:11:17.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:17 smithi006 ceph-mon[30970]: pgmap v657: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-21T08:11:17.878 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf194f93', total seconds elapsed: 29.6 2024-09-21T08:11:17.878 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T08:11:17.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:11:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:17 smithi119 ceph-mon[33564]: pgmap v657: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-21T08:11:18.308 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.002+0000 7f045d820640 1 -- 172.21.15.6:0/1325631983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458114460 msgr2=0x7f0458116930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.002+0000 7f0455ffb640 1 -- 172.21.15.6:0/1325631983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500307d0 con 0x7f0458114460 2024-09-21T08:11:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.002+0000 7f045d820640 1 --2- 172.21.15.6:0/1325631983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458114460 0x7f0458116930 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0450009ca0 tx=0x7f045002a8d0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.003+0000 7f045d820640 1 -- 172.21.15.6:0/1325631983 shutdown_connections 2024-09-21T08:11:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.003+0000 7f045d820640 1 --2- 172.21.15.6:0/1325631983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0458075dd0 0x7f04580761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.003+0000 7f045d820640 1 --2- 172.21.15.6:0/1325631983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458114460 0x7f0458116930 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.003+0000 7f045d820640 1 --2- 172.21.15.6:0/1325631983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458077380 0x7f04580757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.003+0000 7f045d820640 1 -- 172.21.15.6:0/1325631983 >> 172.21.15.6:0/1325631983 conn(0x7f04580ff600 msgr2=0x7f0458101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.006+0000 7f045d820640 1 -- 172.21.15.6:0/1325631983 shutdown_connections 2024-09-21T08:11:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.006+0000 7f045d820640 1 -- 172.21.15.6:0/1325631983 wait complete. 2024-09-21T08:11:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.007+0000 7f045d820640 1 Processor -- start 2024-09-21T08:11:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 -- start start 2024-09-21T08:11:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0458075dd0 0x7f0458074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458077380 0x7f045806e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f045811a000 con 0x7f0458077380 2024-09-21T08:11:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0458119e80 con 0x7f0458114460 2024-09-21T08:11:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.008+0000 7f045d820640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f045811a180 con 0x7f0458075dd0 2024-09-21T08:11:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.009+0000 7f04577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.009+0000 7f04577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54580/0 (socket says 172.21.15.6:54580) 2024-09-21T08:11:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.009+0000 7f04577fe640 1 -- 172.21.15.6:0/103683306 learned_addr learned my addr 172.21.15.6:0/103683306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.010+0000 7f04577fe640 1 -- 172.21.15.6:0/103683306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0458075dd0 msgr2=0x7f0458074e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:11:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.010+0000 7f04577fe640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0458075dd0 0x7f0458074e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.010+0000 7f04577fe640 1 -- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458077380 msgr2=0x7f045806e100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:11:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.010+0000 7f04577fe640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458077380 0x7f045806e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.010+0000 7f04577fe640 1 -- 172.21.15.6:0/103683306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045806ee80 con 0x7f0458114460 2024-09-21T08:11:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.012+0000 7f04577fe640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0450006010 tx=0x7f0450003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.012+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450003d90 con 0x7f0458114460 2024-09-21T08:11:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.013+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04500044d0 con 0x7f0458114460 2024-09-21T08:11:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.013+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0458073aa0 con 0x7f0458114460 2024-09-21T08:11:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.013+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450030d50 con 0x7f0458114460 2024-09-21T08:11:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.013+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04580740b0 con 0x7f0458114460 2024-09-21T08:11:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.017+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04440052c0 con 0x7f0458114460 2024-09-21T08:11:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.018+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f04500305d0 con 0x7f0458114460 2024-09-21T08:11:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.020+0000 7f045c81e640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 0x7f04400b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.020+0000 7f0456ffd640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 0x7f04400b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:19.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.020+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f04500caab0 con 0x7f0458114460 2024-09-21T08:11:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.022+0000 7f0456ffd640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 0x7f04400b8c40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0448009a60 tx=0x7f0448005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.028+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04500098b0 con 0x7f0458114460 2024-09-21T08:11:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.465+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0444005880 con 0x7f0458114460 2024-09-21T08:11:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.472+0000 7f045c81e640 1 -- 172.21.15.6:0/103683306 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f04500098b0 con 0x7f0458114460 2024-09-21T08:11:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:11:19.474 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:11:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:11:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 msgr2=0x7f04400b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 0x7f04400b8c40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0448009a60 tx=0x7f0448005f90 comp rx=0 tx=0).stop 2024-09-21T08:11:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 msgr2=0x7f045806e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0450006010 tx=0x7f0450003970 comp rx=0 tx=0).stop 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 shutdown_connections 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04400b6730 0x7f04400b8c40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0458114460 0x7f045806e660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0458077380 0x7f045806e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 --2- 172.21.15.6:0/103683306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0458075dd0 0x7f0458074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.479+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 >> 172.21.15.6:0/103683306 conn(0x7f04580ff600 msgr2=0x7f0458110360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.481+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 shutdown_connections 2024-09-21T08:11:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:19.484+0000 7f045d820640 1 -- 172.21.15.6:0/103683306 wait complete. 2024-09-21T08:11:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:19 smithi119 ceph-mon[33564]: pgmap v658: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-21T08:11:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:19 smithi119 ceph-mon[33564]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T08:11:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:19 smithi145 ceph-mon[34049]: pgmap v658: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-21T08:11:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:19 smithi145 ceph-mon[34049]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T08:11:19.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:19 smithi006 ceph-mon[30970]: pgmap v658: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-21T08:11:19.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:19 smithi006 ceph-mon[30970]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T08:11:20.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:20 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/103683306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:20.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:20 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/103683306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:20.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:20 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/103683306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:21.695 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:21 smithi006 ceph-mon[30970]: pgmap v660: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-09-21T08:11:21.695 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:21 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:11:21.742 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T08:11:21.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T08:11:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:21 smithi119 ceph-mon[33564]: pgmap v660: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-09-21T08:11:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:21 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:11:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:21 smithi145 ceph-mon[34049]: pgmap v660: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-09-21T08:11:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:21 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:11:22.208 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 505.0 s, 718.2 tps, lat 139.470 ms stddev 166.184 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.877+0000 7fcdd3fff640 1 -- 172.21.15.6:0/1051204404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0a29d0 msgr2=0x7fcdcc0a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.877+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/1051204404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc0a9200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009900 tx=0x7fcdc802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 -- 172.21.15.6:0/1051204404 shutdown_connections 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/1051204404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc0a9200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/1051204404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 0x7fcdcc0a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/1051204404 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc09c740 0x7fcdcc09cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 -- 172.21.15.6:0/1051204404 >> 172.21.15.6:0/1051204404 conn(0x7fcdcc00bab0 msgr2=0x7fcdcc00bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:22.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.878+0000 7fcdd3fff640 1 -- 172.21.15.6:0/1051204404 shutdown_connections 2024-09-21T08:11:22.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.879+0000 7fcdd3fff640 1 -- 172.21.15.6:0/1051204404 wait complete. 2024-09-21T08:11:22.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.880+0000 7fcdd3fff640 1 Processor -- start 2024-09-21T08:11:22.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.880+0000 7fcdd3fff640 1 -- start start 2024-09-21T08:11:22.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 0x7fcdcc133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54596/0 (socket says 172.21.15.6:54596) 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd2ffd640 1 -- 172.21.15.6:0/3959156578 learned_addr learned my addr 172.21.15.6:0/3959156578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.881+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc1387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.882+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0ac570 con 0x7fcdcc0a2080 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.882+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0ac3f0 con 0x7fcdcc09c740 2024-09-21T08:11:22.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.882+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0ac6f0 con 0x7fcdcc0a29d0 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.882+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 0x7fcdcc133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.882+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc1387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 -- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 msgr2=0x7fcdcc1387c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc1387c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 -- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 msgr2=0x7fcdcc133520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 0x7fcdcc133520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc138e30 con 0x7fcdcc09c740 2024-09-21T08:11:22.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd2ffd640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4051d10 tx=0x7fcdd40759c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdbbfff640 1 -- 172.21.15.6:0/3959156578 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd406a5d0 con 0x7fcdcc09c740 2024-09-21T08:11:22.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc139120 con 0x7fcdcc09c740 2024-09-21T08:11:22.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.883+0000 7fcdbbfff640 1 -- 172.21.15.6:0/3959156578 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdd4084070 con 0x7fcdcc09c740 2024-09-21T08:11:22.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.884+0000 7fcdbbfff640 1 -- 172.21.15.6:0/3959156578 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd407ea90 con 0x7fcdcc09c740 2024-09-21T08:11:22.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.884+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1395e0 con 0x7fcdcc09c740 2024-09-21T08:11:22.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.886+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc1387c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:22.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.888+0000 7fcddf963740 1 Processor -- start 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.888+0000 7fcddf963740 1 -- start start 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.888+0000 7fcddf963740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.888+0000 7fcddf963740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003ba980 0x55ec0078ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.888+0000 7fcddf963740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003c2b60 0x55ec0078b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcddf963740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ec00700b90 con 0x55ec003c2b60 2024-09-21T08:11:22.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcddf963740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ec006effc0 con 0x55ec003e3840 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcddf963740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ec006f3dd0 con 0x55ec003ba980 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54598/0 (socket says 172.21.15.6:54598) 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcdd37fe640 1 -- 172.21.15.6:0/2808942672 learned_addr learned my addr 172.21.15.6:0/2808942672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003c2b60 0x55ec0078b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.889+0000 7fcdd37fe640 1 -- 172.21.15.6:0/2808942672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003ba980 msgr2=0x55ec0078ad00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.890+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003ba980 0x55ec0078ad00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.890+0000 7fcdd37fe640 1 -- 172.21.15.6:0/2808942672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003c2b60 msgr2=0x55ec0078b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.890+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003c2b60 0x55ec0078b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.890+0000 7fcdd37fe640 1 -- 172.21.15.6:0/2808942672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec00677060 con 0x55ec003e3840 2024-09-21T08:11:22.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.890+0000 7fcdbbfff640 1 -- 172.21.15.6:0/3959156578 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcdd407c050 con 0x7fcdcc09c740 2024-09-21T08:11:22.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.891+0000 7fcdbbfff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 0x7fcdbc0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdbbfff640 1 -- 172.21.15.6:0/3959156578 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fcdd4155570 con 0x7fcdcc09c740 2024-09-21T08:11:22.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009a20 tx=0x7fcdc8032c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c65b9a9c36b0e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdd2ffd640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 0x7fcdbc0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdb97fa640 1 -- 172.21.15.6:0/2808942672 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc803f070 con 0x55ec003e3840 2024-09-21T08:11:22.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdb97fa640 1 -- 172.21.15.6:0/2808942672 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc80044c0 con 0x55ec003e3840 2024-09-21T08:11:22.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.892+0000 7fcdb97fa640 1 -- 172.21.15.6:0/2808942672 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8035070 con 0x55ec003e3840 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 -- 172.21.15.6:0/2808942672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 msgr2=0x55ec0078a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcdd2ffd640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 0x7fcdbc0b8cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55ec00789440 tx=0x7fcdd406ccd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009a20 tx=0x7fcdc8032c40 comp rx=0 tx=0).stop 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 -- 172.21.15.6:0/2808942672 shutdown_connections 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003ba980 0x55ec0078ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003c2b60 0x55ec0078b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 --2- 172.21.15.6:0/2808942672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003e3840 0x55ec0078a7c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 -- 172.21.15.6:0/2808942672 >> 172.21.15.6:0/2808942672 conn(0x55ec003d7990 msgr2=0x55ec007886b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 -- 172.21.15.6:0/2808942672 shutdown_connections 2024-09-21T08:11:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.894+0000 7fcddf963740 1 -- 172.21.15.6:0/2808942672 wait complete. 2024-09-21T08:11:22.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.895+0000 7fcddf963740 1 -- start start 2024-09-21T08:11:22.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.895+0000 7fcddf963740 1 Processor -- start 2024-09-21T08:11:22.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00796310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00796850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec007a2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ec005517a0 con 0x55ec003ba980 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ec006950a0 con 0x55ec003c2b60 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ec00798f40 con 0x55ec003e3840 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcddf963740 10 client.0 _ll_register_callbacks cb 0x55ec006723c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec007a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec007a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:41546/0 (socket says 172.21.15.6:41546) 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.896+0000 7fcdd37fe640 1 -- 172.21.15.6:0/178079228 learned_addr learned my addr 172.21.15.6:0/178079228 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00796850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 -- 172.21.15.6:0/178079228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 msgr2=0x55ec007a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec007a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 -- 172.21.15.6:0/178079228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 msgr2=0x55ec00796310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00796310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.897+0000 7fcdd27fc640 1 -- 172.21.15.6:0/178079228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec00683880 con 0x55ec003c2b60 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.898+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00796850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0074c0 tx=0x7fcdc400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f1ca5b1e71b779 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.898+0000 7fcdb6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.898+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4003cd0 con 0x55ec003c2b60 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.899+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fcdc4005020 con 0x55ec003c2b60 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.899+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec00702ae0 con 0x55ec003c2b60 2024-09-21T08:11:22.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.899+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4024050 con 0x55ec003c2b60 2024-09-21T08:11:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.899+0000 7fcddf963740 10 client.26666 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ec0045db90 con 0x55ec003c2b60 2024-09-21T08:11:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc40047a0 con 0x55ec003c2b60 2024-09-21T08:11:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcdc401b470 con 0x55ec003c2b60 2024-09-21T08:11:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 10 client.26666 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 10 client.26666 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 20 client.26666 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec003a21c0 0x55ec007b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 4 client.26666 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.900+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec00702ae0 con 0x55ec003a21c0 2024-09-21T08:11:22.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.903+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec003a21c0 0x55ec007b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.905+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec003a21c0 0x55ec007b92e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd8b9ad67aacb1a server_cookie=8bade79b5dcbe045 in_seq=0 out_seq=0 2024-09-21T08:11:22.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.905+0000 7fcdb6ff5640 10 client.26666 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.906+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/178079228 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec00702ae0 con 0x55ec003a21c0 2024-09-21T08:11:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.906+0000 7fcdb6ff5640 10 client.26666 handle_command_reply: tid=0 2024-09-21T08:11:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.906+0000 7fcddf963740 1 client.26666 shutdown 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 msgr2=0x55ec00796850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00796850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0074c0 tx=0x7fcdc400bf30 comp rx=0 tx=0).stop 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 shutdown_connections 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec003a21c0 0x55ec007b92e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec007a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00796850 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 --2- 172.21.15.6:0/178079228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00796310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.909+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 >> 172.21.15.6:0/178079228 conn(0x55ec003d7990 msgr2=0x55ec0078d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.910+0000 7fcdb6ff5640 0 client.26666 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.910+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 shutdown_connections 2024-09-21T08:11:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.910+0000 7fcddf963740 1 -- 172.21.15.6:0/178079228 wait complete. 2024-09-21T08:11:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.910+0000 7fcddf963740 20 client.26666 trim_cache size 0 max 16384 2024-09-21T08:11:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.943+0000 7fcddf963740 1 Processor -- start 2024-09-21T08:11:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.943+0000 7fcddf963740 1 -- start start 2024-09-21T08:11:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 0x55ec0078dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003e3840 0x55ec00793840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc147b70 con 0x55ec003e3840 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:41560/0 (socket says 172.21.15.6:41560) 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcdd27fc640 1 -- 172.21.15.6:0/4161763490 learned_addr learned my addr 172.21.15.6:0/4161763490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 0x55ec0078dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc14a3d0 con 0x55ec003ba980 2024-09-21T08:11:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.944+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1481c0 con 0x55ec003c2b60 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd27fc640 1 -- 172.21.15.6:0/4161763490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 msgr2=0x55ec0078dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 0x55ec0078dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd27fc640 1 -- 172.21.15.6:0/4161763490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003e3840 msgr2=0x55ec00793840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003e3840 0x55ec00793840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd27fc640 1 -- 172.21.15.6:0/4161763490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec007a25a0 con 0x55ec003c2b60 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.945+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 0x55ec0078dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.946+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4004300 tx=0x7fcdc4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=513f40e6da8051b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.946+0000 7fcdb8ff9640 1 -- 172.21.15.6:0/4161763490 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402c070 con 0x55ec003c2b60 2024-09-21T08:11:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.947+0000 7fcdb8ff9640 1 -- 172.21.15.6:0/4161763490 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc40054b0 con 0x55ec003c2b60 2024-09-21T08:11:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.947+0000 7fcdb8ff9640 1 -- 172.21.15.6:0/4161763490 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc401b5e0 con 0x55ec003c2b60 2024-09-21T08:11:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.948+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 msgr2=0x55ec00793300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.948+0000 7fcddf963740 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4004300 tx=0x7fcdc4000bc0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.948+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 shutdown_connections 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.948+0000 7fcddf963740 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003c2b60 0x55ec00793300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.948+0000 7fcddf963740 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003e3840 0x55ec00793840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.949+0000 7fcddf963740 1 --2- 172.21.15.6:0/4161763490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003ba980 0x55ec0078dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.949+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 >> 172.21.15.6:0/4161763490 conn(0x55ec003d7990 msgr2=0x55ec0078d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.949+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 shutdown_connections 2024-09-21T08:11:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.949+0000 7fcddf963740 1 -- 172.21.15.6:0/4161763490 wait complete. 2024-09-21T08:11:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.950+0000 7fcddf963740 1 -- start start 2024-09-21T08:11:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.950+0000 7fcddf963740 1 Processor -- start 2024-09-21T08:11:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.951+0000 7fcddf963740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00799580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.951+0000 7fcddf963740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.951+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00799580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:54614/0 (socket says 172.21.15.6:54614) 2024-09-21T08:11:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcdd27fc640 1 -- 172.21.15.6:0/916752428 learned_addr learned my addr 172.21.15.6:0/916752428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec00823ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc148890 con 0x55ec003ba980 2024-09-21T08:11:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc149d00 con 0x55ec003c2b60 2024-09-21T08:11:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.952+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc148f60 con 0x55ec003e3840 2024-09-21T08:11:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcdd27fc640 1 -- 172.21.15.6:0/916752428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 msgr2=0x55ec00823ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec00823ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcdd27fc640 1 -- 172.21.15.6:0/916752428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 msgr2=0x55ec00799580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00799580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcdd27fc640 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0079a3b0 con 0x55ec003c2b60 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.953+0000 7fcddf963740 10 client.0 _ll_register_callbacks cb 0x7fcdc4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.954+0000 7fcdd27fc640 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc401baf0 tx=0x7fcdc4005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a39f7947e72b5a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.954+0000 7fcdb6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:11:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.954+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc40054b0 con 0x55ec003c2b60 2024-09-21T08:11:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.956+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/916752428 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402c070 con 0x55ec003c2b60 2024-09-21T08:11:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.956+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/916752428 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fcdc4005020 con 0x55ec003c2b60 2024-09-21T08:11:22.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.957+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/916752428 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4042050 con 0x55ec003c2b60 2024-09-21T08:11:22.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.958+0000 7fcddf963740 10 client.26672 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:22.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.958+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55ec00825090 con 0x55ec003c2b60 2024-09-21T08:11:22.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/916752428 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcdc4004680 con 0x55ec003c2b60 2024-09-21T08:11:22.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 10 client.26672 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 10 client.26672 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 20 client.26672 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec00377570 0x55ec008277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 4 client.26672 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.960+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x55ec006fe590 con 0x55ec00377570 2024-09-21T08:11:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.961+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec00377570 0x55ec008277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.961+0000 7fcdb6ff5640 10 client.26672 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:22.961+0000 7fcdd37fe640 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec00377570 0x55ec008277a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0be0ffb3920c1a0 server_cookie=1a3c06bdcccd897c in_seq=0 out_seq=0 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcdb6ff5640 1 -- 172.21.15.6:0/916752428 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ec006fe590 con 0x55ec00377570 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcdb6ff5640 10 client.26672 handle_command_reply: tid=0 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 client.26672 shutdown 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 msgr2=0x55ec00799ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc401baf0 tx=0x7fcdc4005b20 comp rx=0 tx=0).stop 2024-09-21T08:11:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 shutdown_connections 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ec00377570 0x55ec008277a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec003e3840 0x55ec00823ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ec003c2b60 0x55ec00799ac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcdb6ff5640 0 client.26672 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 --2- 172.21.15.6:0/916752428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec003ba980 0x55ec00799580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 >> 172.21.15.6:0/916752428 conn(0x55ec003d7990 msgr2=0x55ec007945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 shutdown_connections 2024-09-21T08:11:23.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.329+0000 7fcddf963740 1 -- 172.21.15.6:0/916752428 wait complete. 2024-09-21T08:11:23.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcddf963740 20 client.26672 trim_cache size 0 max 16384 2024-09-21T08:11:23.333 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 42, 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "2a694ba4": { 2024-09-21T08:11:23.334 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 42, 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:11:23.335 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 144.5, 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:23.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:23.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:23.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:23.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:23.337 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 msgr2=0x7fcdbc0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 0x7fcdbc0b8cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55ec00789440 tx=0x7fcdd406ccd0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 msgr2=0x7fcdcc132f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4051d10 tx=0x7fcdd40759c0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.330+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 shutdown_connections 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcdbc0b67b0 0x7fcdbc0b8cc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0a29d0 0x7fcdcc1387c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdcc0a2080 0x7fcdcc133520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 --2- 172.21.15.6:0/3959156578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdcc09c740 0x7fcdcc132f80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 >> 172.21.15.6:0/3959156578 conn(0x7fcdcc00bab0 msgr2=0x7fcdcc004f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 shutdown_connections 2024-09-21T08:11:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:23.331+0000 7fcdd3fff640 1 -- 172.21.15.6:0/3959156578 wait complete. 2024-09-21T08:11:23.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:23 smithi006 ceph-mon[30970]: pgmap v661: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 776 KiB/s wr, 76 op/s 2024-09-21T08:11:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:23 smithi119 ceph-mon[33564]: pgmap v661: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 776 KiB/s wr, 76 op/s 2024-09-21T08:11:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:23 smithi145 ceph-mon[34049]: pgmap v661: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 776 KiB/s wr, 76 op/s 2024-09-21T08:11:24.169 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2a694ba4', quiesce took 6.3 seconds. Will release after: 18.2 2024-09-21T08:11:25.745 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:25 smithi145 ceph-mon[34049]: pgmap v662: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T08:11:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:25 smithi119 ceph-mon[33564]: pgmap v662: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T08:11:25.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:25 smithi006 ceph-mon[30970]: pgmap v662: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T08:11:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 510.0 s, 104.7 tps, lat 124.580 ms stddev 46.336 2024-09-21T08:11:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:27 smithi119 ceph-mon[33564]: pgmap v663: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T08:11:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:27 smithi145 ceph-mon[34049]: pgmap v663: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T08:11:27.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:27 smithi006 ceph-mon[30970]: pgmap v663: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T08:11:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:29 smithi119 ceph-mon[33564]: pgmap v664: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 320 op/s 2024-09-21T08:11:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:29 smithi145 ceph-mon[34049]: pgmap v664: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 320 op/s 2024-09-21T08:11:29.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:29 smithi006 ceph-mon[30970]: pgmap v664: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.0 MiB/s wr, 320 op/s 2024-09-21T08:11:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:31 smithi119 ceph-mon[33564]: pgmap v665: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.5 MiB/s wr, 274 op/s 2024-09-21T08:11:31.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:31 smithi145 ceph-mon[34049]: pgmap v665: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.5 MiB/s wr, 274 op/s 2024-09-21T08:11:31.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:31 smithi006 ceph-mon[30970]: pgmap v665: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.5 MiB/s wr, 274 op/s 2024-09-21T08:11:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:33 smithi119 ceph-mon[33564]: pgmap v666: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T08:11:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:33 smithi145 ceph-mon[34049]: pgmap v666: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T08:11:33.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:33 smithi006 ceph-mon[30970]: pgmap v666: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T08:11:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:34 smithi119 ceph-mon[33564]: pgmap v667: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 213 op/s 2024-09-21T08:11:34.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:34 smithi145 ceph-mon[34049]: pgmap v667: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 213 op/s 2024-09-21T08:11:34.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:34 smithi006 ceph-mon[30970]: pgmap v667: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 213 op/s 2024-09-21T08:11:37.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:36 smithi119 ceph-mon[33564]: pgmap v668: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1009 KiB/s wr, 111 op/s 2024-09-21T08:11:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:36 smithi145 ceph-mon[34049]: pgmap v668: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1009 KiB/s wr, 111 op/s 2024-09-21T08:11:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:36 smithi006 ceph-mon[30970]: pgmap v668: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1009 KiB/s wr, 111 op/s 2024-09-21T08:11:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:38.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:11:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:38.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 -- 172.21.15.6:0/864478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 msgr2=0x7f3c38104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 --2- 172.21.15.6:0/864478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38104de0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009900 tx=0x7f3c3402a410 comp rx=0 tx=0).stop 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 -- 172.21.15.6:0/864478859 shutdown_connections 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 --2- 172.21.15.6:0/864478859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c38105320 0x7f3c3810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 --2- 172.21.15.6:0/864478859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c3810de30 0x7f3c38110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 --2- 172.21.15.6:0/864478859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38104de0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 -- 172.21.15.6:0/864478859 >> 172.21.15.6:0/864478859 conn(0x7f3c38079740 msgr2=0x7f3c38079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 -- 172.21.15.6:0/864478859 shutdown_connections 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.878+0000 7f3c402f0640 1 -- 172.21.15.6:0/864478859 wait complete. 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 Processor -- start 2024-09-21T08:11:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 -- start start 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c38105320 0x7f3c38102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c3810de30 0x7f3c38103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38113960 con 0x7f3c381049d0 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381137e0 con 0x7f3c38105320 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c402f0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38113ae0 con 0x7f3c3810de30 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57108/0 (socket says 172.21.15.6:57108) 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 -- 172.21.15.6:0/2099996178 learned_addr learned my addr 172.21.15.6:0/2099996178 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c38105320 0x7f3c38102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c3810de30 0x7f3c38103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 -- 172.21.15.6:0/2099996178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c3810de30 msgr2=0x7f3c38103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c3810de30 0x7f3c38103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 -- 172.21.15.6:0/2099996178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c38105320 msgr2=0x7f3c38102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c38105320 0x7f3c38102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.879+0000 7f3c3e08c640 1 -- 172.21.15.6:0/2099996178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c381a86d0 con 0x7f3c381049d0 2024-09-21T08:11:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c3e08c640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005940 tx=0x7f3c34005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c2f7fe640 1 -- 172.21.15.6:0/2099996178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403f030 con 0x7f3c381049d0 2024-09-21T08:11:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c2f7fe640 1 -- 172.21.15.6:0/2099996178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c340043d0 con 0x7f3c381049d0 2024-09-21T08:11:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c381a8960 con 0x7f3c381049d0 2024-09-21T08:11:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c2f7fe640 1 -- 172.21.15.6:0/2099996178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34035070 con 0x7f3c381049d0 2024-09-21T08:11:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.880+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c381a8e90 con 0x7f3c381049d0 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.882+0000 7f3c46864740 1 Processor -- start 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 -- start start 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c1953650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c1953b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c2f7fe640 1 -- 172.21.15.6:0/2099996178 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3c34042030 con 0x7f3c381049d0 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5644c18c9e50 con 0x5644c15831b0 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5644c18b9280 con 0x5644c158b390 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c46864740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5644c18bd090 con 0x5644c15ac070 2024-09-21T08:11:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c1953b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c1953650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c1953b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57110/0 (socket says 172.21.15.6:57110) 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e08c640 1 -- 172.21.15.6:0/3455867407 learned_addr learned my addr 172.21.15.6:0/3455867407 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3455867407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 msgr2=0x5644c19540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3455867407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 msgr2=0x5644c1953b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c1953b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.883+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3455867407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c1617650 con 0x5644c15ac070 2024-09-21T08:11:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c1953650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009f00 tx=0x7f3c30011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e30744905845f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c2cd9a640 1 -- 172.21.15.6:0/3455867407 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30004d20 con 0x5644c15ac070 2024-09-21T08:11:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c2cd9a640 1 -- 172.21.15.6:0/3455867407 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c30004030 con 0x5644c15ac070 2024-09-21T08:11:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c2cd9a640 1 -- 172.21.15.6:0/3455867407 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30005260 con 0x5644c15ac070 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c2f7fe640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 0x7f3c240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c3e08c640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 0x7f3c240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.884+0000 7f3c2f7fe640 1 -- 172.21.15.6:0/2099996178 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3c34107d40 con 0x7f3c381049d0 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- 172.21.15.6:0/3455867407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 msgr2=0x5644c1953650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c3e08c640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 0x7f3c240b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cd560 tx=0x7f3c340c9040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c1953650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009f00 tx=0x7f3c30011810 comp rx=0 tx=0).stop 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- 172.21.15.6:0/3455867407 shutdown_connections 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c1953b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 --2- 172.21.15.6:0/3455867407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c1953650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- 172.21.15.6:0/3455867407 >> 172.21.15.6:0/3455867407 conn(0x5644c15a0460 msgr2=0x5644c1951540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- 172.21.15.6:0/3455867407 shutdown_connections 2024-09-21T08:11:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- 172.21.15.6:0/3455867407 wait complete. 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 -- start start 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.885+0000 7f3c46864740 1 Processor -- start 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15831b0 0x5644c195ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c196b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5644c171a700 con 0x5644c158b390 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5644c1854110 con 0x5644c15831b0 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5644c1961e30 con 0x5644c15ac070 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c46864740 10 client.0 _ll_register_callbacks cb 0x5644c186d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57116/0 (socket says 172.21.15.6:57116) 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 -- 172.21.15.6:0/4189900633 learned_addr learned my addr 172.21.15.6:0/4189900633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15831b0 0x5644c195ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c196b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 -- 172.21.15.6:0/4189900633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 msgr2=0x5644c196b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c196b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 -- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15831b0 msgr2=0x5644c195ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15831b0 0x5644c195ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.886+0000 7f3c3d88b640 1 -- 172.21.15.6:0/4189900633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c1881c40 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3c28012700 tx=0x7f3c28012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b76e1c1a5fe80f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28004020 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3c280041c0 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c30004030 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3c280043c0 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 10 client.17031 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5644c196dbf0 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c30004030 con 0x5644c158b390 2024-09-21T08:11:38.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3c28003920 con 0x5644c158b390 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 10 client.17031 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.887+0000 7f3c46864740 20 client.17031 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c156a9f0 0x5644c1971220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c46864740 4 client.17031 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c18cbda0 con 0x5644c156a9f0 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c156a9f0 0x5644c1971220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c156a9f0 0x5644c1971220 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b445d48dd80b651 server_cookie=a769dfc3121e3048 in_seq=0 out_seq=0 2024-09-21T08:11:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.888+0000 7f3c21ffb640 10 client.17031 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c21ffb640 1 -- 172.21.15.6:0/4189900633 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644c18cbda0 con 0x5644c156a9f0 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c21ffb640 10 client.17031 handle_command_reply: tid=0 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 client.17031 shutdown 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 msgr2=0x5644c195f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3c28012700 tx=0x7f3c28012bc0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 shutdown_connections 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c156a9f0 0x5644c1971220 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15ac070 0x5644c196b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c158b390 0x5644c195f250 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 --2- 172.21.15.6:0/4189900633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15831b0 0x5644c195ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 >> 172.21.15.6:0/4189900633 conn(0x5644c15a0460 msgr2=0x5644c19567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.889+0000 7f3c21ffb640 0 client.17031 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.890+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 shutdown_connections 2024-09-21T08:11:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.890+0000 7f3c46864740 1 -- 172.21.15.6:0/4189900633 wait complete. 2024-09-21T08:11:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.890+0000 7f3c46864740 20 client.17031 trim_cache size 0 max 16384 2024-09-21T08:11:38.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.908+0000 7f3c46864740 1 Processor -- start 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 -- start start 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c158b390 0x5644c1954d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15ac070 0x5644c1950b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b1090 con 0x5644c15831b0 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b38f0 con 0x5644c15ac070 2024-09-21T08:11:38.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c46864740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b16e0 con 0x5644c158b390 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57120/0 (socket says 172.21.15.6:57120) 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3068880494 learned_addr learned my addr 172.21.15.6:0/3068880494 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c158b390 0x5644c1954d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3068880494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c158b390 msgr2=0x5644c1954d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c158b390 0x5644c1954d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3068880494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15ac070 msgr2=0x5644c1950b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15ac070 0x5644c1950b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.909+0000 7f3c3e88d640 1 -- 172.21.15.6:0/3068880494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c195f7f0 con 0x5644c15831b0 2024-09-21T08:11:38.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.910+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3c30005fd0 tx=0x7f3c300048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc98982c19fe979a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.910+0000 7f3c23fff640 1 -- 172.21.15.6:0/3068880494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30004480 con 0x5644c15831b0 2024-09-21T08:11:38.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.910+0000 7f3c23fff640 1 -- 172.21.15.6:0/3068880494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c3002e070 con 0x5644c15831b0 2024-09-21T08:11:38.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.910+0000 7f3c23fff640 1 -- 172.21.15.6:0/3068880494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000f820 con 0x5644c15831b0 2024-09-21T08:11:38.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- 172.21.15.6:0/3068880494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 msgr2=0x5644c195dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3c30005fd0 tx=0x7f3c300048b0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- 172.21.15.6:0/3068880494 shutdown_connections 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c158b390 0x5644c1954d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c15ac070 0x5644c1950b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 --2- 172.21.15.6:0/3068880494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15831b0 0x5644c195dc00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- 172.21.15.6:0/3068880494 >> 172.21.15.6:0/3068880494 conn(0x5644c15a0460 msgr2=0x5644c1954680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- 172.21.15.6:0/3068880494 shutdown_connections 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- 172.21.15.6:0/3068880494 wait complete. 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 -- start start 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.911+0000 7f3c46864740 1 Processor -- start 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15831b0 0x5644c1962b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b1db0 con 0x5644c15ac070 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b3220 con 0x5644c158b390 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c381b2480 con 0x5644c15831b0 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c46864740 10 client.0 _ll_register_callbacks cb 0x7f3c28009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57130/0 (socket says 172.21.15.6:57130) 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 -- 172.21.15.6:0/2389811943 learned_addr learned my addr 172.21.15.6:0/2389811943 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15831b0 0x5644c1962b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 -- 172.21.15.6:0/2389811943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15831b0 msgr2=0x5644c1962b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15831b0 0x5644c1962b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 -- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 msgr2=0x5644c19630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 -- 172.21.15.6:0/2389811943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c19d4360 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c3e88d640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009d40 tx=0x7f3c3000f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eed704b511a6fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.912+0000 7f3c21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30003a30 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3c30003bd0 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3002e070 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3c30003dd0 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 10 client.17037 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5644c19db6b0 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c3002e070 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3c30024040 con 0x5644c15ac070 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 10 client.17037 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 20 client.17037 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:38.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c153fda0 0x5644c19ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 4 client.17037 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.913+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644c18c7850 con 0x5644c153fda0 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c153fda0 0x5644c19ddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c3d88b640 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c153fda0 0x5644c19ddb20 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1fa307db960e17 server_cookie=e0d906ee0d4b8392 in_seq=0 out_seq=0 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c21ffb640 10 client.17037 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c21ffb640 1 -- 172.21.15.6:0/2389811943 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x5644c18c7850 con 0x5644c153fda0 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c21ffb640 10 client.17037 handle_command_reply: tid=0 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.914+0000 7f3c46864740 1 client.17037 shutdown 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 msgr2=0x5644c19d3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009d40 tx=0x7f3c3000f480 comp rx=0 tx=0).stop 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 shutdown_connections 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5644c153fda0 0x5644c19ddb20 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5644c15ac070 0x5644c19d3cf0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644c158b390 0x5644c19630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 --2- 172.21.15.6:0/2389811943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5644c15831b0 0x5644c1962b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 >> 172.21.15.6:0/2389811943 conn(0x5644c15a0460 msgr2=0x5644c1954680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c21ffb640 0 client.17037 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 shutdown_connections 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 1 -- 172.21.15.6:0/2389811943 wait complete. 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.915+0000 7f3c46864740 20 client.17037 trim_cache size 0 max 16384 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:11:38.926 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.927 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.929 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:11:38.930 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:11:38.934 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:11:38.935 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.936 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:38.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:38.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:38.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:38.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:38.938 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 msgr2=0x7f3c240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 0x7f3c240b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3c340cd560 tx=0x7f3c340c9040 comp rx=0 tx=0).stop 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 msgr2=0x7f3c38102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005940 tx=0x7f3c34005e30 comp rx=0 tx=0).stop 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 shutdown_connections 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3c240b6700 0x7f3c240b8c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c3810de30 0x7f3c38103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c38105320 0x7f3c38102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 --2- 172.21.15.6:0/2099996178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c381049d0 0x7f3c38102710 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 >> 172.21.15.6:0/2099996178 conn(0x7f3c38079740 msgr2=0x7f3c380ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 shutdown_connections 2024-09-21T08:11:38.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:38.916+0000 7f3c402f0640 1 -- 172.21.15.6:0/2099996178 wait complete. 2024-09-21T08:11:39.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:38 smithi119 ceph-mon[33564]: pgmap v669: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 778 KiB/s wr, 92 op/s 2024-09-21T08:11:39.198 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:38 smithi145 ceph-mon[34049]: pgmap v669: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 778 KiB/s wr, 92 op/s 2024-09-21T08:11:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:38 smithi006 ceph-mon[30970]: pgmap v669: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 778 KiB/s wr, 92 op/s 2024-09-21T08:11:39.836 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:11:39.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:11:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 -- 172.21.15.6:0/4271962512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc108420 msgr2=0x7facbc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 --2- 172.21.15.6:0/4271962512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc108420 0x7facbc108830 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7facb0009900 tx=0x7facb002a410 comp rx=0 tx=0).stop 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 -- 172.21.15.6:0/4271962512 shutdown_connections 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 --2- 172.21.15.6:0/4271962512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 0x7facbc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 --2- 172.21.15.6:0/4271962512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc108420 0x7facbc108830 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 --2- 172.21.15.6:0/4271962512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc102ae0 0x7facbc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 -- 172.21.15.6:0/4271962512 >> 172.21.15.6:0/4271962512 conn(0x7facbc079770 msgr2=0x7facbc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 -- 172.21.15.6:0/4271962512 shutdown_connections 2024-09-21T08:11:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.604+0000 7facc16c6640 1 -- 172.21.15.6:0/4271962512 wait complete. 2024-09-21T08:11:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 Processor -- start 2024-09-21T08:11:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 -- start start 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc108420 0x7facbc0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 0x7facbc1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7facbc1128e0 con 0x7facbc102ae0 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7facbc112760 con 0x7facbc108420 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facc16c6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7facbc112a60 con 0x7facbc108d70 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facbaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facbaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57150/0 (socket says 172.21.15.6:57150) 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facbaffd640 1 -- 172.21.15.6:0/2566625952 learned_addr learned my addr 172.21.15.6:0/2566625952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facbb7fe640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 0x7facbc1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.605+0000 7facba7fc640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc108420 0x7facbc0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 -- 172.21.15.6:0/2566625952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 msgr2=0x7facbc1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 0x7facbc1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 -- 172.21.15.6:0/2566625952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc108420 msgr2=0x7facbc0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc108420 0x7facbc0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 -- 172.21.15.6:0/2566625952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc1a8730 con 0x7facbc102ae0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facbaffd640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7facac00c920 tx=0x7facac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac007c70 con 0x7facbc102ae0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facac007e10 con 0x7facbc102ae0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facbc1a8a20 con 0x7facbc102ae0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac018710 con 0x7facbc102ae0 2024-09-21T08:11:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.606+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facbc1a8f30 con 0x7facbc102ae0 2024-09-21T08:11:40.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.607+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facbc103d60 con 0x7facbc102ae0 2024-09-21T08:11:40.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.609+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7facac00f450 con 0x7facbc102ae0 2024-09-21T08:11:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.610+0000 7faca3fff640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 0x7faca40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.610+0000 7facba7fc640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 0x7faca40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.610+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7facac0e7f30 con 0x7facbc102ae0 2024-09-21T08:11:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.610+0000 7facba7fc640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 0x7faca40b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7facb0005940 tx=0x7facb00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.613+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facac014030 con 0x7facbc102ae0 2024-09-21T08:11:40.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.840+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facbc102ef0 con 0x7facbc102ae0 2024-09-21T08:11:40.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.841+0000 7faca3fff640 1 -- 172.21.15.6:0/2566625952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7facbc102ef0 con 0x7facbc102ae0 2024-09-21T08:11:40.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:11:40.844 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:11:40.844 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 msgr2=0x7faca40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 0x7faca40b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7facb0005940 tx=0x7facb00058d0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 msgr2=0x7facbc0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7facac00c920 tx=0x7facac00cde0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 shutdown_connections 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faca40b6680 0x7faca40b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facbc108d70 0x7facbc1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facbc108420 0x7facbc0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 --2- 172.21.15.6:0/2566625952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc102ae0 0x7facbc0ff670 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 >> 172.21.15.6:0/2566625952 conn(0x7facbc079770 msgr2=0x7facbc101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.843+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 shutdown_connections 2024-09-21T08:11:40.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:40.844+0000 7facc16c6640 1 -- 172.21.15.6:0/2566625952 wait complete. 2024-09-21T08:11:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:40 smithi119 ceph-mon[33564]: pgmap v670: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 576 KiB/s wr, 71 op/s 2024-09-21T08:11:41.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:40 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2566625952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:41.165 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:40 smithi006 ceph-mon[30970]: pgmap v670: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 576 KiB/s wr, 71 op/s 2024-09-21T08:11:41.165 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:40 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2566625952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:40 smithi145 ceph-mon[34049]: pgmap v670: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 576 KiB/s wr, 71 op/s 2024-09-21T08:11:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:40 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2566625952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:41.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:11:41.887 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:42.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:11:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- 172.21.15.6:0/2942897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 msgr2=0x7f8d10102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 --2- 172.21.15.6:0/2942897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d10102e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009900 tx=0x7f8d0002a410 comp rx=0 tx=0).stop 2024-09-21T08:11:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- 172.21.15.6:0/2942897657 shutdown_connections 2024-09-21T08:11:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 --2- 172.21.15.6:0/2942897657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 0x7f8d101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 --2- 172.21.15.6:0/2942897657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 --2- 172.21.15.6:0/2942897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d10102e70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- 172.21.15.6:0/2942897657 >> 172.21.15.6:0/2942897657 conn(0x7f8d10079730 msgr2=0x7f8d10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- 172.21.15.6:0/2942897657 shutdown_connections 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- 172.21.15.6:0/2942897657 wait complete. 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 Processor -- start 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.374+0000 7f8d165b4640 1 -- start start 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 0x7f8d1019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d10112810 con 0x7f8d10102a60 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d10112690 con 0x7f8d10108cf0 2024-09-21T08:11:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d165b4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d10112990 con 0x7f8d101083a0 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57164/0 (socket says 172.21.15.6:57164) 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 -- 172.21.15.6:0/4231430880 learned_addr learned my addr 172.21.15.6:0/4231430880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d14b51640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d07fff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 0x7f8d1019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 -- 172.21.15.6:0/4231430880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 msgr2=0x7f8d1019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 0x7f8d1019b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 -- 172.21.15.6:0/4231430880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 msgr2=0x7f8d1019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d0ffff640 1 -- 172.21.15.6:0/4231430880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d101a6420 con 0x7f8d10102a60 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.375+0000 7f8d14b51640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009230 tx=0x7f8d00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d0dffb640 1 -- 172.21.15.6:0/4231430880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0003f030 con 0x7f8d10102a60 2024-09-21T08:11:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d10198f90 con 0x7f8d10102a60 2024-09-21T08:11:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d0dffb640 1 -- 172.21.15.6:0/4231430880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d00003a80 con 0x7f8d10102a60 2024-09-21T08:11:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d0dffb640 1 -- 172.21.15.6:0/4231430880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00035070 con 0x7f8d10102a60 2024-09-21T08:11:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.376+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d10199470 con 0x7f8d10102a60 2024-09-21T08:11:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 Processor -- start 2024-09-21T08:11:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 -- start start 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d0dffb640 1 -- 172.21.15.6:0/4231430880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8d00042030 con 0x7f8d10102a60 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 0x5633803332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x563380333d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5633802a9ea0 con 0x56337ff631b0 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5633802992d0 con 0x56337ff6b390 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56338029d0e0 con 0x56337ff8c070 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.379+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57170/0 (socket says 172.21.15.6:57170) 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d0ffff640 1 -- 172.21.15.6:0/3011753490 learned_addr learned my addr 172.21.15.6:0/3011753490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 0x5633803332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d07fff640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x563380333d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 -- 172.21.15.6:0/3011753490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 msgr2=0x563380333d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x563380333d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 -- 172.21.15.6:0/3011753490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 msgr2=0x563380333800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 -- 172.21.15.6:0/3011753490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337fff7650 con 0x56337ff8c070 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.380+0000 7f8d14b51640 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 0x5633803332c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d1006bf40 tx=0x7f8d08011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2334a1701c097c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d067fc640 1 -- 172.21.15.6:0/3011753490 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08004d20 con 0x56337ff8c070 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d067fc640 1 -- 172.21.15.6:0/3011753490 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d08003970 con 0x56337ff8c070 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d067fc640 1 -- 172.21.15.6:0/3011753490 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d080043a0 con 0x56337ff8c070 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d0dffb640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 0x7f8cfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 0x7f8cfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.381+0000 7f8d0dffb640 1 -- 172.21.15.6:0/4231430880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8d00108280 con 0x7f8d10102a60 2024-09-21T08:11:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 -- 172.21.15.6:0/3011753490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 msgr2=0x5633803332c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d0ffff640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 0x7f8cfc0b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d00046000 tx=0x7f8d0010e060 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 0x5633803332c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d1006bf40 tx=0x7f8d08011bf0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 -- 172.21.15.6:0/3011753490 shutdown_connections 2024-09-21T08:11:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x563380333d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380333800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/3011753490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff8c070 0x5633803332c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 -- 172.21.15.6:0/3011753490 >> 172.21.15.6:0/3011753490 conn(0x56337ff80460 msgr2=0x5633803311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 -- 172.21.15.6:0/3011753490 shutdown_connections 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.382+0000 7f8d1cb28740 1 -- 172.21.15.6:0/3011753490 wait complete. 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 -- start start 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 Processor -- start 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x56338033e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff8c070 0x56338033f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5633800fa700 con 0x56337ff6b390 2024-09-21T08:11:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563380234160 con 0x56337ff8c070 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563380341aa0 con 0x56337ff631b0 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d1cb28740 10 client.0 _ll_register_callbacks cb 0x56338024d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57174/0 (socket says 172.21.15.6:57174) 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d07fff640 1 -- 172.21.15.6:0/2223628077 learned_addr learned my addr 172.21.15.6:0/2223628077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff8c070 0x56338033f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.383+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x56338033e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 -- 172.21.15.6:0/2223628077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 msgr2=0x56338033e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x56338033e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 -- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff8c070 msgr2=0x56338033f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff8c070 0x56338033f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 -- 172.21.15.6:0/2223628077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563380261c90 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8010820 tx=0x7f8cf8010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706d302d5f38f138 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800fb90 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8cf800fd30 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d08003970 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8cf8024050 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d1cb28740 10 client.17055 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.384+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56338034d7e0 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d08003970 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8cf800e3b0 con 0x56337ff6b390 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 10 client.17055 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 20 client.17055 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff4a9f0 0x563380350dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 4 client.17055 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633802abdf0 con 0x56337ff4a9f0 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.385+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff4a9f0 0x563380350dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.386+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff4a9f0 0x563380350dc0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d795e660063caf5 server_cookie=c93b9483a83b55d in_seq=0 out_seq=0 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.386+0000 7f8cef7fe640 10 client.17055 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.386+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2223628077 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633802abdf0 con 0x56337ff4a9f0 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.386+0000 7f8cef7fe640 10 client.17055 handle_command_reply: tid=0 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.386+0000 7f8d1cb28740 1 client.17055 shutdown 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 msgr2=0x56338033ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8010820 tx=0x7f8cf8010ce0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 shutdown_connections 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff4a9f0 0x563380350dc0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff8c070 0x56338033f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff6b390 0x56338033ee70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8cef7fe640 0 client.17055 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2223628077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x56338033e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 >> 172.21.15.6:0/2223628077 conn(0x56337ff80460 msgr2=0x563380336450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 shutdown_connections 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2223628077 wait complete. 2024-09-21T08:11:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.387+0000 7f8d1cb28740 20 client.17055 trim_cache size 0 max 16384 2024-09-21T08:11:42.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 Processor -- start 2024-09-21T08:11:42.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 -- start start 2024-09-21T08:11:42.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x563380334a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x56338033bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b10d0 con 0x56337ff4a9f0 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b3930 con 0x56337ff6b390 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b1720 con 0x56337ff631b0 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d14b51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d14b51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57176/0 (socket says 172.21.15.6:57176) 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.401+0000 7f8d14b51640 1 -- 172.21.15.6:0/492691421 learned_addr learned my addr 172.21.15.6:0/492691421 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d07fff640 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x563380334a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x56338033bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 -- 172.21.15.6:0/492691421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 msgr2=0x563380334a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x563380334a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 -- 172.21.15.6:0/492691421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 msgr2=0x56338033bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x56338033bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 -- 172.21.15.6:0/492691421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338032b460 con 0x56337ff4a9f0 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d14b51640 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8d0801b040 tx=0x7f8d08009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08f4e6c1e9155a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d05ffb640 1 -- 172.21.15.6:0/492691421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0801d040 con 0x56337ff4a9f0 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d05ffb640 1 -- 172.21.15.6:0/492691421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d0800fd50 con 0x56337ff4a9f0 2024-09-21T08:11:42.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.402+0000 7f8d05ffb640 1 -- 172.21.15.6:0/492691421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08019720 con 0x56337ff4a9f0 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 -- 172.21.15.6:0/492691421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 msgr2=0x56338033a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8d0801b040 tx=0x7f8d08009500 comp rx=0 tx=0).stop 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 -- 172.21.15.6:0/492691421 shutdown_connections 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff631b0 0x563380334a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff6b390 0x56338033bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/492691421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff4a9f0 0x56338033a110 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 -- 172.21.15.6:0/492691421 >> 172.21.15.6:0/492691421 conn(0x56337ff80460 msgr2=0x5633803342f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 -- 172.21.15.6:0/492691421 shutdown_connections 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.403+0000 7f8d1cb28740 1 -- 172.21.15.6:0/492691421 wait complete. 2024-09-21T08:11:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 -- start start 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 Processor -- start 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff4a9f0 0x563380347470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff6b390 0x563380342e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b1df0 con 0x56337ff631b0 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b3260 con 0x56337ff4a9f0 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8d101b24c0 con 0x56337ff6b390 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d1cb28740 10 client.0 _ll_register_callbacks cb 0x7f8cf800a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.404+0000 7f8d07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57180/0 (socket says 172.21.15.6:57180) 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 -- 172.21.15.6:0/2473532737 learned_addr learned my addr 172.21.15.6:0/2473532737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff6b390 0x563380342e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff4a9f0 0x563380347470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 -- 172.21.15.6:0/2473532737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff6b390 msgr2=0x563380342e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff6b390 0x563380342e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 -- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff4a9f0 msgr2=0x563380347470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff4a9f0 0x563380347470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 -- 172.21.15.6:0/2473532737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563380343520 con 0x56337ff631b0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d07fff640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800e9c0 tx=0x7f8cf800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25b61b6316e1aee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800e5c0 con 0x56337ff631b0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8cf800fb90 con 0x56337ff631b0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.405+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d0800fd50 con 0x56337ff631b0 2024-09-21T08:11:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8cf8038050 con 0x56337ff631b0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 10 client.17061 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5633803bb5f0 con 0x56337ff631b0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d0800fd50 con 0x56337ff631b0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8cf8004760 con 0x56337ff631b0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 10 client.17061 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 20 client.17061 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff8c070 0x5633803bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 4 client.17061 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633802a78a0 con 0x56337ff8c070 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.406+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff8c070 0x5633803bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d14b51640 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff8c070 0x5633803bddd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddd7cc518df279c0 server_cookie=fc0ac74cdf1dd7ed in_seq=0 out_seq=0 2024-09-21T08:11:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8cef7fe640 10 client.17061 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8cef7fe640 1 -- 172.21.15.6:0/2473532737 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633802a78a0 con 0x56337ff8c070 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8cef7fe640 10 client.17061 handle_command_reply: tid=0 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 client.17061 shutdown 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 msgr2=0x563380342920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800e9c0 tx=0x7f8cf800ec70 comp rx=0 tx=0).stop 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 shutdown_connections 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56337ff8c070 0x5633803bddd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56337ff6b390 0x563380342e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337ff631b0 0x563380342920 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 --2- 172.21.15.6:0/2473532737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56337ff4a9f0 0x563380347470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8cef7fe640 0 client.17061 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 >> 172.21.15.6:0/2473532737 conn(0x56337ff80460 msgr2=0x563380349ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.407+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 shutdown_connections 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d1cb28740 1 -- 172.21.15.6:0/2473532737 wait complete. 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d1cb28740 20 client.17061 trim_cache size 0 max 16384 2024-09-21T08:11:42.415 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 msgr2=0x7f8cfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 0x7f8cfc0b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d00046000 tx=0x7f8d0010e060 comp rx=0 tx=0).stop 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 msgr2=0x7f8d1019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009230 tx=0x7f8d00004270 comp rx=0 tx=0).stop 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 shutdown_connections 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8cfc0b6680 0x7f8cfc0b8b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d101083a0 0x7f8d1019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d10108cf0 0x7f8d1019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 --2- 172.21.15.6:0/4231430880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10102a60 0x7f8d1019b1a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 >> 172.21.15.6:0/4231430880 conn(0x7f8d10079730 msgr2=0x7f8d101014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 shutdown_connections 2024-09-21T08:11:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:42.408+0000 7f8d165b4640 1 -- 172.21.15.6:0/4231430880 wait complete. 2024-09-21T08:11:42.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:43.135 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:42 smithi006 ceph-mon[30970]: pgmap v671: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 84 op/s 2024-09-21T08:11:43.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:42 smithi119 ceph-mon[33564]: pgmap v671: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 84 op/s 2024-09-21T08:11:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:42 smithi145 ceph-mon[34049]: pgmap v671: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 84 op/s 2024-09-21T08:11:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 -- 172.21.15.6:0/121296151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858102a60 msgr2=0x7f5858102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 --2- 172.21.15.6:0/121296151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858102a60 0x7f5858102e70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5848009900 tx=0x7f584802a410 comp rx=0 tx=0).stop 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 -- 172.21.15.6:0/121296151 shutdown_connections 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 --2- 172.21.15.6:0/121296151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 0x7f585810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 --2- 172.21.15.6:0/121296151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58581083a0 0x7f58581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 --2- 172.21.15.6:0/121296151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5858102a60 0x7f5858102e70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 -- 172.21.15.6:0/121296151 >> 172.21.15.6:0/121296151 conn(0x7f5858079730 msgr2=0x7f5858079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 -- 172.21.15.6:0/121296151 shutdown_connections 2024-09-21T08:11:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.699+0000 7f585f07a640 1 -- 172.21.15.6:0/121296151 wait complete. 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.700+0000 7f585f07a640 1 Processor -- start 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.700+0000 7f585f07a640 1 -- start start 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.700+0000 7f585f07a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5858102a60 0x7f585819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585f07a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585f07a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 0x7f585819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585f07a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5858112810 con 0x7f58581083a0 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585f07a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5858112690 con 0x7f5858102a60 2024-09-21T08:11:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585f07a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5858112990 con 0x7f5858108cf0 2024-09-21T08:11:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57194/0 (socket says 172.21.15.6:57194) 2024-09-21T08:11:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 -- 172.21.15.6:0/3749853830 learned_addr learned my addr 172.21.15.6:0/3749853830 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:43.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585ce16640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5858102a60 0x7f585819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:43.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f585d617640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 0x7f585819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 -- 172.21.15.6:0/3749853830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 msgr2=0x7f585819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 0x7f585819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 -- 172.21.15.6:0/3749853830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5858102a60 msgr2=0x7f585819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5858102a60 0x7f585819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 -- 172.21.15.6:0/3749853830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58581a6480 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5857fff640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017070 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.701+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f584c009c30 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.702+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58581a6770 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.702+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c003c70 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.702+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58581a6d00 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.702+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5858102e70 con 0x7f58581083a0 2024-09-21T08:11:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.704+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f584c003e10 con 0x7f58581083a0 2024-09-21T08:11:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.705+0000 7f5855ffb640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 0x7f58400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.705+0000 7f585ce16640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 0x7f58400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.705+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f584c0e7e50 con 0x7f58581083a0 2024-09-21T08:11:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.706+0000 7f585ce16640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 0x7f58400b8c10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f585806b9e0 tx=0x7f58480058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.708+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f584c020030 con 0x7f58581083a0 2024-09-21T08:11:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.934+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f585806b290 con 0x7f58581083a0 2024-09-21T08:11:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.935+0000 7f5855ffb640 1 -- 172.21.15.6:0/3749853830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f584c0ae040 con 0x7f58581083a0 2024-09-21T08:11:43.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:11:43.938 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:11:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 msgr2=0x7f58400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 0x7f58400b8c10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f585806b9e0 tx=0x7f58480058d0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 msgr2=0x7f585819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c00dde0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 shutdown_connections 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f58400b6700 0x7f58400b8c10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5858108cf0 0x7f585819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58581083a0 0x7f585819b700 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 --2- 172.21.15.6:0/3749853830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5858102a60 0x7f585819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:43.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 >> 172.21.15.6:0/3749853830 conn(0x7f5858079730 msgr2=0x7f5858101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:43.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 shutdown_connections 2024-09-21T08:11:43.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:43.938+0000 7f585f07a640 1 -- 172.21.15.6:0/3749853830 wait complete. 2024-09-21T08:11:44.175 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:11:44.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:11:44.698 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 2a694ba4 --release --await' 2024-09-21T08:11:44.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 2a694ba4 --release --await 2024-09-21T08:11:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:44.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:44 smithi006 ceph-mon[30970]: pgmap v672: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 652 KiB/s wr, 80 op/s 2024-09-21T08:11:44.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:44 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3749853830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:44 smithi119 ceph-mon[33564]: pgmap v672: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 652 KiB/s wr, 80 op/s 2024-09-21T08:11:45.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:44 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3749853830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:44 smithi145 ceph-mon[34049]: pgmap v672: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 652 KiB/s wr, 80 op/s 2024-09-21T08:11:45.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:44 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3749853830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:11:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 -- 172.21.15.6:0/1670225240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9874102a60 msgr2=0x7f9874102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 --2- 172.21.15.6:0/1670225240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9874102a60 0x7f9874102e70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9864009900 tx=0x7f986402a410 comp rx=0 tx=0).stop 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 -- 172.21.15.6:0/1670225240 shutdown_connections 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 --2- 172.21.15.6:0/1670225240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98741083a0 0x7f98741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 --2- 172.21.15.6:0/1670225240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874108cf0 0x7f987410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 --2- 172.21.15.6:0/1670225240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9874102a60 0x7f9874102e70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 -- 172.21.15.6:0/1670225240 >> 172.21.15.6:0/1670225240 conn(0x7f9874079730 msgr2=0x7f9874079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 -- 172.21.15.6:0/1670225240 shutdown_connections 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.295+0000 7f987a120640 1 -- 172.21.15.6:0/1670225240 wait complete. 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 Processor -- start 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 -- start start 2024-09-21T08:11:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874102a60 0x7f987419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9874108cf0 0x7f987419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9874112860 con 0x7f98741083a0 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98741126e0 con 0x7f9874102a60 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.296+0000 7f987a120640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98741129e0 con 0x7f9874108cf0 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57214/0 (socket says 172.21.15.6:57214) 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 -- 172.21.15.6:0/160727911 learned_addr learned my addr 172.21.15.6:0/160727911 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9873fff640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9874108cf0 0x7f987419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f98737fe640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874102a60 0x7f987419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 -- 172.21.15.6:0/160727911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9874108cf0 msgr2=0x7f987419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9874108cf0 0x7f987419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 -- 172.21.15.6:0/160727911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874102a60 msgr2=0x7f987419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874102a60 0x7f987419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 -- 172.21.15.6:0/160727911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98741a6480 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9872ffd640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f986800d740 tx=0x7f986800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9870ff9640 1 -- 172.21.15.6:0/160727911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868017070 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9870ff9640 1 -- 172.21.15.6:0/160727911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f986800de50 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98741a6770 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f9870ff9640 1 -- 172.21.15.6:0/160727911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868004c60 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.297+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741a6c60 con 0x7f98741083a0 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.300+0000 7f9880694740 1 Processor -- start 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 -- start start 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f2f7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f2f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55820f26de60 con 0x55820ef50350 2024-09-21T08:11:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55820f25d290 con 0x55820ef27490 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9880694740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55820f2610a0 con 0x55820ef2f670 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9870ff9640 1 -- 172.21.15.6:0/160727911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9868004e00 con 0x7f98741083a0 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57216/0 (socket says 172.21.15.6:57216) 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f9873fff640 1 -- 172.21.15.6:0/1056592768 learned_addr learned my addr 172.21.15.6:0/1056592768 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.301+0000 7f98737fe640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f2f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9872ffd640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f2f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 -- 172.21.15.6:0/1056592768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 msgr2=0x55820f2f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f2f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 -- 172.21.15.6:0/1056592768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 msgr2=0x55820f2f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f2f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 -- 172.21.15.6:0/1056592768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55820efbb930 con 0x55820ef50350 2024-09-21T08:11:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9872ffd640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f2f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9873fff640 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f986c009ec0 tx=0x7f986c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119b7e5c289bee4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9859ffb640 1 -- 172.21.15.6:0/1056592768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c016070 con 0x55820ef50350 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9859ffb640 1 -- 172.21.15.6:0/1056592768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f986c0128e0 con 0x55820ef50350 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9859ffb640 1 -- 172.21.15.6:0/1056592768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c0118a0 con 0x55820ef50350 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9870ff9640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 0x7f985c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f98737fe640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 0x7f985c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.302+0000 7f9870ff9640 1 -- 172.21.15.6:0/160727911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f98680e74d0 con 0x7f98741083a0 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- 172.21.15.6:0/1056592768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 msgr2=0x55820f2f7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f98737fe640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 0x7f985c0b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f987406ba20 tx=0x7f9864009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f986c009ec0 tx=0x7f986c010740 comp rx=0 tx=0).stop 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- 172.21.15.6:0/1056592768 shutdown_connections 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f2f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f2f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 --2- 172.21.15.6:0/1056592768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f2f7430 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- 172.21.15.6:0/1056592768 >> 172.21.15.6:0/1056592768 conn(0x55820ef44740 msgr2=0x55820f2f5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- 172.21.15.6:0/1056592768 shutdown_connections 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- 172.21.15.6:0/1056592768 wait complete. 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.303+0000 7f9880694740 1 -- start start 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 Processor -- start 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 0x55820f3030b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f303650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55820f0be890 con 0x55820ef50350 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55820f1f7d40 con 0x55820ef2f670 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55820f305c10 con 0x55820ef27490 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9880694740 10 client.0 _ll_register_callbacks cb 0x55820f25bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57224/0 (socket says 172.21.15.6:57224) 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9873fff640 1 -- 172.21.15.6:0/1201521755 learned_addr learned my addr 172.21.15.6:0/1201521755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f9872ffd640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f303650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.304+0000 7f98737fe640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 0x55820f3030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 -- 172.21.15.6:0/1201521755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 msgr2=0x55820f3030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 0x55820f3030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 -- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 msgr2=0x55820f303650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f303650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 -- 172.21.15.6:0/1201521755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55820f30f540 con 0x55820ef50350 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f98737fe640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 0x55820f3030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9873fff640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f986c011580 tx=0x7f986c012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a131e6c82187c059 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c029060 con 0x55820ef50350 2024-09-21T08:11:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f986c011620 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986c0128e0 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f986c030050 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9880694740 10 client.17079 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.305+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55820f311de0 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f986c0128e0 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f986c023030 con 0x55820ef50350 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 10 client.17079 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 20 client.17079 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820ef0ecd0 0x55820f315250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 4 client.17079 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55820f26fdb0 con 0x55820ef0ecd0 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.306+0000 7f98737fe640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820ef0ecd0 0x55820f315250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.307+0000 7f9852ffd640 10 client.17079 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.307+0000 7f98737fe640 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820ef0ecd0 0x55820f315250 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35bce673b288b3f4 server_cookie=8d79a42c242e5561 in_seq=0 out_seq=0 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.307+0000 7f9852ffd640 1 -- 172.21.15.6:0/1201521755 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55820f26fdb0 con 0x55820ef0ecd0 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.307+0000 7f9852ffd640 10 client.17079 handle_command_reply: tid=0 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.307+0000 7f9880694740 1 client.17079 shutdown 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 msgr2=0x55820f30ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f986c011580 tx=0x7f986c012700 comp rx=0 tx=0).stop 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 shutdown_connections 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820ef0ecd0 0x55820f315250 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f30ef00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f303650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 --2- 172.21.15.6:0/1201521755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef27490 0x55820f3030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 >> 172.21.15.6:0/1201521755 conn(0x55820ef44740 msgr2=0x55820f2fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9852ffd640 0 client.17079 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 shutdown_connections 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 1 -- 172.21.15.6:0/1201521755 wait complete. 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.308+0000 7f9880694740 20 client.17079 trim_cache size 0 max 16384 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 Processor -- start 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 -- start start 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f2faa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 0x55820f2fc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98741aefd0 con 0x55820ef27490 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b1830 con 0x55820ef2f670 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9880694740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98741af620 con 0x55820ef50350 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57238/0 (socket says 172.21.15.6:57238) 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 -- 172.21.15.6:0/3171912688 learned_addr learned my addr 172.21.15.6:0/3171912688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9873fff640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 0x55820f2fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 -- 172.21.15.6:0/3171912688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 msgr2=0x55820f2fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9872ffd640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f2faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 0x55820f2fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 -- 172.21.15.6:0/3171912688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 msgr2=0x55820f2faa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f2faa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f98737fe640 1 -- 172.21.15.6:0/3171912688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55820f2fe740 con 0x55820ef27490 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.326+0000 7f9873fff640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 0x55820f2fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f98737fe640 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f986402aa00 tx=0x7f986403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9655e08166b78faf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f98597fa640 1 -- 172.21.15.6:0/3171912688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864035040 con 0x55820ef27490 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f98597fa640 1 -- 172.21.15.6:0/3171912688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9864003d40 con 0x55820ef27490 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f98597fa640 1 -- 172.21.15.6:0/3171912688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864005040 con 0x55820ef27490 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f9880694740 1 -- 172.21.15.6:0/3171912688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 msgr2=0x55820f2fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.327+0000 7f9880694740 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f986402aa00 tx=0x7f986403e000 comp rx=0 tx=0).stop 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 -- 172.21.15.6:0/3171912688 shutdown_connections 2024-09-21T08:11:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef50350 0x55820f2fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef2f670 0x55820f2faa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 --2- 172.21.15.6:0/3171912688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef27490 0x55820f2fa530 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 -- 172.21.15.6:0/3171912688 >> 172.21.15.6:0/3171912688 conn(0x55820ef44740 msgr2=0x55820f301730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 -- 172.21.15.6:0/3171912688 shutdown_connections 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 -- 172.21.15.6:0/3171912688 wait complete. 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 -- start start 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 Processor -- start 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.328+0000 7f9880694740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f306ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f3073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98741afcf0 con 0x55820ef50350 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b1160 con 0x55820ef27490 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b03c0 con 0x55820ef2f670 2024-09-21T08:11:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 10 client.0 _ll_register_callbacks cb 0x7f9864009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57240/0 (socket says 172.21.15.6:57240) 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 -- 172.21.15.6:0/1795790126 learned_addr learned my addr 172.21.15.6:0/1795790126 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f98737fe640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f306ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9872ffd640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f3073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 -- 172.21.15.6:0/1795790126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 msgr2=0x55820f3073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f3073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 -- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 msgr2=0x55820f306ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f306ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 -- 172.21.15.6:0/1795790126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55820f3039c0 con 0x55820ef50350 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9872ffd640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f3073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9873fff640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f986c006010 tx=0x7f986c005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8a21555afcc017 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c029070 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f986c01b460 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.329+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9864003d40 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f986c016040 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 10 client.17085 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55820f37fbf0 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9864003d40 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f986c023070 con 0x55820ef50350 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 10 client.17085 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 20 client.17085 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820eee4080 0x55820f382430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 4 client.17085 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55820f26b860 con 0x55820eee4080 2024-09-21T08:11:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.330+0000 7f98737fe640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820eee4080 0x55820f382430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.331+0000 7f9852ffd640 10 client.17085 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.331+0000 7f98737fe640 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820eee4080 0x55820f382430 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44517ffe740f87be server_cookie=3f46d45a092475de in_seq=0 out_seq=0 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.332+0000 7f9852ffd640 1 -- 172.21.15.6:0/1795790126 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55820f26b860 con 0x55820eee4080 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.332+0000 7f9852ffd640 10 client.17085 handle_command_reply: tid=0 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.332+0000 7f9880694740 1 client.17085 shutdown 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.332+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 msgr2=0x55820f307920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.332+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f986c006010 tx=0x7f986c005c20 comp rx=0 tx=0).stop 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 shutdown_connections 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55820eee4080 0x55820f382430 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55820ef2f670 0x55820f3073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9852ffd640 0 client.17085 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55820ef50350 0x55820f307920 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 --2- 172.21.15.6:0/1795790126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55820ef27490 0x55820f306ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 >> 172.21.15.6:0/1795790126 conn(0x55820ef44740 msgr2=0x55820f2fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 shutdown_connections 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 1 -- 172.21.15.6:0/1795790126 wait complete. 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f9880694740 20 client.17085 trim_cache size 0 max 16384 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "e7f7f916-7851-431e-9b4f-9dd6ba508462", 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 msgr2=0x7f985c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 0x7f985c0b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f987406ba20 tx=0x7f9864009560 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 msgr2=0x7f987419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f986800d740 tx=0x7f986800dc00 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 shutdown_connections 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f985c0b6680 0x7f985c0b8b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9874108cf0 0x7f987419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98741083a0 0x7f987419b6b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 --2- 172.21.15.6:0/160727911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9874102a60 0x7f987419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.333+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 >> 172.21.15.6:0/160727911 conn(0x7f9874079730 msgr2=0x7f98741014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.334+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 shutdown_connections 2024-09-21T08:11:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:45.334+0000 7f987a120640 1 -- 172.21.15.6:0/160727911 wait complete. 2024-09-21T08:11:46.508 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:46.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:11:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:46 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:11:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:46 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:46 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:11:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:46 smithi119 ceph-mon[33564]: pgmap v673: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 640 KiB/s wr, 78 op/s 2024-09-21T08:11:47.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:46 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:46 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:11:47.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:46 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:46 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:11:47.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:46 smithi006 ceph-mon[30970]: pgmap v673: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 640 KiB/s wr, 78 op/s 2024-09-21T08:11:47.187 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:46 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:46 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:11:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:46 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:46 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:11:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:46 smithi145 ceph-mon[34049]: pgmap v673: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 640 KiB/s wr, 78 op/s 2024-09-21T08:11:47.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:46 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.432+0000 7f146bd88640 1 -- 172.21.15.6:0/2915514530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14641083a0 msgr2=0x7f14641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.432+0000 7f146bd88640 1 --2- 172.21.15.6:0/2915514530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14641083a0 0x7f14641087b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f145402a410 comp rx=0 tx=0).stop 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.432+0000 7f146bd88640 1 -- 172.21.15.6:0/2915514530 shutdown_connections 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.432+0000 7f146bd88640 1 --2- 172.21.15.6:0/2915514530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464108cf0 0x7f146410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.432+0000 7f146bd88640 1 --2- 172.21.15.6:0/2915514530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14641083a0 0x7f14641087b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.433+0000 7f146bd88640 1 --2- 172.21.15.6:0/2915514530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1464102a60 0x7f1464102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.433+0000 7f146bd88640 1 -- 172.21.15.6:0/2915514530 >> 172.21.15.6:0/2915514530 conn(0x7f1464079730 msgr2=0x7f1464079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.433+0000 7f146bd88640 1 -- 172.21.15.6:0/2915514530 shutdown_connections 2024-09-21T08:11:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.433+0000 7f146bd88640 1 -- 172.21.15.6:0/2915514530 wait complete. 2024-09-21T08:11:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 Processor -- start 2024-09-21T08:11:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 -- start start 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464102a60 0x7f146419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641083a0 0x7f146419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1464112810 con 0x7f1464108cf0 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1464112690 con 0x7f14641083a0 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146bd88640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1464112990 con 0x7f1464102a60 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146a325640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f1469b24640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464102a60 0x7f146419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146a325640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52038/0 (socket says 172.21.15.6:52038) 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f146a325640 1 -- 172.21.15.6:0/3779803773 learned_addr learned my addr 172.21.15.6:0/3779803773 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.434+0000 7f1469323640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641083a0 0x7f146419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 -- 172.21.15.6:0/3779803773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464102a60 msgr2=0x7f146419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464102a60 0x7f146419b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 -- 172.21.15.6:0/3779803773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641083a0 msgr2=0x7f146419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641083a0 0x7f146419b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 -- 172.21.15.6:0/3779803773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14641a63a0 con 0x7f1464108cf0 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146a325640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f145c00eaa0 tx=0x7f145c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f145affd640 1 -- 172.21.15.6:0/3779803773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c004d20 con 0x7f1464108cf0 2024-09-21T08:11:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14641a6690 con 0x7f1464108cf0 2024-09-21T08:11:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14641a6bf0 con 0x7f1464108cf0 2024-09-21T08:11:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f145affd640 1 -- 172.21.15.6:0/3779803773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f145c005020 con 0x7f1464108cf0 2024-09-21T08:11:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.435+0000 7f145affd640 1 -- 172.21.15.6:0/3779803773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0116d0 con 0x7f1464108cf0 2024-09-21T08:11:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.438+0000 7f14722fc740 1 Processor -- start 2024-09-21T08:11:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f145affd640 1 -- 172.21.15.6:0/3779803773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f145c011870 con 0x7f1464108cf0 2024-09-21T08:11:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 -- start start 2024-09-21T08:11:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de63483510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63483f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55de6336edc0 con 0x55de630b4660 2024-09-21T08:11:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55de633fb1f0 con 0x55de630dd520 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f14722fc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55de633ea620 con 0x55de630bc840 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f1469b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f1469b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52054/0 (socket says 172.21.15.6:52054) 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.439+0000 7f1469b24640 1 -- 172.21.15.6:0/1473330733 learned_addr learned my addr 172.21.15.6:0/1473330733 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469323640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de63483510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469323640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63483f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 -- 172.21.15.6:0/1473330733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 msgr2=0x55de63483f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63483f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 -- 172.21.15.6:0/1473330733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 msgr2=0x55de63483510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de63483510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 -- 172.21.15.6:0/1473330733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de633b2fd0 con 0x55de630b4660 2024-09-21T08:11:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469323640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63483f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f145affd640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 0x7f14500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469b24640 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f146000acb0 tx=0x7f146000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7539c954f4bc720f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f144ffff640 1 -- 172.21.15.6:0/1473330733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146001d070 con 0x55de630b4660 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.440+0000 7f1469323640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 0x7f14500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.441+0000 7f145affd640 1 -- 172.21.15.6:0/3779803773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f145c0e7890 con 0x7f1464108cf0 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.441+0000 7f144ffff640 1 -- 172.21.15.6:0/1473330733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1460018ad0 con 0x55de630b4660 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.441+0000 7f144ffff640 1 -- 172.21.15.6:0/1473330733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460010b50 con 0x55de630b4660 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f1469323640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 0x7f14500b8c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1454004770 tx=0x7f1454005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- 172.21.15.6:0/1473330733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 msgr2=0x55de63483a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f146000acb0 tx=0x7f146000f790 comp rx=0 tx=0).stop 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- 172.21.15.6:0/1473330733 shutdown_connections 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63483f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63483a50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 --2- 172.21.15.6:0/1473330733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de63483510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- 172.21.15.6:0/1473330733 >> 172.21.15.6:0/1473330733 conn(0x55de630d1910 msgr2=0x55de63481400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- 172.21.15.6:0/1473330733 shutdown_connections 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- 172.21.15.6:0/1473330733 wait complete. 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 -- start start 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.442+0000 7f14722fc740 1 Processor -- start 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63492f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de634934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55de63385300 con 0x55de630b4660 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55de633ee430 con 0x55de630dd520 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55de6324bbb0 con 0x55de630bc840 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f14722fc740 10 client.0 _ll_register_callbacks cb 0x55de6339f120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f1469b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63492f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58112/0 (socket says 172.21.15.6:58112) 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 -- 172.21.15.6:0/4169325573 learned_addr learned my addr 172.21.15.6:0/4169325573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f1469323640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de634934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 -- 172.21.15.6:0/4169325573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 msgr2=0x55de634934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de634934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 -- 172.21.15.6:0/4169325573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 msgr2=0x55de63492f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.443+0000 7f146a325640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63492f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f146a325640 1 -- 172.21.15.6:0/4169325573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de63374780 con 0x55de630dd520 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f146a325640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f145c0a98d0 tx=0x7f145c0b6c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78abd03acd3b6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f144d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c01f070 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f145c0a8c50 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1460018ad0 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f145c0ace10 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f14722fc740 10 client.26738 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de63148b00 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.444+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f145c0ada00 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f145c00f040 con 0x55de630dd520 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 10 client.26738 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 10 client.26738 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 20 client.26738 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de6309bea0 0x55de634a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 4 client.26738 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1460018ad0 con 0x55de6309bea0 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.445+0000 7f1469b24640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de6309bea0 0x55de634a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f144d7fa640 10 client.26738 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f1469b24640 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de6309bea0 0x55de634a53f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae51ba75360c84d1 server_cookie=86efe78644d4d4b0 in_seq=0 out_seq=0 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f144d7fa640 1 -- 172.21.15.6:0/4169325573 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1460018ad0 con 0x55de6309bea0 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f144d7fa640 10 client.26738 handle_command_reply: tid=0 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f14722fc740 1 client.26738 shutdown 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 msgr2=0x55de6349f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.446+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f145c0a98d0 tx=0x7f145c0b6c50 comp rx=0 tx=0).stop 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 shutdown_connections 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de6309bea0 0x55de634a53f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de634934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f144d7fa640 0 client.26738 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630dd520 0x55de6349f260 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 --2- 172.21.15.6:0/4169325573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63492f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 >> 172.21.15.6:0/4169325573 conn(0x55de630d1910 msgr2=0x55de634866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 shutdown_connections 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 1 -- 172.21.15.6:0/4169325573 wait complete. 2024-09-21T08:11:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.447+0000 7f14722fc740 20 client.26738 trim_cache size 0 max 16384 2024-09-21T08:11:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 Processor -- start 2024-09-21T08:11:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 -- start start 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 0x55de63494e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 0x55de63484c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f144800e040 con 0x55de6309bea0 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14480108a0 con 0x55de630bc840 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.466+0000 7f14722fc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f144800e690 con 0x55de630b4660 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52068/0 (socket says 172.21.15.6:52068) 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 -- 172.21.15.6:0/1788792415 learned_addr learned my addr 172.21.15.6:0/1788792415 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f146a325640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 0x55de63484c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469323640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 0x55de63494e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 -- 172.21.15.6:0/1788792415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 msgr2=0x55de63494e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 0x55de63494e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 -- 172.21.15.6:0/1788792415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 msgr2=0x55de63484c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 0x55de63484c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 -- 172.21.15.6:0/1788792415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de631bf960 con 0x55de6309bea0 2024-09-21T08:11:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f146a325640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 0x55de63484c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469323640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 0x55de63494e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:11:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f1469b24640 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f146000a8d0 tx=0x7f1460005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a5ef16b351f8bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.467+0000 7f144f7fe640 1 -- 172.21.15.6:0/1788792415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460032070 con 0x55de6309bea0 2024-09-21T08:11:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f144f7fe640 1 -- 172.21.15.6:0/1788792415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14600054d0 con 0x55de6309bea0 2024-09-21T08:11:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f144f7fe640 1 -- 172.21.15.6:0/1788792415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146001d040 con 0x55de6309bea0 2024-09-21T08:11:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 -- 172.21.15.6:0/1788792415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 msgr2=0x55de6349f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f146000a8d0 tx=0x7f1460005e80 comp rx=0 tx=0).stop 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 -- 172.21.15.6:0/1788792415 shutdown_connections 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630b4660 0x55de63494e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de630bc840 0x55de63484c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 --2- 172.21.15.6:0/1788792415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de6309bea0 0x55de6349f160 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.468+0000 7f14722fc740 1 -- 172.21.15.6:0/1788792415 >> 172.21.15.6:0/1788792415 conn(0x55de630d1910 msgr2=0x55de63484540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.469+0000 7f14722fc740 1 -- 172.21.15.6:0/1788792415 shutdown_connections 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.469+0000 7f14722fc740 1 -- 172.21.15.6:0/1788792415 wait complete. 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.469+0000 7f14722fc740 1 -- start start 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.469+0000 7f14722fc740 1 Processor -- start 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 0x55de63497d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63508f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f144800ed60 con 0x55de630b4660 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14480101d0 con 0x55de6309bea0 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f144800f430 con 0x55de630bc840 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f14722fc740 10 client.0 _ll_register_callbacks cb 0x7f145c004f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52076/0 (socket says 172.21.15.6:52076) 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 -- 172.21.15.6:0/3216140408 learned_addr learned my addr 172.21.15.6:0/3216140408 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469b24640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 0x55de63497d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f146a325640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63508f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 -- 172.21.15.6:0/3216140408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 msgr2=0x55de63508f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63508f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 -- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 msgr2=0x55de63497d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 0x55de63497d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469323640 1 -- 172.21.15.6:0/3216140408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de63509580 con 0x55de630b4660 2024-09-21T08:11:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f146a325640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63508f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:11:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.470+0000 7f1469b24640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 0x55de63497d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f1469323640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f145402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad8dd349be52f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f144d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454035040 con 0x55de630b4660 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f14540035f0 con 0x55de630b4660 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14600054d0 con 0x55de630b4660 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f14540037f0 con 0x55de630b4660 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f14722fc740 10 client.17103 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.471+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de635109e0 con 0x55de630b4660 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14600054d0 con 0x55de630b4660 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1454047040 con 0x55de630b4660 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 10 client.17103 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 10 client.17103 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 20 client.17103 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de630dd520 0x55de63513200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 4 client.17103 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2a694ba4", "release": true, "await": true}] 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2a694ba4", "release": true, "await": true}) -- 0x55de633fd140 con 0x55de630dd520 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.472+0000 7f1469b24640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de630dd520 0x55de63513200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.473+0000 7f144d7fa640 10 client.17103 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.473+0000 7f1469b24640 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de630dd520 0x55de63513200 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5f8576f2e91cf server_cookie=4a2bb4674df42d73 in_seq=0 out_seq=0 2024-09-21T08:11:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:11:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f144d7fa640 1 -- 172.21.15.6:0/3216140408 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55de633fd140 con 0x55de630dd520 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f144d7fa640 10 client.17103 handle_command_reply: tid=0 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 client.17103 shutdown 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 msgr2=0x55de63498320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f145402a410 comp rx=0 tx=0).stop 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 shutdown_connections 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55de630dd520 0x55de63513200 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f144d7fa640 0 client.17103 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55de630bc840 0x55de63508f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de630b4660 0x55de63498320 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 --2- 172.21.15.6:0/3216140408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55de6309bea0 0x55de63497d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 >> 172.21.15.6:0/3216140408 conn(0x55de630d1910 msgr2=0x55de63487020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 shutdown_connections 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 1 -- 172.21.15.6:0/3216140408 wait complete. 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.908+0000 7f14722fc740 20 client.17103 trim_cache size 0 max 16384 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 44, 2024-09-21T08:11:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "2a694ba4": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 44, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 144.5, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:11:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 msgr2=0x7f14500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 0x7f14500b8c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1454004770 tx=0x7f1454005fd0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 msgr2=0x7f146419bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f145c00eaa0 tx=0x7f145c00eea0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 shutdown_connections 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f14500b6700 0x7f14500b8c10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1464108cf0 0x7f146419bba0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14641083a0 0x7f146419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 --2- 172.21.15.6:0/3779803773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1464102a60 0x7f146419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 >> 172.21.15.6:0/3779803773 conn(0x7f1464079730 msgr2=0x7f1464104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 shutdown_connections 2024-09-21T08:11:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:47.909+0000 7f146bd88640 1 -- 172.21.15.6:0/3779803773 wait complete. 2024-09-21T08:11:48.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 -- 172.21.15.6:0/4193272342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 msgr2=0x7f40ac103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4193272342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac103590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009900 tx=0x7f40a002a400 comp rx=0 tx=0).stop 2024-09-21T08:11:48.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 -- 172.21.15.6:0/4193272342 shutdown_connections 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4193272342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac108d00 0x7f40ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4193272342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac1083b0 0x7f40ac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4193272342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac103590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.013+0000 7f40b42bb640 1 -- 172.21.15.6:0/4193272342 >> 172.21.15.6:0/4193272342 conn(0x7f40ac077c60 msgr2=0x7f40ac0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.014+0000 7f40b42bb640 1 -- 172.21.15.6:0/4193272342 shutdown_connections 2024-09-21T08:11:48.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.014+0000 7f40b42bb640 1 -- 172.21.15.6:0/4193272342 wait complete. 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 Processor -- start 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 -- start start 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac108d00 0x7f40ac1a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac119fc0 con 0x7f40ac108d00 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac119e40 con 0x7f40ac1083b0 2024-09-21T08:11:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.015+0000 7f40b42bb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac11a140 con 0x7f40ac103180 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b2057640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b1856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b2858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac108d00 0x7f40ac1a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b2057640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:46466/0 (socket says 172.21.15.6:46466) 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b2057640 1 -- 172.21.15.6:0/4259724913 learned_addr learned my addr 172.21.15.6:0/4259724913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.016+0000 7f40b1856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58138/0 (socket says 172.21.15.6:58138) 2024-09-21T08:11:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 -- 172.21.15.6:0/4259724913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 msgr2=0x7f40ac1a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 -- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac108d00 msgr2=0x7f40ac1a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac108d00 0x7f40ac1a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 -- 172.21.15.6:0/4259724913 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac1a6920 con 0x7f40ac103180 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b1856640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.017+0000 7f40b2057640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40a002a970 tx=0x7f40a0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.018+0000 7f409f7fe640 1 -- 172.21.15.6:0/4259724913 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a003f070 con 0x7f40ac103180 2024-09-21T08:11:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.018+0000 7f409f7fe640 1 -- 172.21.15.6:0/4259724913 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a003baf0 con 0x7f40ac103180 2024-09-21T08:11:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.018+0000 7f409f7fe640 1 -- 172.21.15.6:0/4259724913 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0035030 con 0x7f40ac103180 2024-09-21T08:11:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.018+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac1a6bb0 con 0x7f40ac103180 2024-09-21T08:11:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.018+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac1ad370 con 0x7f40ac103180 2024-09-21T08:11:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.022+0000 7f40ba82f740 1 Processor -- start 2024-09-21T08:11:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.022+0000 7f40ba82f740 1 -- start start 2024-09-21T08:11:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f409f7fe640 1 -- 172.21.15.6:0/4259724913 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f40a0042070 con 0x7f40ac103180 2024-09-21T08:11:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x557061203650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x557061203b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557061179e50 con 0x557060e3b390 2024-09-21T08:11:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557061169280 con 0x557060e5c070 2024-09-21T08:11:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40ba82f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55706116d090 con 0x557060e331b0 2024-09-21T08:11:48.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40b1856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40b2858640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x557061203650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40b1856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52112/0 (socket says 172.21.15.6:52112) 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.023+0000 7f40b1856640 1 -- 172.21.15.6:0/2263924075 learned_addr learned my addr 172.21.15.6:0/2263924075 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 -- 172.21.15.6:0/2263924075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 msgr2=0x557061203b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x557061203b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 -- 172.21.15.6:0/2263924075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 msgr2=0x557061203650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x557061203650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 -- 172.21.15.6:0/2263924075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557060ec7650 con 0x557060e3b390 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b2858640 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x557061203650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.024+0000 7f40b1856640 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c490 tx=0x7f40a8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a19badf164cb0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f409f7fe640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 0x7f40980b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f409cd9a640 1 -- 172.21.15.6:0/2263924075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a801c070 con 0x557060e3b390 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f409cd9a640 1 -- 172.21.15.6:0/2263924075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a80035f0 con 0x557060e3b390 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f409cd9a640 1 -- 172.21.15.6:0/2263924075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80044c0 con 0x557060e3b390 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f40b2858640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 0x7f40980b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.025+0000 7f409f7fe640 1 -- 172.21.15.6:0/4259724913 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f40a00c9f20 con 0x7f40ac103180 2024-09-21T08:11:48.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 -- 172.21.15.6:0/2263924075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 msgr2=0x5570612040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40b2858640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 0x7f40980b8c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005fd0 tx=0x7f40a400d040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c490 tx=0x7f40a8005f90 comp rx=0 tx=0).stop 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 -- 172.21.15.6:0/2263924075 shutdown_connections 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x557061203b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x5570612040d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 --2- 172.21.15.6:0/2263924075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x557061203650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.026+0000 7f40ba82f740 1 -- 172.21.15.6:0/2263924075 >> 172.21.15.6:0/2263924075 conn(0x557060e50460 msgr2=0x557061201540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.028+0000 7f40ba82f740 1 -- 172.21.15.6:0/2263924075 shutdown_connections 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.028+0000 7f40ba82f740 1 -- 172.21.15.6:0/2263924075 wait complete. 2024-09-21T08:11:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.029+0000 7f40ba82f740 1 -- start start 2024-09-21T08:11:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.029+0000 7f40ba82f740 1 Processor -- start 2024-09-21T08:11:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40b2057640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40b2057640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:46482/0 (socket says 172.21.15.6:46482) 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40b2057640 1 -- 172.21.15.6:0/3300667468 learned_addr learned my addr 172.21.15.6:0/3300667468 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x55706121b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557060fca700 con 0x557060e3b390 2024-09-21T08:11:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557061104110 con 0x557060e5c070 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40b1856640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557061211e30 con 0x557060e331b0 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.030+0000 7f40ba82f740 10 client.0 _ll_register_callbacks cb 0x55706111d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 -- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 msgr2=0x55706121b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x55706121b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 -- 172.21.15.6:0/3300667468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 msgr2=0x55706120f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557061131c40 con 0x557060e331b0 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b1856640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40b2057640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40a0005ab0 tx=0x7f40a00cdb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94705eee693cf53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f4095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:11:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0049070 con 0x557060e331b0 2024-09-21T08:11:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f40a003bca0 con 0x557060e331b0 2024-09-21T08:11:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.031+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a80035f0 con 0x557060e331b0 2024-09-21T08:11:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40a00cd7c0 con 0x557060e331b0 2024-09-21T08:11:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 10 client.26842 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55706121db60 con 0x557060e331b0 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a80035f0 con 0x557060e331b0 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f40a00f5020 con 0x557060e331b0 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 10 client.26842 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 10 client.26842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 20 client.26842 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.032+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e1a9f0 0x5570612210d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.033+0000 7f40ba82f740 4 client.26842 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.033+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55706117bda0 con 0x557060e1a9f0 2024-09-21T08:11:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.033+0000 7f40b1856640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e1a9f0 0x5570612210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.034+0000 7f4095ffb640 10 client.26842 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:48.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.034+0000 7f40b1856640 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e1a9f0 0x5570612210d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fd4e790e63016c server_cookie=8b5caef03651bbde in_seq=0 out_seq=0 2024-09-21T08:11:48.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.035+0000 7f4095ffb640 1 -- 172.21.15.6:0/3300667468 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55706117bda0 con 0x557060e1a9f0 2024-09-21T08:11:48.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.035+0000 7f4095ffb640 10 client.26842 handle_command_reply: tid=0 2024-09-21T08:11:48.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.035+0000 7f40ba82f740 1 client.26842 shutdown 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 msgr2=0x55706120ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40a0005ab0 tx=0x7f40a00cdb40 comp rx=0 tx=0).stop 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 shutdown_connections 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e1a9f0 0x5570612210d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f4095ffb640 0 client.26842 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e5c070 0x55706121b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 --2- 172.21.15.6:0/3300667468 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706120ed20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 >> 172.21.15.6:0/3300667468 conn(0x557060e50460 msgr2=0x5570612067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 shutdown_connections 2024-09-21T08:11:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 1 -- 172.21.15.6:0/3300667468 wait complete. 2024-09-21T08:11:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.036+0000 7f40ba82f740 20 client.26842 trim_cache size 0 max 16384 2024-09-21T08:11:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.067+0000 7f40ba82f740 1 Processor -- start 2024-09-21T08:11:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.067+0000 7f40ba82f740 1 -- start start 2024-09-21T08:11:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.067+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.067+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706121b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.067+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b2057640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40ba82f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b5410 con 0x557060e3b390 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40ba82f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b7c70 con 0x557060e1a9f0 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b2057640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58154/0 (socket says 172.21.15.6:58154) 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40ba82f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b5a60 con 0x557060e331b0 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b2057640 1 -- 172.21.15.6:0/1464884171 learned_addr learned my addr 172.21.15.6:0/1464884171 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706121b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b2858640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 -- 172.21.15.6:0/1464884171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 msgr2=0x557061204d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 -- 172.21.15.6:0/1464884171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 msgr2=0x55706120bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b1856640 1 -- 172.21.15.6:0/1464884171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557061211300 con 0x557060e331b0 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.068+0000 7f40b2057640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.069+0000 7f40b1856640 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706121b050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000c00 tx=0x7f40a800d740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ede311cff8f626 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.069+0000 7f4097fff640 1 -- 172.21.15.6:0/1464884171 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a801c040 con 0x557060e331b0 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.069+0000 7f4097fff640 1 -- 172.21.15.6:0/1464884171 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a80054d0 con 0x557060e331b0 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.069+0000 7f4097fff640 1 -- 172.21.15.6:0/1464884171 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8023bc0 con 0x557060e331b0 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 -- 172.21.15.6:0/1464884171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 msgr2=0x55706121b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706121b050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40a8000c00 tx=0x7f40a800d740 comp rx=0 tx=0).stop 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 -- 172.21.15.6:0/1464884171 shutdown_connections 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e331b0 0x55706121b050 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e3b390 0x55706120bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 --2- 172.21.15.6:0/1464884171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e1a9f0 0x557061204d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.070+0000 7f40ba82f740 1 -- 172.21.15.6:0/1464884171 >> 172.21.15.6:0/1464884171 conn(0x557060e50460 msgr2=0x557061204680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.071+0000 7f40ba82f740 1 -- 172.21.15.6:0/1464884171 shutdown_connections 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.071+0000 7f40ba82f740 1 -- 172.21.15.6:0/1464884171 wait complete. 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.071+0000 7f40ba82f740 1 -- start start 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 Processor -- start 2024-09-21T08:11:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e1a9f0 0x557061213810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 0x55706128aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b6130 con 0x557060e331b0 2024-09-21T08:11:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b75a0 con 0x557060e3b390 2024-09-21T08:11:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1b6800 con 0x557060e1a9f0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40b2057640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e1a9f0 0x557061213810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.072+0000 7f40ba82f740 10 client.0 _ll_register_callbacks cb 0x7f40a0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52142/0 (socket says 172.21.15.6:52142) 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 -- 172.21.15.6:0/4125266995 learned_addr learned my addr 172.21.15.6:0/4125266995 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b2858640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 0x55706128aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 -- 172.21.15.6:0/4125266995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e1a9f0 msgr2=0x557061213810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e1a9f0 0x557061213810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 -- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 msgr2=0x55706128aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 0x55706128aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 -- 172.21.15.6:0/4125266995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55706128afd0 con 0x557060e331b0 2024-09-21T08:11:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b2858640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 0x55706128aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.073+0000 7f40b1856640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f40a800cde0 tx=0x7f40a8003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c05ed0f22370ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f4095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a801c040 con 0x557060e331b0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f40a80050e0 con 0x557060e331b0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a80054d0 con 0x557060e331b0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40a80052e0 con 0x557060e331b0 2024-09-21T08:11:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f40ba82f740 10 client.17121 fetch_fsmap learned FSMap version 21 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.074+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55706128c260 con 0x557060e331b0 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a80054d0 con 0x557060e331b0 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f40a80335a0 con 0x557060e331b0 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 10 client.17121 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 20 client.17121 populate_metadata read hostname 'smithi006' 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e5c070 0x55706128e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 4 client.17121 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557061177850 con 0x557060e5c070 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.075+0000 7f40b2057640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e5c070 0x55706128e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.076+0000 7f4095ffb640 10 client.17121 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.076+0000 7f40b2057640 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e5c070 0x55706128e7d0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad10921381c3920 server_cookie=7afbc65c634a72a2 in_seq=0 out_seq=0 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.076+0000 7f4095ffb640 1 -- 172.21.15.6:0/4125266995 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x557061177850 con 0x557060e5c070 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.076+0000 7f4095ffb640 10 client.17121 handle_command_reply: tid=0 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.076+0000 7f40ba82f740 1 client.17121 shutdown 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 msgr2=0x557061213d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f40a800cde0 tx=0x7f40a8003730 comp rx=0 tx=0).stop 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 shutdown_connections 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557060e5c070 0x55706128e7d0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557060e3b390 0x55706128aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557060e331b0 0x557061213d50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 --2- 172.21.15.6:0/4125266995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557060e1a9f0 0x557061213810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 >> 172.21.15.6:0/4125266995 conn(0x557060e50460 msgr2=0x5570612101d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.077+0000 7f4095ffb640 0 client.17121 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.078+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 shutdown_connections 2024-09-21T08:11:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.078+0000 7f40ba82f740 1 -- 172.21.15.6:0/4125266995 wait complete. 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.078+0000 7f40ba82f740 20 client.17121 trim_cache size 0 max 16384 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "e7f7f916-7851-431e-9b4f-9dd6ba508462", 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:11:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:11:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:11:48.092 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.079+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 msgr2=0x7f40980b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.079+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 0x7f40980b8c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005fd0 tx=0x7f40a400d040 comp rx=0 tx=0).stop 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.079+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 msgr2=0x7f40ac1a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.079+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40a002a970 tx=0x7f40a0003b90 comp rx=0 tx=0).stop 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 shutdown_connections 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f40980b6730 0x7f40980b8c40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40ac108d00 0x7f40ac1a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40ac1083b0 0x7f40ac1a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 --2- 172.21.15.6:0/4259724913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40ac103180 0x7f40ac1a09b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:11:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 >> 172.21.15.6:0/4259724913 conn(0x7f40ac077c60 msgr2=0x7f40ac1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:11:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 shutdown_connections 2024-09-21T08:11:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:11:48.080+0000 7f40b42bb640 1 -- 172.21.15.6:0/4259724913 wait complete. 2024-09-21T08:11:48.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:48 smithi006 ceph-mon[30970]: pgmap v674: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 622 KiB/s wr, 76 op/s 2024-09-21T08:11:49.045 INFO:tasks.cephfs.filesystem:scrub status for tag:e7f7f916-7851-431e-9b4f-9dd6ba508462 - {'path': '/', 'tag': 'e7f7f916-7851-431e-9b4f-9dd6ba508462', 'options': 'recursive,force'} 2024-09-21T08:11:49.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:48 smithi119 ceph-mon[33564]: pgmap v674: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 622 KiB/s wr, 76 op/s 2024-09-21T08:11:49.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:48 smithi145 ceph-mon[34049]: pgmap v674: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 622 KiB/s wr, 76 op/s 2024-09-21T08:11:49.531 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2a694ba4', total seconds elapsed: 31.7 2024-09-21T08:11:51.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:50 smithi119 ceph-mon[33564]: pgmap v675: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 352 KiB/s wr, 44 op/s 2024-09-21T08:11:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:50 smithi145 ceph-mon[34049]: pgmap v675: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 352 KiB/s wr, 44 op/s 2024-09-21T08:11:51.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:50 smithi006 ceph-mon[30970]: pgmap v675: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 352 KiB/s wr, 44 op/s 2024-09-21T08:11:52.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:51 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:11:52.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:51 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:11:52.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:51 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:11:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 535.0 s, 934.2 tps, lat 629.457 ms stddev 3580.994 2024-09-21T08:11:53.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:52 smithi119 ceph-mon[33564]: pgmap v676: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-09-21T08:11:53.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:52 smithi145 ceph-mon[34049]: pgmap v676: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-09-21T08:11:53.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:52 smithi006 ceph-mon[30970]: pgmap v676: 129 pgs: 129 active+clean; 2.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-09-21T08:11:55.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:54 smithi119 ceph-mon[33564]: pgmap v677: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 4.5 MiB/s wr, 237 op/s 2024-09-21T08:11:55.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:54 smithi145 ceph-mon[34049]: pgmap v677: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 4.5 MiB/s wr, 237 op/s 2024-09-21T08:11:55.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:54 smithi006 ceph-mon[30970]: pgmap v677: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 4.5 MiB/s wr, 237 op/s 2024-09-21T08:11:57.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:56 smithi145 ceph-mon[34049]: pgmap v678: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-21T08:11:57.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:56 smithi006 ceph-mon[30970]: pgmap v678: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-21T08:11:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:56 smithi119 ceph-mon[33564]: pgmap v678: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-21T08:11:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 540.0 s, 1051.6 tps, lat 94.631 ms stddev 35.011 2024-09-21T08:11:59.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:11:58 smithi145 ceph-mon[34049]: pgmap v679: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 9.8 MiB/s wr, 541 op/s 2024-09-21T08:11:59.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:11:58 smithi006 ceph-mon[30970]: pgmap v679: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 9.8 MiB/s wr, 541 op/s 2024-09-21T08:11:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:11:58 smithi119 ceph-mon[33564]: pgmap v679: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 9.8 MiB/s wr, 541 op/s 2024-09-21T08:12:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:00 smithi145 ceph-mon[34049]: pgmap v680: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-21T08:12:01.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:00 smithi006 ceph-mon[30970]: pgmap v680: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-21T08:12:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:00 smithi119 ceph-mon[33564]: pgmap v680: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-21T08:12:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:12:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:01 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:12:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:01 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:12:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:01 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 545.0 s, 932.0 tps, lat 105.989 ms stddev 64.086 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: pgmap v681: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:02 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: pgmap v681: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:12:03.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:12:03.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:12:03.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:02 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: pgmap v681: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 15 MiB/s wr, 880 op/s 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:12:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:02 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:12:05.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:04 smithi145 ceph-mon[34049]: pgmap v682: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 15 MiB/s wr, 941 op/s 2024-09-21T08:12:05.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:04 smithi006 ceph-mon[30970]: pgmap v682: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 15 MiB/s wr, 941 op/s 2024-09-21T08:12:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:04 smithi119 ceph-mon[33564]: pgmap v682: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 15 MiB/s wr, 941 op/s 2024-09-21T08:12:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:06 smithi006 ceph-mon[30970]: pgmap v683: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 14 MiB/s wr, 891 op/s 2024-09-21T08:12:07.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:06 smithi006 ceph-mon[30970]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T08:12:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:06 smithi119 ceph-mon[33564]: pgmap v683: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 14 MiB/s wr, 891 op/s 2024-09-21T08:12:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:06 smithi119 ceph-mon[33564]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T08:12:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:06 smithi145 ceph-mon[34049]: pgmap v683: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 14 MiB/s wr, 891 op/s 2024-09-21T08:12:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:06 smithi145 ceph-mon[34049]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T08:12:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 550.0 s, 748.2 tps, lat 135.323 ms stddev 136.820 2024-09-21T08:12:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:09 smithi119 ceph-mon[33564]: pgmap v685: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 14 MiB/s wr, 913 op/s 2024-09-21T08:12:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:09 smithi145 ceph-mon[34049]: pgmap v685: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 14 MiB/s wr, 913 op/s 2024-09-21T08:12:09.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:09 smithi006 ceph-mon[30970]: pgmap v685: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 14 MiB/s wr, 913 op/s 2024-09-21T08:12:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:11 smithi119 ceph-mon[33564]: pgmap v686: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-09-21T08:12:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:11 smithi145 ceph-mon[34049]: pgmap v686: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-09-21T08:12:11.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:11 smithi006 ceph-mon[30970]: pgmap v686: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-09-21T08:12:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 555.0 s, 939.9 tps, lat 106.487 ms stddev 64.421 2024-09-21T08:12:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:13 smithi119 ceph-mon[33564]: pgmap v687: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 12 MiB/s wr, 785 op/s 2024-09-21T08:12:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:13 smithi119 ceph-mon[33564]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:12:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:13 smithi145 ceph-mon[34049]: pgmap v687: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 12 MiB/s wr, 785 op/s 2024-09-21T08:12:13.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:13 smithi145 ceph-mon[34049]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:12:13.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:13 smithi006 ceph-mon[30970]: pgmap v687: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 12 MiB/s wr, 785 op/s 2024-09-21T08:12:13.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:13 smithi006 ceph-mon[30970]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:12:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:15 smithi119 ceph-mon[33564]: pgmap v689: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-21T08:12:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:15 smithi145 ceph-mon[34049]: pgmap v689: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-21T08:12:15.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:15 smithi006 ceph-mon[30970]: pgmap v689: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-21T08:12:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 560.0 s, 931.7 tps, lat 107.521 ms stddev 52.927 2024-09-21T08:12:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:17 smithi119 ceph-mon[33564]: pgmap v690: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 12 MiB/s wr, 806 op/s 2024-09-21T08:12:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:17 smithi145 ceph-mon[34049]: pgmap v690: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 12 MiB/s wr, 806 op/s 2024-09-21T08:12:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:17 smithi006 ceph-mon[30970]: pgmap v690: 129 pgs: 129 active+clean; 2.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 12 MiB/s wr, 806 op/s 2024-09-21T08:12:19.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:12:19.529 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:19.859 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:19 smithi006 ceph-mon[30970]: pgmap v691: 129 pgs: 129 active+clean; 2.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T08:12:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:19 smithi119 ceph-mon[33564]: pgmap v691: 129 pgs: 129 active+clean; 2.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T08:12:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:19 smithi145 ceph-mon[34049]: pgmap v691: 129 pgs: 129 active+clean; 2.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T08:12:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/4285602425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb541049b0 msgr2=0x7fdb54104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/4285602425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb541049b0 0x7fdb54104dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009be0 tx=0x7fdb4402a6d0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/4285602425 shutdown_connections 2024-09-21T08:12:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/4285602425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410de10 0x7fdb54110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/4285602425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/4285602425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb541049b0 0x7fdb54104dc0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009be0 tx=0x7fdb4402a6d0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.194+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/4285602425 >> 172.21.15.6:0/4285602425 conn(0x7fdb54079730 msgr2=0x7fdb54079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.196+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/4285602425 shutdown_connections 2024-09-21T08:12:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.197+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/4285602425 wait complete. 2024-09-21T08:12:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.198+0000 7fdb5a9ea640 1 Processor -- start 2024-09-21T08:12:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.198+0000 7fdb5a9ea640 1 -- start start 2024-09-21T08:12:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 0x7fdb5410b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 0x7fdb541ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:52796/0 (socket says 172.21.15.6:52796) 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb4b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 0x7fdb5410b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54103ff0 con 0x7fdb5410b890 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54103e70 con 0x7fdb54105300 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb5a9ea640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54104170 con 0x7fdb5410de10 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb53fff640 1 -- 172.21.15.6:0/2307850979 learned_addr learned my addr 172.21.15.6:0/2307850979 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.199+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 0x7fdb541ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/2307850979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 msgr2=0x7fdb5410ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 msgr2=0x7fdb541ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 0x7fdb541ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/2307850979 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb541ad060 con 0x7fdb5410de10 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.200+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 0x7fdb541ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.201+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 0x7fdb5410b350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb5406aaa0 tx=0x7fdb3c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.202+0000 7fdb51ffb640 1 -- 172.21.15.6:0/2307850979 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00ccd0 con 0x7fdb5410de10 2024-09-21T08:12:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.202+0000 7fdb51ffb640 1 -- 172.21.15.6:0/2307850979 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb3c0035f0 con 0x7fdb5410de10 2024-09-21T08:12:20.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.203+0000 7fdb51ffb640 1 -- 172.21.15.6:0/2307850979 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c010690 con 0x7fdb5410de10 2024-09-21T08:12:20.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.203+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb541ad350 con 0x7fdb5410de10 2024-09-21T08:12:20.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.203+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541ad810 con 0x7fdb5410de10 2024-09-21T08:12:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.207+0000 7fdb60f5e740 1 Processor -- start 2024-09-21T08:12:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 -- start start 2024-09-21T08:12:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38df0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38df10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ac38d66e50 con 0x55ac38a28390 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac38d56280 con 0x55ac38a201b0 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.208+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ac38d5a090 con 0x55ac38a49070 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb51ffb640 1 -- 172.21.15.6:0/2307850979 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdb3c003aa0 con 0x7fdb5410de10 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb58f87640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb58f87640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50904/0 (socket says 172.21.15.6:50904) 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb58f87640 1 -- 172.21.15.6:0/1351552274 learned_addr learned my addr 172.21.15.6:0/1351552274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb53fff640 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38df0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.209+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38df10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 -- 172.21.15.6:0/1351552274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 msgr2=0x55ac38df0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38df0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 -- 172.21.15.6:0/1351552274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 msgr2=0x55ac38df10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38df10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 -- 172.21.15.6:0/1351552274 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38ab4650 con 0x55ac38a49070 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb58f87640 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009cc0 tx=0x7fdb4c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71054698dea86f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.210+0000 7fdb4a7fc640 1 -- 172.21.15.6:0/1351552274 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c012450 con 0x55ac38a49070 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.211+0000 7fdb4a7fc640 1 -- 172.21.15.6:0/1351552274 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb4c012a80 con 0x55ac38a49070 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.211+0000 7fdb4a7fc640 1 -- 172.21.15.6:0/1351552274 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00fb50 con 0x55ac38a49070 2024-09-21T08:12:20.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.211+0000 7fdb51ffb640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 0x7fdb400b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb51ffb640 1 -- 172.21.15.6:0/2307850979 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fdb3c0e7c60 con 0x7fdb5410de10 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 -- 172.21.15.6:0/1351552274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 msgr2=0x55ac38df0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009cc0 tx=0x7fdb4c0117b0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 -- 172.21.15.6:0/1351552274 shutdown_connections 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38df10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38df0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/1351552274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38df0650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb60f5e740 1 -- 172.21.15.6:0/1351552274 >> 172.21.15.6:0/1351552274 conn(0x55ac38a3d460 msgr2=0x55ac38dee540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.212+0000 7fdb53fff640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 0x7fdb400b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.213+0000 7fdb53fff640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 0x7fdb400b8d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000f80 tx=0x7fdb44005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.214+0000 7fdb60f5e740 1 -- 172.21.15.6:0/1351552274 shutdown_connections 2024-09-21T08:12:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.215+0000 7fdb60f5e740 1 -- 172.21.15.6:0/1351552274 wait complete. 2024-09-21T08:12:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.215+0000 7fdb60f5e740 1 -- start start 2024-09-21T08:12:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 Processor -- start 2024-09-21T08:12:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a201b0 0x55ac38dfbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 0x55ac38dfc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38e08120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ac38bb7700 con 0x55ac38a201b0 2024-09-21T08:12:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac38cf1110 con 0x55ac38a28390 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ac38dfee30 con 0x55ac38a49070 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.216+0000 7fdb4b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 0x55ac38dfc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb4b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 0x55ac38dfc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:52806/0 (socket says 172.21.15.6:52806) 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/2416176800 learned_addr learned my addr 172.21.15.6:0/2416176800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb53fff640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a201b0 0x55ac38dfbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38e08120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb60f5e740 10 client.0 _ll_register_callbacks cb 0x55ac38d0a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 -- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 msgr2=0x55ac38dfc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 0x55ac38dfc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 -- 172.21.15.6:0/2416176800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a201b0 msgr2=0x55ac38dfbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a201b0 0x55ac38dfbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.217+0000 7fdb58f87640 1 -- 172.21.15.6:0/2416176800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38d1ec40 con 0x55ac38a49070 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.218+0000 7fdb58f87640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38e08120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009c90 tx=0x7fdb4c00f4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458acd7aa14662d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.218+0000 7fdb337fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.218+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c029020 con 0x55ac38a49070 2024-09-21T08:12:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.218+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fdb4c00faa0 con 0x55ac38a49070 2024-09-21T08:12:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.218+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb4c012a80 con 0x55ac38a49070 2024-09-21T08:12:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.221+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdb4c00fca0 con 0x55ac38a49070 2024-09-21T08:12:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.221+0000 7fdb60f5e740 10 client.26860 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.221+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ac38e0ab50 con 0x55ac38a49070 2024-09-21T08:12:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.221+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb4c012a80 con 0x55ac38a49070 2024-09-21T08:12:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.222+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdb4c0047d0 con 0x55ac38a49070 2024-09-21T08:12:20.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 10 client.26860 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:20.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 10 client.26860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:20.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 20 client.26860 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac38a079f0 0x55ac38e0dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 4 client.26860 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.225+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac38d68da0 con 0x55ac38a079f0 2024-09-21T08:12:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.226+0000 7fdb53fff640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac38a079f0 0x55ac38e0dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.227+0000 7fdb53fff640 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac38a079f0 0x55ac38e0dfc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cd552d07f0c0797 server_cookie=b38949522636ed0d in_seq=0 out_seq=0 2024-09-21T08:12:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.227+0000 7fdb337fe640 10 client.26860 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.227+0000 7fdb337fe640 1 -- 172.21.15.6:0/2416176800 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac38d68da0 con 0x55ac38a079f0 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.227+0000 7fdb337fe640 10 client.26860 handle_command_reply: tid=0 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 client.26860 shutdown 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 msgr2=0x55ac38e08120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38e08120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009c90 tx=0x7fdb4c00f4b0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 shutdown_connections 2024-09-21T08:12:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac38a079f0 0x55ac38e0dfc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38e08120 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a28390 0x55ac38dfc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/2416176800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a201b0 0x55ac38dfbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 >> 172.21.15.6:0/2416176800 conn(0x55ac38a3d460 msgr2=0x55ac38df37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb337fe640 0 client.26860 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 shutdown_connections 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 1 -- 172.21.15.6:0/2416176800 wait complete. 2024-09-21T08:12:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.228+0000 7fdb60f5e740 20 client.26860 trim_cache size 0 max 16384 2024-09-21T08:12:20.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.264+0000 7fdb60f5e740 1 Processor -- start 2024-09-21T08:12:20.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.264+0000 7fdb60f5e740 1 -- start start 2024-09-21T08:12:20.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38dedb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38dee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b5cf0 con 0x55ac38a28390 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b8550 con 0x55ac38a201b0 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb60f5e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b6340 con 0x55ac38a49070 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:52814/0 (socket says 172.21.15.6:52814) 2024-09-21T08:12:20.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.265+0000 7fdb53fff640 1 -- 172.21.15.6:0/3519235825 learned_addr learned my addr 172.21.15.6:0/3519235825 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38dedb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 -- 172.21.15.6:0/3519235825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 msgr2=0x55ac38dee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38dee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 -- 172.21.15.6:0/3519235825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 msgr2=0x55ac38dedb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38dedb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 -- 172.21.15.6:0/3519235825 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38dfac90 con 0x55ac38a201b0 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38dedb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:12:20.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.266+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb44004af0 tx=0x7fdb4403f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a72983b0907f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.267+0000 7fdb49ffb640 1 -- 172.21.15.6:0/3519235825 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44059070 con 0x55ac38a201b0 2024-09-21T08:12:20.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.267+0000 7fdb49ffb640 1 -- 172.21.15.6:0/3519235825 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb44037040 con 0x55ac38a201b0 2024-09-21T08:12:20.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.267+0000 7fdb49ffb640 1 -- 172.21.15.6:0/3519235825 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44036040 con 0x55ac38a201b0 2024-09-21T08:12:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.268+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3519235825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 msgr2=0x55ac38dfc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.268+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb44004af0 tx=0x7fdb4403f000 comp rx=0 tx=0).stop 2024-09-21T08:12:20.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.270+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3519235825 shutdown_connections 2024-09-21T08:12:20.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.270+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a49070 0x55ac38dee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.270+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a28390 0x55ac38dedb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.270+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3519235825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38dfc1f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.270+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3519235825 >> 172.21.15.6:0/3519235825 conn(0x55ac38a3d460 msgr2=0x55ac38dfbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.271+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3519235825 shutdown_connections 2024-09-21T08:12:20.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.271+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3519235825 wait complete. 2024-09-21T08:12:20.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.272+0000 7fdb60f5e740 1 -- start start 2024-09-21T08:12:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.272+0000 7fdb60f5e740 1 Processor -- start 2024-09-21T08:12:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 0x55ac38e0ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:52826/0 (socket says 172.21.15.6:52826) 2024-09-21T08:12:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb53fff640 1 -- 172.21.15.6:0/3626851847 learned_addr learned my addr 172.21.15.6:0/3626851847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a49070 0x55ac38e0f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b6a10 con 0x55ac38a49070 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b7e80 con 0x55ac38a201b0 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541b70e0 con 0x55ac38a28390 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb60f5e740 10 client.0 _ll_register_callbacks cb 0x7fdb4c009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.273+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 0x55ac38e0ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 msgr2=0x55ac38e11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/3626851847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a49070 msgr2=0x55ac38e0f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a49070 0x55ac38e0f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb4b7fe640 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38e77740 con 0x55ac38a28390 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.274+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.275+0000 7fdb4b7fe640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 0x55ac38e0ef40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0a9c40 tx=0x7fdb3c0e54f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd0fe2e5080a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.275+0000 7fdb337fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.275+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0ad180 con 0x55ac38a28390 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.275+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fdb3c0b6040 con 0x55ac38a28390 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.275+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb44037040 con 0x55ac38a28390 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.276+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdb3c0add70 con 0x55ac38a28390 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.276+0000 7fdb60f5e740 10 client.26863 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.276+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ac38e788a0 con 0x55ac38a28390 2024-09-21T08:12:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.278+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb3c0b2150 con 0x55ac38a28390 2024-09-21T08:12:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdb3c0ac340 con 0x55ac38a28390 2024-09-21T08:12:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 10 client.26863 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 10 client.26863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 20 client.26863 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac389dcda0 0x55ac38e7b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 4 client.26863 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:12:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fdb44037040 con 0x55ac389dcda0 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.279+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac389dcda0 0x55ac38e7b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.280+0000 7fdb53fff640 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac389dcda0 0x55ac38e7b010 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656bef000c81c647 server_cookie=a0c7899a151a46a0 in_seq=0 out_seq=0 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.280+0000 7fdb337fe640 10 client.26863 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.280+0000 7fdb337fe640 1 -- 172.21.15.6:0/3626851847 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x7fdb44037040 con 0x55ac389dcda0 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.280+0000 7fdb337fe640 10 client.26863 handle_command_reply: tid=0 2024-09-21T08:12:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.280+0000 7fdb60f5e740 1 client.26863 shutdown 2024-09-21T08:12:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.282+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 msgr2=0x55ac38e0ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.282+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 0x55ac38e0ef40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0a9c40 tx=0x7fdb3c0e54f0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.282+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 shutdown_connections 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.282+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ac389dcda0 0x55ac38e7b010 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.282+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ac38a28390 0x55ac38e0ef40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.283+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac38a49070 0x55ac38e0f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.283+0000 7fdb337fe640 0 client.26863 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.283+0000 7fdb60f5e740 1 --2- 172.21.15.6:0/3626851847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac38a201b0 0x55ac38e11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.283+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 >> 172.21.15.6:0/3626851847 conn(0x55ac38a3d460 msgr2=0x55ac38df36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.284+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 shutdown_connections 2024-09-21T08:12:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.284+0000 7fdb60f5e740 1 -- 172.21.15.6:0/3626851847 wait complete. 2024-09-21T08:12:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.284+0000 7fdb60f5e740 20 client.26863 trim_cache size 0 max 16384 2024-09-21T08:12:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:12:20.287 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:12:20.287 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:12:20.288 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:12:20.288 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:12:20.288 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:12:20.288 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.290 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.292 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.294 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:12:20.295 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:12:20.296 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.297 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:20.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:20.299 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:20.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:20.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 msgr2=0x7fdb400b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 0x7fdb400b8d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000f80 tx=0x7fdb44005fd0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 msgr2=0x7fdb5410b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 0x7fdb5410b350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb5406aaa0 tx=0x7fdb3c00ee50 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 shutdown_connections 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdb400b6800 0x7fdb400b8d10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb5410de10 0x7fdb5410b350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5410b890 0x7fdb541ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 --2- 172.21.15.6:0/2307850979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb54105300 0x7fdb5410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 >> 172.21.15.6:0/2307850979 conn(0x7fdb54079730 msgr2=0x7fdb541006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 shutdown_connections 2024-09-21T08:12:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:20.287+0000 7fdb5a9ea640 1 -- 172.21.15.6:0/2307850979 wait complete. 2024-09-21T08:12:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:21 smithi119 ceph-mon[33564]: pgmap v692: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 13 MiB/s wr, 878 op/s 2024-09-21T08:12:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:21 smithi145 ceph-mon[34049]: pgmap v692: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 13 MiB/s wr, 878 op/s 2024-09-21T08:12:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:21 smithi006 ceph-mon[30970]: pgmap v692: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 13 MiB/s wr, 878 op/s 2024-09-21T08:12:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 565.0 s, 838.2 tps, lat 118.826 ms stddev 65.115 2024-09-21T08:12:22.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:22 smithi119 ceph-mon[33564]: pgmap v693: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-21T08:12:22.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:22 smithi145 ceph-mon[34049]: pgmap v693: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-21T08:12:22.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:22 smithi006 ceph-mon[30970]: pgmap v693: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-21T08:12:23.387 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:12:23.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:12:23.867 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:25.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:24 smithi119 ceph-mon[33564]: pgmap v694: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-21T08:12:25.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:24 smithi145 ceph-mon[34049]: pgmap v694: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-21T08:12:25.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:24 smithi006 ceph-mon[30970]: pgmap v694: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-21T08:12:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.583+0000 7fdf460ac640 1 -- 172.21.15.6:0/4230559052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf401083a0 msgr2=0x7fdf401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:25.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.583+0000 7fdf460ac640 1 --2- 172.21.15.6:0/4230559052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf401083a0 0x7fdf401087b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009860 tx=0x7fdf3002a340 comp rx=0 tx=0).stop 2024-09-21T08:12:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 -- 172.21.15.6:0/4230559052 shutdown_connections 2024-09-21T08:12:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 --2- 172.21.15.6:0/4230559052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 --2- 172.21.15.6:0/4230559052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf401083a0 0x7fdf401087b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 --2- 172.21.15.6:0/4230559052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40102a60 0x7fdf40102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 -- 172.21.15.6:0/4230559052 >> 172.21.15.6:0/4230559052 conn(0x7fdf40079730 msgr2=0x7fdf40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 -- 172.21.15.6:0/4230559052 shutdown_connections 2024-09-21T08:12:25.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.588+0000 7fdf460ac640 1 -- 172.21.15.6:0/4230559052 wait complete. 2024-09-21T08:12:25.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.589+0000 7fdf460ac640 1 Processor -- start 2024-09-21T08:12:25.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.590+0000 7fdf460ac640 1 -- start start 2024-09-21T08:12:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 0x7fdf4010f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 0x7fdf4010f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401118b0 con 0x7fdf401083a0 2024-09-21T08:12:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40111730 con 0x7fdf40102a60 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf460ac640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40111a30 con 0x7fdf40108cf0 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf3ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf3ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50940/0 (socket says 172.21.15.6:50940) 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf3ffff640 1 -- 172.21.15.6:0/2117332221 learned_addr learned my addr 172.21.15.6:0/2117332221 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf3f7fe640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 0x7fdf4010f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.593+0000 7fdf3effd640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 0x7fdf4010f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 -- 172.21.15.6:0/2117332221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 msgr2=0x7fdf4010f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 0x7fdf4010f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 -- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 msgr2=0x7fdf4010f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 0x7fdf4010f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 -- 172.21.15.6:0/2117332221 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf40075340 con 0x7fdf40108cf0 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3effd640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 0x7fdf4010f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3f7fe640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 0x7fdf4010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3ffff640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e970 tx=0x7fdf3400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.594+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400ccc0 con 0x7fdf40108cf0 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.595+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4006e330 con 0x7fdf40108cf0 2024-09-21T08:12:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.595+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4006e840 con 0x7fdf40108cf0 2024-09-21T08:12:25.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.596+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf3400ce60 con 0x7fdf40108cf0 2024-09-21T08:12:25.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.596+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34010430 con 0x7fdf40108cf0 2024-09-21T08:12:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.598+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c0052c0 con 0x7fdf40108cf0 2024-09-21T08:12:25.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.600+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdf340046c0 con 0x7fdf40108cf0 2024-09-21T08:12:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.601+0000 7fdf3cff9640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 0x7fdf280b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.601+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fdf340e7d60 con 0x7fdf40108cf0 2024-09-21T08:12:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.601+0000 7fdf3f7fe640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 0x7fdf280b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.602+0000 7fdf3f7fe640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 0x7fdf280b8c40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009fd0 tx=0x7fdf38009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.606+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf340ade70 con 0x7fdf40108cf0 2024-09-21T08:12:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.996+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf2c005880 con 0x7fdf40108cf0 2024-09-21T08:12:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:25.997+0000 7fdf3cff9640 1 -- 172.21.15.6:0/2117332221 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fdf340b2250 con 0x7fdf40108cf0 2024-09-21T08:12:25.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:12:25.999 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:12:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:12:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 msgr2=0x7fdf280b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 0x7fdf280b8c40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009fd0 tx=0x7fdf38009680 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 msgr2=0x7fdf4006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e970 tx=0x7fdf3400ed70 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 shutdown_connections 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf280b6730 0x7fdf280b8c40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf40108cf0 0x7fdf4006ddf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf401083a0 0x7fdf4010f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 --2- 172.21.15.6:0/2117332221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf40102a60 0x7fdf4010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 >> 172.21.15.6:0/2117332221 conn(0x7fdf40079730 msgr2=0x7fdf40101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.001+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 shutdown_connections 2024-09-21T08:12:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:26.002+0000 7fdf460ac640 1 -- 172.21.15.6:0/2117332221 wait complete. 2024-09-21T08:12:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:26 smithi119 ceph-mon[33564]: pgmap v695: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 781 op/s 2024-09-21T08:12:27.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:26 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2117332221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:27.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:26 smithi145 ceph-mon[34049]: pgmap v695: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 781 op/s 2024-09-21T08:12:27.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:26 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2117332221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:27.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:26 smithi006 ceph-mon[30970]: pgmap v695: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 781 op/s 2024-09-21T08:12:27.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:26 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2117332221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 570.0 s, 743.2 tps, lat 132.199 ms stddev 81.308 2024-09-21T08:12:27.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:12:28.420 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:29.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.040+0000 7fb143fff640 1 -- 172.21.15.6:0/1395320508 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144031d80 con 0x7fb14c115360 2024-09-21T08:12:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 -- 172.21.15.6:0/1395320508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c115360 msgr2=0x7fb14c117830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 --2- 172.21.15.6:0/1395320508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c115360 0x7fb14c117830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb144009ca0 tx=0x7fb14402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 -- 172.21.15.6:0/1395320508 shutdown_connections 2024-09-21T08:12:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 --2- 172.21.15.6:0/1395320508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c115360 0x7fb14c117830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 --2- 172.21.15.6:0/1395320508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c10c880 0x7fb14c114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 --2- 172.21.15.6:0/1395320508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 0x7fb14c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.042+0000 7fb15210b640 1 -- 172.21.15.6:0/1395320508 >> 172.21.15.6:0/1395320508 conn(0x7fb14c06e9f0 msgr2=0x7fb14c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.043+0000 7fb15210b640 1 -- 172.21.15.6:0/1395320508 shutdown_connections 2024-09-21T08:12:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.043+0000 7fb15210b640 1 -- 172.21.15.6:0/1395320508 wait complete. 2024-09-21T08:12:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 Processor -- start 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 -- start start 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 0x7fb14c119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 0x7fb14c1181f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c11bfb0 con 0x7fb14c115360 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c11be30 con 0x7fb14c10bf30 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.044+0000 7fb15210b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c11c130 con 0x7fb14c10c880 2024-09-21T08:12:29.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.045+0000 7fb15190a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.045+0000 7fb15190a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45806/0 (socket says 172.21.15.6:45806) 2024-09-21T08:12:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.045+0000 7fb15190a640 1 -- 172.21.15.6:0/1028742392 learned_addr learned my addr 172.21.15.6:0/1028742392 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.045+0000 7fb151109640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 0x7fb14c119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb150908640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 0x7fb14c1181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 -- 172.21.15.6:0/1028742392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 msgr2=0x7fb14c1181f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 0x7fb14c1181f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 -- 172.21.15.6:0/1028742392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 msgr2=0x7fb14c119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 0x7fb14c119c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 -- 172.21.15.6:0/1028742392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c118f50 con 0x7fb14c115360 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb150908640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 0x7fb14c1181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.046+0000 7fb15190a640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb144005e30 tx=0x7fb1440093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.047+0000 7fb1427fc640 1 -- 172.21.15.6:0/1028742392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144032d10 con 0x7fb14c115360 2024-09-21T08:12:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.047+0000 7fb1427fc640 1 -- 172.21.15.6:0/1028742392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb144032eb0 con 0x7fb14c115360 2024-09-21T08:12:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.047+0000 7fb1427fc640 1 -- 172.21.15.6:0/1028742392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144030b20 con 0x7fb14c115360 2024-09-21T08:12:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.047+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1a6b20 con 0x7fb14c115360 2024-09-21T08:12:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.047+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1a7010 con 0x7fb14c115360 2024-09-21T08:12:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.052+0000 7fb1598e1740 1 Processor -- start 2024-09-21T08:12:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.053+0000 7fb1427fc640 1 -- 172.21.15.6:0/1028742392 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb144030cc0 con 0x7fb14c115360 2024-09-21T08:12:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 -- start start 2024-09-21T08:12:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1427fc640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 0x7fb1380b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee83b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1427fc640 1 -- 172.21.15.6:0/1028742392 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fb144108cb0 con 0x7fb14c115360 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bbee7b1ea0 con 0x55bbee46b1b0 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bbee7a12d0 con 0x55bbee473390 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb1598e1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bbee7a50e0 con 0x55bbee494070 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb150908640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 0x7fb1380b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb150908640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb150908640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45816/0 (socket says 172.21.15.6:45816) 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb150908640 1 -- 172.21.15.6:0/2822243733 learned_addr learned my addr 172.21.15.6:0/2822243733 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb15190a640 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.055+0000 7fb151109640 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee83b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 -- 172.21.15.6:0/2822243733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 msgr2=0x55bbee83b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee83b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 -- 172.21.15.6:0/2822243733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 msgr2=0x55bbee83c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 -- 172.21.15.6:0/2822243733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbee4ff650 con 0x55bbee46b1b0 2024-09-21T08:12:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.056+0000 7fb150908640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 0x7fb1380b8ce0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009fd0 tx=0x7fb13c009aa0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.057+0000 7fb150908640 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0117b0 tx=0x7fb13c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba928f78edee941 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.057+0000 7fb1377fe640 1 -- 172.21.15.6:0/2822243733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c014270 con 0x55bbee46b1b0 2024-09-21T08:12:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.058+0000 7fb1377fe640 1 -- 172.21.15.6:0/2822243733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb13c0054b0 con 0x55bbee46b1b0 2024-09-21T08:12:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.058+0000 7fb1377fe640 1 -- 172.21.15.6:0/2822243733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0047a0 con 0x55bbee46b1b0 2024-09-21T08:12:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 -- 172.21.15.6:0/2822243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 msgr2=0x55bbee83bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0117b0 tx=0x7fb13c01b000 comp rx=0 tx=0).stop 2024-09-21T08:12:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 -- 172.21.15.6:0/2822243733 shutdown_connections 2024-09-21T08:12:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee83bda0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 --2- 172.21.15.6:0/2822243733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee83b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.060+0000 7fb1598e1740 1 -- 172.21.15.6:0/2822243733 >> 172.21.15.6:0/2822243733 conn(0x55bbee488460 msgr2=0x55bbee839750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.063+0000 7fb1598e1740 1 -- 172.21.15.6:0/2822243733 shutdown_connections 2024-09-21T08:12:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.064+0000 7fb1598e1740 1 -- 172.21.15.6:0/2822243733 wait complete. 2024-09-21T08:12:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.064+0000 7fb1598e1740 1 -- start start 2024-09-21T08:12:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.064+0000 7fb1598e1740 1 Processor -- start 2024-09-21T08:12:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee847460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee853400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bbee602700 con 0x55bbee46b1b0 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bbee73c160 con 0x55bbee473390 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bbee84a080 con 0x55bbee494070 2024-09-21T08:12:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb1598e1740 10 client.0 _ll_register_callbacks cb 0x55bbee7559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb151109640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb151109640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45832/0 (socket says 172.21.15.6:45832) 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.065+0000 7fb151109640 1 -- 172.21.15.6:0/3977780738 learned_addr learned my addr 172.21.15.6:0/3977780738 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb15190a640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee853400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb150908640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee847460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb151109640 1 -- 172.21.15.6:0/3977780738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 msgr2=0x55bbee853400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb151109640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee853400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb151109640 1 -- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 msgr2=0x55bbee847460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb151109640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee847460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.066+0000 7fb151109640 1 -- 172.21.15.6:0/3977780738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbee769c90 con 0x55bbee46b1b0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.067+0000 7fb151109640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb14800b940 tx=0x7fb14800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e323d0387bead4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.067+0000 7fb134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.067+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14801b470 con 0x55bbee46b1b0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.067+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb13c0054b0 con 0x55bbee46b1b0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.068+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fb14801b610 con 0x55bbee46b1b0 2024-09-21T08:12:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.068+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb14801b810 con 0x55bbee46b1b0 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.068+0000 7fb1598e1740 10 client.17151 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.068+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bbee855e70 con 0x55bbee46b1b0 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb13c0054b0 con 0x55bbee46b1b0 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb148025590 con 0x55bbee46b1b0 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 10 client.17151 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 20 client.17151 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee4529f0 0x55bbee859770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 4 client.17151 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.069+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbee7b3df0 con 0x55bbee4529f0 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.070+0000 7fb150908640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee4529f0 0x55bbee859770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.070+0000 7fb134ff9640 10 client.17151 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.070+0000 7fb150908640 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee4529f0 0x55bbee859770 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf79d864132295a server_cookie=73082c856f26ed54 in_seq=0 out_seq=0 2024-09-21T08:12:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.072+0000 7fb134ff9640 1 -- 172.21.15.6:0/3977780738 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbee7b3df0 con 0x55bbee4529f0 2024-09-21T08:12:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.072+0000 7fb134ff9640 10 client.17151 handle_command_reply: tid=0 2024-09-21T08:12:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.073+0000 7fb1598e1740 1 client.17151 shutdown 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.073+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 msgr2=0x55bbee846f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.073+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb14800b940 tx=0x7fb14800bd40 comp rx=0 tx=0).stop 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 shutdown_connections 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee4529f0 0x55bbee859770 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee853400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee847460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 --2- 172.21.15.6:0/3977780738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee846f20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 >> 172.21.15.6:0/3977780738 conn(0x55bbee488460 msgr2=0x55bbee83e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.074+0000 7fb134ff9640 0 client.17151 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.075+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 shutdown_connections 2024-09-21T08:12:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.075+0000 7fb1598e1740 1 -- 172.21.15.6:0/3977780738 wait complete. 2024-09-21T08:12:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.076+0000 7fb1598e1740 20 client.17151 trim_cache size 0 max 16384 2024-09-21T08:12:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.102+0000 7fb1598e1740 1 Processor -- start 2024-09-21T08:12:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.102+0000 7fb1598e1740 1 -- start start 2024-09-21T08:12:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee46b1b0 0x55bbee845e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 0x55bbee838d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb150908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb150908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39064/0 (socket says 172.21.15.6:39064) 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.103+0000 7fb150908640 1 -- 172.21.15.6:0/242331661 learned_addr learned my addr 172.21.15.6:0/242331661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.104+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb13000e0e0 con 0x55bbee494070 2024-09-21T08:12:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.104+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb130010940 con 0x55bbee473390 2024-09-21T08:12:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.104+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb13000e730 con 0x55bbee46b1b0 2024-09-21T08:12:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.106+0000 7fb15190a640 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 0x55bbee838d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.106+0000 7fb151109640 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee46b1b0 0x55bbee845e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 -- 172.21.15.6:0/242331661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee46b1b0 msgr2=0x55bbee845e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee46b1b0 0x55bbee845e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 -- 172.21.15.6:0/242331661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 msgr2=0x55bbee83cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 -- 172.21.15.6:0/242331661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbee847690 con 0x55bbee494070 2024-09-21T08:12:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.107+0000 7fb15190a640 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 0x55bbee838d20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb144106020 tx=0x7fb1440ce600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac04e38639e4565 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.108+0000 7fb136ffd640 1 -- 172.21.15.6:0/242331661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440ce230 con 0x55bbee494070 2024-09-21T08:12:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.109+0000 7fb136ffd640 1 -- 172.21.15.6:0/242331661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb144036030 con 0x55bbee494070 2024-09-21T08:12:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.109+0000 7fb136ffd640 1 -- 172.21.15.6:0/242331661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440cdbe0 con 0x55bbee494070 2024-09-21T08:12:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.111+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 msgr2=0x55bbee838d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 0x55bbee838d20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb144106020 tx=0x7fb1440ce600 comp rx=0 tx=0).stop 2024-09-21T08:12:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 shutdown_connections 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee494070 0x55bbee838d20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee83cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 --2- 172.21.15.6:0/242331661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee46b1b0 0x55bbee845e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 >> 172.21.15.6:0/242331661 conn(0x55bbee488460 msgr2=0x55bbee83c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 shutdown_connections 2024-09-21T08:12:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.112+0000 7fb1598e1740 1 -- 172.21.15.6:0/242331661 wait complete. 2024-09-21T08:12:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.113+0000 7fb1598e1740 1 -- start start 2024-09-21T08:12:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.113+0000 7fb1598e1740 1 Processor -- start 2024-09-21T08:12:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee84f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb1598e1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee84b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb1598e1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb13000ee00 con 0x55bbee46b1b0 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb150908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb150908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39068/0 (socket says 172.21.15.6:39068) 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb150908640 1 -- 172.21.15.6:0/4168951537 learned_addr learned my addr 172.21.15.6:0/4168951537 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb151109640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee84f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb15190a640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee84b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.114+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb130010270 con 0x55bbee473390 2024-09-21T08:12:29.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb13000f4d0 con 0x55bbee494070 2024-09-21T08:12:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb1598e1740 10 client.0 _ll_register_callbacks cb 0x7fb148004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 -- 172.21.15.6:0/4168951537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 msgr2=0x55bbee84b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee84b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 -- 172.21.15.6:0/4168951537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 msgr2=0x55bbee84f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee84f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbee84b7d0 con 0x55bbee473390 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb150908640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0095f0 tx=0x7fb13c00fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f533bdafdb09b287 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.115+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb144036030 con 0x55bbee473390 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb134ff9640 1 -- 172.21.15.6:0/4168951537 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0142b0 con 0x55bbee473390 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb134ff9640 1 -- 172.21.15.6:0/4168951537 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fb13c00fac0 con 0x55bbee473390 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb134ff9640 1 -- 172.21.15.6:0/4168951537 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb13c00fcc0 con 0x55bbee473390 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb1598e1740 10 client.26798 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55bbee8c3c80 con 0x55bbee473390 2024-09-21T08:12:29.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.116+0000 7fb134ff9640 1 -- 172.21.15.6:0/4168951537 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb13c004020 con 0x55bbee473390 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 10 client.26798 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 10 client.26798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 20 client.26798 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee427da0 0x55bbee8c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 4 client.26798 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb144036030 con 0x55bbee427da0 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.117+0000 7fb151109640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee427da0 0x55bbee8c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.118+0000 7fb151109640 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee427da0 0x55bbee8c6070 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2137f8a9be6d42de server_cookie=ebfc51acd4bee735 in_seq=0 out_seq=0 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.118+0000 7fb134ff9640 10 client.26798 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.118+0000 7fb134ff9640 1 -- 172.21.15.6:0/4168951537 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb144036030 con 0x55bbee427da0 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.118+0000 7fb134ff9640 10 client.26798 handle_command_reply: tid=0 2024-09-21T08:12:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.118+0000 7fb1598e1740 1 client.26798 shutdown 2024-09-21T08:12:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.119+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 msgr2=0x55bbee84ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.119+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0095f0 tx=0x7fb13c00fa50 comp rx=0 tx=0).stop 2024-09-21T08:12:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.119+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 shutdown_connections 2024-09-21T08:12:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.119+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bbee427da0 0x55bbee8c6070 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bbee494070 0x55bbee84b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb134ff9640 0 client.26798 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bbee473390 0x55bbee84ad50 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0095f0 tx=0x7fb13c00fa50 comp rx=0 tx=0).stop 2024-09-21T08:12:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 --2- 172.21.15.6:0/4168951537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbee46b1b0 0x55bbee84f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 >> 172.21.15.6:0/4168951537 conn(0x55bbee488460 msgr2=0x55bbee848350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:28 smithi006 ceph-mon[30970]: pgmap v696: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:12:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 shutdown_connections 2024-09-21T08:12:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 1 -- 172.21.15.6:0/4168951537 wait complete. 2024-09-21T08:12:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.120+0000 7fb1598e1740 20 client.26798 trim_cache size 0 max 16384 2024-09-21T08:12:29.123 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 msgr2=0x7fb1380b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 0x7fb1380b8ce0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009fd0 tx=0x7fb13c009aa0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 msgr2=0x7fb14c118730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb144005e30 tx=0x7fb1440093d0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 shutdown_connections 2024-09-21T08:12:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb1380b67d0 0x7fb1380b8ce0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb14c10c880 0x7fb14c1181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb14c115360 0x7fb14c118730 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 --2- 172.21.15.6:0/1028742392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb14c10bf30 0x7fb14c119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 >> 172.21.15.6:0/1028742392 conn(0x7fb14c06e9f0 msgr2=0x7fb14c072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 shutdown_connections 2024-09-21T08:12:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:29.122+0000 7fb15210b640 1 -- 172.21.15.6:0/1028742392 wait complete. 2024-09-21T08:12:29.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:28 smithi119 ceph-mon[33564]: pgmap v696: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:12:29.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:28 smithi145 ceph-mon[34049]: pgmap v696: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:12:30.985 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:12:30.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:12:31.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:30 smithi145 ceph-mon[34049]: pgmap v697: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-21T08:12:31.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:30 smithi006 ceph-mon[30970]: pgmap v697: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-21T08:12:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:30 smithi119 ceph-mon[33564]: pgmap v697: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-21T08:12:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 575.0 s, 759.4 tps, lat 134.138 ms stddev 135.346 2024-09-21T08:12:33.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:32 smithi145 ceph-mon[34049]: pgmap v698: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:32 smithi006 ceph-mon[30970]: pgmap v698: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:33.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:32 smithi119 ceph-mon[33564]: pgmap v698: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.757+0000 7effe641e640 1 -- 172.21.15.6:0/2824463044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 msgr2=0x7effe0118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.757+0000 7effe641e640 1 --2- 172.21.15.6:0/2824463044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe0118b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7effd8009ca0 tx=0x7effd802a8e0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 -- 172.21.15.6:0/2824463044 shutdown_connections 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 --2- 172.21.15.6:0/2824463044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010aee0 0x7effe0115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 --2- 172.21.15.6:0/2824463044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe0118b50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 --2- 172.21.15.6:0/2824463044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010a590 0x7effe010a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 -- 172.21.15.6:0/2824463044 >> 172.21.15.6:0/2824463044 conn(0x7effe0070ec0 msgr2=0x7effe00712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 -- 172.21.15.6:0/2824463044 shutdown_connections 2024-09-21T08:12:33.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.758+0000 7effe641e640 1 -- 172.21.15.6:0/2824463044 wait complete. 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.759+0000 7effe641e640 1 Processor -- start 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.759+0000 7effe641e640 1 -- start start 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.760+0000 7effe641e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.760+0000 7effe641e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.760+0000 7effe641e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe01aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.760+0000 7effdf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effdffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effdffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43690/0 (socket says 172.21.15.6:43690) 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effdf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45870/0 (socket says 172.21.15.6:45870) 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effe641e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effe011e3d0 con 0x7effe010aee0 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effe641e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe011e250 con 0x7effe0116640 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effe641e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effe011e550 con 0x7effe010a590 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effdffff640 1 -- 172.21.15.6:0/692177896 learned_addr learned my addr 172.21.15.6:0/692177896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effdffff640 1 -- 172.21.15.6:0/692177896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 msgr2=0x7effe01aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.761+0000 7effe49bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe01aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.762+0000 7effdffff640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe01aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.762+0000 7effdffff640 1 -- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 msgr2=0x7effe01a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.762+0000 7effdffff640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.762+0000 7effdffff640 1 -- 172.21.15.6:0/692177896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe01aab50 con 0x7effe010a590 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.762+0000 7effdf7fe640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.763+0000 7effe49bb640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe01aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.763+0000 7effdffff640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7effd000d950 tx=0x7effd000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.763+0000 7effdd7fa640 1 -- 172.21.15.6:0/692177896 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0017030 con 0x7effe010a590 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.763+0000 7effdd7fa640 1 -- 172.21.15.6:0/692177896 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd0004020 con 0x7effe010a590 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.763+0000 7effdd7fa640 1 -- 172.21.15.6:0/692177896 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0003b60 con 0x7effe010a590 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.764+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe01aae40 con 0x7effe010a590 2024-09-21T08:12:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.765+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe01b15a0 con 0x7effe010a590 2024-09-21T08:12:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 Processor -- start 2024-09-21T08:12:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 -- start start 2024-09-21T08:12:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effdd7fa640 1 -- 172.21.15.6:0/692177896 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7effd001a070 con 0x7effe010a590 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 0x5627404da970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562740450e60 con 0x562740133350 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562740440290 con 0x562740112670 2024-09-21T08:12:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.769+0000 7effec992740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5627404440a0 con 0x56274010a490 2024-09-21T08:12:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effe49bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effe49bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45880/0 (socket says 172.21.15.6:45880) 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effe49bb640 1 -- 172.21.15.6:0/4198665145 learned_addr learned my addr 172.21.15.6:0/4198665145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effdf7fe640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effdf7fe640 1 -- 172.21.15.6:0/4198665145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 msgr2=0x5627404da970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.770+0000 7effdd7fa640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 0x7effc80c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdffff640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 0x5627404da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdf7fe640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 0x5627404da970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdf7fe640 1 -- 172.21.15.6:0/4198665145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 msgr2=0x5627404da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdf7fe640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdf7fe640 1 -- 172.21.15.6:0/4198665145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274019e930 con 0x562740112670 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effe49bb640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdf7fe640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404daeb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7effe006c6e0 tx=0x7effd4007be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e835ca1ea5fdc8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdffff640 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 0x5627404da970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:12:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.771+0000 7effdd7fa640 1 -- 172.21.15.6:0/692177896 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effd00e6b30 con 0x7effe010a590 2024-09-21T08:12:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.772+0000 7effc67fc640 1 -- 172.21.15.6:0/4198665145 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4007e30 con 0x562740112670 2024-09-21T08:12:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.772+0000 7effc67fc640 1 -- 172.21.15.6:0/4198665145 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd4018070 con 0x562740112670 2024-09-21T08:12:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.772+0000 7effe49bb640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 0x7effc80c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.772+0000 7effc67fc640 1 -- 172.21.15.6:0/4198665145 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4013c80 con 0x562740112670 2024-09-21T08:12:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 -- 172.21.15.6:0/4198665145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 msgr2=0x5627404daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effe49bb640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 0x7effc80c14d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7effd80094e0 tx=0x7effd8005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404daeb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7effe006c6e0 tx=0x7effd4007be0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 -- 172.21.15.6:0/4198665145 shutdown_connections 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56274010a490 0x5627404da970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404daeb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 --2- 172.21.15.6:0/4198665145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 -- 172.21.15.6:0/4198665145 >> 172.21.15.6:0/4198665145 conn(0x562740127740 msgr2=0x5627404d8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.774+0000 7effec992740 1 -- 172.21.15.6:0/4198665145 shutdown_connections 2024-09-21T08:12:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.776+0000 7effec992740 1 -- 172.21.15.6:0/4198665145 wait complete. 2024-09-21T08:12:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.776+0000 7effec992740 1 -- start start 2024-09-21T08:12:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.777+0000 7effec992740 1 Processor -- start 2024-09-21T08:12:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.777+0000 7effec992740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.777+0000 7effec992740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404e6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effdffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effdffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39108/0 (socket says 172.21.15.6:39108) 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effdffff640 1 -- 172.21.15.6:0/2979727296 learned_addr learned my addr 172.21.15.6:0/2979727296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5627402a1890 con 0x562740133350 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5627403dad40 con 0x56274010a490 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5627404e8c60 con 0x562740112670 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effec992740 10 client.0 _ll_register_callbacks cb 0x56274043ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.778+0000 7effdf7fe640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdffff640 1 -- 172.21.15.6:0/2979727296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 msgr2=0x5627404e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdffff640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdffff640 1 -- 172.21.15.6:0/2979727296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 msgr2=0x5627404f1f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdffff640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404f1f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdffff640 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627404f25c0 con 0x56274010a490 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.779+0000 7effdf7fe640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.780+0000 7effdffff640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7effd00ac2d0 tx=0x7effd00ac410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4993b3fad9ccc9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.780+0000 7effbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.780+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd00ac0e0 con 0x56274010a490 2024-09-21T08:12:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.780+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effd00ab830 con 0x56274010a490 2024-09-21T08:12:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.780+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd4018070 con 0x56274010a490 2024-09-21T08:12:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.781+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd00accd0 con 0x56274010a490 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.781+0000 7effec992740 10 client.26807 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.781+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5627404f4ec0 con 0x56274010a490 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd00b10b0 con 0x56274010a490 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effd00a7ff0 con 0x56274010a490 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 10 client.26807 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 10 client.26807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 20 client.26807 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5627400f1cd0 0x5627404f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 4 client.26807 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.782+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7effd4018070 con 0x5627400f1cd0 2024-09-21T08:12:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.785+0000 7effdf7fe640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5627400f1cd0 0x5627404f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.785+0000 7effdf7fe640 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5627400f1cd0 0x5627404f8410 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d8c7bf52e32328 server_cookie=98ae8cf8f49a9322 in_seq=0 out_seq=0 2024-09-21T08:12:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.785+0000 7effbf7fe640 10 client.26807 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.786+0000 7effbf7fe640 1 -- 172.21.15.6:0/2979727296 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7effd4018070 con 0x5627400f1cd0 2024-09-21T08:12:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.786+0000 7effbf7fe640 10 client.26807 handle_command_reply: tid=0 2024-09-21T08:12:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.787+0000 7effec992740 1 client.26807 shutdown 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.787+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 msgr2=0x5627404e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.787+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7effd00ac2d0 tx=0x7effd00ac410 comp rx=0 tx=0).stop 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.787+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 shutdown_connections 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5627400f1cd0 0x5627404f8410 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562740133350 0x5627404f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effec992740 1 --2- 172.21.15.6:0/2979727296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56274010a490 0x5627404e6090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 >> 172.21.15.6:0/2979727296 conn(0x562740127740 msgr2=0x5627404dd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.788+0000 7effbf7fe640 0 client.26807 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:33.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.790+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 shutdown_connections 2024-09-21T08:12:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.790+0000 7effec992740 1 -- 172.21.15.6:0/2979727296 wait complete. 2024-09-21T08:12:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.790+0000 7effec992740 20 client.26807 trim_cache size 0 max 16384 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.827+0000 7effec992740 1 Processor -- start 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.827+0000 7effec992740 1 -- start start 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 0x5627404f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b56a0 con 0x56274010a490 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b7ee0 con 0x562740127740 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effec992740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b5cf0 con 0x562740112670 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effe49bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effe49bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43714/0 (socket says 172.21.15.6:43714) 2024-09-21T08:12:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.828+0000 7effe49bb640 1 -- 172.21.15.6:0/602582157 learned_addr learned my addr 172.21.15.6:0/602582157 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdffff640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 0x5627404f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 -- 172.21.15.6:0/602582157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 msgr2=0x5627404dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404dfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 -- 172.21.15.6:0/602582157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 msgr2=0x5627404f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 0x5627404f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 -- 172.21.15.6:0/602582157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627404dc750 con 0x56274010a490 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdffff640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 0x5627404f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.829+0000 7effdf7fe640 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404df6b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5627404f8b40 tx=0x7effd400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df49abb7be2e40b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.830+0000 7effc5ffb640 1 -- 172.21.15.6:0/602582157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd400db20 con 0x56274010a490 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.830+0000 7effc5ffb640 1 -- 172.21.15.6:0/602582157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd4018030 con 0x56274010a490 2024-09-21T08:12:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.830+0000 7effc5ffb640 1 -- 172.21.15.6:0/602582157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4013a40 con 0x56274010a490 2024-09-21T08:12:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 -- 172.21.15.6:0/602582157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 msgr2=0x5627404df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404df6b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5627404f8b40 tx=0x7effd400f040 comp rx=0 tx=0).stop 2024-09-21T08:12:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 -- 172.21.15.6:0/602582157 shutdown_connections 2024-09-21T08:12:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740112670 0x5627404dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404df6b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 --2- 172.21.15.6:0/602582157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740127740 0x5627404f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.831+0000 7effec992740 1 -- 172.21.15.6:0/602582157 >> 172.21.15.6:0/602582157 conn(0x5627404f8700 msgr2=0x5627404e0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.832+0000 7effec992740 1 -- 172.21.15.6:0/602582157 shutdown_connections 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.832+0000 7effec992740 1 -- 172.21.15.6:0/602582157 wait complete. 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.832+0000 7effec992740 1 -- start start 2024-09-21T08:12:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 Processor -- start 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404edec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 0x5627404e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b63a0 con 0x56274010a490 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b7810 con 0x562740112670 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effe01b6a70 con 0x562740127740 2024-09-21T08:12:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.833+0000 7effec992740 10 client.0 _ll_register_callbacks cb 0x7effd00043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.834+0000 7effdf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.834+0000 7effe49bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 0x5627404e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.834+0000 7effe49bb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 0x5627404e8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43726/0 (socket says 172.21.15.6:43726) 2024-09-21T08:12:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.834+0000 7effe49bb640 1 -- 172.21.15.6:0/1191602744 learned_addr learned my addr 172.21.15.6:0/1191602744 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.834+0000 7effdffff640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 -- 172.21.15.6:0/1191602744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 msgr2=0x5627404e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 0x5627404e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 -- 172.21.15.6:0/1191602744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 msgr2=0x5627404edec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404edec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 -- 172.21.15.6:0/1191602744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627404e93b0 con 0x562740112670 2024-09-21T08:12:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdffff640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404edec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effdf7fe640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404ee440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7effd40076a0 tx=0x7effd400db50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511f305168bf05de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.835+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4032070 con 0x562740112670 2024-09-21T08:12:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.836+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effd4004240 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.836+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd4018030 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.836+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd4007280 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.837+0000 7effec992740 10 client.26813 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.837+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562740574560 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.837+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd4018030 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.837+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effd4003880 con 0x562740112670 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 10 client.26813 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 10 client.26813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 20 client.26813 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562740133350 0x562740576a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 4 client.26813 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:12:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.838+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562740452db0 con 0x562740133350 2024-09-21T08:12:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.839+0000 7effdffff640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562740133350 0x562740576a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.840+0000 7effdffff640 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562740133350 0x562740576a30 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8d594b298d70d78 server_cookie=af18a051372a8b35 in_seq=0 out_seq=0 2024-09-21T08:12:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.840+0000 7effbf7fe640 10 client.26813 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.842+0000 7effbf7fe640 1 -- 172.21.15.6:0/1191602744 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562740452db0 con 0x562740133350 2024-09-21T08:12:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.842+0000 7effbf7fe640 10 client.26813 handle_command_reply: tid=0 2024-09-21T08:12:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.843+0000 7effec992740 1 client.26813 shutdown 2024-09-21T08:12:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.845+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 msgr2=0x5627404ee440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.845+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404ee440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7effd40076a0 tx=0x7effd400db50 comp rx=0 tx=0).stop 2024-09-21T08:12:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 shutdown_connections 2024-09-21T08:12:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562740133350 0x562740576a30 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562740127740 0x5627404e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562740112670 0x5627404ee440 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 --2- 172.21.15.6:0/1191602744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56274010a490 0x5627404edec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 >> 172.21.15.6:0/1191602744 conn(0x5627404f8700 msgr2=0x5627404dd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effbf7fe640 0 client.26813 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.846+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 shutdown_connections 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.847+0000 7effec992740 1 -- 172.21.15.6:0/1191602744 wait complete. 2024-09-21T08:12:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.847+0000 7effec992740 20 client.26813 trim_cache size 0 max 16384 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d", 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 msgr2=0x7effc80c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 0x7effc80c14d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7effd80094e0 tx=0x7effd8005fd0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 msgr2=0x7effe01a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7effd000d950 tx=0x7effd000de10 comp rx=0 tx=0).stop 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 shutdown_connections 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc80befc0 0x7effc80c14d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe0116640 0x7effe01aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe010aee0 0x7effe01a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 --2- 172.21.15.6:0/692177896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effe010a590 0x7effe01a4be0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.848+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 >> 172.21.15.6:0/692177896 conn(0x7effe0070ec0 msgr2=0x7effe0072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.849+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 shutdown_connections 2024-09-21T08:12:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:33.849+0000 7effe641e640 1 -- 172.21.15.6:0/692177896 wait complete. 2024-09-21T08:12:34.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:12:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:34 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:12:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:34 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:34 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:12:35.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:34 smithi145 ceph-mon[34049]: pgmap v699: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-21T08:12:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:34 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:12:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:34 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:34 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:12:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:34 smithi006 ceph-mon[30970]: pgmap v699: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-21T08:12:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:34 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:12:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:34 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:34 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:12:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:34 smithi119 ceph-mon[33564]: pgmap v699: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-21T08:12:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.686+0000 7f884493d640 1 -- 172.21.15.6:0/1839157097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 msgr2=0x7f8840112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.686+0000 7f884493d640 1 --2- 172.21.15.6:0/1839157097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f8840112680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8828009900 tx=0x7f882802a420 comp rx=0 tx=0).stop 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.687+0000 7f884493d640 1 -- 172.21.15.6:0/1839157097 shutdown_connections 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.687+0000 7f884493d640 1 --2- 172.21.15.6:0/1839157097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f8840112680 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.687+0000 7f884493d640 1 --2- 172.21.15.6:0/1839157097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f884010b500 0x7f884010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.687+0000 7f884493d640 1 --2- 172.21.15.6:0/1839157097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8840105bc0 0x7f8840105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.687+0000 7f884493d640 1 -- 172.21.15.6:0/1839157097 >> 172.21.15.6:0/1839157097 conn(0x7f8840101630 msgr2=0x7f8840103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.688+0000 7f884493d640 1 -- 172.21.15.6:0/1839157097 shutdown_connections 2024-09-21T08:12:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.688+0000 7f884493d640 1 -- 172.21.15.6:0/1839157097 wait complete. 2024-09-21T08:12:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 Processor -- start 2024-09-21T08:12:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 -- start start 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884010b500 0x7f884019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f88401a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88401159c0 con 0x7f884010be50 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8840115840 con 0x7f8840105bc0 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f884493d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8840115b40 con 0x7f884010b500 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39152/0 (socket says 172.21.15.6:39152) 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f883ed9d640 1 -- 172.21.15.6:0/2341533840 learned_addr learned my addr 172.21.15.6:0/2341533840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.690+0000 7f883e59c640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884010b500 0x7f884019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883f59e640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f88401a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 -- 172.21.15.6:0/2341533840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884010b500 msgr2=0x7f884019c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884010b500 0x7f884019c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 -- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 msgr2=0x7f88401a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f88401a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 -- 172.21.15.6:0/2341533840 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88401a2300 con 0x7f8840105bc0 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883f59e640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f88401a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f883ed9d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f883800d950 tx=0x7f883800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f8837fff640 1 -- 172.21.15.6:0/2341533840 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838017070 con 0x7f8840105bc0 2024-09-21T08:12:35.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f8837fff640 1 -- 172.21.15.6:0/2341533840 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8838009c30 con 0x7f8840105bc0 2024-09-21T08:12:35.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.691+0000 7f8837fff640 1 -- 172.21.15.6:0/2341533840 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800f620 con 0x7f8840105bc0 2024-09-21T08:12:35.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.692+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88401a25f0 con 0x7f8840105bc0 2024-09-21T08:12:35.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.692+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88401a8d50 con 0x7f8840105bc0 2024-09-21T08:12:35.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.695+0000 7f884b6b2740 1 Processor -- start 2024-09-21T08:12:35.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 -- start start 2024-09-21T08:12:35.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 0x5638b75e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5638b7553e50 con 0x5638b720d1b0 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5638b7543280 con 0x5638b7236070 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f884b6b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5638b7547090 con 0x5638b7215390 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f883f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 0x5638b75e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f8837fff640 1 -- 172.21.15.6:0/2341533840 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8838010460 con 0x7f8840105bc0 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f883e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f883e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43746/0 (socket says 172.21.15.6:43746) 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f883f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 0x5638b75e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39168/0 (socket says 172.21.15.6:39168) 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.696+0000 7f883e59c640 1 -- 172.21.15.6:0/290907090 learned_addr learned my addr 172.21.15.6:0/290907090 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.697+0000 7f883e59c640 1 -- 172.21.15.6:0/290907090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 msgr2=0x5638b75e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.697+0000 7f883e59c640 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 0x5638b75e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.697+0000 7f883e59c640 1 -- 172.21.15.6:0/290907090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 msgr2=0x5638b75e6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.697+0000 7f883e59c640 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.697+0000 7f883e59c640 1 -- 172.21.15.6:0/290907090 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b72a1650 con 0x5638b7215390 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.698+0000 7f883e59c640 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f883000ae90 tx=0x7f883000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26337e9a64ac10ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.698+0000 7f88357fa640 1 -- 172.21.15.6:0/290907090 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830003b70 con 0x5638b7215390 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.698+0000 7f8837fff640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 0x7f882c0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.698+0000 7f88357fa640 1 -- 172.21.15.6:0/290907090 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8830003d10 con 0x5638b7215390 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.699+0000 7f883f59e640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 0x7f882c0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.699+0000 7f8837fff640 1 -- 172.21.15.6:0/2341533840 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f88380e7700 con 0x7f8840105bc0 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 -- 172.21.15.6:0/290907090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 msgr2=0x5638b75e6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f883000ae90 tx=0x7f883000f790 comp rx=0 tx=0).stop 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f883f59e640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 0x7f882c0b8cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8828006010 tx=0x7f8828005e70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 -- 172.21.15.6:0/290907090 shutdown_connections 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7215390 0x5638b75e6aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 --2- 172.21.15.6:0/290907090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7236070 0x5638b75e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 -- 172.21.15.6:0/290907090 >> 172.21.15.6:0/290907090 conn(0x5638b722a460 msgr2=0x5638b75e3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 -- 172.21.15.6:0/290907090 shutdown_connections 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.700+0000 7f884b6b2740 1 -- 172.21.15.6:0/290907090 wait complete. 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.701+0000 7f884b6b2740 1 -- start start 2024-09-21T08:12:35.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.701+0000 7f884b6b2740 1 Processor -- start 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 0x5638b75e0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75e0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 0x5638b75e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5638b73a4700 con 0x5638b7236070 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5638b74de110 con 0x5638b7215390 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5638b75e33f0 con 0x5638b720d1b0 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.702+0000 7f884b6b2740 10 client.0 _ll_register_callbacks cb 0x5638b74f7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 0x5638b75e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 0x5638b75e0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45950/0 (socket says 172.21.15.6:45950) 2024-09-21T08:12:35.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883f59e640 1 -- 172.21.15.6:0/4106453260 learned_addr learned my addr 172.21.15.6:0/4106453260 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:35.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 0x5638b75e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 -- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 msgr2=0x5638b75e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 -- 172.21.15.6:0/4106453260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 msgr2=0x5638b75e0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 0x5638b75e0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.703+0000 7f883ed9d640 1 -- 172.21.15.6:0/4106453260 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b750bc40 con 0x5638b720d1b0 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.704+0000 7f883ed9d640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 0x5638b75e0210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f88380e4a10 tx=0x7f88380a90e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94357e1a3732a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.704+0000 7f88267fc640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.704+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838020070 con 0x5638b720d1b0 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.704+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f88380e7b30 con 0x5638b720d1b0 2024-09-21T08:12:35.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.705+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8830003d10 con 0x5638b720d1b0 2024-09-21T08:12:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.705+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f88380ac880 con 0x5638b720d1b0 2024-09-21T08:12:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.706+0000 7f884b6b2740 10 client.26905 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.706+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5638b7608cf0 con 0x5638b720d1b0 2024-09-21T08:12:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.706+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8830003d10 con 0x5638b720d1b0 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.706+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f88380a8a60 con 0x5638b720d1b0 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 10 client.26905 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 10 client.26905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 20 client.26905 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71f49f0 0x5638b760c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 4 client.26905 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:35.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638b7555da0 con 0x5638b71f49f0 2024-09-21T08:12:35.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.707+0000 7f883e59c640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71f49f0 0x5638b760c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.708+0000 7f883e59c640 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71f49f0 0x5638b760c5d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60a367838d6e4c9 server_cookie=78a9bdf13d454053 in_seq=0 out_seq=0 2024-09-21T08:12:35.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.708+0000 7f88267fc640 10 client.26905 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.709+0000 7f88267fc640 1 -- 172.21.15.6:0/4106453260 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638b7555da0 con 0x5638b71f49f0 2024-09-21T08:12:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.709+0000 7f88267fc640 10 client.26905 handle_command_reply: tid=0 2024-09-21T08:12:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.709+0000 7f884b6b2740 1 client.26905 shutdown 2024-09-21T08:12:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.710+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 msgr2=0x5638b75e0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.710+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 0x5638b75e0210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f88380e4a10 tx=0x7f88380a90e0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 shutdown_connections 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71f49f0 0x5638b760c5d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b7236070 0x5638b75e0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 --2- 172.21.15.6:0/4106453260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b720d1b0 0x5638b75e0210 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f88267fc640 0 client.26905 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.713+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 >> 172.21.15.6:0/4106453260 conn(0x5638b722a460 msgr2=0x5638b75e7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.714+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 shutdown_connections 2024-09-21T08:12:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.714+0000 7f884b6b2740 1 -- 172.21.15.6:0/4106453260 wait complete. 2024-09-21T08:12:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.714+0000 7f884b6b2740 20 client.26905 trim_cache size 0 max 16384 2024-09-21T08:12:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.750+0000 7f884b6b2740 1 Processor -- start 2024-09-21T08:12:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 -- start start 2024-09-21T08:12:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75dd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75dd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88401acaf0 con 0x5638b720d1b0 2024-09-21T08:12:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88401af350 con 0x5638b7215390 2024-09-21T08:12:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.752+0000 7f884b6b2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ad140 con 0x5638b7236070 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883f59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883f59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75dd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43770/0 (socket says 172.21.15.6:43770) 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883f59e640 1 -- 172.21.15.6:0/3293983691 learned_addr learned my addr 172.21.15.6:0/3293983691 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883ed9d640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883e59c640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75dd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883ed9d640 1 -- 172.21.15.6:0/3293983691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 msgr2=0x5638b75dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883ed9d640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883ed9d640 1 -- 172.21.15.6:0/3293983691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 msgr2=0x5638b75dd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.753+0000 7f883ed9d640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75dd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.754+0000 7f883ed9d640 1 -- 172.21.15.6:0/3293983691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b75df170 con 0x5638b720d1b0 2024-09-21T08:12:35.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.754+0000 7f883e59c640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75dd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:35.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.754+0000 7f883ed9d640 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e7760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f88380ace10 tx=0x7f88380a8fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ba327143a41a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.754+0000 7f8834ff9640 1 -- 172.21.15.6:0/3293983691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838020070 con 0x5638b720d1b0 2024-09-21T08:12:35.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.755+0000 7f8834ff9640 1 -- 172.21.15.6:0/3293983691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88380e7e50 con 0x5638b720d1b0 2024-09-21T08:12:35.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.755+0000 7f8834ff9640 1 -- 172.21.15.6:0/3293983691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88380b6b30 con 0x5638b720d1b0 2024-09-21T08:12:35.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.756+0000 7f884b6b2740 1 -- 172.21.15.6:0/3293983691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 msgr2=0x5638b75e7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.756+0000 7f884b6b2740 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e7760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f88380ace10 tx=0x7f88380a8fb0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 -- 172.21.15.6:0/3293983691 shutdown_connections 2024-09-21T08:12:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75dd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 --2- 172.21.15.6:0/3293983691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b75e7760 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 -- 172.21.15.6:0/3293983691 >> 172.21.15.6:0/3293983691 conn(0x5638b722a460 msgr2=0x5638b75e7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 -- 172.21.15.6:0/3293983691 shutdown_connections 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.757+0000 7f884b6b2740 1 -- 172.21.15.6:0/3293983691 wait complete. 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.758+0000 7f884b6b2740 1 -- start start 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.758+0000 7f884b6b2740 1 Processor -- start 2024-09-21T08:12:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b7602b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f884b6b2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f883e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f883e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:39188/0 (socket says 172.21.15.6:39188) 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b7602b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.759+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b7602b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45962/0 (socket says 172.21.15.6:45962) 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 -- 172.21.15.6:0/1882105800 learned_addr learned my addr 172.21.15.6:0/1882105800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ad810 con 0x5638b720d1b0 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88401aec80 con 0x5638b7215390 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f88401adee0 con 0x5638b7236070 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883f59e640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f884b6b2740 10 client.0 _ll_register_callbacks cb 0x7f88380a9590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 -- 172.21.15.6:0/1882105800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 msgr2=0x5638b75fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 -- 172.21.15.6:0/1882105800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 msgr2=0x5638b7602b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b7602b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.760+0000 7f883e59c640 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b75fed00 con 0x5638b7215390 2024-09-21T08:12:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.761+0000 7f883e59c640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8830004990 tx=0x7f8830005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db0fe9e2777229d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.761+0000 7f88267fc640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.762+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830032060 con 0x5638b7215390 2024-09-21T08:12:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.762+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f88300049e0 con 0x5638b7215390 2024-09-21T08:12:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.762+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88380e7e50 con 0x5638b7215390 2024-09-21T08:12:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.762+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8830010e30 con 0x5638b7215390 2024-09-21T08:12:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 10 client.26828 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5638b7676f30 con 0x5638b7215390 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8830004be0 con 0x5638b7215390 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8830018440 con 0x5638b7215390 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 10 client.26828 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 10 client.26828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 20 client.26828 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.763+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71c9da0 0x5638b7679510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.764+0000 7f884b6b2740 4 client.26828 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.764+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f88380e7e50 con 0x5638b71c9da0 2024-09-21T08:12:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.764+0000 7f883ed9d640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71c9da0 0x5638b7679510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:35.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.764+0000 7f88267fc640 10 client.26828 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:35.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.765+0000 7f883ed9d640 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71c9da0 0x5638b7679510 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd90e47070e828e server_cookie=f81a67e23acebf9a in_seq=0 out_seq=0 2024-09-21T08:12:35.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.765+0000 7f88267fc640 1 -- 172.21.15.6:0/1882105800 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x7f88380e7e50 con 0x5638b71c9da0 2024-09-21T08:12:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.765+0000 7f88267fc640 10 client.26828 handle_command_reply: tid=0 2024-09-21T08:12:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.765+0000 7f884b6b2740 1 client.26828 shutdown 2024-09-21T08:12:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.766+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 msgr2=0x5638b75fe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.766+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8830004990 tx=0x7f8830005fa0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 shutdown_connections 2024-09-21T08:12:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638b71c9da0 0x5638b7679510 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f88267fc640 0 client.26828 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638b7236070 0x5638b75fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638b7215390 0x5638b75fe030 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 --2- 172.21.15.6:0/1882105800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638b720d1b0 0x5638b7602b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 >> 172.21.15.6:0/1882105800 conn(0x5638b722a460 msgr2=0x5638b75e7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.767+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 shutdown_connections 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.768+0000 7f884b6b2740 1 -- 172.21.15.6:0/1882105800 wait complete. 2024-09-21T08:12:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.768+0000 7f884b6b2740 20 client.26828 trim_cache size 0 max 16384 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:12:35.771 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.772 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:12:35.774 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.775 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.777 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:12:35.779 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:35.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:35.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:35.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:35.781 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 msgr2=0x7f882c0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 0x7f882c0b8cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8828006010 tx=0x7f8828005e70 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 msgr2=0x7f884019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f883800d950 tx=0x7f883800de10 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 shutdown_connections 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f882c0b67b0 0x7f882c0b8cc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f884010b500 0x7f884019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f884010be50 0x7f88401a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 --2- 172.21.15.6:0/2341533840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840105bc0 0x7f884019c390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.770+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 >> 172.21.15.6:0/2341533840 conn(0x7f8840101630 msgr2=0x7f8840103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.771+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 shutdown_connections 2024-09-21T08:12:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:35.771+0000 7f884493d640 1 -- 172.21.15.6:0/2341533840 wait complete. 2024-09-21T08:12:36.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:35 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:36.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:35 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:36.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:35 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:36 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:12:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:36 smithi145 ceph-mon[34049]: pgmap v700: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 9.4 MiB/s wr, 693 op/s 2024-09-21T08:12:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:36 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:12:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:36 smithi006 ceph-mon[30970]: pgmap v700: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 9.4 MiB/s wr, 693 op/s 2024-09-21T08:12:37.305 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:12:37.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:12:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:36 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:12:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:36 smithi119 ceph-mon[33564]: pgmap v700: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 9.4 MiB/s wr, 693 op/s 2024-09-21T08:12:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 580.0 s, 767.6 tps, lat 129.646 ms stddev 85.618 2024-09-21T08:12:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:38 smithi145 ceph-mon[34049]: pgmap v701: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:38 smithi006 ceph-mon[30970]: pgmap v701: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:38 smithi119 ceph-mon[33564]: pgmap v701: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 10 MiB/s wr, 785 op/s 2024-09-21T08:12:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.320+0000 7fae3a7fc640 1 -- 172.21.15.6:0/2618883252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30040770 con 0x7fae34094d50 2024-09-21T08:12:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 -- 172.21.15.6:0/2618883252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34094d50 msgr2=0x7fae34095160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 --2- 172.21.15.6:0/2618883252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34094d50 0x7fae34095160 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fae3001a940 tx=0x7fae3003b450 comp rx=0 tx=0).stop 2024-09-21T08:12:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 -- 172.21.15.6:0/2618883252 shutdown_connections 2024-09-21T08:12:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 --2- 172.21.15.6:0/2618883252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae340956a0 0x7fae34099bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 --2- 172.21.15.6:0/2618883252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 0x7fae3409a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 --2- 172.21.15.6:0/2618883252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34094d50 0x7fae34095160 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.322+0000 7fae40930640 1 -- 172.21.15.6:0/2618883252 >> 172.21.15.6:0/2618883252 conn(0x7fae3400cbd0 msgr2=0x7fae3400cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.323+0000 7fae40930640 1 -- 172.21.15.6:0/2618883252 shutdown_connections 2024-09-21T08:12:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.325+0000 7fae40930640 1 -- 172.21.15.6:0/2618883252 wait complete. 2024-09-21T08:12:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.327+0000 7fae40930640 1 Processor -- start 2024-09-21T08:12:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.327+0000 7fae40930640 1 -- start start 2024-09-21T08:12:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.327+0000 7fae40930640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae40930640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 0x7fae340a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae40930640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 0x7fae340a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae40930640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae3409d880 con 0x7fae340956a0 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae40930640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fae3409d700 con 0x7fae3409a190 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae40930640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fae3409da00 con 0x7fae34094d50 2024-09-21T08:12:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae3b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae3b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40674/0 (socket says 172.21.15.6:40674) 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae3b7fe640 1 -- 172.21.15.6:0/1167516286 learned_addr learned my addr 172.21.15.6:0/1167516286 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae3affd640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 0x7fae340a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.328+0000 7fae3bfff640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 0x7fae340a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3affd640 1 -- 172.21.15.6:0/1167516286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 msgr2=0x7fae340a9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3affd640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3affd640 1 -- 172.21.15.6:0/1167516286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 msgr2=0x7fae340a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3affd640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 0x7fae340a5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3affd640 1 -- 172.21.15.6:0/1167516286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae340a6030 con 0x7fae340956a0 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.329+0000 7fae3b7fe640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.330+0000 7fae3affd640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 0x7fae340a53f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fae3c069e80 tx=0x7fae3c0755f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.330+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c06a5d0 con 0x7fae340956a0 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.330+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae3c085070 con 0x7fae340956a0 2024-09-21T08:12:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.330+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c07f820 con 0x7fae340956a0 2024-09-21T08:12:40.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.331+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae34136b50 con 0x7fae340956a0 2024-09-21T08:12:40.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.331+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae34136f50 con 0x7fae340956a0 2024-09-21T08:12:40.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.332+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae34099bd0 con 0x7fae340956a0 2024-09-21T08:12:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.336+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fae3c07f9c0 con 0x7fae340956a0 2024-09-21T08:12:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.338+0000 7fae38ff9640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 0x7fae2c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.338+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fae3c1563a0 con 0x7fae340956a0 2024-09-21T08:12:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.339+0000 7fae3b7fe640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 0x7fae2c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:40.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.341+0000 7fae3b7fe640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 0x7fae2c0b8c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fae3001a910 tx=0x7fae30005de0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:40.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.343+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae3c11c4b0 con 0x7fae340956a0 2024-09-21T08:12:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.782+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae340a66f0 con 0x7fae340956a0 2024-09-21T08:12:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.784+0000 7fae38ff9640 1 -- 172.21.15.6:0/1167516286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fae3c120890 con 0x7fae340956a0 2024-09-21T08:12:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:12:40.787 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:12:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:12:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 msgr2=0x7fae2c0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 0x7fae2c0b8c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fae3001a910 tx=0x7fae30005de0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 msgr2=0x7fae340a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 0x7fae340a53f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fae3c069e80 tx=0x7fae3c0755f0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 shutdown_connections 2024-09-21T08:12:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fae2c0b6780 0x7fae2c0b8c90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae3409a190 0x7fae340a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae340956a0 0x7fae340a53f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 --2- 172.21.15.6:0/1167516286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae34094d50 0x7fae340a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.788+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 >> 172.21.15.6:0/1167516286 conn(0x7fae3400cbd0 msgr2=0x7fae34097ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.791+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 shutdown_connections 2024-09-21T08:12:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:40.791+0000 7fae40930640 1 -- 172.21.15.6:0/1167516286 wait complete. 2024-09-21T08:12:41.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:40 smithi006 ceph-mon[30970]: pgmap v702: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 8.2 MiB/s wr, 655 op/s 2024-09-21T08:12:41.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:40 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1167516286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:40 smithi119 ceph-mon[33564]: pgmap v702: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 8.2 MiB/s wr, 655 op/s 2024-09-21T08:12:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:40 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1167516286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:40 smithi145 ceph-mon[34049]: pgmap v702: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 8.2 MiB/s wr, 655 op/s 2024-09-21T08:12:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:40 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1167516286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:12:41.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:12:42.072 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 585.0 s, 698.4 tps, lat 140.415 ms stddev 156.278 2024-09-21T08:12:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.720+0000 7effe117f640 1 -- 172.21.15.6:0/1982524996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 msgr2=0x7effdc110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.720+0000 7effe117f640 1 --2- 172.21.15.6:0/1982524996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 0x7effdc110470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7effd4009be0 tx=0x7effd402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.721+0000 7effe117f640 1 -- 172.21.15.6:0/1982524996 shutdown_connections 2024-09-21T08:12:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.721+0000 7effe117f640 1 --2- 172.21.15.6:0/1982524996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 0x7effdc110470 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.721+0000 7effe117f640 1 --2- 172.21.15.6:0/1982524996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 0x7effdc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.721+0000 7effe117f640 1 --2- 172.21.15.6:0/1982524996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.721+0000 7effe117f640 1 -- 172.21.15.6:0/1982524996 >> 172.21.15.6:0/1982524996 conn(0x7effdc0ff400 msgr2=0x7effdc101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.727+0000 7effe117f640 1 -- 172.21.15.6:0/1982524996 shutdown_connections 2024-09-21T08:12:42.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.727+0000 7effe117f640 1 -- 172.21.15.6:0/1982524996 wait complete. 2024-09-21T08:12:42.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.728+0000 7effe117f640 1 Processor -- start 2024-09-21T08:12:42.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.728+0000 7effe117f640 1 -- start start 2024-09-21T08:12:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.729+0000 7effe117f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.729+0000 7effe117f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 0x7effdc1a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effe117f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 0x7effdc1ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38460/0 (socket says 172.21.15.6:38460) 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effdbfff640 1 -- 172.21.15.6:0/3975156124 learned_addr learned my addr 172.21.15.6:0/3975156124 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1137d0 con 0x7effdc1092f0 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effdc113650 con 0x7effdc1039b0 2024-09-21T08:12:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effdc113950 con 0x7effdc109c40 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.730+0000 7effdb7fe640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 0x7effdc1a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 -- 172.21.15.6:0/3975156124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 msgr2=0x7effdc1ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 0x7effdc1ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 -- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 msgr2=0x7effdc1a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 0x7effdc1a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc1aca70 con 0x7effdc1039b0 2024-09-21T08:12:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effdbfff640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7effcc00e9f0 tx=0x7effcc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effd97fa640 1 -- 172.21.15.6:0/3975156124 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc00ccc0 con 0x7effdc1039b0 2024-09-21T08:12:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.731+0000 7effd97fa640 1 -- 172.21.15.6:0/3975156124 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effcc0054b0 con 0x7effdc1039b0 2024-09-21T08:12:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.732+0000 7effd97fa640 1 -- 172.21.15.6:0/3975156124 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc010430 con 0x7effdc1039b0 2024-09-21T08:12:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.732+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc1acc40 con 0x7effdc1039b0 2024-09-21T08:12:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.732+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc1ad0d0 con 0x7effdc1039b0 2024-09-21T08:12:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.736+0000 7effe8955740 1 Processor -- start 2024-09-21T08:12:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.736+0000 7effe8955740 1 -- start start 2024-09-21T08:12:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e859070 0x557a0ec00860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 0x557a0ec00da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557a0eb76ea0 con 0x557a0e8301b0 2024-09-21T08:12:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a0eb662d0 con 0x557a0e859070 2024-09-21T08:12:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.737+0000 7effe8955740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a0eb6a0e0 con 0x557a0e838390 2024-09-21T08:12:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effdb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effe097e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e859070 0x557a0ec00860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effdb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40704/0 (socket says 172.21.15.6:40704) 2024-09-21T08:12:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effdb7fe640 1 -- 172.21.15.6:0/460152962 learned_addr learned my addr 172.21.15.6:0/460152962 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effd97fa640 1 -- 172.21.15.6:0/3975156124 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7effcc004f60 con 0x7effdc1039b0 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.738+0000 7effdbfff640 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 0x557a0ec00da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.739+0000 7effdbfff640 1 -- 172.21.15.6:0/460152962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 msgr2=0x557a0ec012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.739+0000 7effdbfff640 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.739+0000 7effdbfff640 1 -- 172.21.15.6:0/460152962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e859070 msgr2=0x557a0ec00860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.739+0000 7effdbfff640 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e859070 0x557a0ec00860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.739+0000 7effdbfff640 1 -- 172.21.15.6:0/460152962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0e8c4650 con 0x557a0e8301b0 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.740+0000 7effdbfff640 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 0x557a0ec00da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7effcc0e5270 tx=0x7effcc0f04b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3013fe0e2106570 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.740+0000 7effd97fa640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 0x7effc40b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.740+0000 7effd97fa640 1 -- 172.21.15.6:0/3975156124 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effcc0e7f60 con 0x7effdc1039b0 2024-09-21T08:12:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.741+0000 7effc27fc640 1 -- 172.21.15.6:0/460152962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc0fc070 con 0x557a0e8301b0 2024-09-21T08:12:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.741+0000 7effc27fc640 1 -- 172.21.15.6:0/460152962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effcc0ad480 con 0x557a0e8301b0 2024-09-21T08:12:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.741+0000 7effc27fc640 1 -- 172.21.15.6:0/460152962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc0a9fc0 con 0x557a0e8301b0 2024-09-21T08:12:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.742+0000 7effe097e640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 0x7effc40b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.743+0000 7effe8955740 1 -- 172.21.15.6:0/460152962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 msgr2=0x557a0ec00da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.743+0000 7effe8955740 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 0x557a0ec00da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7effcc0e5270 tx=0x7effcc0f04b0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.743+0000 7effe097e640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 0x7effc40b8cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7effd40099a0 tx=0x7effd40093b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.744+0000 7effe8955740 1 -- 172.21.15.6:0/460152962 shutdown_connections 2024-09-21T08:12:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.744+0000 7effe8955740 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.744+0000 7effe8955740 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e8301b0 0x557a0ec00da0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.744+0000 7effe8955740 1 --2- 172.21.15.6:0/460152962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e859070 0x557a0ec00860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.744+0000 7effe8955740 1 -- 172.21.15.6:0/460152962 >> 172.21.15.6:0/460152962 conn(0x557a0e84d460 msgr2=0x557a0ebfe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.745+0000 7effe8955740 1 -- 172.21.15.6:0/460152962 shutdown_connections 2024-09-21T08:12:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.745+0000 7effe8955740 1 -- 172.21.15.6:0/460152962 wait complete. 2024-09-21T08:12:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.746+0000 7effe8955740 1 -- start start 2024-09-21T08:12:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.746+0000 7effe8955740 1 Processor -- start 2024-09-21T08:12:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.747+0000 7effe8955740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 0x557a0ec0bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.747+0000 7effe8955740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 0x557a0ec0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.747+0000 7effe8955740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec29370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.747+0000 7effe8955740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557a0e9c7700 con 0x557a0e859070 2024-09-21T08:12:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.747+0000 7effe8955740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a0eb01160 con 0x557a0e838390 2024-09-21T08:12:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effe8955740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a0ec20050 con 0x557a0e8301b0 2024-09-21T08:12:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effe8955740 10 client.0 _ll_register_callbacks cb 0x557a0eb1a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effe097e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec29370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effe097e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec29370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41352/0 (socket says 172.21.15.6:41352) 2024-09-21T08:12:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effe097e640 1 -- 172.21.15.6:0/3435540566 learned_addr learned my addr 172.21.15.6:0/3435540566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effdbfff640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 0x557a0ec0bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.748+0000 7effdb7fe640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 0x557a0ec0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 -- 172.21.15.6:0/3435540566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 msgr2=0x557a0ec0bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 0x557a0ec0bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 -- 172.21.15.6:0/3435540566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 msgr2=0x557a0ec29370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec29370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 -- 172.21.15.6:0/3435540566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a0eb2ec90 con 0x557a0e838390 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdbfff640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 0x557a0ec0bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effdb7fe640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 0x557a0ec0c4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7effd0012700 tx=0x7effd0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5a6c302b839c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.749+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0004050 con 0x557a0e838390 2024-09-21T08:12:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effd00041f0 con 0x557a0e838390 2024-09-21T08:12:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effcc0ad480 con 0x557a0e838390 2024-09-21T08:12:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd0025050 con 0x557a0e838390 2024-09-21T08:12:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effe8955740 10 client.26843 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a0ec2be20 con 0x557a0e838390 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.750+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effcc0ad480 con 0x557a0e838390 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effd0003880 con 0x557a0e838390 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 10 client.26843 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 10 client.26843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 20 client.26843 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e8179f0 0x557a0ec2f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 4 client.26843 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a0eb78df0 con 0x557a0e8179f0 2024-09-21T08:12:42.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.751+0000 7effdbfff640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e8179f0 0x557a0ec2f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.754+0000 7effbb7fe640 10 client.26843 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.754+0000 7effdbfff640 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e8179f0 0x557a0ec2f2f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a4ab5091477269 server_cookie=e81c65f9a0686a3 in_seq=0 out_seq=0 2024-09-21T08:12:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effbb7fe640 1 -- 172.21.15.6:0/3435540566 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a0eb78df0 con 0x557a0e8179f0 2024-09-21T08:12:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effbb7fe640 10 client.26843 handle_command_reply: tid=0 2024-09-21T08:12:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 client.26843 shutdown 2024-09-21T08:12:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 msgr2=0x557a0ec0c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 0x557a0ec0c4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7effd0012700 tx=0x7effd0012bc0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 shutdown_connections 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e8179f0 0x557a0ec2f2f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec29370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e838390 0x557a0ec0c4f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 --2- 172.21.15.6:0/3435540566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e8301b0 0x557a0ec0bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 >> 172.21.15.6:0/3435540566 conn(0x557a0e84d460 msgr2=0x557a0ec039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.755+0000 7effbb7fe640 0 client.26843 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.756+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 shutdown_connections 2024-09-21T08:12:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.756+0000 7effe8955740 1 -- 172.21.15.6:0/3435540566 wait complete. 2024-09-21T08:12:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.756+0000 7effe8955740 20 client.26843 trim_cache size 0 max 16384 2024-09-21T08:12:42.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.781+0000 7effe8955740 1 Processor -- start 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 -- start start 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec29270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec03960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1a0d50 con 0x557a0e859070 2024-09-21T08:12:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1af460 con 0x557a0e8301b0 2024-09-21T08:12:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effe8955740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1ad360 con 0x557a0e838390 2024-09-21T08:12:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effdbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38478/0 (socket says 172.21.15.6:38478) 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.782+0000 7effdbfff640 1 -- 172.21.15.6:0/1520552231 learned_addr learned my addr 172.21.15.6:0/1520552231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effe097e640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec03960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdb7fe640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdbfff640 1 -- 172.21.15.6:0/1520552231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 msgr2=0x557a0ec29270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdbfff640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec29270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdbfff640 1 -- 172.21.15.6:0/1520552231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 msgr2=0x557a0ec03960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdbfff640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec03960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdbfff640 1 -- 172.21.15.6:0/1520552231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0ec02b50 con 0x557a0e8301b0 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effe097e640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec03960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.783+0000 7effdb7fe640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec29270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:42.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.784+0000 7effdbfff640 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effcc009230 tx=0x7effcc0d1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0694d73e1168845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.784+0000 7effc1ffb640 1 -- 172.21.15.6:0/1520552231 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc0ad0e0 con 0x557a0e8301b0 2024-09-21T08:12:42.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.784+0000 7effc1ffb640 1 -- 172.21.15.6:0/1520552231 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557a0eb78df0 con 0x557a0e8301b0 2024-09-21T08:12:42.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.784+0000 7effc1ffb640 1 -- 172.21.15.6:0/1520552231 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc0ad2c0 con 0x557a0e8301b0 2024-09-21T08:12:42.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.786+0000 7effe8955740 1 -- 172.21.15.6:0/1520552231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 msgr2=0x557a0ebfe780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.786+0000 7effe8955740 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7effcc009230 tx=0x7effcc0d1040 comp rx=0 tx=0).stop 2024-09-21T08:12:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 -- 172.21.15.6:0/1520552231 shutdown_connections 2024-09-21T08:12:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec29270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec03960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 --2- 172.21.15.6:0/1520552231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ebfe780 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 -- 172.21.15.6:0/1520552231 >> 172.21.15.6:0/1520552231 conn(0x557a0e84d460 msgr2=0x557a0ebfe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.787+0000 7effe8955740 1 -- 172.21.15.6:0/1520552231 shutdown_connections 2024-09-21T08:12:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.788+0000 7effe8955740 1 -- 172.21.15.6:0/1520552231 wait complete. 2024-09-21T08:12:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.788+0000 7effe8955740 1 -- start start 2024-09-21T08:12:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 Processor -- start 2024-09-21T08:12:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ec215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec21ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec98c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1ad920 con 0x557a0e859070 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1aed90 con 0x557a0e8301b0 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1adff0 con 0x557a0e838390 2024-09-21T08:12:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.789+0000 7effe8955740 10 client.0 _ll_register_callbacks cb 0x7effd0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effe097e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec98c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effe097e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec98c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41368/0 (socket says 172.21.15.6:41368) 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effe097e640 1 -- 172.21.15.6:0/264372863 learned_addr learned my addr 172.21.15.6:0/264372863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec21ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdbfff640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ec215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 -- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 msgr2=0x557a0ec215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ec215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 -- 172.21.15.6:0/264372863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 msgr2=0x557a0ec98c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec98c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 -- 172.21.15.6:0/264372863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a0ec22360 con 0x557a0e838390 2024-09-21T08:12:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdbfff640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ec215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effdb7fe640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec21ae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effd0003df0 tx=0x7effd0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3ba41922379112 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.790+0000 7effbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd002d070 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7effd0003800 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a0eb78df0 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd0037050 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effe8955740 10 client.26932 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.791+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a0ec9a1f0 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557a0eb78df0 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effd00053e0 con 0x557a0e838390 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 10 client.26932 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 10 client.26932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 20 client.26932 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:42.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e7ecda0 0x557a0ec9c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:42.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 4 client.26932 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:12:42.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a0eb748a0 con 0x557a0e7ecda0 2024-09-21T08:12:42.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.792+0000 7effdbfff640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e7ecda0 0x557a0ec9c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.793+0000 7effbb7fe640 10 client.26932 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.793+0000 7effdbfff640 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e7ecda0 0x557a0ec9c9a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d2c34476dc4876 server_cookie=96dfcd4422bd87f5 in_seq=0 out_seq=0 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effbb7fe640 1 -- 172.21.15.6:0/264372863 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a0eb748a0 con 0x557a0e7ecda0 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effbb7fe640 10 client.26932 handle_command_reply: tid=0 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 client.26932 shutdown 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 msgr2=0x557a0ec21ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec21ae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effd0003df0 tx=0x7effd0009260 comp rx=0 tx=0).stop 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 shutdown_connections 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557a0e7ecda0 0x557a0ec9c9a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a0e838390 0x557a0ec21ae0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557a0e859070 0x557a0ec98c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 --2- 172.21.15.6:0/264372863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a0e8301b0 0x557a0ec215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 >> 172.21.15.6:0/264372863 conn(0x557a0e84d460 msgr2=0x557a0ec03960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effbb7fe640 0 client.26932 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 shutdown_connections 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.794+0000 7effe8955740 1 -- 172.21.15.6:0/264372863 wait complete. 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.795+0000 7effe8955740 20 client.26932 trim_cache size 0 max 16384 2024-09-21T08:12:42.797 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.795+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 msgr2=0x7effc40b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.795+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 0x7effc40b8cc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7effd40099a0 tx=0x7effd40093b0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 msgr2=0x7effdc1a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7effcc00e9f0 tx=0x7effcc00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 shutdown_connections 2024-09-21T08:12:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc40b67b0 0x7effc40b8cc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effdc109c40 0x7effdc1ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1092f0 0x7effdc1a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 --2- 172.21.15.6:0/3975156124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effdc1039b0 0x7effdc1a14b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 >> 172.21.15.6:0/3975156124 conn(0x7effdc0ff400 msgr2=0x7effdc0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 shutdown_connections 2024-09-21T08:12:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:42.796+0000 7effe117f640 1 -- 172.21.15.6:0/3975156124 wait complete. 2024-09-21T08:12:43.204 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:42 smithi006 ceph-mon[30970]: pgmap v703: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 9.5 MiB/s wr, 734 op/s 2024-09-21T08:12:43.411 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:42 smithi119 ceph-mon[33564]: pgmap v703: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 9.5 MiB/s wr, 734 op/s 2024-09-21T08:12:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:42 smithi145 ceph-mon[34049]: pgmap v703: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 9.5 MiB/s wr, 734 op/s 2024-09-21T08:12:44.653 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:12:44.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:12:44.955 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:44 smithi006 ceph-mon[30970]: pgmap v704: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 8.4 MiB/s wr, 687 op/s 2024-09-21T08:12:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:44 smithi119 ceph-mon[33564]: pgmap v704: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 8.4 MiB/s wr, 687 op/s 2024-09-21T08:12:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:44 smithi145 ceph-mon[34049]: pgmap v704: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 8.4 MiB/s wr, 687 op/s 2024-09-21T08:12:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.722+0000 7f807db24640 1 -- 172.21.15.6:0/4275447823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8078116640 msgr2=0x7f8078118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.722+0000 7f807db24640 1 --2- 172.21.15.6:0/4275447823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8078116640 0x7f8078118b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8070009be0 tx=0x7f807002a6c0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 -- 172.21.15.6:0/4275447823 shutdown_connections 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 --2- 172.21.15.6:0/4275447823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8078116640 0x7f8078118b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 --2- 172.21.15.6:0/4275447823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807810aee0 0x7f8078115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 --2- 172.21.15.6:0/4275447823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f807810a590 0x7f807810a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 -- 172.21.15.6:0/4275447823 >> 172.21.15.6:0/4275447823 conn(0x7f80780712f0 msgr2=0x7f8078073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 -- 172.21.15.6:0/4275447823 shutdown_connections 2024-09-21T08:12:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.723+0000 7f807db24640 1 -- 172.21.15.6:0/4275447823 wait complete. 2024-09-21T08:12:45.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.724+0000 7f807db24640 1 Processor -- start 2024-09-21T08:12:45.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 -- start start 2024-09-21T08:12:45.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807810a590 0x7f80781a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8078116640 0x7f80781ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8078122790 con 0x7f807810a590 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8078122610 con 0x7f807810aee0 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f807db24640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8078122910 con 0x7f8078116640 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38512/0 (socket says 172.21.15.6:38512) 2024-09-21T08:12:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.725+0000 7f8076ffd640 1 -- 172.21.15.6:0/1056322647 learned_addr learned my addr 172.21.15.6:0/1056322647 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 -- 172.21.15.6:0/1056322647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8078116640 msgr2=0x7f80781ae980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:12:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8078116640 0x7f80781ae980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 -- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807810a590 msgr2=0x7f80781a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807810a590 0x7f80781a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 -- 172.21.15.6:0/1056322647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80781af080 con 0x7f807810aee0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8076ffd640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f806800d770 tx=0x7f806800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8074ff9640 1 -- 172.21.15.6:0/1056322647 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068017070 con 0x7f807810aee0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8074ff9640 1 -- 172.21.15.6:0/1056322647 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f806800de80 con 0x7f807810aee0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.726+0000 7f8074ff9640 1 -- 172.21.15.6:0/1056322647 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806800f3c0 con 0x7f807810aee0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.727+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80781af370 con 0x7f807810aee0 2024-09-21T08:12:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.727+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8078119a80 con 0x7f807810aee0 2024-09-21T08:12:45.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.731+0000 7f8074ff9640 1 -- 172.21.15.6:0/1056322647 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f806801a070 con 0x7f807810aee0 2024-09-21T08:12:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.735+0000 7f8074ff9640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 0x7f80640b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.736+0000 7f80777fe640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 0x7f80640b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.736+0000 7f8074ff9640 1 -- 172.21.15.6:0/1056322647 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f80680e7630 con 0x7f807810aee0 2024-09-21T08:12:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.737+0000 7f8084098740 1 Processor -- start 2024-09-21T08:12:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.737+0000 7f80777fe640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 0x7f80640b8c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f80600058c0 tx=0x7f8060005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.737+0000 7f8084098740 1 -- start start 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.738+0000 7f8084098740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.738+0000 7f8084098740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.738+0000 7f80777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.738+0000 7f80777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41392/0 (socket says 172.21.15.6:41392) 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.738+0000 7f8084098740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38528/0 (socket says 172.21.15.6:38528) 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8077fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8077fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40770/0 (socket says 172.21.15.6:40770) 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8077fff640 1 -- 172.21.15.6:0/3891097390 learned_addr learned my addr 172.21.15.6:0/3891097390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5621a8269e60 con 0x5621a7f4c350 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5621a8259290 con 0x5621a7f23490 2024-09-21T08:12:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.739+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5621a825d0a0 con 0x5621a7f2b670 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f8077fff640 1 -- 172.21.15.6:0/3891097390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 msgr2=0x5621a82f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f8077fff640 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f8077fff640 1 -- 172.21.15.6:0/3891097390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 msgr2=0x5621a82f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f8077fff640 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f8077fff640 1 -- 172.21.15.6:0/3891097390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a7fb7930 con 0x5621a7f2b670 2024-09-21T08:12:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.740+0000 7f80777fe640 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.741+0000 7f8076ffd640 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.741+0000 7f8077fff640 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8070009800 tx=0x7f8070009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c91c22e18ad0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.742+0000 7f806dffb640 1 -- 172.21.15.6:0/3891097390 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807003f030 con 0x5621a7f2b670 2024-09-21T08:12:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.742+0000 7f806dffb640 1 -- 172.21.15.6:0/3891097390 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8070030bf0 con 0x5621a7f2b670 2024-09-21T08:12:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.742+0000 7f806dffb640 1 -- 172.21.15.6:0/3891097390 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070036070 con 0x5621a7f2b670 2024-09-21T08:12:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 msgr2=0x5621a82f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8070009800 tx=0x7f8070009830 comp rx=0 tx=0).stop 2024-09-21T08:12:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 shutdown_connections 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a82f3eb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 --2- 172.21.15.6:0/3891097390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f4c350 0x5621a82f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 >> 172.21.15.6:0/3891097390 conn(0x5621a7f40740 msgr2=0x5621a82f1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 shutdown_connections 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.744+0000 7f8084098740 1 -- 172.21.15.6:0/3891097390 wait complete. 2024-09-21T08:12:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.745+0000 7f8084098740 1 -- start start 2024-09-21T08:12:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.746+0000 7f8084098740 1 Processor -- start 2024-09-21T08:12:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 0x5621a82ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82ff690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f80777fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 0x5621a82ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f80777fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 0x5621a82ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40776/0 (socket says 172.21.15.6:40776) 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f80777fe640 1 -- 172.21.15.6:0/4238097012 learned_addr learned my addr 172.21.15.6:0/4238097012 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a830aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5621a80ba890 con 0x5621a7f2b670 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5621a81f3d40 con 0x5621a7f4c350 2024-09-21T08:12:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.747+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5621a8301bb0 con 0x5621a7f23490 2024-09-21T08:12:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.748+0000 7f8084098740 10 client.0 _ll_register_callbacks cb 0x5621a8257c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.748+0000 7f8077fff640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a830aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 -- 172.21.15.6:0/4238097012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 msgr2=0x5621a82ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 0x5621a82ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 -- 172.21.15.6:0/4238097012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 msgr2=0x5621a82ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a830b560 con 0x5621a7f4c350 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8077fff640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a830aef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8070009b30 tx=0x7f8070003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5ed3534f8ff016 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070036050 con 0x5621a7f4c350 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.749+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f8070004040 con 0x5621a7f4c350 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.750+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8070030bf0 con 0x5621a7f4c350 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.750+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f807003f040 con 0x5621a7f4c350 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.750+0000 7f8084098740 10 client.26861 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.750+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5621a830de70 con 0x5621a7f4c350 2024-09-21T08:12:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.751+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80700306b0 con 0x5621a7f4c350 2024-09-21T08:12:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8070031940 con 0x5621a7f4c350 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 10 client.26861 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 10 client.26861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 20 client.26861 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7f0acd0 0x5621a83111d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 4 client.26861 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8070030bf0 con 0x5621a7f0acd0 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.752+0000 7f80777fe640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7f0acd0 0x5621a83111d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.753+0000 7f80777fe640 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7f0acd0 0x5621a83111d0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a26d66806f15d4cc server_cookie=81bde541ad371a0f in_seq=0 out_seq=0 2024-09-21T08:12:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.753+0000 7f8056ffd640 10 client.26861 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.754+0000 7f8056ffd640 1 -- 172.21.15.6:0/4238097012 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8070030bf0 con 0x5621a7f0acd0 2024-09-21T08:12:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.754+0000 7f8056ffd640 10 client.26861 handle_command_reply: tid=0 2024-09-21T08:12:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.754+0000 7f8084098740 1 client.26861 shutdown 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.755+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 msgr2=0x5621a830aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.755+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a830aef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8070009b30 tx=0x7f8070003ba0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 shutdown_connections 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7f0acd0 0x5621a83111d0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a830aef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8056ffd640 0 client.26861 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 --2- 172.21.15.6:0/4238097012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f23490 0x5621a82ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 >> 172.21.15.6:0/4238097012 conn(0x5621a7f40740 msgr2=0x5621a82f6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 shutdown_connections 2024-09-21T08:12:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.756+0000 7f8084098740 1 -- 172.21.15.6:0/4238097012 wait complete. 2024-09-21T08:12:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.757+0000 7f8084098740 20 client.26861 trim_cache size 0 max 16384 2024-09-21T08:12:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 Processor -- start 2024-09-21T08:12:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 -- start start 2024-09-21T08:12:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 0x5621a82f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f807810b5e0 con 0x5621a7f2b670 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f80781c8cd0 con 0x5621a7f23490 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.791+0000 7f8084098740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f80781c6b10 con 0x5621a7f4c350 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f80777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f80777fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:38556/0 (socket says 172.21.15.6:38556) 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f80777fe640 1 -- 172.21.15.6:0/231003488 learned_addr learned my addr 172.21.15.6:0/231003488 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8076ffd640 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 0x5621a82f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 -- 172.21.15.6:0/231003488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 msgr2=0x5621a82f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 -- 172.21.15.6:0/231003488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 msgr2=0x5621a82f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.792+0000 7f8077fff640 1 -- 172.21.15.6:0/231003488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a82fd3c0 con 0x5621a7f4c350 2024-09-21T08:12:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.793+0000 7f8077fff640 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 0x5621a82f8a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f807002abe0 tx=0x7f8070009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54b66d01d6b82fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.793+0000 7f806d7fa640 1 -- 172.21.15.6:0/231003488 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070036070 con 0x5621a7f4c350 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.793+0000 7f806d7fa640 1 -- 172.21.15.6:0/231003488 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8070003e20 con 0x5621a7f4c350 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.793+0000 7f806d7fa640 1 -- 172.21.15.6:0/231003488 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070056a40 con 0x5621a7f4c350 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 -- 172.21.15.6:0/231003488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 msgr2=0x5621a82f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 0x5621a82f8a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f807002abe0 tx=0x7f8070009ac0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 -- 172.21.15.6:0/231003488 shutdown_connections 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f4c350 0x5621a82f8a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f2b670 0x5621a82f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 --2- 172.21.15.6:0/231003488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f23490 0x5621a82f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 -- 172.21.15.6:0/231003488 >> 172.21.15.6:0/231003488 conn(0x5621a7f40740 msgr2=0x5621a82fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 -- 172.21.15.6:0/231003488 shutdown_connections 2024-09-21T08:12:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.794+0000 7f8084098740 1 -- 172.21.15.6:0/231003488 wait complete. 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.795+0000 7f8084098740 1 -- start start 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.795+0000 7f8084098740 1 Processor -- start 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f23490 0x5621a8314c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a83128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f80781c7190 con 0x5621a7f23490 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f80781c8600 con 0x5621a7f4c350 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f80781c7860 con 0x5621a7f2b670 2024-09-21T08:12:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8084098740 10 client.0 _ll_register_callbacks cb 0x7f8060005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8076ffd640 1 -- 172.21.15.6:0/2454201490 learned_addr learned my addr 172.21.15.6:0/2454201490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f8077fff640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a83128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.796+0000 7f80777fe640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f23490 0x5621a8314c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 -- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 msgr2=0x5621a83128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a83128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 -- 172.21.15.6:0/2454201490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f23490 msgr2=0x5621a8314c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f23490 0x5621a8314c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 -- 172.21.15.6:0/2454201490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a837a950 con 0x5621a7f2b670 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8076ffd640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80680e4fa0 tx=0x7f80680ac940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea4f5e8e5858032c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068021040 con 0x5621a7f2b670 2024-09-21T08:12:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f80680983b0 con 0x5621a7f2b670 2024-09-21T08:12:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.797+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8070003e20 con 0x5621a7f2b670 2024-09-21T08:12:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f80680ad7a0 con 0x5621a7f2b670 2024-09-21T08:12:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 10 client.26947 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5621a837bb10 con 0x5621a7f2b670 2024-09-21T08:12:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8070003e20 con 0x5621a7f2b670 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f806805c1b0 con 0x5621a7f2b670 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 10 client.26947 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 10 client.26947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 20 client.26947 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7ee0080 0x5621a837e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 4 client.26947 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.798+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5621a826bdb0 con 0x5621a7ee0080 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.799+0000 7f80777fe640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7ee0080 0x5621a837e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.801+0000 7f80777fe640 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7ee0080 0x5621a837e240 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f60c185951c5b9 server_cookie=f65d4c1af4ed9fa6 in_seq=0 out_seq=0 2024-09-21T08:12:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.801+0000 7f8056ffd640 10 client.26947 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.802+0000 7f8056ffd640 1 -- 172.21.15.6:0/2454201490 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5621a826bdb0 con 0x5621a7ee0080 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.802+0000 7f8056ffd640 10 client.26947 handle_command_reply: tid=0 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.802+0000 7f8084098740 1 client.26947 shutdown 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 msgr2=0x5621a8312190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80680e4fa0 tx=0x7f80680ac940 comp rx=0 tx=0).stop 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 shutdown_connections 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5621a7ee0080 0x5621a837e240 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621a7f2b670 0x5621a8312190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8056ffd640 0 client.26947 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5621a7f4c350 0x5621a83128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 --2- 172.21.15.6:0/2454201490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621a7f23490 0x5621a8314c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.803+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 >> 172.21.15.6:0/2454201490 conn(0x5621a7f40740 msgr2=0x5621a82f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.804+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 shutdown_connections 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.804+0000 7f8084098740 1 -- 172.21.15.6:0/2454201490 wait complete. 2024-09-21T08:12:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.804+0000 7f8084098740 20 client.26947 trim_cache size 0 max 16384 2024-09-21T08:12:45.806 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:12:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:12:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029", 2024-09-21T08:12:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:12:45.806 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:12:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 msgr2=0x7f80640b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 0x7f80640b8c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f80600058c0 tx=0x7f8060005850 comp rx=0 tx=0).stop 2024-09-21T08:12:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 msgr2=0x7f80781a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f806800d770 tx=0x7f806800dc30 comp rx=0 tx=0).stop 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 shutdown_connections 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.805+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f80640b6700 0x7f80640b8c10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8078116640 0x7f80781ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807810aee0 0x7f80781a96e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 --2- 172.21.15.6:0/1056322647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807810a590 0x7f80781a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 >> 172.21.15.6:0/1056322647 conn(0x7f80780712f0 msgr2=0x7f80781100d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 shutdown_connections 2024-09-21T08:12:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:45.806+0000 7f807db24640 1 -- 172.21.15.6:0/1056322647 wait complete. 2024-09-21T08:12:46.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:12:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:12:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:46 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:12:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:46 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:46 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:12:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:46 smithi006 ceph-mon[30970]: pgmap v705: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 8.6 MiB/s wr, 670 op/s 2024-09-21T08:12:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:46 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:12:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:46 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:46 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:12:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:46 smithi119 ceph-mon[33564]: pgmap v705: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 8.6 MiB/s wr, 670 op/s 2024-09-21T08:12:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:46 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:12:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:46 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:46 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:12:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:46 smithi145 ceph-mon[34049]: pgmap v705: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 8.6 MiB/s wr, 670 op/s 2024-09-21T08:12:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 590.0 s, 774.8 tps, lat 132.157 ms stddev 122.426 2024-09-21T08:12:47.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.667+0000 7ff76e543640 1 -- 172.21.15.6:0/1976155596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768081940 msgr2=0x7ff768081d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.667+0000 7ff766ffd640 1 -- 172.21.15.6:0/1976155596 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758059070 con 0x7ff768081940 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.667+0000 7ff76e543640 1 --2- 172.21.15.6:0/1976155596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768081940 0x7ff768081d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff758009860 tx=0x7ff75804c370 comp rx=0 tx=0).stop 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.669+0000 7ff76e543640 1 -- 172.21.15.6:0/1976155596 shutdown_connections 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.669+0000 7ff76e543640 1 --2- 172.21.15.6:0/1976155596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768081940 0x7ff768081d50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.669+0000 7ff76e543640 1 --2- 172.21.15.6:0/1976155596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768082290 0x7ff768082ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.669+0000 7ff76e543640 1 --2- 172.21.15.6:0/1976155596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff76807c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.669+0000 7ff76e543640 1 -- 172.21.15.6:0/1976155596 >> 172.21.15.6:0/1976155596 conn(0x7ff7680780e0 msgr2=0x7ff7681081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.670+0000 7ff76e543640 1 -- 172.21.15.6:0/1976155596 shutdown_connections 2024-09-21T08:12:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.670+0000 7ff76e543640 1 -- 172.21.15.6:0/1976155596 wait complete. 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.670+0000 7ff76e543640 1 Processor -- start 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 -- start start 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768081940 0x7ff768198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768082290 0x7ff76819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff76810b7e0 con 0x7ff76807c000 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff76810b660 con 0x7ff768081940 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.671+0000 7ff76e543640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff76810b960 con 0x7ff768082290 2024-09-21T08:12:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48906/0 (socket says 172.21.15.6:48906) 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 -- 172.21.15.6:0/2817256463 learned_addr learned my addr 172.21.15.6:0/2817256463 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff7677fe640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768081940 0x7ff768198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff76cae0640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768082290 0x7ff76819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 -- 172.21.15.6:0/2817256463 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768082290 msgr2=0x7ff76819da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768082290 0x7ff76819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 -- 172.21.15.6:0/2817256463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768081940 msgr2=0x7ff768198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768081940 0x7ff768198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.672+0000 7ff767fff640 1 -- 172.21.15.6:0/2817256463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76819e150 con 0x7ff76807c000 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.673+0000 7ff767fff640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff76000ed80 tx=0x7ff76000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.673+0000 7ff7657fa640 1 -- 172.21.15.6:0/2817256463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76001c070 con 0x7ff76807c000 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.674+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76819e440 con 0x7ff76807c000 2024-09-21T08:12:47.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.674+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7681a4ba0 con 0x7ff76807c000 2024-09-21T08:12:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.677+0000 7ff774ab7740 1 Processor -- start 2024-09-21T08:12:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.678+0000 7ff7657fa640 1 -- 172.21.15.6:0/2817256463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff76000f890 con 0x7ff76807c000 2024-09-21T08:12:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.678+0000 7ff7657fa640 1 -- 172.21.15.6:0/2817256463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760026060 con 0x7ff76807c000 2024-09-21T08:12:47.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.682+0000 7ff774ab7740 1 -- start start 2024-09-21T08:12:47.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.682+0000 7ff7657fa640 1 -- 172.21.15.6:0/2817256463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff76001f070 con 0x7ff76807c000 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 0x565216ec1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 0x565216ec1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216ec20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x565216e37e50 con 0x565216b1a070 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565216e27280 con 0x565216af11b0 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff774ab7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x565216e2b090 con 0x565216af9390 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.683+0000 7ff7657fa640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 0x7ff7500c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.684+0000 7ff7657fa640 1 -- 172.21.15.6:0/2817256463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff7600e8a10 con 0x7ff76807c000 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.684+0000 7ff76cae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 0x565216ec1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.684+0000 7ff76cae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 0x565216ec1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48922/0 (socket says 172.21.15.6:48922) 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 0x565216ec1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff76cae0640 1 -- 172.21.15.6:0/1208815769 learned_addr learned my addr 172.21.15.6:0/1208815769 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff76cae0640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 0x7ff7500c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff7677fe640 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216ec20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 -- 172.21.15.6:0/1208815769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 msgr2=0x565216ec20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216ec20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 -- 172.21.15.6:0/1208815769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 msgr2=0x565216ec1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 0x565216ec1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.685+0000 7ff767fff640 1 -- 172.21.15.6:0/1208815769 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565216b85650 con 0x565216af11b0 2024-09-21T08:12:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.686+0000 7ff767fff640 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 0x565216ec1b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7600e5d00 tx=0x7ff76000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92ef2365d83fcfbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.686+0000 7ff74e7fc640 1 -- 172.21.15.6:0/1208815769 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7600aeb00 con 0x565216af11b0 2024-09-21T08:12:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.686+0000 7ff76cae0640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 0x7ff7500c9cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff75c014910 tx=0x7ff75c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.686+0000 7ff74e7fc640 1 -- 172.21.15.6:0/1208815769 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7600b2ee0 con 0x565216af11b0 2024-09-21T08:12:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.686+0000 7ff74e7fc640 1 -- 172.21.15.6:0/1208815769 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7600b7990 con 0x565216af11b0 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 -- 172.21.15.6:0/1208815769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 msgr2=0x565216ec1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 0x565216ec1b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7600e5d00 tx=0x7ff76000ef90 comp rx=0 tx=0).stop 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 -- 172.21.15.6:0/1208815769 shutdown_connections 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216ec20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af11b0 0x565216ec1b90 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7600e5d00 tx=0x7ff76000ef90 comp rx=0 tx=0).stop 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 --2- 172.21.15.6:0/1208815769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216b1a070 0x565216ec1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.688+0000 7ff774ab7740 1 -- 172.21.15.6:0/1208815769 >> 172.21.15.6:0/1208815769 conn(0x565216b0e460 msgr2=0x565216ebf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.692+0000 7ff774ab7740 1 -- 172.21.15.6:0/1208815769 shutdown_connections 2024-09-21T08:12:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.692+0000 7ff774ab7740 1 -- 172.21.15.6:0/1208815769 wait complete. 2024-09-21T08:12:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.692+0000 7ff774ab7740 1 -- start start 2024-09-21T08:12:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.693+0000 7ff774ab7740 1 Processor -- start 2024-09-21T08:12:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ed9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x565216c88700 con 0x565216ad89f0 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565216dc2110 con 0x565216af9390 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x565216ecfe20 con 0x565216b1a070 2024-09-21T08:12:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff774ab7740 10 client.0 _ll_register_callbacks cb 0x565216ddb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff7677fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:41488/0 (socket says 172.21.15.6:41488) 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff767fff640 1 -- 172.21.15.6:0/736298905 learned_addr learned my addr 172.21.15.6:0/736298905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.694+0000 7ff7677fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:60984/0 (socket says 172.21.15.6:60984) 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff76cae0640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ed9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 -- 172.21.15.6:0/736298905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 msgr2=0x565216ecd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 -- 172.21.15.6:0/736298905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 msgr2=0x565216ed9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ed9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 -- 172.21.15.6:0/736298905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565216defc40 con 0x565216af9390 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff7677fe640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff767fff640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7600ab670 tx=0x7ff7600aa8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eda0af7e6a443bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff76cae0640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ed9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.695+0000 7ff7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:12:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7600aeb00 con 0x565216af9390 2024-09-21T08:12:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff7600b7ba0 con 0x565216af9390 2024-09-21T08:12:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7600b2ee0 con 0x565216af9390 2024-09-21T08:12:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff760095b40 con 0x565216af9390 2024-09-21T08:12:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff774ab7740 10 client.26876 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.696+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565216edbc10 con 0x565216af9390 2024-09-21T08:12:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff760095ce0 con 0x565216af9390 2024-09-21T08:12:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff76000b030 con 0x565216af9390 2024-09-21T08:12:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 10 client.26876 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 10 client.26876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 20 client.26876 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216aadda0 0x565216edef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 4 client.26876 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.699+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff7600b2ee0 con 0x565216aadda0 2024-09-21T08:12:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.700+0000 7ff7677fe640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216aadda0 0x565216edef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.702+0000 7ff7477fe640 10 client.26876 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.702+0000 7ff7677fe640 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216aadda0 0x565216edef70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=493576ea854fb0fa server_cookie=999e5cb371390f81 in_seq=0 out_seq=0 2024-09-21T08:12:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.703+0000 7ff7477fe640 1 -- 172.21.15.6:0/736298905 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ff7600b2ee0 con 0x565216aadda0 2024-09-21T08:12:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.703+0000 7ff7477fe640 10 client.26876 handle_command_reply: tid=0 2024-09-21T08:12:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.703+0000 7ff774ab7740 1 client.26876 shutdown 2024-09-21T08:12:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 msgr2=0x565216eccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7600ab670 tx=0x7ff7600aa8a0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 shutdown_connections 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216aadda0 0x565216edef70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff7477fe640 0 client.26876 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.704+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216b1a070 0x565216ecd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.705+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ed9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.705+0000 7ff774ab7740 1 --2- 172.21.15.6:0/736298905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216af9390 0x565216eccdc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.705+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 >> 172.21.15.6:0/736298905 conn(0x565216b0e460 msgr2=0x565216ec47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.705+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 shutdown_connections 2024-09-21T08:12:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.705+0000 7ff774ab7740 1 -- 172.21.15.6:0/736298905 wait complete. 2024-09-21T08:12:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.706+0000 7ff774ab7740 20 client.26876 trim_cache size 0 max 16384 2024-09-21T08:12:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 Processor -- start 2024-09-21T08:12:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 -- start start 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216ece9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ec9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216eca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400e180 con 0x565216ad89f0 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff7540109e0 con 0x565216aadda0 2024-09-21T08:12:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.740+0000 7ff774ab7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400e7d0 con 0x565216af9390 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.741+0000 7ff7677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ec9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.741+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216ece9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.741+0000 7ff7677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ec9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48950/0 (socket says 172.21.15.6:48950) 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.741+0000 7ff7677fe640 1 -- 172.21.15.6:0/3315558555 learned_addr learned my addr 172.21.15.6:0/3315558555 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.741+0000 7ff76cae0640 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216eca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.742+0000 7ff76cae0640 1 -- 172.21.15.6:0/3315558555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 msgr2=0x565216ece9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.742+0000 7ff76cae0640 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216ece9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.742+0000 7ff76cae0640 1 -- 172.21.15.6:0/3315558555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 msgr2=0x565216ec9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.742+0000 7ff76cae0640 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ec9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.742+0000 7ff76cae0640 1 -- 172.21.15.6:0/3315558555 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565216ecb2c0 con 0x565216af9390 2024-09-21T08:12:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.745+0000 7ff76cae0640 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216eca4f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff75c014350 tx=0x7ff75c009690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=273b453c2b9062e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.745+0000 7ff74dffb640 1 -- 172.21.15.6:0/3315558555 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c026030 con 0x565216af9390 2024-09-21T08:12:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.746+0000 7ff74dffb640 1 -- 172.21.15.6:0/3315558555 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff75c011e00 con 0x565216af9390 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 -- 172.21.15.6:0/3315558555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 msgr2=0x565216eca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216eca4f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff75c014350 tx=0x7ff75c009690 comp rx=0 tx=0).stop 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 -- 172.21.15.6:0/3315558555 shutdown_connections 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216af9390 0x565216eca4f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216ad89f0 0x565216ec9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 --2- 172.21.15.6:0/3315558555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216ece9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.747+0000 7ff774ab7740 1 -- 172.21.15.6:0/3315558555 >> 172.21.15.6:0/3315558555 conn(0x565216b0e460 msgr2=0x565216ece2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.748+0000 7ff774ab7740 1 -- 172.21.15.6:0/3315558555 shutdown_connections 2024-09-21T08:12:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.748+0000 7ff774ab7740 1 -- 172.21.15.6:0/3315558555 wait complete. 2024-09-21T08:12:47.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.748+0000 7ff774ab7740 1 -- start start 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 Processor -- start 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216f3d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 0x565216f3dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 0x565216f48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400eea0 con 0x565216af9390 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff754010310 con 0x565216aadda0 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400f570 con 0x565216ad89f0 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff774ab7740 10 client.0 _ll_register_callbacks cb 0x7ff7600adfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216f3d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216f3d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:41502/0 (socket says 172.21.15.6:41502) 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.749+0000 7ff767fff640 1 -- 172.21.15.6:0/2496302034 learned_addr learned my addr 172.21.15.6:0/2496302034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 0x565216f3dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff76cae0640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 0x565216f48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 -- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 msgr2=0x565216f3d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216f3d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 -- 172.21.15.6:0/2496302034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 msgr2=0x565216f48700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 0x565216f48700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 -- 172.21.15.6:0/2496302034 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565216f3e3d0 con 0x565216ad89f0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff76cae0640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 0x565216f48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7677fe640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 0x565216f3dbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff758005cd0 tx=0x7ff758004460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09ceb6559d3be31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.750+0000 7ff7477fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758059040 con 0x565216ad89f0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75c011e00 con 0x565216ad89f0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff758005510 con 0x565216ad89f0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff758076050 con 0x565216ad89f0 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff774ab7740 10 client.26962 fetch_fsmap learned FSMap version 21 2024-09-21T08:12:47.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565216f49c70 con 0x565216ad89f0 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.751+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff75c011e00 con 0x565216ad89f0 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff75805f040 con 0x565216ad89f0 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 10 client.26962 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 10 client.26962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 20 client.26962 populate_metadata read hostname 'smithi006' 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216b1a070 0x565216f4c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 4 client.26962 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565216e39da0 con 0x565216b1a070 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff767fff640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216b1a070 0x565216f4c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.752+0000 7ff7477fe640 10 client.26962 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:47.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff767fff640 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216b1a070 0x565216f4c400 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5fef2e5720164e5 server_cookie=386bc08172a8a71b in_seq=0 out_seq=0 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff7477fe640 1 -- 172.21.15.6:0/2496302034 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x565216e39da0 con 0x565216b1a070 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff7477fe640 10 client.26962 handle_command_reply: tid=0 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 client.26962 shutdown 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 msgr2=0x565216f3dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 0x565216f3dbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff758005cd0 tx=0x7ff758004460 comp rx=0 tx=0).stop 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 shutdown_connections 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565216b1a070 0x565216f4c400 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565216ad89f0 0x565216f3dbc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565216af9390 0x565216f48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.753+0000 7ff774ab7740 1 --2- 172.21.15.6:0/2496302034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565216aadda0 0x565216f3d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.754+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 >> 172.21.15.6:0/2496302034 conn(0x565216b0e460 msgr2=0x565216ec4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.754+0000 7ff7477fe640 0 client.26962 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:12:47.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.754+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 shutdown_connections 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.754+0000 7ff774ab7740 1 -- 172.21.15.6:0/2496302034 wait complete. 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.754+0000 7ff774ab7740 20 client.26962 trim_cache size 0 max 16384 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029", 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:12:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:12:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:12:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:12:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:12:47.774 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:12:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.755+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 msgr2=0x7ff7500c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.755+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 0x7ff7500c9cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff75c014910 tx=0x7ff75c005f90 comp rx=0 tx=0).stop 2024-09-21T08:12:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.755+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 msgr2=0x7ff7681981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:12:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.755+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff76000ed80 tx=0x7ff76000c6e0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 shutdown_connections 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff7500c77c0 0x7ff7500c9cd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff768082290 0x7ff76819da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff768081940 0x7ff768198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 --2- 172.21.15.6:0/2817256463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76807c000 0x7ff7681981e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 >> 172.21.15.6:0/2817256463 conn(0x7ff7680780e0 msgr2=0x7ff76807d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 shutdown_connections 2024-09-21T08:12:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:12:47.756+0000 7ff76e543640 1 -- 172.21.15.6:0/2817256463 wait complete. 2024-09-21T08:12:48.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:47 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:48.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:47 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:48.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:47 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:12:48.586 INFO:tasks.cephfs.filesystem:scrub status for tag:1d4fa5e1-3be1-487e-a1b2-2bc0d9241029 - {'path': '/', 'tag': '1d4fa5e1-3be1-487e-a1b2-2bc0d9241029', 'options': 'recursive,force'} 2024-09-21T08:12:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:48 smithi119 ceph-mon[33564]: pgmap v706: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.1 MiB/s wr, 771 op/s 2024-09-21T08:12:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:48 smithi145 ceph-mon[34049]: pgmap v706: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.1 MiB/s wr, 771 op/s 2024-09-21T08:12:49.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:48 smithi006 ceph-mon[30970]: pgmap v706: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 9.1 MiB/s wr, 771 op/s 2024-09-21T08:12:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:50 smithi119 ceph-mon[33564]: pgmap v707: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 8.6 MiB/s wr, 685 op/s 2024-09-21T08:12:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:50 smithi145 ceph-mon[34049]: pgmap v707: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 8.6 MiB/s wr, 685 op/s 2024-09-21T08:12:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:50 smithi006 ceph-mon[30970]: pgmap v707: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 8.6 MiB/s wr, 685 op/s 2024-09-21T08:12:52.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:51 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:12:52.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:51 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:12:52.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:51 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:12:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 595.0 s, 616.8 tps, lat 138.833 ms stddev 88.276 2024-09-21T08:12:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:53 smithi119 ceph-mon[33564]: pgmap v708: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-21T08:12:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:53 smithi145 ceph-mon[34049]: pgmap v708: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-21T08:12:53.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:53 smithi006 ceph-mon[30970]: pgmap v708: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-21T08:12:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:55 smithi119 ceph-mon[33564]: pgmap v709: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T08:12:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:55 smithi145 ceph-mon[34049]: pgmap v709: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T08:12:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:55 smithi006 ceph-mon[30970]: pgmap v709: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T08:12:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:57 smithi119 ceph-mon[33564]: pgmap v710: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 9.1 MiB/s wr, 746 op/s 2024-09-21T08:12:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:57 smithi145 ceph-mon[34049]: pgmap v710: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 9.1 MiB/s wr, 746 op/s 2024-09-21T08:12:57.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:57 smithi006 ceph-mon[30970]: pgmap v710: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 9.1 MiB/s wr, 746 op/s 2024-09-21T08:12:57.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 600.0 s, 678.0 tps, lat 168.413 ms stddev 268.968 2024-09-21T08:12:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:12:59 smithi119 ceph-mon[33564]: pgmap v711: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-09-21T08:12:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:12:59 smithi145 ceph-mon[34049]: pgmap v711: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-09-21T08:12:59.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:12:59 smithi006 ceph-mon[30970]: pgmap v711: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-09-21T08:13:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:01 smithi119 ceph-mon[33564]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-09-21T08:13:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:01 smithi145 ceph-mon[34049]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-09-21T08:13:01.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:01 smithi006 ceph-mon[30970]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-09-21T08:13:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 605.0 s, 608.0 tps, lat 122.274 ms stddev 144.784 2024-09-21T08:13:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:03 smithi119 ceph-mon[33564]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-21T08:13:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:03 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:13:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:03 smithi145 ceph-mon[34049]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-21T08:13:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:03 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:13:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:03 smithi006 ceph-mon[30970]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-21T08:13:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:03 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:13:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:05 smithi119 ceph-mon[33564]: pgmap v714: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-21T08:13:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:05 smithi145 ceph-mon[34049]: pgmap v714: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-21T08:13:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:05 smithi006 ceph-mon[30970]: pgmap v714: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-21T08:13:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:13:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:13:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:13:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:13:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:13:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:13:06.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:13:06.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:13:06.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:06 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:13:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:07 smithi119 ceph-mon[33564]: pgmap v715: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:13:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:07 smithi119 ceph-mon[33564]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:13:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:07 smithi145 ceph-mon[34049]: pgmap v715: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:13:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:07 smithi145 ceph-mon[34049]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:13:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:07 smithi006 ceph-mon[30970]: pgmap v715: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-21T08:13:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:07 smithi006 ceph-mon[30970]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:13:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 610.0 s, 227.6 tps, lat 479.612 ms stddev 786.441 2024-09-21T08:13:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:09 smithi145 ceph-mon[34049]: pgmap v717: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-09-21T08:13:09.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:09 smithi006 ceph-mon[30970]: pgmap v717: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-09-21T08:13:09.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:09 smithi119 ceph-mon[33564]: pgmap v717: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-09-21T08:13:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:11 smithi145 ceph-mon[34049]: pgmap v718: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-21T08:13:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:11 smithi006 ceph-mon[30970]: pgmap v718: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-21T08:13:11.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:11 smithi119 ceph-mon[33564]: pgmap v718: 129 pgs: 6 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 117 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-21T08:13:12.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 615.0 s, 576.4 tps, lat 192.525 ms stddev 369.931 2024-09-21T08:13:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:13 smithi145 ceph-mon[34049]: pgmap v719: 129 pgs: 4 active+clean+snaptrim, 125 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 888 op/s 2024-09-21T08:13:13.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:13 smithi006 ceph-mon[30970]: pgmap v719: 129 pgs: 4 active+clean+snaptrim, 125 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 888 op/s 2024-09-21T08:13:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:13 smithi119 ceph-mon[33564]: pgmap v719: 129 pgs: 4 active+clean+snaptrim, 125 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 888 op/s 2024-09-21T08:13:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:14 smithi119 ceph-mon[33564]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:13:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:14 smithi145 ceph-mon[34049]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:13:14.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:14 smithi006 ceph-mon[30970]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:13:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:15 smithi119 ceph-mon[33564]: pgmap v721: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 908 op/s 2024-09-21T08:13:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:15 smithi145 ceph-mon[34049]: pgmap v721: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 908 op/s 2024-09-21T08:13:15.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:15 smithi006 ceph-mon[30970]: pgmap v721: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 908 op/s 2024-09-21T08:13:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 620.0 s, 641.2 tps, lat 164.086 ms stddev 355.992 2024-09-21T08:13:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:17 smithi119 ceph-mon[33564]: pgmap v722: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-21T08:13:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:17 smithi145 ceph-mon[34049]: pgmap v722: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-21T08:13:17.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:17 smithi006 ceph-mon[30970]: pgmap v722: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-21T08:13:18.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:13:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.740+0000 7f7547c26640 1 -- 172.21.15.6:0/509349062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75401076e0 msgr2=0x7f7540107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.740+0000 7f7547c26640 1 --2- 172.21.15.6:0/509349062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75401076e0 0x7f7540107af0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7534009860 tx=0x7f753402a360 comp rx=0 tx=0).stop 2024-09-21T08:13:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 -- 172.21.15.6:0/509349062 shutdown_connections 2024-09-21T08:13:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 --2- 172.21.15.6:0/509349062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7540108030 0x7f754010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 --2- 172.21.15.6:0/509349062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75401076e0 0x7f7540107af0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 --2- 172.21.15.6:0/509349062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f75401021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 -- 172.21.15.6:0/509349062 >> 172.21.15.6:0/509349062 conn(0x7f7540077800 msgr2=0x7f7540077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 -- 172.21.15.6:0/509349062 shutdown_connections 2024-09-21T08:13:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.741+0000 7f7547c26640 1 -- 172.21.15.6:0/509349062 wait complete. 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.743+0000 7f7547c26640 1 Processor -- start 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.743+0000 7f7547c26640 1 -- start start 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f7540074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 0x7f754006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7540108030 0x7f754006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f75459c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f7540074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f75459c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f7540074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:59892/0 (socket says 172.21.15.6:59892) 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f75459c2640 1 -- 172.21.15.6:0/389721851 learned_addr learned my addr 172.21.15.6:0/389721851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f754006d3b0 con 0x7f7540108030 2024-09-21T08:13:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f754006d230 con 0x7f7540101da0 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.744+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f754006d530 con 0x7f75401076e0 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.745+0000 7f75451c1640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 0x7f754006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.745+0000 7f75461c3640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7540108030 0x7f754006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.746+0000 7f75451c1640 1 -- 172.21.15.6:0/389721851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 msgr2=0x7f7540074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.746+0000 7f75451c1640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f7540074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.746+0000 7f75451c1640 1 -- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7540108030 msgr2=0x7f754006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.746+0000 7f75451c1640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7540108030 0x7f754006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.746+0000 7f75451c1640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754006fc00 con 0x7f75401076e0 2024-09-21T08:13:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.747+0000 7f75451c1640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 0x7f754006ef90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f754006cc00 tx=0x7f7534030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.747+0000 7f753effd640 1 -- 172.21.15.6:0/389721851 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534040020 con 0x7f75401076e0 2024-09-21T08:13:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.747+0000 7f753effd640 1 -- 172.21.15.6:0/389721851 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75340044d0 con 0x7f75401076e0 2024-09-21T08:13:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.747+0000 7f753effd640 1 -- 172.21.15.6:0/389721851 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534037040 con 0x7f75401076e0 2024-09-21T08:13:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.748+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401ae020 con 0x7f75401076e0 2024-09-21T08:13:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.749+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75401ae3c0 con 0x7f75401076e0 2024-09-21T08:13:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.754+0000 7f754e19a740 1 Processor -- start 2024-09-21T08:13:19.755 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:19 smithi006 ceph-mon[30970]: pgmap v723: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 13 MiB/s wr, 809 op/s 2024-09-21T08:13:19.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:19 smithi006 ceph-mon[30970]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:13:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.755+0000 7f754e19a740 1 -- start start 2024-09-21T08:13:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0cb1b0 0x557c9d4a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d49bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557c9d411e50 con 0x557c9d0d3390 2024-09-21T08:13:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557c9d401280 con 0x557c9d0cb1b0 2024-09-21T08:13:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.756+0000 7f754e19a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557c9d405090 con 0x557c9d0f4070 2024-09-21T08:13:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44902/0 (socket says 172.21.15.6:44902) 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 -- 172.21.15.6:0/2664053905 learned_addr learned my addr 172.21.15.6:0/2664053905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f753effd640 1 -- 172.21.15.6:0/389721851 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7534043020 con 0x7f75401076e0 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 -- 172.21.15.6:0/2664053905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0cb1b0 msgr2=0x557c9d4a79c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0cb1b0 0x557c9d4a79c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 -- 172.21.15.6:0/2664053905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 msgr2=0x557c9d49bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d49bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.757+0000 7f75461c3640 1 -- 172.21.15.6:0/2664053905 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c9d15f650 con 0x557c9d0f4070 2024-09-21T08:13:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.759+0000 7f75461c3640 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7538009f70 tx=0x7f7538010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f396b9ab8a983a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.759+0000 7f753effd640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 0x7f75280b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.759+0000 7f7527fff640 1 -- 172.21.15.6:0/2664053905 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538016070 con 0x557c9d0f4070 2024-09-21T08:13:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.759+0000 7f753effd640 1 -- 172.21.15.6:0/389721851 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7534107540 con 0x7f75401076e0 2024-09-21T08:13:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.760+0000 7f7527fff640 1 -- 172.21.15.6:0/2664053905 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7538004d20 con 0x557c9d0f4070 2024-09-21T08:13:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.760+0000 7f7527fff640 1 -- 172.21.15.6:0/2664053905 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538012720 con 0x557c9d0f4070 2024-09-21T08:13:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 -- 172.21.15.6:0/2664053905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 msgr2=0x557c9d49b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7538009f70 tx=0x7f7538010800 comp rx=0 tx=0).stop 2024-09-21T08:13:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 -- 172.21.15.6:0/2664053905 shutdown_connections 2024-09-21T08:13:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d49bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0cb1b0 0x557c9d4a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 --2- 172.21.15.6:0/2664053905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d49b650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f754e19a740 1 -- 172.21.15.6:0/2664053905 >> 172.21.15.6:0/2664053905 conn(0x557c9d0e8460 msgr2=0x557c9d499540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.761+0000 7f75459c2640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 0x7f75280b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.762+0000 7f754e19a740 1 -- 172.21.15.6:0/2664053905 shutdown_connections 2024-09-21T08:13:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.762+0000 7f754e19a740 1 -- 172.21.15.6:0/2664053905 wait complete. 2024-09-21T08:13:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.762+0000 7f754e19a740 1 -- start start 2024-09-21T08:13:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.762+0000 7f75459c2640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 0x7f75280b8cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x557c9d49db30 tx=0x7f753000be80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 Processor -- start 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4a5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557c9d262700 con 0x557c9d0d3390 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557c9d39c110 con 0x557c9d0b29f0 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557c9d49c450 con 0x557c9d0f4070 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f754e19a740 10 client.0 _ll_register_callbacks cb 0x557c9d3b5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.763+0000 7f75459c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75459c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38574/0 (socket says 172.21.15.6:38574) 2024-09-21T08:13:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75459c2640 1 -- 172.21.15.6:0/4173042163 learned_addr learned my addr 172.21.15.6:0/4173042163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75461c3640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 -- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 msgr2=0x557c9d4bb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4bb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 -- 172.21.15.6:0/4173042163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 msgr2=0x557c9d4a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 -- 172.21.15.6:0/4173042163 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c9d3c9c40 con 0x557c9d0f4070 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75451c1640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4a5860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7534104880 tx=0x7f7534104d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd03477c108ad2af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.764+0000 7f75257fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.765+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340cc8d0 con 0x557c9d0f4070 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.765+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7538004d20 con 0x557c9d0f4070 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.765+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7534004250 con 0x557c9d0f4070 2024-09-21T08:13:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.765+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f75340cc6f0 con 0x557c9d0f4070 2024-09-21T08:13:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 10 client.26974 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557c9d4be3e0 con 0x557c9d0f4070 2024-09-21T08:13:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7538004d20 con 0x557c9d0f4070 2024-09-21T08:13:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f75341070b0 con 0x557c9d0f4070 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 10 client.26974 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 10 client.26974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 20 client.26974 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d087da0 0x557c9d4c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 4 client.26974 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.766+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c9d413da0 con 0x557c9d087da0 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.767+0000 7f75459c2640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d087da0 0x557c9d4c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.767+0000 7f75257fa640 10 client.26974 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.768+0000 7f75459c2640 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d087da0 0x557c9d4c1940 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=586657eaec940c34 server_cookie=b0992338e94d1bd0 in_seq=0 out_seq=0 2024-09-21T08:13:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f75257fa640 1 -- 172.21.15.6:0/4173042163 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c9d413da0 con 0x557c9d087da0 2024-09-21T08:13:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f75257fa640 10 client.26974 handle_command_reply: tid=0 2024-09-21T08:13:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 client.26974 shutdown 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 msgr2=0x557c9d4a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4a5860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7534104880 tx=0x7f7534104d30 comp rx=0 tx=0).stop 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 shutdown_connections 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d087da0 0x557c9d4c1940 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4a5860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4bb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 --2- 172.21.15.6:0/4173042163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 >> 172.21.15.6:0/4173042163 conn(0x557c9d0e8460 msgr2=0x557c9d49e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f75257fa640 0 client.26974 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 shutdown_connections 2024-09-21T08:13:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.769+0000 7f754e19a740 1 -- 172.21.15.6:0/4173042163 wait complete. 2024-09-21T08:13:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.770+0000 7f754e19a740 20 client.26974 trim_cache size 0 max 16384 2024-09-21T08:13:19.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.804+0000 7f754e19a740 1 Processor -- start 2024-09-21T08:13:19.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.805+0000 7f754e19a740 1 -- start start 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.806+0000 7f754e19a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.806+0000 7f754e19a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.806+0000 7f75459c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.806+0000 7f75459c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:59914/0 (socket says 172.21.15.6:59914) 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 -- 172.21.15.6:0/1804439038 learned_addr learned my addr 172.21.15.6:0/1804439038 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f754e19a740 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4bb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b5470 con 0x557c9d0d3390 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b7cd0 con 0x557c9d0b29f0 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b5ac0 con 0x557c9d0f4070 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75461c3640 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75451c1640 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 -- 172.21.15.6:0/1804439038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 msgr2=0x557c9d4bb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4bb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 -- 172.21.15.6:0/1804439038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 msgr2=0x557c9d4992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.807+0000 7f75459c2640 1 -- 172.21.15.6:0/1804439038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c9d4a4280 con 0x557c9d0b29f0 2024-09-21T08:13:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.808+0000 7f75459c2640 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f753000fec0 tx=0x7f7530015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bda24832dc085a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.808+0000 7f75277fe640 1 -- 172.21.15.6:0/1804439038 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530030640 con 0x557c9d0b29f0 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.808+0000 7f75277fe640 1 -- 172.21.15.6:0/1804439038 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7530030c70 con 0x557c9d0b29f0 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.808+0000 7f75277fe640 1 -- 172.21.15.6:0/1804439038 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530011ba0 con 0x557c9d0b29f0 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 msgr2=0x557c9d4a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f753000fec0 tx=0x7f7530015000 comp rx=0 tx=0).stop 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 shutdown_connections 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d0f4070 0x557c9d4bb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0d3390 0x557c9d4992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 --2- 172.21.15.6:0/1804439038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0b29f0 0x557c9d4a3ba0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f753000fec0 tx=0x7f7530015000 comp rx=0 tx=0).stop 2024-09-21T08:13:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.809+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 >> 172.21.15.6:0/1804439038 conn(0x557c9d0e8460 msgr2=0x557c9d498be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.810+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 shutdown_connections 2024-09-21T08:13:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.810+0000 7f754e19a740 1 -- 172.21.15.6:0/1804439038 wait complete. 2024-09-21T08:13:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.810+0000 7f754e19a740 1 -- start start 2024-09-21T08:13:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.810+0000 7f754e19a740 1 Processor -- start 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0d3390 0x557c9d4b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0f4070 0x557c9d4b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b6190 con 0x557c9d0f4070 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b7600 con 0x557c9d0d3390 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.811+0000 7f754e19a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b6860 con 0x557c9d4acfa0 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.812+0000 7f754e19a740 10 client.0 _ll_register_callbacks cb 0x7f7534005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.812+0000 7f75461c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.812+0000 7f75461c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44922/0 (socket says 172.21.15.6:44922) 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.812+0000 7f75461c3640 1 -- 172.21.15.6:0/4008099165 learned_addr learned my addr 172.21.15.6:0/4008099165 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.812+0000 7f75459c2640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0d3390 0x557c9d4b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.813+0000 7f75461c3640 1 -- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0d3390 msgr2=0x557c9d4b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.813+0000 7f75461c3640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0d3390 0x557c9d4b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.813+0000 7f75461c3640 1 -- 172.21.15.6:0/4008099165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0f4070 msgr2=0x557c9d4b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.813+0000 7f75461c3640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0f4070 0x557c9d4b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.813+0000 7f75461c3640 1 -- 172.21.15.6:0/4008099165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c9d4af900 con 0x557c9d4acfa0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f75461c3640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f75380127e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb052726528923b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f75257fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538016040 con 0x557c9d4acfa0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7538012950 con 0x557c9d4acfa0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7530030c70 con 0x557c9d4acfa0 2024-09-21T08:13:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.814+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7538003e40 con 0x557c9d4acfa0 2024-09-21T08:13:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.815+0000 7f754e19a740 10 client.26980 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.815+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557c9d5356e0 con 0x557c9d4acfa0 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.815+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7530030c70 con 0x557c9d4acfa0 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.815+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f753802e030 con 0x557c9d4acfa0 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 10 client.26980 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 10 client.26980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 20 client.26980 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d535ab0 0x557c9d537ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 4 client.26980 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:13:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.817+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c9d40f850 con 0x557c9d535ab0 2024-09-21T08:13:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.818+0000 7f75459c2640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d535ab0 0x557c9d537ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f75257fa640 10 client.26980 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f75459c2640 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d535ab0 0x557c9d537ed0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cf13c058f743424 server_cookie=6b871e8a39b1286e in_seq=0 out_seq=0 2024-09-21T08:13:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f75257fa640 1 -- 172.21.15.6:0/4008099165 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x557c9d40f850 con 0x557c9d535ab0 2024-09-21T08:13:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f75257fa640 10 client.26980 handle_command_reply: tid=0 2024-09-21T08:13:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f754e19a740 1 client.26980 shutdown 2024-09-21T08:13:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 msgr2=0x557c9d4af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.819+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f75380127e0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 shutdown_connections 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x557c9d535ab0 0x557c9d537ed0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557c9d4acfa0 0x557c9d4af3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f75257fa640 0 client.26980 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c9d0f4070 0x557c9d4b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 --2- 172.21.15.6:0/4008099165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c9d0d3390 0x557c9d4b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 >> 172.21.15.6:0/4008099165 conn(0x557c9d0e8460 msgr2=0x557c9d4a66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 shutdown_connections 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 1 -- 172.21.15.6:0/4008099165 wait complete. 2024-09-21T08:13:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.820+0000 7f754e19a740 20 client.26980 trim_cache size 0 max 16384 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:13:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:13:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:13:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:19.835 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.822+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 msgr2=0x7f75280b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.822+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 0x7f75280b8cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x557c9d49db30 tx=0x7f753000be80 comp rx=0 tx=0).stop 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.822+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 msgr2=0x7f754006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.822+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 0x7f754006ef90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f754006cc00 tx=0x7f7534030ce0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 shutdown_connections 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f75280b67b0 0x7f75280b8cc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75401076e0 0x7f754006ef90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7540108030 0x7f754006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 --2- 172.21.15.6:0/389721851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7540101da0 0x7f7540074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 >> 172.21.15.6:0/389721851 conn(0x7f7540077800 msgr2=0x7f7540103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.823+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 shutdown_connections 2024-09-21T08:13:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:19.824+0000 7f7547c26640 1 -- 172.21.15.6:0/389721851 wait complete. 2024-09-21T08:13:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:19 smithi119 ceph-mon[33564]: pgmap v723: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 13 MiB/s wr, 809 op/s 2024-09-21T08:13:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:19 smithi119 ceph-mon[33564]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:13:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:19 smithi145 ceph-mon[34049]: pgmap v723: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 13 MiB/s wr, 809 op/s 2024-09-21T08:13:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:19 smithi145 ceph-mon[34049]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:13:20.532 INFO:tasks.quiescer.fs.[cephfs]:Total duration (35.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:13:20.532 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T08:13:20.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:13:20.716 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:13:20.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:13:21.086 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:21 smithi119 ceph-mon[33564]: pgmap v725: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-21T08:13:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:21 smithi145 ceph-mon[34049]: pgmap v725: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-21T08:13:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:21 smithi006 ceph-mon[30970]: pgmap v725: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-21T08:13:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 625.0 s, 649.0 tps, lat 148.834 ms stddev 97.350 2024-09-21T08:13:23.568 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:23 smithi006 ceph-mon[30970]: pgmap v726: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 12 MiB/s wr, 701 op/s 2024-09-21T08:13:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:23 smithi119 ceph-mon[33564]: pgmap v726: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 12 MiB/s wr, 701 op/s 2024-09-21T08:13:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:23 smithi145 ceph-mon[34049]: pgmap v726: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 12 MiB/s wr, 701 op/s 2024-09-21T08:13:25.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:25 smithi006 ceph-mon[30970]: pgmap v727: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-09-21T08:13:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:25 smithi119 ceph-mon[33564]: pgmap v727: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-09-21T08:13:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:25 smithi145 ceph-mon[34049]: pgmap v727: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 -- 172.21.15.6:0/2988754140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 msgr2=0x7fdf1c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 --2- 172.21.15.6:0/2988754140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c10d8d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009900 tx=0x7fdf0c02a410 comp rx=0 tx=0).stop 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 -- 172.21.15.6:0/2988754140 shutdown_connections 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 --2- 172.21.15.6:0/2988754140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c10de60 0x7fdf1c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 --2- 172.21.15.6:0/2988754140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c10d8d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 --2- 172.21.15.6:0/2988754140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c104a30 0x7fdf1c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 -- 172.21.15.6:0/2988754140 >> 172.21.15.6:0/2988754140 conn(0x7fdf1c079790 msgr2=0x7fdf1c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 -- 172.21.15.6:0/2988754140 shutdown_connections 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.348+0000 7fdf234b8640 1 -- 172.21.15.6:0/2988754140 wait complete. 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 Processor -- start 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 -- start start 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c104a30 0x7fdf1c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 0x7fdf1c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c113950 con 0x7fdf1c105380 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c1137d0 con 0x7fdf1c10de60 2024-09-21T08:13:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.349+0000 7fdf234b8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c113ad0 con 0x7fdf1c104a30 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38612/0 (socket says 172.21.15.6:38612) 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 -- 172.21.15.6:0/3446240753 learned_addr learned my addr 172.21.15.6:0/3446240753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf21254640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c104a30 0x7fdf1c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf21a55640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 0x7fdf1c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 -- 172.21.15.6:0/3446240753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c104a30 msgr2=0x7fdf1c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c104a30 0x7fdf1c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 -- 172.21.15.6:0/3446240753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 msgr2=0x7fdf1c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:26.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 0x7fdf1c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 -- 172.21.15.6:0/3446240753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c1a02f0 con 0x7fdf1c105380 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf21a55640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 0x7fdf1c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf20a53640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004770 tx=0x7fdf0c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c03f030 con 0x7fdf1c105380 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf0c004440 con 0x7fdf1c105380 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c1a0580 con 0x7fdf1c105380 2024-09-21T08:13:26.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c035070 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.350+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c1a6d40 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.352+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1c104e40 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.354+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdf0c042030 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.354+0000 7fdf127fc640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 0x7fdf080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.355+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fdf0c1082b0 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.355+0000 7fdf21254640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 0x7fdf080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.355+0000 7fdf21254640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 0x7fdf080b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800bbe0 tx=0x7fdf1800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.358+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf0c0ce450 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.760+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf1c19b4b0 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.762+0000 7fdf127fc640 1 -- 172.21.15.6:0/3446240753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fdf0c0d2830 con 0x7fdf1c105380 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 msgr2=0x7fdf080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 0x7fdf080b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800bbe0 tx=0x7fdf1800b390 comp rx=0 tx=0).stop 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 msgr2=0x7fdf1c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:26.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004770 tx=0x7fdf0c004040 comp rx=0 tx=0).stop 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 shutdown_connections 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdf080b6680 0x7fdf080b8b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf1c10de60 0x7fdf1c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf1c105380 0x7fdf1c19a920 secure :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004770 tx=0x7fdf0c004040 comp rx=0 tx=0).stop 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 --2- 172.21.15.6:0/3446240753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf1c104a30 0x7fdf1c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.767+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 >> 172.21.15.6:0/3446240753 conn(0x7fdf1c079790 msgr2=0x7fdf1c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.771+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 shutdown_connections 2024-09-21T08:13:26.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:25.773+0000 7fdf234b8640 1 -- 172.21.15.6:0/3446240753 wait complete. 2024-09-21T08:13:26.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:26 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3446240753' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:26 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3446240753' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:26 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3446240753' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 630.0 s, 485.6 tps, lat 170.032 ms stddev 161.335 2024-09-21T08:13:27.808 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:27 smithi119 ceph-mon[33564]: pgmap v728: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 12 MiB/s wr, 753 op/s 2024-09-21T08:13:27.843 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:27 smithi145 ceph-mon[34049]: pgmap v728: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 12 MiB/s wr, 753 op/s 2024-09-21T08:13:27.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:27 smithi006 ceph-mon[30970]: pgmap v728: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 12 MiB/s wr, 753 op/s 2024-09-21T08:13:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:29 smithi119 ceph-mon[33564]: pgmap v729: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-21T08:13:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:29 smithi145 ceph-mon[34049]: pgmap v729: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-21T08:13:29.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:29 smithi006 ceph-mon[30970]: pgmap v729: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-21T08:13:31.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:31 smithi119 ceph-mon[33564]: pgmap v730: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-21T08:13:31.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:31 smithi145 ceph-mon[34049]: pgmap v730: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-21T08:13:31.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:31 smithi006 ceph-mon[30970]: pgmap v730: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-09-21T08:13:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 635.0 s, 253.2 tps, lat 477.108 ms stddev 960.809 2024-09-21T08:13:33.022 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T08:13:33.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T08:13:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.558+0000 7f298e977640 1 -- 172.21.15.6:0/3037863287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29800097a0 msgr2=0x7f29800a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.558+0000 7f298e977640 1 --2- 172.21.15.6:0/3037863287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29800097a0 0x7f29800a6770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2978009860 tx=0x7f297802a340 comp rx=0 tx=0).stop 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 -- 172.21.15.6:0/3037863287 shutdown_connections 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 --2- 172.21.15.6:0/3037863287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29800a6cb0 0x7f29800a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 --2- 172.21.15.6:0/3037863287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29800097a0 0x7f29800a6770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 --2- 172.21.15.6:0/3037863287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2980008e50 0x7f2980009260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 -- 172.21.15.6:0/3037863287 >> 172.21.15.6:0/3037863287 conn(0x7f2980093d60 msgr2=0x7f29800961b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.560+0000 7f298e977640 1 -- 172.21.15.6:0/3037863287 shutdown_connections 2024-09-21T08:13:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.561+0000 7f298e977640 1 -- 172.21.15.6:0/3037863287 wait complete. 2024-09-21T08:13:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 Processor -- start 2024-09-21T08:13:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 -- start start 2024-09-21T08:13:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 0x7f2980132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 0x7f2980133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29800a6cb0 0x7f2980138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29800ac490 con 0x7f29800a6cb0 2024-09-21T08:13:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f29800ac310 con 0x7f2980008e50 2024-09-21T08:13:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298e977640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f29800ac610 con 0x7f29800097a0 2024-09-21T08:13:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298d174640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 0x7f2980133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298d174640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 0x7f2980133560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:49672/0 (socket says 172.21.15.6:49672) 2024-09-21T08:13:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.562+0000 7f298d174640 1 -- 172.21.15.6:0/2837837593 learned_addr learned my addr 172.21.15.6:0/2837837593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 0x7f2980132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 -- 172.21.15.6:0/2837837593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 msgr2=0x7f2980133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 0x7f2980133560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 -- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29800a6cb0 msgr2=0x7f2980138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29800a6cb0 0x7f2980138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.563+0000 7f298d975640 1 -- 172.21.15.6:0/2837837593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2980138f30 con 0x7f2980008e50 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.564+0000 7f298d975640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 0x7f2980132fc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f298400e9f0 tx=0x7f298400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.564+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298400cd80 con 0x7f2980008e50 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.564+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29840035f0 con 0x7f2980008e50 2024-09-21T08:13:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.564+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984010670 con 0x7f2980008e50 2024-09-21T08:13:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.564+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2980139220 con 0x7f2980008e50 2024-09-21T08:13:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.565+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298013f980 con 0x7f2980008e50 2024-09-21T08:13:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.566+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2980009260 con 0x7f2980008e50 2024-09-21T08:13:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.568+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2984004000 con 0x7f2980008e50 2024-09-21T08:13:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.570+0000 7f297effd640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 0x7f29740b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.570+0000 7f298d174640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 0x7f29740b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.570+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f29840e7d60 con 0x7f2980008e50 2024-09-21T08:13:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.571+0000 7f298d174640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 0x7f29740b8ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f297802a930 tx=0x7f2978000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:33.574+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29840adea0 con 0x7f2980008e50 2024-09-21T08:13:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:33.789 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:33 smithi006 ceph-mon[30970]: pgmap v731: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-21T08:13:33.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:33 smithi119 ceph-mon[33564]: pgmap v731: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-21T08:13:33.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:33 smithi145 ceph-mon[34049]: pgmap v731: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-21T08:13:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.013+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29801340f0 con 0x7f2980008e50 2024-09-21T08:13:34.016 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:13:34.016 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:13:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.014+0000 7f297effd640 1 -- 172.21.15.6:0/2837837593 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f29801340f0 con 0x7f2980008e50 2024-09-21T08:13:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:13:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.017+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 msgr2=0x7f29740b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.017+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 0x7f29740b8ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f297802a930 tx=0x7f2978000bc0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.017+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 msgr2=0x7f2980132fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.017+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 0x7f2980132fc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f298400e9f0 tx=0x7f298400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 shutdown_connections 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29740b67d0 0x7f29740b8ce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29800097a0 0x7f2980133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29800a6cb0 0x7f2980138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 --2- 172.21.15.6:0/2837837593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2980008e50 0x7f2980132fc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.018+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 >> 172.21.15.6:0/2837837593 conn(0x7f2980093d60 msgr2=0x7f29800a8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.021+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 shutdown_connections 2024-09-21T08:13:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.021+0000 7f298e977640 1 -- 172.21.15.6:0/2837837593 wait complete. 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.244+0000 7fa264982640 1 -- 172.21.15.6:0/2841024338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 msgr2=0x7fa260110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 --2- 172.21.15.6:0/2841024338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa260110640 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa258009900 tx=0x7fa25802a420 comp rx=0 tx=0).stop 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 -- 172.21.15.6:0/2841024338 shutdown_connections 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 --2- 172.21.15.6:0/2841024338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa260110640 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 --2- 172.21.15.6:0/2841024338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2601094c0 0x7fa2601098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 --2- 172.21.15.6:0/2841024338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa260103b80 0x7fa260103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.245+0000 7fa264982640 1 -- 172.21.15.6:0/2841024338 >> 172.21.15.6:0/2841024338 conn(0x7fa2600ff5d0 msgr2=0x7fa260101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.247+0000 7fa264982640 1 -- 172.21.15.6:0/2841024338 shutdown_connections 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.247+0000 7fa264982640 1 -- 172.21.15.6:0/2841024338 wait complete. 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.248+0000 7fa264982640 1 Processor -- start 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.248+0000 7fa264982640 1 -- start start 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa260103b80 0x7fa26010d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa2601ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa260076550 con 0x7fa260109e10 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600763d0 con 0x7fa260103b80 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.249+0000 7fa264982640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600766d0 con 0x7fa2601094c0 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.250+0000 7fa257fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.250+0000 7fa25ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa2601ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.250+0000 7fa257fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:49702/0 (socket says 172.21.15.6:49702) 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.250+0000 7fa257fff640 1 -- 172.21.15.6:0/501605804 learned_addr learned my addr 172.21.15.6:0/501605804 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa25ed9d640 1 -- 172.21.15.6:0/501605804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 msgr2=0x7fa26010d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa25ed9d640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa25ed9d640 1 -- 172.21.15.6:0/501605804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa260103b80 msgr2=0x7fa26010d230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa25ed9d640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa260103b80 0x7fa26010d230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa25ed9d640 1 -- 172.21.15.6:0/501605804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2601acb00 con 0x7fa260109e10 2024-09-21T08:13:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.251+0000 7fa257fff640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa25ed9d640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa2601ac400 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa258005d90 tx=0x7fa258005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa2577fe640 1 -- 172.21.15.6:0/501605804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258040030 con 0x7fa260109e10 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa2577fe640 1 -- 172.21.15.6:0/501605804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa25803cae0 con 0x7fa260109e10 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa2577fe640 1 -- 172.21.15.6:0/501605804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258031830 con 0x7fa260109e10 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2601acd90 con 0x7fa260109e10 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.252+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2601ad1c0 con 0x7fa260109e10 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.256+0000 7fa26aef6740 1 Processor -- start 2024-09-21T08:13:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.258+0000 7fa2577fe640 1 -- 172.21.15.6:0/501605804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa258043030 con 0x7fa260109e10 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.258+0000 7fa26aef6740 1 -- start start 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.258+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56466472f840 0x564664ad6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.258+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ad7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa26aef6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564664a4cb90 con 0x56466470eb60 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa26aef6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564664a3bfc0 con 0x56466472f840 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa26aef6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564664a3fdd0 con 0x564664706980 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:49710/0 (socket says 172.21.15.6:49710) 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.259+0000 7fa25e59c640 1 -- 172.21.15.6:0/3928067271 learned_addr learned my addr 172.21.15.6:0/3928067271 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 -- 172.21.15.6:0/3928067271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56466472f840 msgr2=0x564664ad6600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56466472f840 0x564664ad6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 -- 172.21.15.6:0/3928067271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 msgr2=0x564664ad7080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ad7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 -- 172.21.15.6:0/3928067271 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646649c3060 con 0x564664706980 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa2577fe640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 0x7fa24c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa25e59c640 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa250009d80 tx=0x7fa25000b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07e0e3c65bc89c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa2577fe640 1 -- 172.21.15.6:0/501605804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fa258108050 con 0x7fa260109e10 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.260+0000 7fa254ff9640 1 -- 172.21.15.6:0/3928067271 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25000bd40 con 0x564664706980 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.261+0000 7fa254ff9640 1 -- 172.21.15.6:0/3928067271 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa250017070 con 0x564664706980 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.261+0000 7fa254ff9640 1 -- 172.21.15.6:0/3928067271 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500115b0 con 0x564664706980 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa257fff640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 0x7fa24c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa26aef6740 1 -- 172.21.15.6:0/3928067271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 msgr2=0x564664ad6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa26aef6740 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa250009d80 tx=0x7fa25000b420 comp rx=0 tx=0).stop 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa26aef6740 1 -- 172.21.15.6:0/3928067271 shutdown_connections 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa26aef6740 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564664706980 0x564664ad6b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.262+0000 7fa26aef6740 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ad7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.263+0000 7fa26aef6740 1 --2- 172.21.15.6:0/3928067271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56466472f840 0x564664ad6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.263+0000 7fa26aef6740 1 -- 172.21.15.6:0/3928067271 >> 172.21.15.6:0/3928067271 conn(0x564664723990 msgr2=0x564664ad44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.266+0000 7fa26aef6740 1 -- 172.21.15.6:0/3928067271 shutdown_connections 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.267+0000 7fa26aef6740 1 -- 172.21.15.6:0/3928067271 wait complete. 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.267+0000 7fa257fff640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 0x7fa24c0b8c40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa2601062c0 tx=0x7fa248005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.267+0000 7fa26aef6740 1 -- start start 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 Processor -- start 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466472f840 0x564664aee060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56466489d7a0 con 0x56466470eb60 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5646649e10a0 con 0x564664706980 2024-09-21T08:13:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564664ae4cc0 con 0x56466472f840 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.268+0000 7fa26aef6740 10 client.0 _ll_register_callbacks cb 0x5646649be3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.269+0000 7fa257fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.269+0000 7fa257fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44468/0 (socket says 172.21.15.6:44468) 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.269+0000 7fa257fff640 1 -- 172.21.15.6:0/707049096 learned_addr learned my addr 172.21.15.6:0/707049096 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 -- 172.21.15.6:0/707049096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466472f840 msgr2=0x564664aee060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466472f840 0x564664aee060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 -- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 msgr2=0x564664ae20c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae20c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 -- 172.21.15.6:0/707049096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646649cf880 con 0x56466470eb60 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.270+0000 7fa257fff640 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa248009770 tx=0x7fa248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2e5118cee3fc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.272+0000 7fa245ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.272+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24800fb40 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.272+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fa24800fce0 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.272+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa250017070 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.273+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa24801ce30 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.273+0000 7fa26aef6740 10 client.17268 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.273+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5646647a9b90 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa250017070 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa248026470 con 0x56466470eb60 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa26aef6740 10 client.17268 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa26aef6740 10 client.17268 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa26aef6740 20 client.17268 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.274+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646ee1c0 0x564664af41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.275+0000 7fa26aef6740 4 client.17268 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.275+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564664a4eae0 con 0x5646646ee1c0 2024-09-21T08:13:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.276+0000 7fa25e59c640 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646ee1c0 0x564664af41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.276+0000 7fa25e59c640 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646ee1c0 0x564664af41f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e1459503ba0740 server_cookie=55a1fef3a64bab52 in_seq=0 out_seq=0 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.276+0000 7fa245ffb640 10 client.17268 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.278+0000 7fa245ffb640 1 -- 172.21.15.6:0/707049096 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564664a4eae0 con 0x5646646ee1c0 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.278+0000 7fa245ffb640 10 client.17268 handle_command_reply: tid=0 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.278+0000 7fa26aef6740 1 client.17268 shutdown 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.283+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 msgr2=0x564664ae2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.283+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa248009770 tx=0x7fa248004730 comp rx=0 tx=0).stop 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 shutdown_connections 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646ee1c0 0x564664af41f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466472f840 0x564664aee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466470eb60 0x564664ae2600 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 --2- 172.21.15.6:0/707049096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 >> 172.21.15.6:0/707049096 conn(0x564664723990 msgr2=0x564664ad9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.285+0000 7fa245ffb640 0 client.17268 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.287+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 shutdown_connections 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.289+0000 7fa26aef6740 1 -- 172.21.15.6:0/707049096 wait complete. 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.290+0000 7fa26aef6740 20 client.17268 trim_cache size 0 max 16384 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.323+0000 7fa26aef6740 1 Processor -- start 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.323+0000 7fa26aef6740 1 -- start start 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ad3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa26010e360 con 0x56466472f840 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601d15b0 con 0x564664706980 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa26aef6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601cf4c0 con 0x56466470eb60 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa25ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ad3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:49736/0 (socket says 172.21.15.6:49736) 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 -- 172.21.15.6:0/2712313202 learned_addr learned my addr 172.21.15.6:0/2712313202 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 -- 172.21.15.6:0/2712313202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 msgr2=0x564664ae0ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae0ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 -- 172.21.15.6:0/2712313202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 msgr2=0x564664ad3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ad3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.324+0000 7fa257fff640 1 -- 172.21.15.6:0/2712313202 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564664ad9460 con 0x56466470eb60 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.325+0000 7fa257fff640 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa248009740 tx=0x7fa24801cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493d65c316d38517 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.325+0000 7fa247fff640 1 -- 172.21.15.6:0/2712313202 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248026430 con 0x56466470eb60 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.325+0000 7fa247fff640 1 -- 172.21.15.6:0/2712313202 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa248035070 con 0x56466470eb60 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.325+0000 7fa247fff640 1 -- 172.21.15.6:0/2712313202 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248005410 con 0x56466470eb60 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 -- 172.21.15.6:0/2712313202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 msgr2=0x564664ad44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa248009740 tx=0x7fa24801cfd0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 -- 172.21.15.6:0/2712313202 shutdown_connections 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664ad44c0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa248009740 tx=0x7fa24801cfd0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ad3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 --2- 172.21.15.6:0/2712313202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ae0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.327+0000 7fa26aef6740 1 -- 172.21.15.6:0/2712313202 >> 172.21.15.6:0/2712313202 conn(0x564664723990 msgr2=0x564664ad7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.328+0000 7fa26aef6740 1 -- 172.21.15.6:0/2712313202 shutdown_connections 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.329+0000 7fa26aef6740 1 -- 172.21.15.6:0/2712313202 wait complete. 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.329+0000 7fa26aef6740 1 -- start start 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.330+0000 7fa26aef6740 1 Processor -- start 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.330+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.330+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664adef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.330+0000 7fa26aef6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ae8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.330+0000 7fa26aef6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601cfa70 con 0x56466472f840 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:35958/0 (socket says 172.21.15.6:35958) 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 -- 172.21.15.6:0/1244238503 learned_addr learned my addr 172.21.15.6:0/1244238503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa257fff640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664adef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25ed9d640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ae8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601d0ee0 con 0x564664706980 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601d0140 con 0x56466470eb60 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa26aef6740 10 client.0 _ll_register_callbacks cb 0x7fa248009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 -- 172.21.15.6:0/1244238503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 msgr2=0x564664adef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664adef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 -- 172.21.15.6:0/1244238503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 msgr2=0x564664ae8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.331+0000 7fa25e59c640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ae8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa25e59c640 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564664ae95d0 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa257fff640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664adef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa248035070 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa25e59c640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa25000d010 tx=0x7fa2500127a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc883d9eb6ecfb8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa245ffb640 10 client.26912 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.332+0000 7fa245ffb640 1 -- 172.21.15.6:0/1244238503 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250012b60 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.333+0000 7fa245ffb640 1 -- 172.21.15.6:0/1244238503 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fa250012d00 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.333+0000 7fa245ffb640 1 -- 172.21.15.6:0/1244238503 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa25002c420 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 10 client.26912 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x564664aea790 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa245ffb640 1 -- 172.21.15.6:0/1244238503 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa250011070 con 0x564664706980 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 10 client.26912 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 10 client.26912 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 20 client.26912 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646c3570 0x564664b61df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.334+0000 7fa26aef6740 4 client.26912 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.335+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x564664a4a590 con 0x5646646c3570 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.335+0000 7fa257fff640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646c3570 0x564664b61df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.336+0000 7fa257fff640 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646c3570 0x564664b61df0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f489e3973f5ed55 server_cookie=7fd0f08bdd7ef7d2 in_seq=0 out_seq=0 2024-09-21T08:13:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.336+0000 7fa245ffb640 10 client.26912 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:34.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:34 smithi006 ceph-mon[30970]: pgmap v732: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 10 MiB/s wr, 817 op/s 2024-09-21T08:13:34.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2837837593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa245ffb640 1 -- 172.21.15.6:0/1244238503 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564664a4a590 con 0x5646646c3570 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa245ffb640 10 client.26912 handle_command_reply: tid=0 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 client.26912 shutdown 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 msgr2=0x564664ade9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa25000d010 tx=0x7fa2500127a0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 shutdown_connections 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5646646c3570 0x564664b61df0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56466470eb60 0x564664adef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56466472f840 0x564664ae8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa245ffb640 0 client.26912 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 --2- 172.21.15.6:0/1244238503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564664706980 0x564664ade9d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 >> 172.21.15.6:0/1244238503 conn(0x564664723990 msgr2=0x564664ae0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 shutdown_connections 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.753+0000 7fa26aef6740 1 -- 172.21.15.6:0/1244238503 wait complete. 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa26aef6740 20 client.26912 trim_cache size 0 max 16384 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 46, 2024-09-21T08:13:34.757 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "bcba40bc": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 46, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.8, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:13:34.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 msgr2=0x7fa24c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 0x7fa24c0b8c40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa2601062c0 tx=0x7fa248005f90 comp rx=0 tx=0).stop 2024-09-21T08:13:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 msgr2=0x7fa2601ac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa2601ac400 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa258005d90 tx=0x7fa258005460 comp rx=0 tx=0).stop 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 shutdown_connections 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa24c0b6730 0x7fa24c0b8c40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2601094c0 0x7fa26010d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa260109e10 0x7fa2601ac400 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 --2- 172.21.15.6:0/501605804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa260103b80 0x7fa26010d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 >> 172.21.15.6:0/501605804 conn(0x7fa2600ff5d0 msgr2=0x7fa260108340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 shutdown_connections 2024-09-21T08:13:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:34.754+0000 7fa264982640 1 -- 172.21.15.6:0/501605804 wait complete. 2024-09-21T08:13:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:34 smithi119 ceph-mon[33564]: pgmap v732: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 10 MiB/s wr, 817 op/s 2024-09-21T08:13:34.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2837837593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:34.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:34 smithi145 ceph-mon[34049]: pgmap v732: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 10 MiB/s wr, 817 op/s 2024-09-21T08:13:34.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2837837593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:35.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:13:35.626 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bcba40bc', quiesce took 15.1 seconds. Will release after: 2.700000000000001 2024-09-21T08:13:35.708 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 -- 172.21.15.6:0/3384474465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 msgr2=0x7f0cd4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 --2- 172.21.15.6:0/3384474465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd4102e90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009900 tx=0x7f0cd002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 -- 172.21.15.6:0/3384474465 shutdown_connections 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 --2- 172.21.15.6:0/3384474465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 0x7f0cd410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 --2- 172.21.15.6:0/3384474465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 --2- 172.21.15.6:0/3384474465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd4102e90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 -- 172.21.15.6:0/3384474465 >> 172.21.15.6:0/3384474465 conn(0x7f0cd4079740 msgr2=0x7f0cd4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 -- 172.21.15.6:0/3384474465 shutdown_connections 2024-09-21T08:13:36.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.477+0000 7f0cdc128640 1 -- 172.21.15.6:0/3384474465 wait complete. 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 Processor -- start 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 -- start start 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 0x7f0cd419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4112830 con 0x7f0cd4102a80 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41126b0 con 0x7f0cd41083c0 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cdc128640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41129b0 con 0x7f0cd4108d10 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cd9ec4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cd9ec4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56980/0 (socket says 172.21.15.6:56980) 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cd9ec4640 1 -- 172.21.15.6:0/543545035 learned_addr learned my addr 172.21.15.6:0/543545035 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.478+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 0x7f0cd419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 -- 172.21.15.6:0/543545035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 msgr2=0x7f0cd419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 0x7f0cd419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 -- 172.21.15.6:0/543545035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 msgr2=0x7f0cd419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 -- 172.21.15.6:0/543545035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd41a0240 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009230 tx=0x7f0cd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0ccaffd640 1 -- 172.21.15.6:0/543545035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd003f030 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd41a04d0 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0ccaffd640 1 -- 172.21.15.6:0/543545035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cd0003a80 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0ccaffd640 1 -- 172.21.15.6:0/543545035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0035070 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.479+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd41a09b0 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 Processor -- start 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 -- start start 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ccaffd640 1 -- 172.21.15.6:0/543545035 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0cd0042030 con 0x7f0cd4102a80 2024-09-21T08:13:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e16839e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e16839ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e168314ea0 con 0x55e167ff7070 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1683042d0 con 0x55e167fce1b0 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0ce269c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e1683080e0 con 0x55e167fd6390 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.482+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56994/0 (socket says 172.21.15.6:56994) 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 -- 172.21.15.6:0/2129896379 learned_addr learned my addr 172.21.15.6:0/2129896379 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e16839e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e16839ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 -- 172.21.15.6:0/2129896379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 msgr2=0x55e16839ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e16839ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 -- 172.21.15.6:0/2129896379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 msgr2=0x55e16839e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e16839e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 -- 172.21.15.6:0/2129896379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e168062650 con 0x55e167ff7070 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0ccaffd640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007e50 tx=0x7f0ccc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81962433c9ef21da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.483+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.484+0000 7f0cbffff640 1 -- 172.21.15.6:0/2129896379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc014070 con 0x55e167ff7070 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.484+0000 7f0ccaffd640 1 -- 172.21.15.6:0/543545035 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f0cd0108200 con 0x7f0cd4102a80 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.484+0000 7f0cbffff640 1 -- 172.21.15.6:0/2129896379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ccc004d20 con 0x55e167ff7070 2024-09-21T08:13:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.484+0000 7f0cbffff640 1 -- 172.21.15.6:0/2129896379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc010760 con 0x55e167ff7070 2024-09-21T08:13:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- 172.21.15.6:0/2129896379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 msgr2=0x55e16839e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007e50 tx=0x7f0ccc00e720 comp rx=0 tx=0).stop 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0cd9ec4640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0105650 tx=0x7f0cd010bd50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- 172.21.15.6:0/2129896379 shutdown_connections 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e16839ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e16839e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 --2- 172.21.15.6:0/2129896379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167ff7070 0x55e16839e2c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- 172.21.15.6:0/2129896379 >> 172.21.15.6:0/2129896379 conn(0x55e167feb460 msgr2=0x55e16839c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- 172.21.15.6:0/2129896379 shutdown_connections 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- 172.21.15.6:0/2129896379 wait complete. 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 -- start start 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.485+0000 7f0ce269c740 1 Processor -- start 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e1683ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167ff7070 0x55e1683ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e168165700 con 0x55e167fce1b0 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e16829f160 con 0x55e167ff7070 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e1683b0e00 con 0x55e167fd6390 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0ce269c740 10 client.0 _ll_register_callbacks cb 0x55e1682b89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57002/0 (socket says 172.21.15.6:57002) 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 -- 172.21.15.6:0/181767088 learned_addr learned my addr 172.21.15.6:0/181767088 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e1683ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167ff7070 0x55e1683ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 -- 172.21.15.6:0/181767088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 msgr2=0x55e1683ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e1683ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 -- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167ff7070 msgr2=0x55e1683ba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167ff7070 0x55e1683ba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cda6c5640 1 -- 172.21.15.6:0/181767088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1682ccc90 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.486+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e1683ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000f80 tx=0x7f0ccc005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cce96580adcf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc014030 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f0ccc020070 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc004d20 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc005400 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 10 client.17286 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e1683bcbd0 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ccc004d20 con 0x55e167fce1b0 2024-09-21T08:13:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0ccc010bc0 con 0x55e167fce1b0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 10 client.17286 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.487+0000 7f0ce269c740 20 client.17286 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167fb59f0 0x55e1683bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0ce269c740 4 client.17286 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e168316df0 con 0x55e167fb59f0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167fb59f0 0x55e1683bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0cbd7fa640 10 client.17286 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.488+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167fb59f0 0x55e1683bff30 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f8dadca9eebf62 server_cookie=ad6f2ade8514fee8 in_seq=0 out_seq=0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/181767088 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e168316df0 con 0x55e167fb59f0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0cbd7fa640 10 client.17286 handle_command_reply: tid=0 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 client.17286 shutdown 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 msgr2=0x55e1683ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000f80 tx=0x7f0ccc005ae0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 shutdown_connections 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167fb59f0 0x55e1683bff30 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fd6390 0x55e1683ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167ff7070 0x55e1683ba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0cbd7fa640 0 client.17286 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 --2- 172.21.15.6:0/181767088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683ade40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 >> 172.21.15.6:0/181767088 conn(0x55e167feb460 msgr2=0x55e16839a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 shutdown_connections 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.489+0000 7f0ce269c740 1 -- 172.21.15.6:0/181767088 wait complete. 2024-09-21T08:13:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.490+0000 7f0ce269c740 20 client.17286 trim_cache size 0 max 16384 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 Processor -- start 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 -- start start 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e16839c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e1683ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41acbd0 con 0x55e167fd6390 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41af430 con 0x55e167fce1b0 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0ce269c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ad220 con 0x55e167fb59f0 2024-09-21T08:13:36.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57008/0 (socket says 172.21.15.6:57008) 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 -- 172.21.15.6:0/1152425067 learned_addr learned my addr 172.21.15.6:0/1152425067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e16839c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e1683ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 -- 172.21.15.6:0/1152425067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 msgr2=0x55e16839c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e16839c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 -- 172.21.15.6:0/1152425067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 msgr2=0x55e1683ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e1683ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.503+0000 7f0cda6c5640 1 -- 172.21.15.6:0/1152425067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e16839b060 con 0x55e167fd6390 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.504+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005ab0 tx=0x7f0ccc0072a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34a1b6fbf7a0a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.504+0000 7f0cbf7fe640 1 -- 172.21.15.6:0/1152425067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc014070 con 0x55e167fd6390 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.504+0000 7f0cbf7fe640 1 -- 172.21.15.6:0/1152425067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ccc007a20 con 0x55e167fd6390 2024-09-21T08:13:36.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.504+0000 7f0cbf7fe640 1 -- 172.21.15.6:0/1152425067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc003970 con 0x55e167fd6390 2024-09-21T08:13:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- 172.21.15.6:0/1152425067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 msgr2=0x55e1683ab030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005ab0 tx=0x7f0ccc0072a0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- 172.21.15.6:0/1152425067 shutdown_connections 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fd6390 0x55e1683ab030 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fce1b0 0x55e1683ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1152425067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e16839c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- 172.21.15.6:0/1152425067 >> 172.21.15.6:0/1152425067 conn(0x55e167feb460 msgr2=0x55e16839baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- 172.21.15.6:0/1152425067 shutdown_connections 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- 172.21.15.6:0/1152425067 wait complete. 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 -- start start 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.505+0000 7f0ce269c740 1 Processor -- start 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e1683b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fd6390 0x55e1683b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ad8f0 con 0x55e167fce1b0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41aed60 con 0x55e167fd6390 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41adfc0 con 0x55e167fb59f0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0ce269c740 10 client.0 _ll_register_callbacks cb 0x7f0cd010bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57014/0 (socket says 172.21.15.6:57014) 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 -- 172.21.15.6:0/1073987788 learned_addr learned my addr 172.21.15.6:0/1073987788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fd6390 0x55e1683b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e1683b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 -- 172.21.15.6:0/1073987788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 msgr2=0x55e1683b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e1683b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 -- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fd6390 msgr2=0x55e1683b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fd6390 0x55e1683b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 -- 172.21.15.6:0/1073987788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1683b6500 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cd96c3640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0cd406b6c0 tx=0x7f0cc4011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76cdda0fae4e100 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.506+0000 7f0cbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc401dba0 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f0cc401dd40 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc007a20 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0cc4031050 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 10 client.17292 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e16842a240 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ccc007a20 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0cc4010430 con 0x55e167fce1b0 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 10 client.17292 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 20 client.17292 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167ff7070 0x55e16842ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 4 client.17292 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1683128a0 con 0x55e167ff7070 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.507+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167ff7070 0x55e16842ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0cbd7fa640 10 client.17292 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0cda6c5640 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167ff7070 0x55e16842ca30 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993eb52e62d993ad server_cookie=4f0147497dda8f62 in_seq=0 out_seq=0 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0cbd7fa640 1 -- 172.21.15.6:0/1073987788 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1683128a0 con 0x55e167ff7070 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0cbd7fa640 10 client.17292 handle_command_reply: tid=0 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 client.17292 shutdown 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 msgr2=0x55e1683b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0cd406b6c0 tx=0x7f0cc4011de0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 shutdown_connections 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e167ff7070 0x55e16842ca30 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e167fd6390 0x55e1683b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e167fce1b0 0x55e1683b1f80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0cbd7fa640 0 client.17292 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 --2- 172.21.15.6:0/1073987788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e167fb59f0 0x55e1683b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 >> 172.21.15.6:0/1073987788 conn(0x55e167feb460 msgr2=0x55e16839f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.508+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 shutdown_connections 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0ce269c740 1 -- 172.21.15.6:0/1073987788 wait complete. 2024-09-21T08:13:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0ce269c740 20 client.17292 trim_cache size 0 max 16384 2024-09-21T08:13:36.517 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:13:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 msgr2=0x7f0cc00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0105650 tx=0x7f0cd010bd50 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 msgr2=0x7f0cd419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009230 tx=0x7f0cd0004270 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 shutdown_connections 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0cc00b66b0 0x7f0cc00b8bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cd4108d10 0x7f0cd419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd41083c0 0x7f0cd419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 --2- 172.21.15.6:0/543545035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4102a80 0x7f0cd419a390 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 >> 172.21.15.6:0/543545035 conn(0x7f0cd4079740 msgr2=0x7f0cd4101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 shutdown_connections 2024-09-21T08:13:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:36.509+0000 7f0cdc128640 1 -- 172.21.15.6:0/543545035 wait complete. 2024-09-21T08:13:37.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:36 smithi145 ceph-mon[34049]: pgmap v733: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 9.6 MiB/s wr, 735 op/s 2024-09-21T08:13:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:36 smithi006 ceph-mon[30970]: pgmap v733: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 9.6 MiB/s wr, 735 op/s 2024-09-21T08:13:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:36 smithi119 ceph-mon[33564]: pgmap v733: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 9.6 MiB/s wr, 735 op/s 2024-09-21T08:13:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 640.0 s, 400.4 tps, lat 100.530 ms stddev 69.640 2024-09-21T08:13:38.290 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:13:38.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:13:38.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:13:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:38.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:38 smithi006 ceph-mon[30970]: pgmap v734: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 8.8 MiB/s wr, 698 op/s 2024-09-21T08:13:39.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:38 smithi145 ceph-mon[34049]: pgmap v734: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 8.8 MiB/s wr, 698 op/s 2024-09-21T08:13:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 -- 172.21.15.6:0/3481895187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec01094a0 msgr2=0x7faec01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 --2- 172.21.15.6:0/3481895187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec01094a0 0x7faec01098b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009900 tx=0x7faeb402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 -- 172.21.15.6:0/3481895187 shutdown_connections 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 --2- 172.21.15.6:0/3481895187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 0x7faec0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 --2- 172.21.15.6:0/3481895187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec01094a0 0x7faec01098b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 --2- 172.21.15.6:0/3481895187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec0103b60 0x7faec0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 -- 172.21.15.6:0/3481895187 >> 172.21.15.6:0/3481895187 conn(0x7faec007b850 msgr2=0x7faec007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 -- 172.21.15.6:0/3481895187 shutdown_connections 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.357+0000 7faec5e86640 1 -- 172.21.15.6:0/3481895187 wait complete. 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 Processor -- start 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 -- start start 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec01094a0 0x7faec019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 0x7faec019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec0113960 con 0x7faec0103b60 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec01137e0 con 0x7faec0109df0 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faec5e86640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec0113ae0 con 0x7faec01094a0 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faebf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faebf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57022/0 (socket says 172.21.15.6:57022) 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faebf7fe640 1 -- 172.21.15.6:0/190779313 learned_addr learned my addr 172.21.15.6:0/190779313 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faebeffd640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec01094a0 0x7faec019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.358+0000 7faebffff640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 0x7faec019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 -- 172.21.15.6:0/190779313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec01094a0 msgr2=0x7faec019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec01094a0 0x7faec019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 -- 172.21.15.6:0/190779313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 msgr2=0x7faec019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 0x7faec019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 -- 172.21.15.6:0/190779313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec01a02e0 con 0x7faec0103b60 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebf7fe640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7faeb000d950 tx=0x7faeb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebcff9640 1 -- 172.21.15.6:0/190779313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0017070 con 0x7faec0103b60 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebcff9640 1 -- 172.21.15.6:0/190779313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb0009c30 con 0x7faec0103b60 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec01a05d0 con 0x7faec0103b60 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faebcff9640 1 -- 172.21.15.6:0/190779313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb000f620 con 0x7faec0103b60 2024-09-21T08:13:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.359+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec01a6df0 con 0x7faec0103b60 2024-09-21T08:13:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.362+0000 7faecc3fa740 1 Processor -- start 2024-09-21T08:13:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.362+0000 7faecc3fa740 1 -- start start 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebcff9640 1 -- 172.21.15.6:0/190779313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7faeb0010460 con 0x7faec0103b60 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806bc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d880632e60 con 0x55d880315350 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d880622290 con 0x55d8802ec490 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faecc3fa740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d8806260a0 con 0x55d8802f4670 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57032/0 (socket says 172.21.15.6:57032) 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebffff640 1 -- 172.21.15.6:0/2265863913 learned_addr learned my addr 172.21.15.6:0/2265863913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebf7fe640 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806bc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebeffd640 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebffff640 1 -- 172.21.15.6:0/2265863913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 msgr2=0x55d8806bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.363+0000 7faebffff640 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebffff640 1 -- 172.21.15.6:0/2265863913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 msgr2=0x55d8806bc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebffff640 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806bc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebffff640 1 -- 172.21.15.6:0/2265863913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d880380930 con 0x55d880315350 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebcff9640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 0x7faea80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebffff640 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007ec0 tx=0x7faeb800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c083f3922bcb742a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebf7fe640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 0x7faea80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faea5ffb640 1 -- 172.21.15.6:0/2265863913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8010840 con 0x55d880315350 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faebcff9640 1 -- 172.21.15.6:0/190779313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7faeb00e7640 con 0x7faec0103b60 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faea5ffb640 1 -- 172.21.15.6:0/2265863913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80183f0 con 0x55d880315350 2024-09-21T08:13:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.364+0000 7faea5ffb640 1 -- 172.21.15.6:0/2265863913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8017600 con 0x55d880315350 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 -- 172.21.15.6:0/2265863913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 msgr2=0x55d8806bc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faebf7fe640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 0x7faea80b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faeb00e4a90 tx=0x7faeb00ed550 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007ec0 tx=0x7faeb800f790 comp rx=0 tx=0).stop 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 -- 172.21.15.6:0/2265863913 shutdown_connections 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806bc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2265863913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806bc430 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 -- 172.21.15.6:0/2265863913 >> 172.21.15.6:0/2265863913 conn(0x55d880309740 msgr2=0x55d8806ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 -- 172.21.15.6:0/2265863913 shutdown_connections 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.365+0000 7faecc3fa740 1 -- 172.21.15.6:0/2265863913 wait complete. 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 -- start start 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 Processor -- start 2024-09-21T08:13:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d880483890 con 0x55d880315350 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d8805bcd40 con 0x55d8802ec490 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d8806cac10 con 0x55d8802f4670 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.366+0000 7faecc3fa740 10 client.0 _ll_register_callbacks cb 0x55d880620c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57042/0 (socket says 172.21.15.6:57042) 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 -- 172.21.15.6:0/3218716805 learned_addr learned my addr 172.21.15.6:0/3218716805 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebeffd640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 -- 172.21.15.6:0/3218716805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 msgr2=0x55d8806c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 -- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 msgr2=0x55d8806c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 -- 172.21.15.6:0/3218716805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8806d44c0 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebeffd640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faebffff640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7faeb8018c00 tx=0x7faeb8012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31e160b2bfdcbb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7fae9effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb802c060 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7faeb8003970 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.367+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb80183f0 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faeb8003b70 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 10 client.17304 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d8806d6df0 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80183f0 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faeb8024040 con 0x55d880315350 2024-09-21T08:13:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 10 client.17304 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 20 client.17304 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802d3cd0 0x55d8806da260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 4 client.17304 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d880634db0 con 0x55d8802d3cd0 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.368+0000 7faebeffd640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802d3cd0 0x55d8806da260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.369+0000 7faebeffd640 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802d3cd0 0x55d8806da260 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f94043f1f2150b server_cookie=16a6fcfb7fba2c16 in_seq=0 out_seq=0 2024-09-21T08:13:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.369+0000 7fae9effd640 10 client.17304 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7fae9effd640 1 -- 172.21.15.6:0/3218716805 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d880634db0 con 0x55d8802d3cd0 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7fae9effd640 10 client.17304 handle_command_reply: tid=0 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 client.17304 shutdown 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 msgr2=0x55d8806d3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7faeb8018c00 tx=0x7faeb8012040 comp rx=0 tx=0).stop 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 shutdown_connections 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802d3cd0 0x55d8806da260 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d8802f4670 0x55d8806c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d880315350 0x55d8806d3f00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3218716805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802ec490 0x55d8806c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 >> 172.21.15.6:0/3218716805 conn(0x55d880309740 msgr2=0x55d8806bf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7fae9effd640 0 client.17304 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 shutdown_connections 2024-09-21T08:13:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 1 -- 172.21.15.6:0/3218716805 wait complete. 2024-09-21T08:13:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.370+0000 7faecc3fa740 20 client.17304 trim_cache size 0 max 16384 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 Processor -- start 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 -- start start 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec01aeec0 con 0x55d8802ec490 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec01b1720 con 0x55d8802f4670 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faecc3fa740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec01af510 con 0x55d880315350 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57056/0 (socket says 172.21.15.6:57056) 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.388+0000 7faebffff640 1 -- 172.21.15.6:0/2236879358 learned_addr learned my addr 172.21.15.6:0/2236879358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebeffd640 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 -- 172.21.15.6:0/2236879358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 msgr2=0x55d8806c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 -- 172.21.15.6:0/2236879358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 msgr2=0x55d8806c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 -- 172.21.15.6:0/2236879358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8806c9090 con 0x55d8802ec490 2024-09-21T08:13:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faebffff640 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007310 tx=0x7faeb8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e9e3a9851cea38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faea57fa640 1 -- 172.21.15.6:0/2236879358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb802c040 con 0x55d8802ec490 2024-09-21T08:13:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faea57fa640 1 -- 172.21.15.6:0/2236879358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80183f0 con 0x55d8802ec490 2024-09-21T08:13:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.389+0000 7faea57fa640 1 -- 172.21.15.6:0/2236879358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80187b0 con 0x55d8802ec490 2024-09-21T08:13:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- 172.21.15.6:0/2236879358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 msgr2=0x55d8806d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007310 tx=0x7faeb8007d10 comp rx=0 tx=0).stop 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- 172.21.15.6:0/2236879358 shutdown_connections 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 --2- 172.21.15.6:0/2236879358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806d3e70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- 172.21.15.6:0/2236879358 >> 172.21.15.6:0/2236879358 conn(0x55d880309740 msgr2=0x55d8806c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- 172.21.15.6:0/2236879358 shutdown_connections 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- 172.21.15.6:0/2236879358 wait complete. 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.390+0000 7faecc3fa740 1 -- start start 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 Processor -- start 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806daf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec01afbe0 con 0x55d8802ec490 2024-09-21T08:13:39.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec01b1050 con 0x55d8802f4670 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec01b02b0 con 0x55d880315350 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faecc3fa740 10 client.0 _ll_register_callbacks cb 0x7faeb00ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57062/0 (socket says 172.21.15.6:57062) 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 -- 172.21.15.6:0/3701771799 learned_addr learned my addr 172.21.15.6:0/3701771799 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebeffd640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 -- 172.21.15.6:0/3701771799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 msgr2=0x55d8806db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 -- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 msgr2=0x55d8806daf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806daf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.391+0000 7faebffff640 1 -- 172.21.15.6:0/3701771799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8806dbca0 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faebffff640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faeb8004420 tx=0x7faeb8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a193b0c9482aa807 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb802c070 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb80183f0 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7faeb8018c60 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faeb8017720 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 10 client.17310 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d8807449a0 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80183f0 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faeb8004b90 con 0x55d8802ec490 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 10 client.17310 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 20 client.17310 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:39.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.392+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802a9080 0x55d8807470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.393+0000 7faecc3fa740 4 client.17310 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:13:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.393+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d8806c2a20 con 0x55d8802a9080 2024-09-21T08:13:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.393+0000 7faebeffd640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802a9080 0x55d8807470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.393+0000 7fae9effd640 10 client.17310 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:39.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.393+0000 7faebeffd640 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802a9080 0x55d8807470a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54492f5850635623 server_cookie=8ec780a8dc8409da in_seq=0 out_seq=0 2024-09-21T08:13:39.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7fae9effd640 1 -- 172.21.15.6:0/3701771799 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d8806c2a20 con 0x55d8802a9080 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7fae9effd640 10 client.17310 handle_command_reply: tid=0 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 client.17310 shutdown 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 msgr2=0x55d8806ddac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faeb8004420 tx=0x7faeb8007720 comp rx=0 tx=0).stop 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 shutdown_connections 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d8802a9080 0x55d8807470a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d880315350 0x55d8806db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8802f4670 0x55d8806daf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 --2- 172.21.15.6:0/3701771799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8802ec490 0x55d8806ddac0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7fae9effd640 0 client.17310 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 >> 172.21.15.6:0/3701771799 conn(0x55d880309740 msgr2=0x55d8806c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 shutdown_connections 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 1 -- 172.21.15.6:0/3701771799 wait complete. 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.395+0000 7faecc3fa740 20 client.17310 trim_cache size 0 max 16384 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7", 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:13:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 msgr2=0x7faea80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 0x7faea80b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faeb00e4a90 tx=0x7faeb00ed550 comp rx=0 tx=0).stop 2024-09-21T08:13:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 msgr2=0x7faec019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7faeb000d950 tx=0x7faeb000de10 comp rx=0 tx=0).stop 2024-09-21T08:13:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 shutdown_connections 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faea80b66b0 0x7faea80b8bc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec01094a0 0x7faec019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec0109df0 0x7faec019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 --2- 172.21.15.6:0/190779313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec0103b60 0x7faec019a430 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 >> 172.21.15.6:0/190779313 conn(0x7faec007b850 msgr2=0x7faec01055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 shutdown_connections 2024-09-21T08:13:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.396+0000 7faec5e86640 1 -- 172.21.15.6:0/190779313 wait complete. 2024-09-21T08:13:39.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:38 smithi119 ceph-mon[33564]: pgmap v734: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 8.8 MiB/s wr, 698 op/s 2024-09-21T08:13:39.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 -- 172.21.15.6:0/4108667680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90075730 msgr2=0x7fce90075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 --2- 172.21.15.6:0/4108667680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90075730 0x7fce90075b40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009900 tx=0x7fce8c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 -- 172.21.15.6:0/4108667680 shutdown_connections 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 --2- 172.21.15.6:0/4108667680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce90112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 --2- 172.21.15.6:0/4108667680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90076080 0x7fce9010fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 --2- 172.21.15.6:0/4108667680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90075730 0x7fce90075b40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 -- 172.21.15.6:0/4108667680 >> 172.21.15.6:0/4108667680 conn(0x7fce900ff610 msgr2=0x7fce90101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 -- 172.21.15.6:0/4108667680 shutdown_connections 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.599+0000 7fce987b1640 1 -- 172.21.15.6:0/4108667680 wait complete. 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 Processor -- start 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 -- start start 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 0x7fce9019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce901a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fce90115b50 con 0x7fce90076080 2024-09-21T08:13:39.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce901159d0 con 0x7fce90075730 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce987b1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fce90115cd0 con 0x7fce90110160 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce95d4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce9654d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 0x7fce9019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce95d4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57076/0 (socket says 172.21.15.6:57076) 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce95d4c640 1 -- 172.21.15.6:0/1727950913 learned_addr learned my addr 172.21.15.6:0/1727950913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.600+0000 7fce96d4e640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce901a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 -- 172.21.15.6:0/1727950913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 msgr2=0x7fce901a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce901a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 -- 172.21.15.6:0/1727950913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 msgr2=0x7fce9019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 0x7fce9019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 -- 172.21.15.6:0/1727950913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce901a2550 con 0x7fce90076080 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce9654d640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 0x7fce9019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:39.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce96d4e640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce901a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce95d4c640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fce8000e9f0 tx=0x7fce8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8000ccc0 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce901a2840 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce800108c0 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80018660 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.601+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce901a8fa0 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.602+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce90076c40 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.604+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fce80010430 con 0x7fce90076080 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.605+0000 7fce877fe640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 0x7fce7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.605+0000 7fce9654d640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 0x7fce7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:39.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.605+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fce800e8380 con 0x7fce90076080 2024-09-21T08:13:39.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.606+0000 7fce9654d640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 0x7fce7c0b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0057c0 tx=0x7fce8c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:39.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.609+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce800ae4c0 con 0x7fce90076080 2024-09-21T08:13:39.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.857+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce90075b40 con 0x7fce90076080 2024-09-21T08:13:39.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.858+0000 7fce877fe640 1 -- 172.21.15.6:0/1727950913 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fce800b28a0 con 0x7fce90076080 2024-09-21T08:13:39.860 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:13:39.860 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:13:39.860 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 msgr2=0x7fce7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 0x7fce7c0b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0057c0 tx=0x7fce8c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 msgr2=0x7fce9019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fce8000e9f0 tx=0x7fce8000edf0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 shutdown_connections 2024-09-21T08:13:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fce7c0b6680 0x7fce7c0b8b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce90110160 0x7fce901a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce90076080 0x7fce9019cb80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 --2- 172.21.15.6:0/1727950913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce90075730 0x7fce9019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 >> 172.21.15.6:0/1727950913 conn(0x7fce900ff610 msgr2=0x7fce90109d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 shutdown_connections 2024-09-21T08:13:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:39.860+0000 7fce987b1640 1 -- 172.21.15.6:0/1727950913 wait complete. 2024-09-21T08:13:40.154 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:39 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1727950913' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:40.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:39 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1727950913' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:40.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:39 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1727950913' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:40.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:13:40.970 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id bcba40bc --release --await' 2024-09-21T08:13:40.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id bcba40bc --release --await 2024-09-21T08:13:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:40 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:13:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:40 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:40 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:13:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:40 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:40 smithi145 ceph-mon[34049]: pgmap v735: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.7 MiB/s wr, 521 op/s 2024-09-21T08:13:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:40 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:13:41.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:40 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:40 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:13:41.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:40 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:40 smithi006 ceph-mon[30970]: pgmap v735: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.7 MiB/s wr, 521 op/s 2024-09-21T08:13:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:40 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:13:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:40 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:40 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:13:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:40 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:13:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:40 smithi119 ceph-mon[33564]: pgmap v735: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.7 MiB/s wr, 521 op/s 2024-09-21T08:13:41.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 -- 172.21.15.6:0/3389610270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 msgr2=0x7f6ff4105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 --2- 172.21.15.6:0/3389610270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff4105580 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009900 tx=0x7f6fdc02a410 comp rx=0 tx=0).stop 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 -- 172.21.15.6:0/3389610270 shutdown_connections 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 --2- 172.21.15.6:0/3389610270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4105ac0 0x7f6ff410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 --2- 172.21.15.6:0/3389610270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff4105580 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 --2- 172.21.15.6:0/3389610270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4103160 0x7f6ff4103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 -- 172.21.15.6:0/3389610270 >> 172.21.15.6:0/3389610270 conn(0x7f6ff4077c60 msgr2=0x7f6ff40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 -- 172.21.15.6:0/3389610270 shutdown_connections 2024-09-21T08:13:41.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.592+0000 7f6ff9796640 1 -- 172.21.15.6:0/3389610270 wait complete. 2024-09-21T08:13:41.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.593+0000 7f6ff9796640 1 Processor -- start 2024-09-21T08:13:41.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.593+0000 7f6ff9796640 1 -- start start 2024-09-21T08:13:41.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.593+0000 7f6ff9796640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4103160 0x7f6ff419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff9796640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff9796640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4105ac0 0x7f6ff41a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff9796640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4112870 con 0x7f6ff4105170 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff9796640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41126f0 con 0x7f6ff4103160 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff9796640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41129f0 con 0x7f6ff4105ac0 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57092/0 (socket says 172.21.15.6:57092) 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 -- 172.21.15.6:0/2118627908 learned_addr learned my addr 172.21.15.6:0/2118627908 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4103160 0x7f6ff419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4105ac0 0x7f6ff41a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 -- 172.21.15.6:0/2118627908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4105ac0 msgr2=0x7f6ff41a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4105ac0 0x7f6ff41a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 -- 172.21.15.6:0/2118627908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4103160 msgr2=0x7f6ff419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4103160 0x7f6ff419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 -- 172.21.15.6:0/2118627908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff41a2550 con 0x7f6ff4105170 2024-09-21T08:13:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.594+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc005940 tx=0x7f6fdc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.595+0000 7f6ff0ff9640 1 -- 172.21.15.6:0/2118627908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc03f030 con 0x7f6ff4105170 2024-09-21T08:13:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.595+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff41a27e0 con 0x7f6ff4105170 2024-09-21T08:13:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.595+0000 7f6ff0ff9640 1 -- 172.21.15.6:0/2118627908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc003a80 con 0x7f6ff4105170 2024-09-21T08:13:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.595+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff41a8fa0 con 0x7f6ff4105170 2024-09-21T08:13:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.596+0000 7f6ff0ff9640 1 -- 172.21.15.6:0/2118627908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc049060 con 0x7f6ff4105170 2024-09-21T08:13:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.598+0000 7f6ff0ff9640 1 -- 172.21.15.6:0/2118627908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6fdc042030 con 0x7f6ff4105170 2024-09-21T08:13:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 Processor -- start 2024-09-21T08:13:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 -- start start 2024-09-21T08:13:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 0x563166397270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x563166397cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56316630de50 con 0x563165ff0070 2024-09-21T08:13:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5631662fd280 con 0x563165fc71b0 2024-09-21T08:13:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563166301090 con 0x563165fcf390 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.599+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 0x563166397270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 0x563166397270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57100/0 (socket says 172.21.15.6:57100) 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff37fe640 1 -- 172.21.15.6:0/712434393 learned_addr learned my addr 172.21.15.6:0/712434393 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x563166397cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff0ff9640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 0x7f6fe00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/712434393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 msgr2=0x563166397cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x563166397cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/712434393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 msgr2=0x563166397270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 0x563166397270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/712434393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316605b650 con 0x563165fc71b0 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.600+0000 7f6ff0ff9640 1 -- 172.21.15.6:0/2118627908 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f6fdc1082e0 con 0x7f6ff4105170 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.601+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663977b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400bbf0 tx=0x7f6fe40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d348a1253d8c70d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.601+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 0x7f6fe00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.601+0000 7f6fe97fa640 1 -- 172.21.15.6:0/712434393 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4004030 con 0x563165fc71b0 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.601+0000 7f6fe97fa640 1 -- 172.21.15.6:0/712434393 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fe40035f0 con 0x563165fc71b0 2024-09-21T08:13:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.601+0000 7f6fe97fa640 1 -- 172.21.15.6:0/712434393 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011680 con 0x563165fc71b0 2024-09-21T08:13:41.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 -- 172.21.15.6:0/712434393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 msgr2=0x5631663977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 0x7f6fe00b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6fec003fd0 tx=0x7f6fec004ab0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663977b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400bbf0 tx=0x7f6fe40107a0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 -- 172.21.15.6:0/712434393 shutdown_connections 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x563166397cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663977b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/712434393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165ff0070 0x563166397270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.602+0000 7f6fffd0a740 1 -- 172.21.15.6:0/712434393 >> 172.21.15.6:0/712434393 conn(0x563165fe4460 msgr2=0x563166395160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.603+0000 7f6fffd0a740 1 -- 172.21.15.6:0/712434393 shutdown_connections 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.603+0000 7f6fffd0a740 1 -- 172.21.15.6:0/712434393 wait complete. 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.603+0000 7f6fffd0a740 1 -- start start 2024-09-21T08:13:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6fffd0a740 1 Processor -- start 2024-09-21T08:13:41.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x5631663a2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165ff0070 0x5631663aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56316615e700 con 0x563165fc71b0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.604+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57102/0 (socket says 172.21.15.6:57102) 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/2575739660 learned_addr learned my addr 172.21.15.6:0/2575739660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563166298110 con 0x563165ff0070 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x5631663a2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5631663a5a50 con 0x563165fcf390 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165ff0070 0x5631663aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6fffd0a740 10 client.0 _ll_register_callbacks cb 0x5631662b1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/2575739660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 msgr2=0x5631663a2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x5631663a2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165ff0070 msgr2=0x5631663aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165ff0070 0x5631663aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.605+0000 7f6ff2ffd640 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631662c5c40 con 0x563165fc71b0 2024-09-21T08:13:41.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400bbc0 tx=0x7f6fe400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90605856090fea7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe402a060 con 0x563165fc71b0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f6fe4004000 con 0x563165fc71b0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fe40035f0 con 0x563165fc71b0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6fe4031050 con 0x563165fc71b0 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fffd0a740 10 client.17328 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:41.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.606+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5631663b1710 con 0x563165fc71b0 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fe40035f0 con 0x563165fc71b0 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6fe40047e0 con 0x563165fc71b0 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 10 client.17328 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 10 client.17328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 20 client.17328 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165fae9f0 0x5631663b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 4 client.17328 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.607+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56316630fda0 con 0x563165fae9f0 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.608+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165fae9f0 0x5631663b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.608+0000 7f6fda7fc640 10 client.17328 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.608+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165fae9f0 0x5631663b4b20 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4086530163839db server_cookie=28c1fac18b642d8a in_seq=0 out_seq=0 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fda7fc640 1 -- 172.21.15.6:0/2575739660 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56316630fda0 con 0x563165fae9f0 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fda7fc640 10 client.17328 handle_command_reply: tid=0 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fffd0a740 1 client.17328 shutdown 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 msgr2=0x5631663a2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400bbc0 tx=0x7f6fe400bfd0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.609+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 shutdown_connections 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165fae9f0 0x5631663b4b20 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fcf390 0x5631663a2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fda7fc640 0 client.17328 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165ff0070 0x5631663aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/2575739660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fc71b0 0x5631663a2930 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 >> 172.21.15.6:0/2575739660 conn(0x563165fe4460 msgr2=0x56316639a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 shutdown_connections 2024-09-21T08:13:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 1 -- 172.21.15.6:0/2575739660 wait complete. 2024-09-21T08:13:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.610+0000 7f6fffd0a740 20 client.17328 trim_cache size 0 max 16384 2024-09-21T08:13:41.629 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:41.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.630+0000 7f6fffd0a740 1 Processor -- start 2024-09-21T08:13:41.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.630+0000 7f6fffd0a740 1 -- start start 2024-09-21T08:13:41.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fae9f0 0x5631663a1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fc71b0 0x5631663aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b1030 con 0x563165fcf390 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b3890 con 0x563165fae9f0 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b1680 con 0x563165fc71b0 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57118/0 (socket says 172.21.15.6:57118) 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6ff37fe640 1 -- 172.21.15.6:0/3045151952 learned_addr learned my addr 172.21.15.6:0/3045151952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fc71b0 0x5631663aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.631+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fae9f0 0x5631663a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 -- 172.21.15.6:0/3045151952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fc71b0 msgr2=0x5631663aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fc71b0 0x5631663aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 -- 172.21.15.6:0/3045151952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fae9f0 msgr2=0x5631663a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fae9f0 0x5631663a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 -- 172.21.15.6:0/3045151952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631663a3bf0 con 0x563165fcf390 2024-09-21T08:13:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6fec014270 tx=0x7f6fec009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e182c85a9c57f31d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6fe8ff9640 1 -- 172.21.15.6:0/3045151952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec028070 con 0x563165fcf390 2024-09-21T08:13:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6fe8ff9640 1 -- 172.21.15.6:0/3045151952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fec011e50 con 0x563165fcf390 2024-09-21T08:13:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.632+0000 7f6fe8ff9640 1 -- 172.21.15.6:0/3045151952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec024c20 con 0x563165fcf390 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 -- 172.21.15.6:0/3045151952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 msgr2=0x5631663a4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6fec014270 tx=0x7f6fec009ce0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 -- 172.21.15.6:0/3045151952 shutdown_connections 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fc71b0 0x5631663aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663a4560 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/3045151952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fae9f0 0x5631663a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 -- 172.21.15.6:0/3045151952 >> 172.21.15.6:0/3045151952 conn(0x563165fe4460 msgr2=0x5631663a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 -- 172.21.15.6:0/3045151952 shutdown_connections 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.633+0000 7f6fffd0a740 1 -- 172.21.15.6:0/3045151952 wait complete. 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 -- start start 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 Processor -- start 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fae9f0 0x5631663b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b1d50 con 0x563165fcf390 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b31c0 con 0x563165fc71b0 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41b2420 con 0x563165fae9f0 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6fffd0a740 10 client.0 _ll_register_callbacks cb 0x7f6fec009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6ff37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57134/0 (socket says 172.21.15.6:57134) 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.634+0000 7f6ff37fe640 1 -- 172.21.15.6:0/1051653941 learned_addr learned my addr 172.21.15.6:0/1051653941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fae9f0 0x5631663b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6fea7fc640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 -- 172.21.15.6:0/1051653941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fae9f0 msgr2=0x5631663b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fae9f0 0x5631663b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 -- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 msgr2=0x5631663b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 -- 172.21.15.6:0/1051653941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316641e4d0 con 0x563165fcf390 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6ff37fe640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706efa664a3890b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6fda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec03a060 con 0x563165fcf390 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec011e50 con 0x563165fcf390 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.635+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f6fec0119c0 con 0x563165fcf390 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6fec041050 con 0x563165fcf390 2024-09-21T08:13:41.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 10 client.17334 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56316641f760 con 0x563165fcf390 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fec011e50 con 0x563165fcf390 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6fec02d4e0 con 0x563165fcf390 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 10 client.17334 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 20 client.17334 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165ff0070 0x563166421f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 4 client.17334 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.636+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56316630b850 con 0x563165ff0070 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.637+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165ff0070 0x563166421f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.637+0000 7f6fda7fc640 10 client.17334 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:41.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.637+0000 7f6ff2ffd640 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165ff0070 0x563166421f00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8977157bac6cc0bf server_cookie=b0bdb549aa9dc63a in_seq=0 out_seq=0 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.637+0000 7f6fda7fc640 1 -- 172.21.15.6:0/1051653941 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x56316630b850 con 0x563165ff0070 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.637+0000 7f6fda7fc640 10 client.17334 handle_command_reply: tid=0 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 client.17334 shutdown 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 msgr2=0x5631663b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6fec006010 tx=0x7f6fec009770 comp rx=0 tx=0).stop 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 shutdown_connections 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563165ff0070 0x563166421f00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563165fcf390 0x5631663b6860 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fda7fc640 0 client.17334 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563165fc71b0 0x5631663b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 --2- 172.21.15.6:0/1051653941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563165fae9f0 0x5631663b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 >> 172.21.15.6:0/1051653941 conn(0x563165fe4460 msgr2=0x5631663a3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.638+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 shutdown_connections 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.639+0000 7f6fffd0a740 1 -- 172.21.15.6:0/1051653941 wait complete. 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.639+0000 7f6fffd0a740 20 client.17334 trim_cache size 0 max 16384 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:13:41.645 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7", 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.646 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.649 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:13:41.650 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.651 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.654 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:13:41.655 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.656 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:13:41.657 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:13:41.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:41.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:41.658 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 msgr2=0x7f6fe00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 0x7f6fe00b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6fec003fd0 tx=0x7f6fec004ab0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 msgr2=0x7f6ff419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc005940 tx=0x7f6fdc0040e0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 shutdown_connections 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6fe00b6680 0x7f6fe00b8b90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ff4105ac0 0x7f6ff41a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff4105170 0x7f6ff419cb80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 --2- 172.21.15.6:0/2118627908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff4103160 0x7f6ff419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.640+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 >> 172.21.15.6:0/2118627908 conn(0x7f6ff4077c60 msgr2=0x7f6ff40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.641+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 shutdown_connections 2024-09-21T08:13:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:41.641+0000 7f6ff9796640 1 -- 172.21.15.6:0/2118627908 wait complete. 2024-09-21T08:13:42.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 -- 172.21.15.6:0/3147712241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3600103b60 msgr2=0x7f3600103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 --2- 172.21.15.6:0/3147712241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3600103b60 0x7f3600103f70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009ca0 tx=0x7f35f002a8e0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 -- 172.21.15.6:0/3147712241 shutdown_connections 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 --2- 172.21.15.6:0/3147712241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36001094a0 0x7f36001098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 --2- 172.21.15.6:0/3147712241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f3600110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 --2- 172.21.15.6:0/3147712241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3600103b60 0x7f3600103f70 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 -- 172.21.15.6:0/3147712241 >> 172.21.15.6:0/3147712241 conn(0x7f360007b850 msgr2=0x7f360007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 -- 172.21.15.6:0/3147712241 shutdown_connections 2024-09-21T08:13:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.359+0000 7f3606c22640 1 -- 172.21.15.6:0/3147712241 wait complete. 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 Processor -- start 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 -- start start 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 0x7f360019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f360019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36001139a0 con 0x7f36001094a0 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113820 con 0x7f3600109df0 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f3606c22640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113b20 con 0x7f3600103b60 2024-09-21T08:13:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57142/0 (socket says 172.21.15.6:57142) 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f35fffff640 1 -- 172.21.15.6:0/1027282833 learned_addr learned my addr 172.21.15.6:0/1027282833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.360+0000 7f36049be640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 0x7f360019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f36051bf640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f360019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 -- 172.21.15.6:0/1027282833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 msgr2=0x7f360019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 0x7f360019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 -- 172.21.15.6:0/1027282833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 msgr2=0x7f360019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f360019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 -- 172.21.15.6:0/1027282833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001a0380 con 0x7f36001094a0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f36049be640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 0x7f360019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f36051bf640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f360019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fffff640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006fd0 tx=0x7f35f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fdffb640 1 -- 172.21.15.6:0/1027282833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011830 con 0x7f36001094a0 2024-09-21T08:13:42.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fdffb640 1 -- 172.21.15.6:0/1027282833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f4016070 con 0x7f36001094a0 2024-09-21T08:13:42.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001a0670 con 0x7f36001094a0 2024-09-21T08:13:42.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f35fdffb640 1 -- 172.21.15.6:0/1027282833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4010d30 con 0x7f36001094a0 2024-09-21T08:13:42.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.361+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001a6e50 con 0x7f36001094a0 2024-09-21T08:13:42.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 Processor -- start 2024-09-21T08:13:42.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 -- start start 2024-09-21T08:13:42.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f35fdffb640 1 -- 172.21.15.6:0/1027282833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f35f40119d0 con 0x7f36001094a0 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd59ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd59ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564acd489dc0 con 0x564acd1f8520 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564acd5161f0 con 0x564acd1cf660 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f360d196740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564acd505620 con 0x564acd1d7840 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f36051bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.364+0000 7f36051bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57146/0 (socket says 172.21.15.6:57146) 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 -- 172.21.15.6:0/3458120289 learned_addr learned my addr 172.21.15.6:0/3458120289 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f35fffff640 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd59ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36049be640 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd59ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 -- 172.21.15.6:0/3458120289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 msgr2=0x564acd59ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd59ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 -- 172.21.15.6:0/3458120289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 msgr2=0x564acd59ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd59ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 -- 172.21.15.6:0/3458120289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564acd4cdfd0 con 0x564acd1f8520 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36051bf640 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f35f800bd20 tx=0x7f35f800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da768935ce86744 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f35fdffb640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 0x7f35e80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f35e6ffd640 1 -- 172.21.15.6:0/3458120289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8015070 con 0x564acd1f8520 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f36049be640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 0x7f35e80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.365+0000 7f35e6ffd640 1 -- 172.21.15.6:0/3458120289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f800be10 con 0x564acd1f8520 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f35e6ffd640 1 -- 172.21.15.6:0/3458120289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8010630 con 0x564acd1f8520 2024-09-21T08:13:42.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f35fdffb640 1 -- 172.21.15.6:0/1027282833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f35f40e7070 con 0x7f36001094a0 2024-09-21T08:13:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 -- 172.21.15.6:0/3458120289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 msgr2=0x564acd59e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f36049be640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 0x7f35e80b8c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f35f00094e0 tx=0x7f35f0009870 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f35f800bd20 tx=0x7f35f800f730 comp rx=0 tx=0).stop 2024-09-21T08:13:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 -- 172.21.15.6:0/3458120289 shutdown_connections 2024-09-21T08:13:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd59ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd59ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 --2- 172.21.15.6:0/3458120289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1f8520 0x564acd59e510 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.366+0000 7f360d196740 1 -- 172.21.15.6:0/3458120289 >> 172.21.15.6:0/3458120289 conn(0x564acd1ec910 msgr2=0x564acd59c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 -- 172.21.15.6:0/3458120289 shutdown_connections 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 -- 172.21.15.6:0/3458120289 wait complete. 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 -- start start 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 Processor -- start 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.367+0000 7f360d196740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f360d196740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564acd4a0300 con 0x564acd1d7840 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f360d196740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564acd509430 con 0x564acd1cf660 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f360d196740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564acd366bb0 con 0x564acd1f8520 2024-09-21T08:13:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f360d196740 10 client.0 _ll_register_callbacks cb 0x564acd4ba120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57148/0 (socket says 172.21.15.6:57148) 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 -- 172.21.15.6:0/1819708666 learned_addr learned my addr 172.21.15.6:0/1819708666 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f36049be640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f36051bf640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 -- 172.21.15.6:0/1819708666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 msgr2=0x564acd5ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 -- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 msgr2=0x564acd5adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 -- 172.21.15.6:0/1819708666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acd48f780 con 0x564acd1d7840 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f36051bf640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35fffff640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35f40acaa0 tx=0x7f35f4010fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea49998b631fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35dffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40ac8e0 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f35f40a8d80 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.368+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f800be10 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f35f40ac280 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 10 client.17346 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564acd263b00 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f800be10 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f35f40e90d0 con 0x564acd1d7840 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 10 client.17346 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 10 client.17346 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 20 client.17346 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd1b6ea0 0x564acd5c0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 4 client.17346 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564acd518140 con 0x564acd1b6ea0 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.369+0000 7f36049be640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd1b6ea0 0x564acd5c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.370+0000 7f35dffff640 10 client.17346 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:42.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.370+0000 7f36049be640 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd1b6ea0 0x564acd5c0360 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad21012def4144f server_cookie=b691268b0cb10da3 in_seq=0 out_seq=0 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f35dffff640 1 -- 172.21.15.6:0/1819708666 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564acd518140 con 0x564acd1b6ea0 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f35dffff640 10 client.17346 handle_command_reply: tid=0 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 client.17346 shutdown 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 msgr2=0x564acd5ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35f40acaa0 tx=0x7f35f4010fe0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 shutdown_connections 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd1b6ea0 0x564acd5c0360 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ae510 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f35dffff640 0 client.17346 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 --2- 172.21.15.6:0/1819708666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 >> 172.21.15.6:0/1819708666 conn(0x564acd1ec910 msgr2=0x564acd5a16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 shutdown_connections 2024-09-21T08:13:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 1 -- 172.21.15.6:0/1819708666 wait complete. 2024-09-21T08:13:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.371+0000 7f360d196740 20 client.17346 trim_cache size 0 max 16384 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.388+0000 7f360d196740 1 Processor -- start 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.388+0000 7f360d196740 1 -- start start 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36001acd00 con 0x564acd1d7840 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36001af560 con 0x564acd1cf660 2024-09-21T08:13:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f360d196740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ad350 con 0x564acd1f8520 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57162/0 (socket says 172.21.15.6:57162) 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 -- 172.21.15.6:0/634687936 learned_addr learned my addr 172.21.15.6:0/634687936 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f36051bf640 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f36049be640 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 -- 172.21.15.6:0/634687936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 msgr2=0x564acd5ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 -- 172.21.15.6:0/634687936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 msgr2=0x564acd5ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 -- 172.21.15.6:0/634687936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564acd2da960 con 0x564acd1d7840 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.389+0000 7f35fffff640 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009fd0 tx=0x7f35f40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db67a0c77340d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f35e67fc640 1 -- 172.21.15.6:0/634687936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40ac460 con 0x564acd1d7840 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f35e67fc640 1 -- 172.21.15.6:0/634687936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f40ac620 con 0x564acd1d7840 2024-09-21T08:13:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f35e67fc640 1 -- 172.21.15.6:0/634687936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40ac8e0 con 0x564acd1d7840 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 -- 172.21.15.6:0/634687936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 msgr2=0x564acd5ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009fd0 tx=0x7f35f40047d0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 -- 172.21.15.6:0/634687936 shutdown_connections 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1f8520 0x564acd5ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1d7840 0x564acd5ab1c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 --2- 172.21.15.6:0/634687936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1cf660 0x564acd5ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 -- 172.21.15.6:0/634687936 >> 172.21.15.6:0/634687936 conn(0x564acd1ec910 msgr2=0x564acd59ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.390+0000 7f360d196740 1 -- 172.21.15.6:0/634687936 shutdown_connections 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 -- 172.21.15.6:0/634687936 wait complete. 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 -- start start 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 Processor -- start 2024-09-21T08:13:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd5b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 0x564acd5b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ada20 con 0x564acd1cf660 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36001aee90 con 0x564acd1f8520 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ae0f0 con 0x564acd1d7840 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f360d196740 10 client.0 _ll_register_callbacks cb 0x7f35f40ea6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f36049be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f36049be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57176/0 (socket says 172.21.15.6:57176) 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.391+0000 7f36049be640 1 -- 172.21.15.6:0/3857108532 learned_addr learned my addr 172.21.15.6:0/3857108532 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35fffff640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd5b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36051bf640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 0x564acd5b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 -- 172.21.15.6:0/3857108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 msgr2=0x564acd5b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd5b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 -- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 msgr2=0x564acd5b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 0x564acd5b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 -- 172.21.15.6:0/3857108532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acd62ad60 con 0x564acd1cf660 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36051bf640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 0x564acd5b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35fffff640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd5b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f36049be640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009ca0 tx=0x7f35f003e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795702e299a40ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35dffff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00305e0 con 0x564acd1cf660 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f35f0030780 con 0x564acd1cf660 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f40ac620 con 0x564acd1cf660 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f35f0063050 con 0x564acd1cf660 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f360d196740 10 client.17352 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.392+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564acd62c050 con 0x564acd1cf660 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35f40ac620 con 0x564acd1cf660 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f35f0043040 con 0x564acd1cf660 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 10 client.17352 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 10 client.17352 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 20 client.17352 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd18c250 0x564acd62e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 4 client.17352 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bcba40bc", "release": true, "await": true}] 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bcba40bc", "release": true, "await": true}) -- 0x564acd513bf0 con 0x564acd18c250 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f35fffff640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd18c250 0x564acd62e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f35fffff640 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd18c250 0x564acd62e840 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6caf897341f262 server_cookie=11d9a30f875a650 in_seq=0 out_seq=0 2024-09-21T08:13:42.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.393+0000 7f35dffff640 10 client.17352 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:42.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:13:42.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f35dffff640 1 -- 172.21.15.6:0/3857108532 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564acd513bf0 con 0x564acd18c250 2024-09-21T08:13:42.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f35dffff640 10 client.17352 handle_command_reply: tid=0 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 client.17352 shutdown 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 msgr2=0x564acd5b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009ca0 tx=0x7f35f003e040 comp rx=0 tx=0).stop 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 shutdown_connections 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564acd18c250 0x564acd62e840 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564acd1d7840 0x564acd5b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564acd1f8520 0x564acd5b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 --2- 172.21.15.6:0/3857108532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564acd1cf660 0x564acd5b32c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 >> 172.21.15.6:0/3857108532 conn(0x564acd1ec910 msgr2=0x564acd59ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f35dffff640 0 client.17352 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 shutdown_connections 2024-09-21T08:13:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 1 -- 172.21.15.6:0/3857108532 wait complete. 2024-09-21T08:13:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.796+0000 7f360d196740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T08:13:42.803 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:42.803 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:13:42.803 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:13:42.803 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 48, 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "bcba40bc": { 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 48, 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.8, 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:13:42.805 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:42.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:42.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:42.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:42.807 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:42.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 msgr2=0x7f35e80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 0x7f35e80b8c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f35f00094e0 tx=0x7f35f0009870 comp rx=0 tx=0).stop 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 msgr2=0x7f360019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006fd0 tx=0x7f35f400b8e0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 shutdown_connections 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f35e80b6700 0x7f35e80b8c10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3600109df0 0x7f360019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36001094a0 0x7f360019a9b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 --2- 172.21.15.6:0/1027282833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3600103b60 0x7f360019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 >> 172.21.15.6:0/1027282833 conn(0x7f360007b850 msgr2=0x7f3600107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 shutdown_connections 2024-09-21T08:13:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:42.797+0000 7f3606c22640 1 -- 172.21.15.6:0/1027282833 wait complete. 2024-09-21T08:13:43.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:42 smithi006 ceph-mon[30970]: pgmap v736: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2024-09-21T08:13:43.068 INFO:tasks.cephfs.filesystem:scrub status for tag:c25dfd7e-21a8-4e74-9299-5b6488ecbfa7 - {'path': '/', 'tag': 'c25dfd7e-21a8-4e74-9299-5b6488ecbfa7', 'options': 'recursive,force'} 2024-09-21T08:13:43.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:42 smithi145 ceph-mon[34049]: pgmap v736: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2024-09-21T08:13:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:42 smithi119 ceph-mon[33564]: pgmap v736: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2024-09-21T08:13:43.731 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bcba40bc', total seconds elapsed: 23.2 2024-09-21T08:13:43.731 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T08:13:43.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:13:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 -- 172.21.15.6:0/794342805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe14410c020 msgr2=0x7fe144112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/794342805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe14410c020 0x7fe144112850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009be0 tx=0x7fe13c02a6c0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 -- 172.21.15.6:0/794342805 shutdown_connections 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/794342805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe14410c020 0x7fe144112850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/794342805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 0x7fe14410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/794342805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe144105d90 0x7fe1441061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.837+0000 7fe14bf7c640 1 -- 172.21.15.6:0/794342805 >> 172.21.15.6:0/794342805 conn(0x7fe1441017c0 msgr2=0x7fe144103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.838+0000 7fe14bf7c640 1 -- 172.21.15.6:0/794342805 shutdown_connections 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.838+0000 7fe14bf7c640 1 -- 172.21.15.6:0/794342805 wait complete. 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.839+0000 7fe14bf7c640 1 Processor -- start 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.839+0000 7fe14bf7c640 1 -- start start 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 0x7fe14419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 0x7fe14419c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe144115b90 con 0x7fe14410b6d0 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe144115a10 con 0x7fe14410c020 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14bf7c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe144115d10 con 0x7fe144105d90 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14a519640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14a519640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:34516/0 (socket says 172.21.15.6:34516) 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe14a519640 1 -- 172.21.15.6:0/1656250240 learned_addr learned my addr 172.21.15.6:0/1656250240 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.840+0000 7fe149d18640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 0x7fe14419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe149517640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 0x7fe14419c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 -- 172.21.15.6:0/1656250240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 msgr2=0x7fe14419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 0x7fe14419c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 -- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 msgr2=0x7fe14419c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 0x7fe14419c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 -- 172.21.15.6:0/1656250240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1441a2340 con 0x7fe14410c020 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe149d18640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 0x7fe14419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.841+0000 7fe14a519640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe13c034040 tx=0x7fe13c030dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.842+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c041020 con 0x7fe14410c020 2024-09-21T08:13:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.842+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe13c037040 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.842+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c036070 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.842+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1441a25d0 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.842+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441a8d90 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.843+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14419d500 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.846+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe13c044020 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.847+0000 7fe13affd640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 0x7fe1300b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.847+0000 7fe149d18640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 0x7fe1300b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.847+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fe13c108510 con 0x7fe14410c020 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.848+0000 7fe149d18640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 0x7fe1300b8c90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fc0 tx=0x7fe140005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:44.853+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe13c04b020 con 0x7fe14410c020 2024-09-21T08:13:45.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:44 smithi006 ceph-mon[30970]: pgmap v737: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T08:13:45.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.284+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe14402e640 con 0x7fe14410c020 2024-09-21T08:13:45.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.285+0000 7fe13affd640 1 -- 172.21.15.6:0/1656250240 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fe13c0ce6e0 con 0x7fe14410c020 2024-09-21T08:13:45.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:13:45.287 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:13:45.288 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 msgr2=0x7fe1300b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 0x7fe1300b8c90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fc0 tx=0x7fe140005f90 comp rx=0 tx=0).stop 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 msgr2=0x7fe1441a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe13c034040 tx=0x7fe13c030dd0 comp rx=0 tx=0).stop 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 shutdown_connections 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe1300b6780 0x7fe1300b8c90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe14410c020 0x7fe1441a1c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14410b6d0 0x7fe14419c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 --2- 172.21.15.6:0/1656250240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144105d90 0x7fe14419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.290+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 >> 172.21.15.6:0/1656250240 conn(0x7fe1441017c0 msgr2=0x7fe14410ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.292+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 shutdown_connections 2024-09-21T08:13:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:45.293+0000 7fe14bf7c640 1 -- 172.21.15.6:0/1656250240 wait complete. 2024-09-21T08:13:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:44 smithi119 ceph-mon[33564]: pgmap v737: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T08:13:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:44 smithi145 ceph-mon[34049]: pgmap v737: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T08:13:46.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:45 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1656250240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:46.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:45 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1656250240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:46.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:45 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1656250240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:13:47.044 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T08:13:47.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T08:13:47.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:46 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:13:47.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:46 smithi006 ceph-mon[30970]: pgmap v738: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-09-21T08:13:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:46 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:13:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:46 smithi119 ceph-mon[33564]: pgmap v738: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-09-21T08:13:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:46 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:13:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:46 smithi145 ceph-mon[34049]: pgmap v738: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-09-21T08:13:47.531 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:13:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 650.0 s, 552.3 tps, lat 470.821 ms stddev 1540.479 2024-09-21T08:13:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.165+0000 7fd93c11b640 1 -- 172.21.15.6:0/2423861308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93406fa20 msgr2=0x7fd93411ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.165+0000 7fd93c11b640 1 --2- 172.21.15.6:0/2423861308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93406fa20 0x7fd93411ca00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd924009900 tx=0x7fd92402a410 comp rx=0 tx=0).stop 2024-09-21T08:13:48.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 -- 172.21.15.6:0/2423861308 shutdown_connections 2024-09-21T08:13:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 --2- 172.21.15.6:0/2423861308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93411cf40 0x7fd93411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 --2- 172.21.15.6:0/2423861308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93406fa20 0x7fd93411ca00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 --2- 172.21.15.6:0/2423861308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93406f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 -- 172.21.15.6:0/2423861308 >> 172.21.15.6:0/2423861308 conn(0x7fd93410a3c0 msgr2=0x7fd93410c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.166+0000 7fd93c11b640 1 -- 172.21.15.6:0/2423861308 shutdown_connections 2024-09-21T08:13:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.167+0000 7fd93c11b640 1 -- 172.21.15.6:0/2423861308 wait complete. 2024-09-21T08:13:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 Processor -- start 2024-09-21T08:13:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 -- start start 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93411c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93411cf40 0x7fd934116040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341227a0 con 0x7fd93406fa20 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd934122620 con 0x7fd93411cf40 2024-09-21T08:13:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.168+0000 7fd93c11b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd934122920 con 0x7fd93406f0d0 2024-09-21T08:13:48.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.169+0000 7fd9396b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.169+0000 7fd9396b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52616/0 (socket says 172.21.15.6:52616) 2024-09-21T08:13:48.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.169+0000 7fd9396b6640 1 -- 172.21.15.6:0/592181770 learned_addr learned my addr 172.21.15.6:0/592181770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:48.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.169+0000 7fd939eb7640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93411c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.169+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93411cf40 0x7fd934116040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 -- 172.21.15.6:0/592181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93411cf40 msgr2=0x7fd934116040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93411cf40 0x7fd934116040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 -- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 msgr2=0x7fd934115aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 -- 172.21.15.6:0/592181770 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd934116860 con 0x7fd93406f0d0 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd9396b6640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd939eb7640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93411c7d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd93000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.170+0000 7fd92affd640 1 -- 172.21.15.6:0/592181770 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93000cd80 con 0x7fd93406f0d0 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.171+0000 7fd92affd640 1 -- 172.21.15.6:0/592181770 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd930011900 con 0x7fd93406f0d0 2024-09-21T08:13:48.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.171+0000 7fd92affd640 1 -- 172.21.15.6:0/592181770 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93001a910 con 0x7fd93406f0d0 2024-09-21T08:13:48.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.172+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93411b500 con 0x7fd93406f0d0 2024-09-21T08:13:48.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.172+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93411b9c0 con 0x7fd93406f0d0 2024-09-21T08:13:48.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.178+0000 7fd94268f740 1 Processor -- start 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 -- start start 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66dcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 0x5592d66dd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5592d6652b90 con 0x5592d6314b60 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5592d6641fc0 con 0x5592d630c980 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.180+0000 7fd94268f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592d6645dd0 con 0x5592d6335840 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd93a6b8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd93a6b8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47314/0 (socket says 172.21.15.6:47314) 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd93a6b8640 1 -- 172.21.15.6:0/4061256117 learned_addr learned my addr 172.21.15.6:0/4061256117 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:48.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd939eb7640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66dcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd92affd640 1 -- 172.21.15.6:0/592181770 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd930011ab0 con 0x7fd93406f0d0 2024-09-21T08:13:48.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.181+0000 7fd9396b6640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 0x5592d66dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.183+0000 7fd92affd640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 0x7fd9200b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.183+0000 7fd92affd640 1 -- 172.21.15.6:0/592181770 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fd9300e8400 con 0x7fd93406f0d0 2024-09-21T08:13:48.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.184+0000 7fd9396b6640 1 -- 172.21.15.6:0/4061256117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 msgr2=0x5592d66dc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.184+0000 7fd9396b6640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.184+0000 7fd9396b6640 1 -- 172.21.15.6:0/4061256117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 msgr2=0x5592d66dcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.184+0000 7fd9396b6640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66dcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.184+0000 7fd9396b6640 1 -- 172.21.15.6:0/4061256117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d65c9060 con 0x5592d6314b60 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.185+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:13:48.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.185+0000 7fd9396b6640 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 0x5592d66dd080 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd9340729f0 tx=0x7fd924003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26df13bee396dbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.186+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 0x7fd9200b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.187+0000 7fd91ffff640 1 -- 172.21.15.6:0/4061256117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924041030 con 0x5592d6314b60 2024-09-21T08:13:48.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.187+0000 7fd91ffff640 1 -- 172.21.15.6:0/4061256117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd924005610 con 0x5592d6314b60 2024-09-21T08:13:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.188+0000 7fd94268f740 1 -- 172.21.15.6:0/4061256117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 msgr2=0x5592d66dd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.188+0000 7fd94268f740 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 0x5592d66dd080 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd9340729f0 tx=0x7fd924003680 comp rx=0 tx=0).stop 2024-09-21T08:13:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 0x7fd9200b8cc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009fd0 tx=0x7fd92c0046c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd94268f740 1 -- 172.21.15.6:0/4061256117 shutdown_connections 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd94268f740 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6314b60 0x5592d66dd080 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd94268f740 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66dcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd94268f740 1 --2- 172.21.15.6:0/4061256117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66dc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.189+0000 7fd94268f740 1 -- 172.21.15.6:0/4061256117 >> 172.21.15.6:0/4061256117 conn(0x5592d6329990 msgr2=0x5592d66da4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.190+0000 7fd94268f740 1 -- 172.21.15.6:0/4061256117 shutdown_connections 2024-09-21T08:13:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.190+0000 7fd94268f740 1 -- 172.21.15.6:0/4061256117 wait complete. 2024-09-21T08:13:48.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.191+0000 7fd94268f740 1 -- start start 2024-09-21T08:13:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.191+0000 7fd94268f740 1 Processor -- start 2024-09-21T08:13:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.191+0000 7fd94268f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5592d64a37a0 con 0x5592d6335840 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5592d65e70a0 con 0x5592d630c980 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592d66eadd0 con 0x5592d6314b60 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.192+0000 7fd94268f740 10 client.0 _ll_register_callbacks cb 0x5592d65c43c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.193+0000 7fd93a6b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.193+0000 7fd93a6b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52634/0 (socket says 172.21.15.6:52634) 2024-09-21T08:13:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.193+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1578552298 learned_addr learned my addr 172.21.15.6:0/1578552298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:48.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1578552298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 msgr2=0x5592d66e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 msgr2=0x5592d66e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1578552298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d65d5880 con 0x5592d6335840 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00fbd0 tx=0x7fd92c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d4b61be0ae0092 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.194+0000 7fd91d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.195+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c02b060 con 0x5592d6335840 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.195+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd924005610 con 0x5592d6335840 2024-09-21T08:13:48.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.195+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fd92c01cd30 con 0x5592d6335840 2024-09-21T08:13:48.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.196+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd92c032050 con 0x5592d6335840 2024-09-21T08:13:48.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.196+0000 7fd94268f740 10 client.17370 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:48.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.196+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5592d63afb90 con 0x5592d6335840 2024-09-21T08:13:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd924005610 con 0x5592d6335840 2024-09-21T08:13:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd92c025030 con 0x5592d6335840 2024-09-21T08:13:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 10 client.17370 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:48.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 10 client.17370 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 20 client.17370 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62f41c0 0x5592d66fa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 4 client.17370 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.197+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d6654ae0 con 0x5592d62f41c0 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.198+0000 7fd939eb7640 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62f41c0 0x5592d66fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.198+0000 7fd91d7fa640 10 client.17370 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.198+0000 7fd939eb7640 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62f41c0 0x5592d66fa240 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23174bd01088016b server_cookie=c23a7cb412bb7fc0 in_seq=0 out_seq=0 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.199+0000 7fd91d7fa640 1 -- 172.21.15.6:0/1578552298 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592d6654ae0 con 0x5592d62f41c0 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.199+0000 7fd91d7fa640 10 client.17370 handle_command_reply: tid=0 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 client.17370 shutdown 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 msgr2=0x5592d66f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00fbd0 tx=0x7fd92c004730 comp rx=0 tx=0).stop 2024-09-21T08:13:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 shutdown_connections 2024-09-21T08:13:48.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62f41c0 0x5592d66fa240 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d6335840 0x5592d66f4110 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 --2- 172.21.15.6:0/1578552298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d630c980 0x5592d66e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 >> 172.21.15.6:0/1578552298 conn(0x5592d6329990 msgr2=0x5592d66df7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.200+0000 7fd91d7fa640 0 client.17370 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.203+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 shutdown_connections 2024-09-21T08:13:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.203+0000 7fd94268f740 1 -- 172.21.15.6:0/1578552298 wait complete. 2024-09-21T08:13:48.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.203+0000 7fd94268f740 20 client.17370 trim_cache size 0 max 16384 2024-09-21T08:13:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.238+0000 7fd94268f740 1 Processor -- start 2024-09-21T08:13:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.238+0000 7fd94268f740 1 -- start start 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.238+0000 7fd94268f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd939eb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd939eb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52646/0 (socket says 172.21.15.6:52646) 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd939eb7640 1 -- 172.21.15.6:0/1826556866 learned_addr learned my addr 172.21.15.6:0/1826556866 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 0x5592d66e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66e5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c65a0 con 0x5592d630c980 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c8e00 con 0x5592d6314b60 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c6bf0 con 0x5592d6335840 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd9396b6640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 0x5592d66e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.239+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 msgr2=0x5592d66e9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 0x5592d66e9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1826556866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 msgr2=0x5592d66d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 -- 172.21.15.6:0/1826556866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d66e91d0 con 0x5592d6335840 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd93a6b8640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66e5100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01b5d0 tx=0x7fd92c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e5e745d1cdae2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd939eb7640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.240+0000 7fd9396b6640 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 0x5592d66e9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:13:48.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.241+0000 7fd91f7fe640 1 -- 172.21.15.6:0/1826556866 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c03b070 con 0x5592d6335840 2024-09-21T08:13:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.241+0000 7fd91f7fe640 1 -- 172.21.15.6:0/1826556866 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd92c01b850 con 0x5592d6335840 2024-09-21T08:13:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.241+0000 7fd91f7fe640 1 -- 172.21.15.6:0/1826556866 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0367e0 con 0x5592d6335840 2024-09-21T08:13:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.242+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 msgr2=0x5592d66e5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.242+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66e5100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01b5d0 tx=0x7fd92c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.245+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 shutdown_connections 2024-09-21T08:13:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.245+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6335840 0x5592d66e5100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.245+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6314b60 0x5592d66e9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.245+0000 7fd94268f740 1 --2- 172.21.15.6:0/1826556866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.245+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 >> 172.21.15.6:0/1826556866 conn(0x5592d6329990 msgr2=0x5592d66e9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.247+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 shutdown_connections 2024-09-21T08:13:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.247+0000 7fd94268f740 1 -- 172.21.15.6:0/1826556866 wait complete. 2024-09-21T08:13:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.248+0000 7fd94268f740 1 -- start start 2024-09-21T08:13:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.248+0000 7fd94268f740 1 Processor -- start 2024-09-21T08:13:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.249+0000 7fd94268f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66eb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd94268f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd94268f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6335840 0x5592d66ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd93a6b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6335840 0x5592d66ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd94268f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c72c0 con 0x5592d630c980 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd94268f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c8730 con 0x5592d6335840 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd94268f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd9341c7990 con 0x5592d6314b60 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd9396b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd9396b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:47358/0 (socket says 172.21.15.6:47358) 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.250+0000 7fd9396b6640 1 -- 172.21.15.6:0/3190891859 learned_addr learned my addr 172.21.15.6:0/3190891859 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd94268f740 10 client.0 _ll_register_callbacks cb 0x7fd92c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:13:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd939eb7640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66eb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd9396b6640 1 -- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6335840 msgr2=0x5592d66ebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd9396b6640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6335840 0x5592d66ebab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd9396b6640 1 -- 172.21.15.6:0/3190891859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 msgr2=0x5592d66eb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:13:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd9396b6640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66eb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.251+0000 7fd9396b6640 1 -- 172.21.15.6:0/3190891859 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d6764c40 con 0x5592d6314b60 2024-09-21T08:13:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.252+0000 7fd9396b6640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd92402aa00 tx=0x7fd92402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c61861cd3d1b87f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:13:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.253+0000 7fd91d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:13:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.253+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924041040 con 0x5592d6314b60 2024-09-21T08:13:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.253+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fd9240046c0 con 0x5592d6314b60 2024-09-21T08:13:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.253+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd92c01b850 con 0x5592d6314b60 2024-09-21T08:13:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.256+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd924009520 con 0x5592d6314b60 2024-09-21T08:13:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.256+0000 7fd94268f740 10 client.27088 fetch_fsmap learned FSMap version 21 2024-09-21T08:13:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.256+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5592d6765c90 con 0x5592d6314b60 2024-09-21T08:13:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.257+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd92c01b850 con 0x5592d6314b60 2024-09-21T08:13:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.257+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd92403dbf0 con 0x5592d6314b60 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 10 client.27088 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 10 client.27088 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 20 client.27088 populate_metadata read hostname 'smithi006' 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62c9570 0x5592d6767ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 4 client.27088 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T08:13:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x5592d6650590 con 0x5592d62c9570 2024-09-21T08:13:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.259+0000 7fd939eb7640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62c9570 0x5592d6767ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:13:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.260+0000 7fd91d7fa640 10 client.27088 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.260+0000 7fd939eb7640 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62c9570 0x5592d6767ed0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=129a83b67210cafd server_cookie=a61984271205706 in_seq=0 out_seq=0 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.581+0000 7fd91d7fa640 1 -- 172.21.15.6:0/3190891859 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5592d6650590 con 0x5592d62c9570 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.581+0000 7fd91d7fa640 10 client.27088 handle_command_reply: tid=0 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.581+0000 7fd94268f740 1 client.27088 shutdown 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 msgr2=0x5592d66eb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd92402aa00 tx=0x7fd92402a410 comp rx=0 tx=0).stop 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 shutdown_connections 2024-09-21T08:13:48.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d62c9570 0x5592d6767ed0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d6314b60 0x5592d66eb570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d6335840 0x5592d66ebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 --2- 172.21.15.6:0/3190891859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d630c980 0x5592d66eb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd91d7fa640 0 client.27088 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 >> 172.21.15.6:0/3190891859 conn(0x5592d6329990 msgr2=0x5592d66e63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 shutdown_connections 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 1 -- 172.21.15.6:0/3190891859 wait complete. 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd94268f740 20 client.27088 trim_cache size 0 max 16384 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:13:48.585 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 50, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "15d7c463": { 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 50, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.8, 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:13:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:13:48.587 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 msgr2=0x7fd9200b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 0x7fd9200b8cc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009fd0 tx=0x7fd92c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 msgr2=0x7fd93411c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.582+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93411c7d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd93000ee80 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 shutdown_connections 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd9200b67b0 0x7fd9200b8cc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd93411cf40 0x7fd934116040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd93406fa20 0x7fd934115aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 --2- 172.21.15.6:0/592181770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd93406f0d0 0x7fd93411c7d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 >> 172.21.15.6:0/592181770 conn(0x7fd93410a3c0 msgr2=0x7fd93411ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 shutdown_connections 2024-09-21T08:13:48.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:13:48.583+0000 7fd93c11b640 1 -- 172.21.15.6:0/592181770 wait complete. 2024-09-21T08:13:49.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:48 smithi006 ceph-mon[30970]: pgmap v739: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-09-21T08:13:49.386 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '15d7c463', quiesce took 5.7 seconds. Will release after: 12.100000000000001 2024-09-21T08:13:49.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:48 smithi119 ceph-mon[33564]: pgmap v739: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-09-21T08:13:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:48 smithi145 ceph-mon[34049]: pgmap v739: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-09-21T08:13:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:50 smithi119 ceph-mon[33564]: pgmap v740: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2024-09-21T08:13:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:50 smithi145 ceph-mon[34049]: pgmap v740: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2024-09-21T08:13:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:50 smithi006 ceph-mon[30970]: pgmap v740: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 MiB/s wr, 263 op/s 2024-09-21T08:13:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 655.0 s, 107.2 tps, lat 130.301 ms stddev 40.548 2024-09-21T08:13:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:52 smithi119 ceph-mon[33564]: pgmap v741: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.5 MiB/s wr, 310 op/s 2024-09-21T08:13:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:52 smithi145 ceph-mon[34049]: pgmap v741: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.5 MiB/s wr, 310 op/s 2024-09-21T08:13:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:52 smithi006 ceph-mon[30970]: pgmap v741: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.5 MiB/s wr, 310 op/s 2024-09-21T08:13:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:54 smithi119 ceph-mon[33564]: pgmap v742: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 3.5 MiB/s wr, 319 op/s 2024-09-21T08:13:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:54 smithi145 ceph-mon[34049]: pgmap v742: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 3.5 MiB/s wr, 319 op/s 2024-09-21T08:13:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:54 smithi006 ceph-mon[30970]: pgmap v742: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 3.5 MiB/s wr, 319 op/s 2024-09-21T08:13:57.245 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:56 smithi145 ceph-mon[34049]: pgmap v743: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.5 MiB/s wr, 316 op/s 2024-09-21T08:13:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:56 smithi119 ceph-mon[33564]: pgmap v743: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.5 MiB/s wr, 316 op/s 2024-09-21T08:13:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:56 smithi006 ceph-mon[30970]: pgmap v743: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.5 MiB/s wr, 316 op/s 2024-09-21T08:13:57.587 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:13:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:13:58 smithi119 ceph-mon[33564]: pgmap v744: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.2 MiB/s wr, 281 op/s 2024-09-21T08:13:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:13:58 smithi145 ceph-mon[34049]: pgmap v744: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.2 MiB/s wr, 281 op/s 2024-09-21T08:13:59.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:13:58 smithi006 ceph-mon[30970]: pgmap v744: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.2 MiB/s wr, 281 op/s 2024-09-21T08:14:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:00 smithi119 ceph-mon[33564]: pgmap v745: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-21T08:14:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:00 smithi145 ceph-mon[34049]: pgmap v745: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-21T08:14:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:00 smithi006 ceph-mon[30970]: pgmap v745: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-21T08:14:01.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:14:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 -- 172.21.15.6:0/1698006493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8104840 msgr2=0x7f31c8104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 --2- 172.21.15.6:0/1698006493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8104840 0x7f31c8104c50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009900 tx=0x7f31c402a410 comp rx=0 tx=0).stop 2024-09-21T08:14:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 -- 172.21.15.6:0/1698006493 shutdown_connections 2024-09-21T08:14:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 --2- 172.21.15.6:0/1698006493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c8105270 0x7f31c810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 --2- 172.21.15.6:0/1698006493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c810ddf0 0x7f31c8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 --2- 172.21.15.6:0/1698006493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8104840 0x7f31c8104c50 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 -- 172.21.15.6:0/1698006493 >> 172.21.15.6:0/1698006493 conn(0x7f31c8079730 msgr2=0x7f31c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 -- 172.21.15.6:0/1698006493 shutdown_connections 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.362+0000 7f31cf941640 1 -- 172.21.15.6:0/1698006493 wait complete. 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.363+0000 7f31cf941640 1 Processor -- start 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.363+0000 7f31cf941640 1 -- start start 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.363+0000 7f31cf941640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c8104840 0x7f31c819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.363+0000 7f31cf941640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.363+0000 7f31cf941640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c810ddf0 0x7f31c81a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cf941640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8113940 con 0x7f31c8105270 2024-09-21T08:14:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cf941640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81137c0 con 0x7f31c8104840 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cf941640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8113ac0 con 0x7f31c810ddf0 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58854/0 (socket says 172.21.15.6:58854) 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 -- 172.21.15.6:0/982606419 learned_addr learned my addr 172.21.15.6:0/982606419 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cd6dd640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c8104840 0x7f31c819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cdede640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c810ddf0 0x7f31c81a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 -- 172.21.15.6:0/982606419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c810ddf0 msgr2=0x7f31c81a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c810ddf0 0x7f31c81a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 -- 172.21.15.6:0/982606419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c8104840 msgr2=0x7f31c819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c8104840 0x7f31c819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 -- 172.21.15.6:0/982606419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c81a2540 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31ccedc640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9c0 tx=0x7f31b800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b800ccc0 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31b80054b0 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c81a2830 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.364+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8010430 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.365+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a8f90 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.366+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c806b500 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.367+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f31b8004f20 con 0x7f31c8105270 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.368+0000 7f31be7fc640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 0x7f31b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.368+0000 7f31cd6dd640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 0x7f31b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.368+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f31b80e7e40 con 0x7f31c8105270 2024-09-21T08:14:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.369+0000 7f31cd6dd640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 0x7f31b40b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31c4004770 tx=0x7f31c40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.373+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31b80adfe0 con 0x7f31c8105270 2024-09-21T08:14:02.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:14:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.603+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31c810b3a0 con 0x7f31c8105270 2024-09-21T08:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.604+0000 7f31be7fc640 1 -- 172.21.15.6:0/982606419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f31b80b23c0 con 0x7f31c8105270 2024-09-21T08:14:02.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:14:02.605 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 msgr2=0x7f31b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 0x7f31b40b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31c4004770 tx=0x7f31c40058d0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 msgr2=0x7f31c819cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9c0 tx=0x7f31b800ee80 comp rx=0 tx=0).stop 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 shutdown_connections 2024-09-21T08:14:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f31b40b6680 0x7f31b40b8b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31c810ddf0 0x7f31c81a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c8105270 0x7f31c819cb70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 --2- 172.21.15.6:0/982606419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31c8104840 0x7f31c819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 >> 172.21.15.6:0/982606419 conn(0x7f31c8079730 msgr2=0x7f31c8100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 shutdown_connections 2024-09-21T08:14:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:02.606+0000 7f31cf941640 1 -- 172.21.15.6:0/982606419 wait complete. 2024-09-21T08:14:03.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:02 smithi006 ceph-mon[30970]: pgmap v746: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 991 KiB/s wr, 93 op/s 2024-09-21T08:14:03.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:02 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/982606419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:03.392 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 15d7c463 --release --await' 2024-09-21T08:14:03.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 15d7c463 --release --await 2024-09-21T08:14:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:02 smithi119 ceph-mon[33564]: pgmap v746: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 991 KiB/s wr, 93 op/s 2024-09-21T08:14:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:02 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/982606419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:02 smithi145 ceph-mon[34049]: pgmap v746: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 991 KiB/s wr, 93 op/s 2024-09-21T08:14:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:02 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/982606419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 -- 172.21.15.6:0/58720549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c1094a0 msgr2=0x7f7f9c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/58720549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c1098b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009900 tx=0x7f7f9002a410 comp rx=0 tx=0).stop 2024-09-21T08:14:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 -- 172.21.15.6:0/58720549 shutdown_connections 2024-09-21T08:14:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/58720549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 0x7f7f9c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/58720549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c1098b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/58720549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c103b60 0x7f7f9c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 -- 172.21.15.6:0/58720549 >> 172.21.15.6:0/58720549 conn(0x7f7f9c07b850 msgr2=0x7f7f9c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 -- 172.21.15.6:0/58720549 shutdown_connections 2024-09-21T08:14:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.161+0000 7f7fa20fe640 1 -- 172.21.15.6:0/58720549 wait complete. 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 Processor -- start 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 -- start start 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 0x7f7f9c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c113960 con 0x7f7f9c103b60 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1137e0 con 0x7f7f9c109df0 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7fa20fe640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c113ae0 con 0x7f7f9c1094a0 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58876/0 (socket says 172.21.15.6:58876) 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/1221032632 learned_addr learned my addr 172.21.15.6:0/1221032632 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9affd640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 0x7f7f9c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/1221032632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c1094a0 msgr2=0x7f7f9c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/1221032632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 msgr2=0x7f7f9c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 0x7f7f9c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.162+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/1221032632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c1a86b0 con 0x7f7f9c103b60 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00d770 tx=0x7f7f8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7f98ff9640 1 -- 172.21.15.6:0/1221032632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c017070 con 0x7f7f9c103b60 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7f98ff9640 1 -- 172.21.15.6:0/1221032632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f8c0054b0 con 0x7f7f9c103b60 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c1a89a0 con 0x7f7f9c103b60 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7f98ff9640 1 -- 172.21.15.6:0/1221032632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c004c60 con 0x7f7f9c103b60 2024-09-21T08:14:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.163+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c1a8eb0 con 0x7f7f9c103b60 2024-09-21T08:14:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.165+0000 7f7fa8672740 1 Processor -- start 2024-09-21T08:14:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 -- start start 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d188f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c8840 0x5592d188ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5592d177adc0 con 0x5592d14c0660 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5592d18071f0 con 0x5592d14e9520 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7fa8672740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592d17f6620 con 0x5592d14c8840 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f98ff9640 1 -- 172.21.15.6:0/1221032632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7f8c004e00 con 0x7f7f9c103b60 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58892/0 (socket says 172.21.15.6:58892) 2024-09-21T08:14:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/3710670057 learned_addr learned my addr 172.21.15.6:0/3710670057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d188f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9affd640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c8840 0x5592d188ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.166+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/3710670057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c8840 msgr2=0x5592d188ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c8840 0x5592d188ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/3710670057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 msgr2=0x5592d188f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d188f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9b7fe640 1 -- 172.21.15.6:0/3710670057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d17befd0 con 0x5592d14c0660 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d188f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0e46f0 tx=0x7f7f8c0eda50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e51b0cc9148e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f98ff9640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 0x7f7f840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f81ffb640 1 -- 172.21.15.6:0/3710670057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0fa070 con 0x5592d14c0660 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 0x7f7f840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f81ffb640 1 -- 172.21.15.6:0/3710670057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f8c0aca70 con 0x5592d14c0660 2024-09-21T08:14:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f81ffb640 1 -- 172.21.15.6:0/3710670057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0ac6d0 con 0x5592d14c0660 2024-09-21T08:14:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.167+0000 7f7f98ff9640 1 -- 172.21.15.6:0/1221032632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7f8c0e7470 con 0x7f7f9c103b60 2024-09-21T08:14:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 -- 172.21.15.6:0/3710670057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 msgr2=0x5592d188fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 0x7f7f840b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f94005fd0 tx=0x7f7f94009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0e46f0 tx=0x7f7f8c0eda50 comp rx=0 tx=0).stop 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 -- 172.21.15.6:0/3710670057 shutdown_connections 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c8840 0x5592d188ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d188fa50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3710670057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d188f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 -- 172.21.15.6:0/3710670057 >> 172.21.15.6:0/3710670057 conn(0x5592d14dd910 msgr2=0x5592d188d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 -- 172.21.15.6:0/3710670057 shutdown_connections 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.168+0000 7f7fa8672740 1 -- 172.21.15.6:0/3710670057 wait complete. 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 -- start start 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 Processor -- start 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c0660 0x5592d189abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d18a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5592d1791300 con 0x5592d14c8840 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5592d17fa430 con 0x5592d14e9520 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592d1657bb0 con 0x5592d14c0660 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.169+0000 7f7fa8672740 10 client.0 _ll_register_callbacks cb 0x5592d17ab120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58902/0 (socket says 172.21.15.6:58902) 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 -- 172.21.15.6:0/3580475375 learned_addr learned my addr 172.21.15.6:0/3580475375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c0660 0x5592d189abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d18a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 -- 172.21.15.6:0/3580475375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c0660 msgr2=0x5592d189abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c0660 0x5592d189abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 -- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 msgr2=0x5592d18a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d18a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 -- 172.21.15.6:0/3580475375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d1780780 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f9affd640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7f90000c00 tx=0x7f7f90031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f49213d7ac3b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90035040 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7f90004040 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.170+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c0aca70 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f9004f050 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 10 client.17391 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5592d1554b00 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f8c0aca70 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f90046480 con 0x5592d14c8840 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 10 client.17391 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 10 client.17391 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 20 client.17391 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d14a7ea0 0x5592d18acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 4 client.17391 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d1809140 con 0x5592d14a7ea0 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.171+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d14a7ea0 0x5592d18acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.172+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d14a7ea0 0x5592d18acf70 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8cda0ca04ecd5e server_cookie=9ec42c84c77f5bd8 in_seq=0 out_seq=0 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.172+0000 7f7f7affd640 10 client.17391 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7f7affd640 1 -- 172.21.15.6:0/3580475375 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592d1809140 con 0x5592d14a7ea0 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7f7affd640 10 client.17391 handle_command_reply: tid=0 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 client.17391 shutdown 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 msgr2=0x5592d189b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7f90000c00 tx=0x7f7f90031400 comp rx=0 tx=0).stop 2024-09-21T08:14:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 shutdown_connections 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d14a7ea0 0x5592d18acf70 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d18a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c8840 0x5592d189b0f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 --2- 172.21.15.6:0/3580475375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d14c0660 0x5592d189abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 >> 172.21.15.6:0/3580475375 conn(0x5592d14dd910 msgr2=0x5592d18926a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7f7affd640 0 client.17391 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 shutdown_connections 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 1 -- 172.21.15.6:0/3580475375 wait complete. 2024-09-21T08:14:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.173+0000 7f7fa8672740 20 client.17391 trim_cache size 0 max 16384 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.190+0000 7f7fa8672740 1 Processor -- start 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.190+0000 7f7fa8672740 1 -- start start 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14c0660 0x5592d189c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d1899430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b1050 con 0x5592d14e9520 2024-09-21T08:14:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b38b0 con 0x5592d14c0660 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7fa8672740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b16a0 con 0x5592d147d250 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58906/0 (socket says 172.21.15.6:58906) 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 -- 172.21.15.6:0/2526780910 learned_addr learned my addr 172.21.15.6:0/2526780910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14c0660 0x5592d189c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d1899430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 -- 172.21.15.6:0/2526780910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 msgr2=0x5592d1899430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d1899430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 -- 172.21.15.6:0/2526780910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14c0660 msgr2=0x5592d189c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14c0660 0x5592d189c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 -- 172.21.15.6:0/2526780910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d15cb960 con 0x5592d14e9520 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.191+0000 7f7f9affd640 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7f900469f0 tx=0x7f7f9002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28986fb4bd3a549d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7f817fa640 1 -- 172.21.15.6:0/2526780910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90035070 con 0x5592d14e9520 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7f817fa640 1 -- 172.21.15.6:0/2526780910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f900044b0 con 0x5592d14e9520 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7f817fa640 1 -- 172.21.15.6:0/2526780910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900035f0 con 0x5592d14e9520 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 -- 172.21.15.6:0/2526780910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 msgr2=0x5592d18a6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7f900469f0 tx=0x7f7f9002a410 comp rx=0 tx=0).stop 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 -- 172.21.15.6:0/2526780910 shutdown_connections 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d1899430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14e9520 0x5592d18a6d90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 --2- 172.21.15.6:0/2526780910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14c0660 0x5592d189c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 -- 172.21.15.6:0/2526780910 >> 172.21.15.6:0/2526780910 conn(0x5592d14dd910 msgr2=0x5592d1890f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.192+0000 7f7fa8672740 1 -- 172.21.15.6:0/2526780910 shutdown_connections 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 -- 172.21.15.6:0/2526780910 wait complete. 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 -- start start 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 Processor -- start 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d189f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d1910ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b1d70 con 0x5592d14c0660 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b31e0 con 0x5592d14e9520 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b2440 con 0x5592d147d250 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7fa8672740 10 client.0 _ll_register_callbacks cb 0x7f7f90009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7f9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58910/0 (socket says 172.21.15.6:58910) 2024-09-21T08:14:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.193+0000 7f7f9affd640 1 -- 172.21.15.6:0/1653355324 learned_addr learned my addr 172.21.15.6:0/1653355324 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9bfff640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d1910ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d189f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 -- 172.21.15.6:0/1653355324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 msgr2=0x5592d189f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d189f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 -- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 msgr2=0x5592d1910ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d1910ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 -- 172.21.15.6:0/1653355324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d1911120 con 0x5592d14c0660 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f9affd640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f7f90004720 tx=0x7f7f90046730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cba1aa4e97b023 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90060060 con 0x5592d14c0660 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f7f90058040 con 0x5592d14c0660 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f900044b0 con 0x5592d14c0660 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f90067050 con 0x5592d14c0660 2024-09-21T08:14:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7fa8672740 10 client.17397 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.194+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5592d1918550 con 0x5592d14c0660 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f900044b0 con 0x5592d14c0660 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f9003dbe0 con 0x5592d14c0660 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 10 client.17397 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 10 client.17397 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 20 client.17397 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d1918b80 0x5592d191afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 4 client.17397 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "15d7c463", "release": true, "await": true}] 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "15d7c463", "release": true, "await": true}) -- 0x5592d189b480 con 0x5592d1918b80 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.195+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d1918b80 0x5592d191afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.196+0000 7f7f9b7fe640 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d1918b80 0x5592d191afa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f77654531573f1d server_cookie=f82a932985a09730 in_seq=0 out_seq=0 2024-09-21T08:14:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.196+0000 7f7f7affd640 10 client.17397 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7f7affd640 1 -- 172.21.15.6:0/1653355324 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5592d189b480 con 0x5592d1918b80 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7f7affd640 10 client.17397 handle_command_reply: tid=0 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 client.17397 shutdown 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 msgr2=0x5592d189ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f7f90004720 tx=0x7f7f90046730 comp rx=0 tx=0).stop 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 shutdown_connections 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5592d1918b80 0x5592d191afa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592d14e9520 0x5592d1910ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592d14c0660 0x5592d189ff50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7f7affd640 0 client.17397 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 --2- 172.21.15.6:0/1653355324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592d147d250 0x5592d189f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 >> 172.21.15.6:0/1653355324 conn(0x5592d14dd910 msgr2=0x5592d1892da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 shutdown_connections 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 1 -- 172.21.15.6:0/1653355324 wait complete. 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.276+0000 7f7fa8672740 20 client.17397 trim_cache size 0 max 16384 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:14:04.279 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 52, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "15d7c463": { 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 52, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 137.8, 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:14:04.280 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:04.281 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 msgr2=0x7f7f840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 0x7f7f840b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f94005fd0 tx=0x7f7f94009600 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 msgr2=0x7f7f9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00d770 tx=0x7f7f8c00dc30 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 shutdown_connections 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7f840b6700 0x7f7f840b8c10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f9c1094a0 0x7f7f9c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f9c109df0 0x7f7f9c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 --2- 172.21.15.6:0/1221032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c103b60 0x7f7f9c075710 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 >> 172.21.15.6:0/1221032632 conn(0x7f7f9c07b850 msgr2=0x7f7f9c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 shutdown_connections 2024-09-21T08:14:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:04.277+0000 7f7fa20fe640 1 -- 172.21.15.6:0/1221032632 wait complete. 2024-09-21T08:14:05.156 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '15d7c463', total seconds elapsed: 21.4 2024-09-21T08:14:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:04 smithi119 ceph-mon[33564]: pgmap v747: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 296 KiB/s wr, 51 op/s 2024-09-21T08:14:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:04 smithi145 ceph-mon[34049]: pgmap v747: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 296 KiB/s wr, 51 op/s 2024-09-21T08:14:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:04 smithi006 ceph-mon[30970]: pgmap v747: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 296 KiB/s wr, 51 op/s 2024-09-21T08:14:06.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:05 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:14:06.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:05 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:14:06.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:05 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:14:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:06 smithi119 ceph-mon[33564]: pgmap v748: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 654 KiB/s wr, 59 op/s 2024-09-21T08:14:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:14:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:14:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:06 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:14:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:06 smithi145 ceph-mon[34049]: pgmap v748: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 654 KiB/s wr, 59 op/s 2024-09-21T08:14:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:14:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:14:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:06 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:14:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:07 smithi006 ceph-mon[30970]: pgmap v748: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 654 KiB/s wr, 59 op/s 2024-09-21T08:14:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:14:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:14:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:14:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 670.0 s, 493.2 tps, lat 783.475 ms stddev 3159.385 2024-09-21T08:14:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:09 smithi119 ceph-mon[33564]: pgmap v749: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T08:14:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:09 smithi145 ceph-mon[34049]: pgmap v749: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T08:14:09.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:09 smithi006 ceph-mon[30970]: pgmap v749: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T08:14:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:11 smithi119 ceph-mon[33564]: pgmap v750: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-21T08:14:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:11 smithi119 ceph-mon[33564]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:14:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:11 smithi145 ceph-mon[34049]: pgmap v750: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-21T08:14:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:11 smithi145 ceph-mon[34049]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:14:11.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:11 smithi006 ceph-mon[30970]: pgmap v750: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-21T08:14:11.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:11 smithi006 ceph-mon[30970]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:14:12.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 675.0 s, 694.4 tps, lat 144.366 ms stddev 132.244 2024-09-21T08:14:13.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:14:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:13.900 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:13 smithi006 ceph-mon[30970]: pgmap v752: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.8 MiB/s wr, 385 op/s 2024-09-21T08:14:13.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:13 smithi119 ceph-mon[33564]: pgmap v752: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.8 MiB/s wr, 385 op/s 2024-09-21T08:14:13.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:13 smithi145 ceph-mon[34049]: pgmap v752: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.8 MiB/s wr, 385 op/s 2024-09-21T08:14:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 -- 172.21.15.6:0/1180826106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 msgr2=0x7fd650104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 --2- 172.21.15.6:0/1180826106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 0x7fd650104dc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd648009ca0 tx=0x7fd64802a8b0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 -- 172.21.15.6:0/1180826106 shutdown_connections 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 --2- 172.21.15.6:0/1180826106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 0x7fd65010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 --2- 172.21.15.6:0/1180826106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd650110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.261+0000 7fd654f64640 1 --2- 172.21.15.6:0/1180826106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 0x7fd650104dc0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.262+0000 7fd654f64640 1 -- 172.21.15.6:0/1180826106 >> 172.21.15.6:0/1180826106 conn(0x7fd650079730 msgr2=0x7fd650079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.262+0000 7fd654f64640 1 -- 172.21.15.6:0/1180826106 shutdown_connections 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.262+0000 7fd654f64640 1 -- 172.21.15.6:0/1180826106 wait complete. 2024-09-21T08:14:14.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.263+0000 7fd654f64640 1 Processor -- start 2024-09-21T08:14:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.263+0000 7fd654f64640 1 -- start start 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 0x7fd6501a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 0x7fd6501a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd650113920 con 0x7fd6501049b0 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501137a0 con 0x7fd65010de10 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd654f64640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd650113aa0 con 0x7fd650105300 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd64dd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 0x7fd6501a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.264+0000 7fd64ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:50358/0 (socket says 172.21.15.6:50358) 2024-09-21T08:14:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 -- 172.21.15.6:0/2032285384 learned_addr learned my addr 172.21.15.6:0/2032285384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 -- 172.21.15.6:0/2032285384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 msgr2=0x7fd6501a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 0x7fd6501a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 -- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 msgr2=0x7fd6501a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.265+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 0x7fd6501a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.266+0000 7fd64ed9d640 1 -- 172.21.15.6:0/2032285384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6501ac870 con 0x7fd65010de10 2024-09-21T08:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.266+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd64000e970 tx=0x7fd64000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.266+0000 7fd63f7fe640 1 -- 172.21.15.6:0/2032285384 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64000ccc0 con 0x7fd65010de10 2024-09-21T08:14:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.266+0000 7fd63f7fe640 1 -- 172.21.15.6:0/2032285384 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd64000ce60 con 0x7fd65010de10 2024-09-21T08:14:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.266+0000 7fd63f7fe640 1 -- 172.21.15.6:0/2032285384 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640010430 con 0x7fd65010de10 2024-09-21T08:14:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.267+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6501acb60 con 0x7fd65010de10 2024-09-21T08:14:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.267+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6501ad050 con 0x7fd65010de10 2024-09-21T08:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.270+0000 7fd65b4d8740 1 Processor -- start 2024-09-21T08:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.271+0000 7fd63f7fe640 1 -- 172.21.15.6:0/2032285384 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd640004f10 con 0x7fd65010de10 2024-09-21T08:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.271+0000 7fd65b4d8740 1 -- start start 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x5638596507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563859288390 0x563859650cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5638595c6e50 con 0x5638592801b0 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5638595b6280 con 0x5638592a9070 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.272+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5638595ba090 con 0x563859288390 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:50372/0 (socket says 172.21.15.6:50372) 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 -- 172.21.15.6:0/1569014201 learned_addr learned my addr 172.21.15.6:0/1569014201 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563859288390 0x563859650cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 -- 172.21.15.6:0/1569014201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563859288390 msgr2=0x563859650cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563859288390 0x563859650cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 -- 172.21.15.6:0/1569014201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 msgr2=0x5638596507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x5638596507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd64dd9b640 1 -- 172.21.15.6:0/1569014201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563859314650 con 0x5638592a9070 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.273+0000 7fd63f7fe640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 0x7fd6380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6440117a0 tx=0x7fd644005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee996cdd7b1527f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd64e59c640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 0x7fd6380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd63f7fe640 1 -- 172.21.15.6:0/2032285384 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9599+0+0 (secure 0 0 0) 0x7fd6400e7fd0 con 0x7fd65010de10 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd63cff9640 1 -- 172.21.15.6:0/1569014201 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd644004030 con 0x5638592a9070 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd63cff9640 1 -- 172.21.15.6:0/1569014201 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd644005020 con 0x5638592a9070 2024-09-21T08:14:14.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.274+0000 7fd63cff9640 1 -- 172.21.15.6:0/1569014201 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd644004b20 con 0x5638592a9070 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd64e59c640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 0x7fd6380b8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd64802add0 tx=0x7fd648005c50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd65b4d8740 1 -- 172.21.15.6:0/1569014201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 msgr2=0x563859650270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6440117a0 tx=0x7fd644005850 comp rx=0 tx=0).stop 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd65b4d8740 1 -- 172.21.15.6:0/1569014201 shutdown_connections 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563859288390 0x563859650cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.275+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x5638596507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.276+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/1569014201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x563859650270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.276+0000 7fd65b4d8740 1 -- 172.21.15.6:0/1569014201 >> 172.21.15.6:0/1569014201 conn(0x56385929d460 msgr2=0x56385964e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.276+0000 7fd65b4d8740 1 -- 172.21.15.6:0/1569014201 shutdown_connections 2024-09-21T08:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.276+0000 7fd65b4d8740 1 -- 172.21.15.6:0/1569014201 wait complete. 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.276+0000 7fd65b4d8740 1 -- start start 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 Processor -- start 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563859288390 0x56385965be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x56385965c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563859417700 con 0x5638592801b0 2024-09-21T08:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563859551110 con 0x563859288390 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56385965ea90 con 0x5638592a9070 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd65b4d8740 10 client.0 _ll_register_callbacks cb 0x56385956a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.277+0000 7fd64e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56060/0 (socket says 172.21.15.6:56060) 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 -- 172.21.15.6:0/637186566 learned_addr learned my addr 172.21.15.6:0/637186566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 -- 172.21.15.6:0/637186566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 msgr2=0x56385965c360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x56385965c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 -- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563859288390 msgr2=0x56385965be20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563859288390 0x56385965be20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.278+0000 7fd64e59c640 1 -- 172.21.15.6:0/637186566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56385957ec40 con 0x5638592801b0 2024-09-21T08:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.279+0000 7fd64e59c640 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd648009bf0 tx=0x7fd648000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68ad142ad394356 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.279+0000 7fd635ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.279+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648004450 con 0x5638592801b0 2024-09-21T08:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.280+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd644005020 con 0x5638592801b0 2024-09-21T08:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.280+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9599+0+0 (secure 0 0 0) 0x7fd6480045f0 con 0x5638592801b0 2024-09-21T08:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.280+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd648059050 con 0x5638592801b0 2024-09-21T08:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.280+0000 7fd65b4d8740 10 client.17403 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.280+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56385966a6d0 con 0x5638592801b0 2024-09-21T08:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.281+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd644005020 con 0x5638592801b0 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd64803b400 con 0x5638592801b0 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 10 client.17403 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 10 client.17403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 20 client.17403 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638592679f0 0x56385966dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 4 client.17403 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:14.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.282+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638595c8da0 con 0x5638592679f0 2024-09-21T08:14:14.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.283+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638592679f0 0x56385966dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.283+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638592679f0 0x56385966dc50 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de35aa3731a10ef7 server_cookie=891761339781cb8d in_seq=0 out_seq=0 2024-09-21T08:14:14.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.283+0000 7fd635ffb640 10 client.17403 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd635ffb640 1 -- 172.21.15.6:0/637186566 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638595c8da0 con 0x5638592679f0 2024-09-21T08:14:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd635ffb640 10 client.17403 handle_command_reply: tid=0 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 client.17403 shutdown 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 msgr2=0x56385965b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd648009bf0 tx=0x7fd648000f40 comp rx=0 tx=0).stop 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 shutdown_connections 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5638592679f0 0x56385966dc50 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd635ffb640 0 client.17403 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x56385965c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563859288390 0x56385965be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/637186566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5638592801b0 0x56385965b8e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 >> 172.21.15.6:0/637186566 conn(0x56385929d460 msgr2=0x563859653400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 shutdown_connections 2024-09-21T08:14:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.284+0000 7fd65b4d8740 1 -- 172.21.15.6:0/637186566 wait complete. 2024-09-21T08:14:14.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.285+0000 7fd65b4d8740 20 client.17403 trim_cache size 0 max 16384 2024-09-21T08:14:14.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.319+0000 7fd65b4d8740 1 Processor -- start 2024-09-21T08:14:14.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.320+0000 7fd65b4d8740 1 -- start start 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.320+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592801b0 0x56385965d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.320+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x5638596519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.320+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b5410 con 0x563859288390 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd65b4d8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b7c70 con 0x5638592a9070 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd64ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd64ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:50400/0 (socket says 172.21.15.6:50400) 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd64ed9d640 1 -- 172.21.15.6:0/3699577880 learned_addr learned my addr 172.21.15.6:0/3699577880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.321+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b5a60 con 0x5638592801b0 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.322+0000 7fd64ed9d640 1 -- 172.21.15.6:0/3699577880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592801b0 msgr2=0x56385965d7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.322+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592801b0 0x56385965d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.322+0000 7fd64ed9d640 1 -- 172.21.15.6:0/3699577880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 msgr2=0x5638596519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:14.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.322+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x5638596519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.322+0000 7fd64ed9d640 1 -- 172.21.15.6:0/3699577880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563859652560 con 0x5638592a9070 2024-09-21T08:14:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.325+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd64000d010 tx=0x7fd6400ad1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4653f6554b54024e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.327+0000 7fd637fff640 1 -- 172.21.15.6:0/3699577880 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400b2020 con 0x5638592a9070 2024-09-21T08:14:14.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.327+0000 7fd637fff640 1 -- 172.21.15.6:0/3699577880 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6400ad4a0 con 0x5638592a9070 2024-09-21T08:14:14.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.327+0000 7fd637fff640 1 -- 172.21.15.6:0/3699577880 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400b73b0 con 0x5638592a9070 2024-09-21T08:14:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 msgr2=0x56385964d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd64000d010 tx=0x7fd6400ad1c0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 shutdown_connections 2024-09-21T08:14:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592a9070 0x56385964d710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x5638596519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/3699577880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592801b0 0x56385965d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.329+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 >> 172.21.15.6:0/3699577880 conn(0x56385929d460 msgr2=0x5638596512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.332+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 shutdown_connections 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.333+0000 7fd65b4d8740 1 -- 172.21.15.6:0/3699577880 wait complete. 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.334+0000 7fd65b4d8740 1 -- start start 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.334+0000 7fd65b4d8740 1 Processor -- start 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.335+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.335+0000 7fd65b4d8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x563859660d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.335+0000 7fd64e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.335+0000 7fd64e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:50408/0 (socket says 172.21.15.6:50408) 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd64e59c640 1 -- 172.21.15.6:0/4157000304 learned_addr learned my addr 172.21.15.6:0/4157000304 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x5638596d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b6130 con 0x563859288390 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd64ed9d640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x5638596d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b75a0 con 0x5638592801b0 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.336+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd6501b6800 con 0x5638592a9070 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 -- 172.21.15.6:0/4157000304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 msgr2=0x5638596d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x5638596d1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 -- 172.21.15.6:0/4157000304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 msgr2=0x563859660d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x563859660d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638596d1d70 con 0x5638592801b0 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd65b4d8740 10 client.0 _ll_register_callbacks cb 0x7fd640005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd64e59c640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd64803b820 tx=0x7fd64803b6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6100f8640964a4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.337+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6400ad4a0 con 0x5638592801b0 2024-09-21T08:14:14.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.338+0000 7fd635ffb640 10 client.27044 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:14.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.338+0000 7fd635ffb640 1 -- 172.21.15.6:0/4157000304 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648062060 con 0x5638592801b0 2024-09-21T08:14:14.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.338+0000 7fd635ffb640 1 -- 172.21.15.6:0/4157000304 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9599+0+0 (secure 0 0 0) 0x7fd648004d50 con 0x5638592801b0 2024-09-21T08:14:14.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.339+0000 7fd635ffb640 1 -- 172.21.15.6:0/4157000304 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd648069050 con 0x5638592801b0 2024-09-21T08:14:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.340+0000 7fd65b4d8740 10 client.27044 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.340+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5638596d90e0 con 0x5638592801b0 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd635ffb640 1 -- 172.21.15.6:0/4157000304 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd648004250 con 0x5638592801b0 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 10 client.27044 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 10 client.27044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 20 client.27044 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56385923cda0 0x5638596db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 4 client.27044 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:14:14.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.343+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fd6400ad4a0 con 0x56385923cda0 2024-09-21T08:14:14.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.344+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56385923cda0 0x5638596db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.349+0000 7fd64dd9b640 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56385923cda0 0x5638596db750 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73048fbe14e18525 server_cookie=b0099d104e299a08 in_seq=0 out_seq=0 2024-09-21T08:14:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.349+0000 7fd635ffb640 10 client.27044 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.350+0000 7fd635ffb640 1 -- 172.21.15.6:0/4157000304 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x7fd6400ad4a0 con 0x56385923cda0 2024-09-21T08:14:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.350+0000 7fd635ffb640 10 client.27044 handle_command_reply: tid=0 2024-09-21T08:14:14.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.350+0000 7fd65b4d8740 1 client.27044 shutdown 2024-09-21T08:14:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 msgr2=0x563859660780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd64803b820 tx=0x7fd64803b6b0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 shutdown_connections 2024-09-21T08:14:14.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56385923cda0 0x5638596db750 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638592a9070 0x5638596d1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.351+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563859288390 0x563859660d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.352+0000 7fd65b4d8740 1 --2- 172.21.15.6:0/4157000304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5638592801b0 0x563859660780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.352+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 >> 172.21.15.6:0/4157000304 conn(0x56385929d460 msgr2=0x56385965d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.352+0000 7fd635ffb640 0 client.27044 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.352+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 shutdown_connections 2024-09-21T08:14:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.352+0000 7fd65b4d8740 1 -- 172.21.15.6:0/4157000304 wait complete. 2024-09-21T08:14:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.353+0000 7fd65b4d8740 20 client.27044 trim_cache size 0 max 16384 2024-09-21T08:14:14.360 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:14:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:14:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:14:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:14:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:14:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:14.374 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.359+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 msgr2=0x7fd6380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.359+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 0x7fd6380b8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd64802add0 tx=0x7fd648005c50 comp rx=0 tx=0).stop 2024-09-21T08:14:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.359+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 msgr2=0x7fd6501a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.359+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd64000e970 tx=0x7fd64000ed70 comp rx=0 tx=0).stop 2024-09-21T08:14:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.359+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 shutdown_connections 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd6380b6700 0x7fd6380b8c10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd650105300 0x7fd6501a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65010de10 0x7fd6501a2080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 --2- 172.21.15.6:0/2032285384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6501049b0 0x7fd6501a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 >> 172.21.15.6:0/2032285384 conn(0x7fd650079730 msgr2=0x7fd650101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 shutdown_connections 2024-09-21T08:14:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:14.360+0000 7fd654f64640 1 -- 172.21.15.6:0/2032285384 wait complete. 2024-09-21T08:14:15.331 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:14:15.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:14:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:15 smithi119 ceph-mon[33564]: pgmap v753: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2024-09-21T08:14:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:15 smithi145 ceph-mon[34049]: pgmap v753: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2024-09-21T08:14:15.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:15 smithi006 ceph-mon[30970]: pgmap v753: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2024-09-21T08:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:14:17.247 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:14:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- 172.21.15.6:0/3792289191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0103b60 msgr2=0x7fcac0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 --2- 172.21.15.6:0/3792289191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0103b60 0x7fcac0103f70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009900 tx=0x7fcab002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- 172.21.15.6:0/3792289191 shutdown_connections 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 --2- 172.21.15.6:0/3792289191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 --2- 172.21.15.6:0/3792289191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0109df0 0x7fcac0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 --2- 172.21.15.6:0/3792289191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0103b60 0x7fcac0103f70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- 172.21.15.6:0/3792289191 >> 172.21.15.6:0/3792289191 conn(0x7fcac007b850 msgr2=0x7fcac007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- 172.21.15.6:0/3792289191 shutdown_connections 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- 172.21.15.6:0/3792289191 wait complete. 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 Processor -- start 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.443+0000 7fcac5cec640 1 -- start start 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0113960 con 0x7fcac0109df0 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcac01137e0 con 0x7fcac0103b60 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcac5cec640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0113ae0 con 0x7fcac01094a0 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33864/0 (socket says 172.21.15.6:33864) 2024-09-21T08:14:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 -- 172.21.15.6:0/4294700181 learned_addr learned my addr 172.21.15.6:0/4294700181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabeffd640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56432/0 (socket says 172.21.15.6:56432) 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 -- 172.21.15.6:0/4294700181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 msgr2=0x7fcac019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 -- 172.21.15.6:0/4294700181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 msgr2=0x7fcac019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabffff640 1 -- 172.21.15.6:0/4294700181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac01a02e0 con 0x7fcac0109df0 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabeffd640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.444+0000 7fcabf7fe640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcabffff640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcab800cce0 tx=0x7fcab800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab800f450 con 0x7fcac0109df0 2024-09-21T08:14:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcab800fa80 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac01a05d0 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8018ad0 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.445+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac01a6df0 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.446+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac0103f70 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.448+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcab800f5f0 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.449+0000 7fcabcff9640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 0x7fcaa80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.449+0000 7fcabf7fe640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 0x7fcaa80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.449+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9599+0+0 (secure 0 0 0) 0x7fcab80e82f0 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.450+0000 7fcabf7fe640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 0x7fcaa80b8bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcab00057c0 tx=0x7fcab00058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.452+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcab8014030 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.838+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcac019b560 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.839+0000 7fcabcff9640 1 -- 172.21.15.6:0/4294700181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fcac019b560 con 0x7fcac0109df0 2024-09-21T08:14:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 msgr2=0x7fcaa80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 0x7fcaa80b8bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcab00057c0 tx=0x7fcab00058d0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 msgr2=0x7fcac019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcab800cce0 tx=0x7fcab800a620 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 shutdown_connections 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcaa80b66b0 0x7fcaa80b8bc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcac01094a0 0x7fcac019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac0109df0 0x7fcac019fc70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 --2- 172.21.15.6:0/4294700181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcac0103b60 0x7fcac019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 >> 172.21.15.6:0/4294700181 conn(0x7fcac007b850 msgr2=0x7fcac0107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 shutdown_connections 2024-09-21T08:14:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:16.841+0000 7fcac5cec640 1 -- 172.21.15.6:0/4294700181 wait complete. 2024-09-21T08:14:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 680.0 s, 769.2 tps, lat 130.226 ms stddev 47.627 2024-09-21T08:14:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:17 smithi119 ceph-mon[33564]: pgmap v754: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-09-21T08:14:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:17 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4294700181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:17 smithi145 ceph-mon[34049]: pgmap v754: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-09-21T08:14:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:17 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4294700181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:17 smithi006 ceph-mon[30970]: pgmap v754: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-09-21T08:14:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:17 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4294700181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:19 smithi119 ceph-mon[33564]: pgmap v755: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 6.6 MiB/s wr, 675 op/s 2024-09-21T08:14:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:19 smithi119 ceph-mon[33564]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:14:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:19 smithi145 ceph-mon[34049]: pgmap v755: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 6.6 MiB/s wr, 675 op/s 2024-09-21T08:14:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:19 smithi145 ceph-mon[34049]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:14:19.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:19 smithi006 ceph-mon[30970]: pgmap v755: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 6.6 MiB/s wr, 675 op/s 2024-09-21T08:14:19.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:19 smithi006 ceph-mon[30970]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:14:20.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:14:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2633903599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a410e5c0 msgr2=0x7f63a410e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2633903599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a410e5c0 0x7f63a410e9d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6394009900 tx=0x7f639402a420 comp rx=0 tx=0).stop 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2633903599 shutdown_connections 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2633903599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 0x7f63a41142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2633903599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a4114800 0x7f63a411b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2633903599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a410e5c0 0x7f63a410e9d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2633903599 >> 172.21.15.6:0/2633903599 conn(0x7f63a410a3c0 msgr2=0x7f63a410c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2633903599 shutdown_connections 2024-09-21T08:14:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.263+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2633903599 wait complete. 2024-09-21T08:14:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.265+0000 7f63a9b2d640 1 Processor -- start 2024-09-21T08:14:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.266+0000 7f63a9b2d640 1 -- start start 2024-09-21T08:14:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 0x7f63a41a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a4114800 0x7f63a41aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63a411e440 con 0x7f63a4114800 2024-09-21T08:14:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63a411e2c0 con 0x7f63a410e5c0 2024-09-21T08:14:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a9b2d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63a411e5c0 con 0x7f63a4113eb0 2024-09-21T08:14:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.267+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56452/0 (socket says 172.21.15.6:56452) 2024-09-21T08:14:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 -- 172.21.15.6:0/2714022783 learned_addr learned my addr 172.21.15.6:0/2714022783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 0x7f63a41a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a3fff640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a4114800 0x7f63a41aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 -- 172.21.15.6:0/2714022783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 msgr2=0x7f63a41a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 0x7f63a41a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 -- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a4114800 msgr2=0x7f63a41aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a4114800 0x7f63a41aa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.268+0000 7f63a37fe640 1 -- 172.21.15.6:0/2714022783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a41aac10 con 0x7f63a410e5c0 2024-09-21T08:14:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.269+0000 7f63a37fe640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f639402a940 tx=0x7f6394030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.269+0000 7f63a0ff9640 1 -- 172.21.15.6:0/2714022783 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639403f070 con 0x7f63a410e5c0 2024-09-21T08:14:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.270+0000 7f63a0ff9640 1 -- 172.21.15.6:0/2714022783 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6394004460 con 0x7f63a410e5c0 2024-09-21T08:14:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.270+0000 7f63a0ff9640 1 -- 172.21.15.6:0/2714022783 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394035030 con 0x7f63a410e5c0 2024-09-21T08:14:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.270+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a41aaea0 con 0x7f63a410e5c0 2024-09-21T08:14:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.270+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a41ab2f0 con 0x7f63a410e5c0 2024-09-21T08:14:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.274+0000 7f63b00a1740 1 Processor -- start 2024-09-21T08:14:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.274+0000 7f63b00a1740 1 -- start start 2024-09-21T08:14:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbca36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbca3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbca4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5575dbc19ea0 con 0x5575db8db390 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5575dbc092d0 con 0x5575db8d31b0 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63b00a1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575dbc0d0e0 con 0x5575db8fc070 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbca4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbca4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33890/0 (socket says 172.21.15.6:33890) 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63a2ffd640 1 -- 172.21.15.6:0/1115156145 learned_addr learned my addr 172.21.15.6:0/1115156145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.275+0000 7f63a3fff640 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbca36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.276+0000 7f63a3fff640 1 -- 172.21.15.6:0/1115156145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 msgr2=0x5575dbca3be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:14:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.276+0000 7f63a3fff640 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbca3be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.276+0000 7f63a3fff640 1 -- 172.21.15.6:0/1115156145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 msgr2=0x5575dbca4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.276+0000 7f63a3fff640 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbca4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.276+0000 7f63a3fff640 1 -- 172.21.15.6:0/1115156145 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575db967650 con 0x5575db8fc070 2024-09-21T08:14:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.277+0000 7f63a3fff640 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbca36a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b6d0 tx=0x7f639c00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e04fc611ab215d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.277+0000 7f6399ffb640 1 -- 172.21.15.6:0/1115156145 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00d740 con 0x5575db8fc070 2024-09-21T08:14:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.277+0000 7f63a0ff9640 1 -- 172.21.15.6:0/2714022783 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6394042070 con 0x7f63a410e5c0 2024-09-21T08:14:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.278+0000 7f6399ffb640 1 -- 172.21.15.6:0/1115156145 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f639c019070 con 0x5575db8fc070 2024-09-21T08:14:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.278+0000 7f6399ffb640 1 -- 172.21.15.6:0/1115156145 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c014c30 con 0x5575db8fc070 2024-09-21T08:14:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.281+0000 7f63b00a1740 1 -- 172.21.15.6:0/1115156145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 msgr2=0x5575dbca36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.281+0000 7f63b00a1740 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbca36a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b6d0 tx=0x7f639c00bb90 comp rx=0 tx=0).stop 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.281+0000 7f63a0ff9640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 0x7f63840b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63a0ff9640 1 -- 172.21.15.6:0/2714022783 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f63941084f0 con 0x7f63a410e5c0 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63b00a1740 1 -- 172.21.15.6:0/1115156145 shutdown_connections 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63b00a1740 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbca4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63b00a1740 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbca3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63b00a1740 1 --2- 172.21.15.6:0/1115156145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbca36a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63b00a1740 1 -- 172.21.15.6:0/1115156145 >> 172.21.15.6:0/1115156145 conn(0x5575db8f0460 msgr2=0x5575dbca1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.282+0000 7f63a3fff640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 0x7f63840b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.283+0000 7f63b00a1740 1 -- 172.21.15.6:0/1115156145 shutdown_connections 2024-09-21T08:14:21.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.283+0000 7f63b00a1740 1 -- 172.21.15.6:0/1115156145 wait complete. 2024-09-21T08:14:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.283+0000 7f63b00a1740 1 -- start start 2024-09-21T08:14:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.283+0000 7f63b00a1740 1 Processor -- start 2024-09-21T08:14:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.284+0000 7f63a3fff640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 0x7f63840b8d60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f639c008010 tx=0x7f639c0069e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.284+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56462/0 (socket says 172.21.15.6:56462) 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbcbb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56870/0 (socket says 172.21.15.6:56870) 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5575dba6a700 con 0x5575db8fc070 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5575dbba4160 con 0x5575db8d31b0 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575dbcb1ed0 con 0x5575db8db390 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63b00a1740 10 client.0 _ll_register_callbacks cb 0x5575dbbbd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a37fe640 1 -- 172.21.15.6:0/896847161 learned_addr learned my addr 172.21.15.6:0/896847161 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.285+0000 7f63a3fff640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbcbb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 -- 172.21.15.6:0/896847161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 msgr2=0x5575dbcaf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 -- 172.21.15.6:0/896847161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 msgr2=0x5575dbcbb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbcbb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 -- 172.21.15.6:0/896847161 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575dbbd1c90 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63a37fe640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6394105860 tx=0x7f6394003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d2db2cf31cb34e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f6392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394049040 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f6394105a80 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.286+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f639c019070 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6394105c80 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 10 client.27053 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5575dbcbdc10 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f639c019070 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63940b9020 con 0x5575db8d31b0 2024-09-21T08:14:21.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 10 client.27053 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 10 client.27053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 20 client.27053 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db8ba9f0 0x5575dbcc1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 4 client.27053 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.287+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575dbc1bdf0 con 0x5575db8ba9f0 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.288+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db8ba9f0 0x5575dbcc1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.290+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db8ba9f0 0x5575dbcc1230 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698cef42212da397 server_cookie=6c5b3da382ec3327 in_seq=0 out_seq=0 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.290+0000 7f6392ffd640 10 client.27053 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.291+0000 7f6392ffd640 1 -- 172.21.15.6:0/896847161 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575dbc1bdf0 con 0x5575db8ba9f0 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.291+0000 7f6392ffd640 10 client.27053 handle_command_reply: tid=0 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.291+0000 7f63b00a1740 1 client.27053 shutdown 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.291+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 msgr2=0x5575dbcaed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.291+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6394105860 tx=0x7f6394003820 comp rx=0 tx=0).stop 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 shutdown_connections 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db8ba9f0 0x5575dbcc1230 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8db390 0x5575dbcaf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbcbb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 --2- 172.21.15.6:0/896847161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcaed60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 >> 172.21.15.6:0/896847161 conn(0x5575db8f0460 msgr2=0x5575dbca6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f6392ffd640 0 client.27053 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 shutdown_connections 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 1 -- 172.21.15.6:0/896847161 wait complete. 2024-09-21T08:14:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.292+0000 7f63b00a1740 20 client.27053 trim_cache size 0 max 16384 2024-09-21T08:14:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.322+0000 7f63b00a1740 1 Processor -- start 2024-09-21T08:14:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.322+0000 7f63b00a1740 1 -- start start 2024-09-21T08:14:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.323+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcbb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.323+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbcaeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.323+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcbb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.323+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcbb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56468/0 (socket says 172.21.15.6:56468) 2024-09-21T08:14:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.323+0000 7f63a37fe640 1 -- 172.21.15.6:0/625992604 learned_addr learned my addr 172.21.15.6:0/625992604 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63b00a1740 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbcaf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41b9980 con 0x5575db8db390 2024-09-21T08:14:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41bc1e0 con 0x5575db8d31b0 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41b9fd0 con 0x5575db8fc070 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63a3fff640 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbcaf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbcaeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63a3fff640 1 -- 172.21.15.6:0/625992604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 msgr2=0x5575dbcbb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.324+0000 7f63a3fff640 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcbb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.325+0000 7f63a3fff640 1 -- 172.21.15.6:0/625992604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 msgr2=0x5575dbcaeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.325+0000 7f63a3fff640 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbcaeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.325+0000 7f63a3fff640 1 -- 172.21.15.6:0/625992604 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575dbcb0020 con 0x5575db8fc070 2024-09-21T08:14:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.325+0000 7f63a3fff640 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbcaf090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b6a0 tx=0x7f639c010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=620f8d75cde3b14b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.326+0000 7f63997fa640 1 -- 172.21.15.6:0/625992604 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c02f070 con 0x5575db8fc070 2024-09-21T08:14:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.326+0000 7f63997fa640 1 -- 172.21.15.6:0/625992604 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f639c019040 con 0x5575db8fc070 2024-09-21T08:14:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.326+0000 7f63997fa640 1 -- 172.21.15.6:0/625992604 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c02aaf0 con 0x5575db8fc070 2024-09-21T08:14:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.328+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 msgr2=0x5575dbcaf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.328+0000 7f63b00a1740 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbcaf090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b6a0 tx=0x7f639c010000 comp rx=0 tx=0).stop 2024-09-21T08:14:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 shutdown_connections 2024-09-21T08:14:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8fc070 0x5575dbcaf090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8db390 0x5575dbcaeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 --2- 172.21.15.6:0/625992604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8d31b0 0x5575dbcbb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 >> 172.21.15.6:0/625992604 conn(0x5575db8f0460 msgr2=0x5575dbcad620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 shutdown_connections 2024-09-21T08:14:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.329+0000 7f63b00a1740 1 -- 172.21.15.6:0/625992604 wait complete. 2024-09-21T08:14:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.330+0000 7f63b00a1740 1 -- start start 2024-09-21T08:14:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.331+0000 7f63b00a1740 1 Processor -- start 2024-09-21T08:14:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.331+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.331+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 0x5575dbcb2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63b00a1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbd29c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56880/0 (socket says 172.21.15.6:56880) 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63b00a1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41ba6a0 con 0x5575db8fc070 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63b00a1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41bbb10 con 0x5575db8db390 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63b00a1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41bad70 con 0x5575db8d31b0 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63b00a1740 10 client.0 _ll_register_callbacks cb 0x7f6394005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 0x5575dbcb2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63a2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 0x5575dbcb2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56478/0 (socket says 172.21.15.6:56478) 2024-09-21T08:14:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.332+0000 7f63a2ffd640 1 -- 172.21.15.6:0/3037097341 learned_addr learned my addr 172.21.15.6:0/3037097341 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 -- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 msgr2=0x5575dbcb2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 0x5575dbcb2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 -- 172.21.15.6:0/3037097341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 msgr2=0x5575dbd29c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbd29c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 -- 172.21.15.6:0/3037097341 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575dbd2a160 con 0x5575db8d31b0 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.333+0000 7f63a37fe640 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63940b93e0 tx=0x7f6394108390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394fbcf65ebf80d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.334+0000 7f6392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:21.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.334+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63940ca550 con 0x5575db8d31b0 2024-09-21T08:14:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.334+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f639c019040 con 0x5575db8d31b0 2024-09-21T08:14:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.336+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f639407d3f0 con 0x5575db8d31b0 2024-09-21T08:14:21.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.336+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6394105c90 con 0x5575db8d31b0 2024-09-21T08:14:21.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.338+0000 7f63b00a1740 10 client.27148 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:21.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.338+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5575dbd2b350 con 0x5575db8d31b0 2024-09-21T08:14:21.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f639c019040 con 0x5575db8d31b0 2024-09-21T08:14:21.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63940e9120 con 0x5575db8d31b0 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 10 client.27148 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 10 client.27148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 20 client.27148 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db88fda0 0x5575dbd2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 4 client.27148 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.340+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575dbc178a0 con 0x5575db88fda0 2024-09-21T08:14:21.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.341+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db88fda0 0x5575dbd2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.351+0000 7f63a2ffd640 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db88fda0 0x5575dbd2d960 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2888ebb64832f17c server_cookie=8a4cb4b33aa62e25 in_seq=0 out_seq=0 2024-09-21T08:14:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.351+0000 7f6392ffd640 10 client.27148 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.353+0000 7f6392ffd640 1 -- 172.21.15.6:0/3037097341 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575dbc178a0 con 0x5575db88fda0 2024-09-21T08:14:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.353+0000 7f6392ffd640 10 client.27148 handle_command_reply: tid=0 2024-09-21T08:14:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.353+0000 7f63b00a1740 1 client.27148 shutdown 2024-09-21T08:14:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.355+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 msgr2=0x5575dbcb2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.355+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63940b93e0 tx=0x7f6394108390 comp rx=0 tx=0).stop 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 shutdown_connections 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5575db88fda0 0x5575dbd2d960 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5575db8fc070 0x5575dbd29c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5575db8db390 0x5575dbcb2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 --2- 172.21.15.6:0/3037097341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575db8d31b0 0x5575dbcb2920 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f6392ffd640 0 client.27148 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.357+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 >> 172.21.15.6:0/3037097341 conn(0x5575db8f0460 msgr2=0x5575dbcaeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.359+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 shutdown_connections 2024-09-21T08:14:21.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.359+0000 7f63b00a1740 1 -- 172.21.15.6:0/3037097341 wait complete. 2024-09-21T08:14:21.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.360+0000 7f63b00a1740 20 client.27148 trim_cache size 0 max 16384 2024-09-21T08:14:21.361 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.362+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 msgr2=0x7f63840b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.362+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 0x7f63840b8d60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f639c008010 tx=0x7f639c0069e0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.362+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 msgr2=0x7f63a41a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.362+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f639402a940 tx=0x7f6394030650 comp rx=0 tx=0).stop 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 shutdown_connections 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63840b6850 0x7f63840b8d60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63a4113eb0 0x7f63a41a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a4114800 0x7f63a41aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 --2- 172.21.15.6:0/2714022783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63a410e5c0 0x7f63a41a4ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 >> 172.21.15.6:0/2714022783 conn(0x7f63a410a3c0 msgr2=0x7f63a4113390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 shutdown_connections 2024-09-21T08:14:21.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:21.364+0000 7f63a9b2d640 1 -- 172.21.15.6:0/2714022783 wait complete. 2024-09-21T08:14:21.903 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:21 smithi006 ceph-mon[30970]: pgmap v757: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.0 MiB/s wr, 751 op/s 2024-09-21T08:14:21.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:21 smithi119 ceph-mon[33564]: pgmap v757: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.0 MiB/s wr, 751 op/s 2024-09-21T08:14:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:21 smithi145 ceph-mon[34049]: pgmap v757: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.0 MiB/s wr, 751 op/s 2024-09-21T08:14:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 685.0 s, 604.6 tps, lat 164.606 ms stddev 128.663 2024-09-21T08:14:23.226 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:14:23.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:14:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:23.846 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:23 smithi006 ceph-mon[30970]: pgmap v758: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 7.3 MiB/s wr, 706 op/s 2024-09-21T08:14:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:23 smithi119 ceph-mon[33564]: pgmap v758: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 7.3 MiB/s wr, 706 op/s 2024-09-21T08:14:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:23 smithi145 ceph-mon[34049]: pgmap v758: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 7.3 MiB/s wr, 706 op/s 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 -- 172.21.15.6:0/1599344521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 msgr2=0x7efcd411efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 --2- 172.21.15.6:0/1599344521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd411efc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009900 tx=0x7efcc402a420 comp rx=0 tx=0).stop 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 -- 172.21.15.6:0/1599344521 shutdown_connections 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 --2- 172.21.15.6:0/1599344521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd411efc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 --2- 172.21.15.6:0/1599344521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd410e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 --2- 172.21.15.6:0/1599344521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.357+0000 7efcd9739640 1 -- 172.21.15.6:0/1599344521 >> 172.21.15.6:0/1599344521 conn(0x7efcd406e9f0 msgr2=0x7efcd406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.358+0000 7efcd9739640 1 -- 172.21.15.6:0/1599344521 shutdown_connections 2024-09-21T08:14:24.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.359+0000 7efcd9739640 1 -- 172.21.15.6:0/1599344521 wait complete. 2024-09-21T08:14:24.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.360+0000 7efcd9739640 1 Processor -- start 2024-09-21T08:14:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.360+0000 7efcd9739640 1 -- start start 2024-09-21T08:14:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.361+0000 7efcd9739640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd41a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.361+0000 7efcd9739640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd41a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.361+0000 7efcd9739640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd9739640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efcd41225d0 con 0x7efcd4111cd0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd9739640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4122450 con 0x7efcd410dbf0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd8f38640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd8f38640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56892/0 (socket says 172.21.15.6:56892) 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd8f38640 1 -- 172.21.15.6:0/3821248612 learned_addr learned my addr 172.21.15.6:0/3821248612 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4122750 con 0x7efcd411cba0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.362+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd41a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd3fff640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd41a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd8f38640 1 -- 172.21.15.6:0/3821248612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 msgr2=0x7efcd41a9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd8f38640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd41a9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd8f38640 1 -- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 msgr2=0x7efcd41a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd8f38640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd41a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd8f38640 1 -- 172.21.15.6:0/3821248612 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd41aef10 con 0x7efcd411cba0 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd41a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.363+0000 7efcd3fff640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd41a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:24.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.364+0000 7efcd8f38640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efcc402a990 tx=0x7efcc4003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.365+0000 7efcd17fa640 1 -- 172.21.15.6:0/3821248612 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc403f070 con 0x7efcd411cba0 2024-09-21T08:14:24.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.365+0000 7efcd17fa640 1 -- 172.21.15.6:0/3821248612 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcc403bd00 con 0x7efcd411cba0 2024-09-21T08:14:24.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.365+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd41af1a0 con 0x7efcd411cba0 2024-09-21T08:14:24.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.365+0000 7efcd17fa640 1 -- 172.21.15.6:0/3821248612 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4035030 con 0x7efcd411cba0 2024-09-21T08:14:24.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.365+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd41af6d0 con 0x7efcd411cba0 2024-09-21T08:14:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.369+0000 7efcd17fa640 1 -- 172.21.15.6:0/3821248612 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7efcc4042070 con 0x7efcd411cba0 2024-09-21T08:14:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.370+0000 7efce0f0f740 1 Processor -- start 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.371+0000 7efcd17fa640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 0x7efcbc0b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.371+0000 7efcd17fa640 1 -- 172.21.15.6:0/3821248612 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efcc4109200 con 0x7efcd411cba0 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 -- start start 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d75610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49ad670 0x5643a4d76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5643a4cebe60 con 0x5643a49a5490 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5643a4cdb290 con 0x5643a49ce350 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.372+0000 7efce0f0f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5643a4cdf0a0 con 0x5643a49ad670 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.373+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.373+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33960/0 (socket says 172.21.15.6:33960) 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.373+0000 7efcd37fe640 1 -- 172.21.15.6:0/692495466 learned_addr learned my addr 172.21.15.6:0/692495466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.373+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 0x7efcbc0b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.374+0000 7efcd37fe640 1 -- 172.21.15.6:0/692495466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49ad670 msgr2=0x5643a4d76090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:14:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.374+0000 7efcd37fe640 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49ad670 0x5643a4d76090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.374+0000 7efcd37fe640 1 -- 172.21.15.6:0/692495466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 msgr2=0x5643a4d75610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.374+0000 7efcd37fe640 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d75610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.374+0000 7efcd37fe640 1 -- 172.21.15.6:0/692495466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a4a39930 con 0x5643a49a5490 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.375+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 0x7efcbc0b8cf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009330 tx=0x7efcc80099c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.375+0000 7efcd37fe640 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcc8017c20 tx=0x7efcc801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e1dce635554884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.376+0000 7efcba7fc640 1 -- 172.21.15.6:0/692495466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8017d10 con 0x5643a49a5490 2024-09-21T08:14:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.377+0000 7efcba7fc640 1 -- 172.21.15.6:0/692495466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcc8027070 con 0x5643a49a5490 2024-09-21T08:14:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efcba7fc640 1 -- 172.21.15.6:0/692495466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8022de0 con 0x5643a49a5490 2024-09-21T08:14:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efce0f0f740 1 -- 172.21.15.6:0/692495466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 msgr2=0x5643a4d75b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efce0f0f740 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcc8017c20 tx=0x7efcc801a000 comp rx=0 tx=0).stop 2024-09-21T08:14:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efce0f0f740 1 -- 172.21.15.6:0/692495466 shutdown_connections 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efce0f0f740 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49ad670 0x5643a4d76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.378+0000 7efce0f0f740 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49a5490 0x5643a4d75b50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.379+0000 7efce0f0f740 1 --2- 172.21.15.6:0/692495466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d75610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.379+0000 7efce0f0f740 1 -- 172.21.15.6:0/692495466 >> 172.21.15.6:0/692495466 conn(0x5643a49c2740 msgr2=0x5643a4d73500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.379+0000 7efce0f0f740 1 -- 172.21.15.6:0/692495466 shutdown_connections 2024-09-21T08:14:24.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.379+0000 7efce0f0f740 1 -- 172.21.15.6:0/692495466 wait complete. 2024-09-21T08:14:24.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.380+0000 7efce0f0f740 1 -- start start 2024-09-21T08:14:24.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.380+0000 7efce0f0f740 1 Processor -- start 2024-09-21T08:14:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.380+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d81260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.380+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.380+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efce0f0f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5643a4b3c890 con 0x5643a49ad670 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efce0f0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5643a4c75d40 con 0x5643a49ce350 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efce0f0f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5643a4d83de0 con 0x5643a49a5490 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efce0f0f740 10 client.0 _ll_register_callbacks cb 0x5643a4cd9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33976/0 (socket says 172.21.15.6:33976) 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 -- 172.21.15.6:0/4187430669 learned_addr learned my addr 172.21.15.6:0/4187430669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd8f38640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd3fff640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d81260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 -- 172.21.15.6:0/4187430669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 msgr2=0x5643a4d81260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d81260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 -- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 msgr2=0x5643a4d8d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d8d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.381+0000 7efcd37fe640 1 -- 172.21.15.6:0/4187430669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a4d8d760 con 0x5643a49ad670 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.382+0000 7efcd37fe640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efcc8000c00 tx=0x7efcc8017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abd067ab4f696b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.382+0000 7efcb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.382+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc802f070 con 0x5643a49ad670 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.382+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efcc8022470 con 0x5643a49ad670 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.382+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcc8027070 con 0x5643a49ad670 2024-09-21T08:14:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.383+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efcc8039050 con 0x5643a49ad670 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.383+0000 7efce0f0f740 10 client.17433 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.383+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5643a4d90090 con 0x5643a49ad670 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.383+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcc8022670 con 0x5643a49ad670 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efcc8004040 con 0x5643a49ad670 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 10 client.17433 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:24.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 20 client.17433 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a498ccd0 0x5643a4d933f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 4 client.17433 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efcc8027070 con 0x5643a498ccd0 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.385+0000 7efcd3fff640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a498ccd0 0x5643a4d933f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.387+0000 7efcd3fff640 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a498ccd0 0x5643a4d933f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eddef399591dbd01 server_cookie=8b6548a39f75044a in_seq=0 out_seq=0 2024-09-21T08:14:24.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.387+0000 7efcb37fe640 10 client.17433 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.388+0000 7efcb37fe640 1 -- 172.21.15.6:0/4187430669 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7efcc8027070 con 0x5643a498ccd0 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.388+0000 7efcb37fe640 10 client.17433 handle_command_reply: tid=0 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.388+0000 7efce0f0f740 1 client.17433 shutdown 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.388+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 msgr2=0x5643a4d81800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.388+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efcc8000c00 tx=0x7efcc8017f40 comp rx=0 tx=0).stop 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 shutdown_connections 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a498ccd0 0x5643a4d933f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efcb37fe640 0 client.17433 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d81800 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 --2- 172.21.15.6:0/4187430669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d81260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.389+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 >> 172.21.15.6:0/4187430669 conn(0x5643a49c2740 msgr2=0x5643a4d787f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.390+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 shutdown_connections 2024-09-21T08:14:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.390+0000 7efce0f0f740 1 -- 172.21.15.6:0/4187430669 wait complete. 2024-09-21T08:14:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.391+0000 7efce0f0f740 20 client.17433 trim_cache size 0 max 16384 2024-09-21T08:14:24.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.423+0000 7efce0f0f740 1 Processor -- start 2024-09-21T08:14:24.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.423+0000 7efce0f0f740 1 -- start start 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.423+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d7ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d72b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efce0f0f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4075ad0 con 0x5643a49ad670 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efce0f0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4078330 con 0x5643a49ce350 2024-09-21T08:14:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efce0f0f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4076120 con 0x5643a49a5490 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efcd3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efcd8f38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d72b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efcd3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:56904/0 (socket says 172.21.15.6:56904) 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.424+0000 7efcd3fff640 1 -- 172.21.15.6:0/1674650441 learned_addr learned my addr 172.21.15.6:0/1674650441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd37fe640 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d7ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd3fff640 1 -- 172.21.15.6:0/1674650441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 msgr2=0x5643a4d72b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd3fff640 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d72b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd3fff640 1 -- 172.21.15.6:0/1674650441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 msgr2=0x5643a4d7ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd3fff640 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d7ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.425+0000 7efcd3fff640 1 -- 172.21.15.6:0/1674650441 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a4d83c40 con 0x5643a49a5490 2024-09-21T08:14:24.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.426+0000 7efcd3fff640 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5643a4c75e20 tx=0x7efccc009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f733c884f4a1d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.426+0000 7efcb9ffb640 1 -- 172.21.15.6:0/1674650441 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc003970 con 0x5643a49a5490 2024-09-21T08:14:24.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.427+0000 7efcb9ffb640 1 -- 172.21.15.6:0/1674650441 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efccc004030 con 0x5643a49a5490 2024-09-21T08:14:24.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.427+0000 7efcb9ffb640 1 -- 172.21.15.6:0/1674650441 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc018650 con 0x5643a49a5490 2024-09-21T08:14:24.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 -- 172.21.15.6:0/1674650441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 msgr2=0x5643a4d7a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5643a4c75e20 tx=0x7efccc009360 comp rx=0 tx=0).stop 2024-09-21T08:14:24.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 -- 172.21.15.6:0/1674650441 shutdown_connections 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ce350 0x5643a4d72b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ad670 0x5643a4d7ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 --2- 172.21.15.6:0/1674650441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d7a720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 -- 172.21.15.6:0/1674650441 >> 172.21.15.6:0/1674650441 conn(0x5643a49c2740 msgr2=0x5643a4d7f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 -- 172.21.15.6:0/1674650441 shutdown_connections 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.428+0000 7efce0f0f740 1 -- 172.21.15.6:0/1674650441 wait complete. 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.429+0000 7efce0f0f740 1 -- start start 2024-09-21T08:14:24.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.429+0000 7efce0f0f740 1 Processor -- start 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 0x5643a4d95120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efcd40767f0 con 0x5643a49ce350 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4077c60 con 0x5643a49ad670 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4076ec0 con 0x5643a49a5490 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efce0f0f740 10 client.0 _ll_register_callbacks cb 0x7efcc8017b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efcd37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56552/0 (socket says 172.21.15.6:56552) 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.430+0000 7efcd37fe640 1 -- 172.21.15.6:0/3177859755 learned_addr learned my addr 172.21.15.6:0/3177859755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:24.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd8f38640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 0x5643a4d95120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd37fe640 1 -- 172.21.15.6:0/3177859755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 msgr2=0x5643a4d94660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd37fe640 1 -- 172.21.15.6:0/3177859755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 msgr2=0x5643a4d95120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 0x5643a4d95120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd37fe640 1 -- 172.21.15.6:0/3177859755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a4dfcdc0 con 0x5643a49ad670 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.431+0000 7efcd8f38640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 0x5643a4d95120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.432+0000 7efcd37fe640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efcc8018cb0 tx=0x7efcc8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681c983cba2d2d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.432+0000 7efcb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8043060 con 0x5643a49ad670 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efcc8034850 con 0x5643a49ad670 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efccc004030 con 0x5643a49ad670 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efcc804a050 con 0x5643a49ad670 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efce0f0f740 10 client.27068 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.433+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5643a4dfe080 con 0x5643a49ad670 2024-09-21T08:14:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcc8027040 con 0x5643a49ad670 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efcc803e700 con 0x5643a49ad670 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efce0f0f740 10 client.27068 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efce0f0f740 10 client.27068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efce0f0f740 20 client.27068 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.434+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a4962080 0x5643a4e00760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.435+0000 7efce0f0f740 4 client.27068 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.435+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7efccc004030 con 0x5643a4962080 2024-09-21T08:14:24.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.435+0000 7efcd3fff640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a4962080 0x5643a4e00760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:24.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.436+0000 7efcd3fff640 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a4962080 0x5643a4e00760 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b96ac6053c4fc69 server_cookie=ee5fc70fea908146 in_seq=0 out_seq=0 2024-09-21T08:14:24.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.436+0000 7efcb37fe640 10 client.27068 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.438+0000 7efcb37fe640 1 -- 172.21.15.6:0/3177859755 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7efccc004030 con 0x5643a4962080 2024-09-21T08:14:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.438+0000 7efcb37fe640 10 client.27068 handle_command_reply: tid=0 2024-09-21T08:14:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.438+0000 7efce0f0f740 1 client.27068 shutdown 2024-09-21T08:14:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.438+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 msgr2=0x5643a4d94ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.438+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efcc8018cb0 tx=0x7efcc8004730 comp rx=0 tx=0).stop 2024-09-21T08:14:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 shutdown_connections 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5643a4962080 0x5643a4e00760 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5643a49ce350 0x5643a4d95120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5643a49ad670 0x5643a4d94ba0 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efcc8018cb0 tx=0x7efcc8004730 comp rx=0 tx=0).stop 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 --2- 172.21.15.6:0/3177859755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5643a49a5490 0x5643a4d94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 >> 172.21.15.6:0/3177859755 conn(0x5643a49c2740 msgr2=0x5643a4d824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efcb37fe640 0 client.27068 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 shutdown_connections 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 1 -- 172.21.15.6:0/3177859755 wait complete. 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.439+0000 7efce0f0f740 20 client.27068 trim_cache size 0 max 16384 2024-09-21T08:14:24.441 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "492d5c41-ebf2-4f18-9be9-73b4a7649e8b", 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.440+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 msgr2=0x7efcbc0b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.440+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 0x7efcbc0b8cf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009330 tx=0x7efcc80099c0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.440+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 msgr2=0x7efcd41ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.440+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efcc402a990 tx=0x7efcc4003cf0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 shutdown_connections 2024-09-21T08:14:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efcbc0b67e0 0x7efcbc0b8cf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd411cba0 0x7efcd41ae8a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd4111cd0 0x7efcd41a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 --2- 172.21.15.6:0/3821248612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd410dbf0 0x7efcd41a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 >> 172.21.15.6:0/3821248612 conn(0x7efcd406e9f0 msgr2=0x7efcd4110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 shutdown_connections 2024-09-21T08:14:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:24.441+0000 7efcd9739640 1 -- 172.21.15.6:0/3821248612 wait complete. 2024-09-21T08:14:25.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:14:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:25.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:25 smithi006 ceph-mon[30970]: pgmap v759: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-21T08:14:25.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:25 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:14:25.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:25 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:25.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:25 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:14:25.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:25 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:25 smithi119 ceph-mon[33564]: pgmap v759: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-21T08:14:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:25 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:14:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:25 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:25 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:14:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:25 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:25.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:25 smithi145 ceph-mon[34049]: pgmap v759: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-21T08:14:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:25 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:14:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:25 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:25 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:14:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:25 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3141812330 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e0411cc30 msgr2=0x7f3e0411f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3141812330 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e0411cc30 0x7f3e0411f140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009ca0 tx=0x7f3dfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3141812330 shutdown_connections 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3141812330 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e0411cc30 0x7f3e0411f140 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3141812330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e0410a9e0 0x7f3e0410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3141812330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e04111f40 0x7f3e0410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3141812330 >> 172.21.15.6:0/3141812330 conn(0x7f3e04070ec0 msgr2=0x7f3e040712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3141812330 shutdown_connections 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.320+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3141812330 wait complete. 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.321+0000 7f3e08b0e640 1 Processor -- start 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.321+0000 7f3e08b0e640 1 -- start start 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e0410a9e0 0x7f3e041a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e0411cc30 0x7f3e041ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04122760 con 0x7f3e0410a9e0 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041225e0 con 0x7f3e0411cc30 2024-09-21T08:14:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e08b0e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041228e0 con 0x7f3e04111f40 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43228/0 (socket says 172.21.15.6:43228) 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 -- 172.21.15.6:0/3285826055 learned_addr learned my addr 172.21.15.6:0/3285826055 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e02d9d640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e0411cc30 0x7f3e041ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 -- 172.21.15.6:0/3285826055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e0411cc30 msgr2=0x7f3e041ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e0411cc30 0x7f3e041ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 -- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e0410a9e0 msgr2=0x7f3e041a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.322+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e0410a9e0 0x7f3e041a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.323+0000 7f3e01d9b640 1 -- 172.21.15.6:0/3285826055 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e041af0e0 con 0x7f3e04111f40 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.323+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e9f0 tx=0x7f3df800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.323+0000 7f3df37fe640 1 -- 172.21.15.6:0/3285826055 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df800ccc0 con 0x7f3e04111f40 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.323+0000 7f3df37fe640 1 -- 172.21.15.6:0/3285826055 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df80035f0 con 0x7f3e04111f40 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.324+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e041af3d0 con 0x7f3e04111f40 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.324+0000 7f3df37fe640 1 -- 172.21.15.6:0/3285826055 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df800ce60 con 0x7f3e04111f40 2024-09-21T08:14:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.324+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e041b5b30 con 0x7f3e04111f40 2024-09-21T08:14:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.328+0000 7f3df37fe640 1 -- 172.21.15.6:0/3285826055 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3df8004000 con 0x7f3e04111f40 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.329+0000 7f3df37fe640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 0x7f3dec0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 Processor -- start 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 -- start start 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0259c640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 0x7f3dec0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3df37fe640 1 -- 172.21.15.6:0/3285826055 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f3df80e7f50 con 0x7f3e04111f40 2024-09-21T08:14:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9a96b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5611d9a0ce50 con 0x5611d96ce390 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5611d99fc280 con 0x5611d96c61b0 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0f082740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5611d9a00090 con 0x5611d96ef070 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43230/0 (socket says 172.21.15.6:43230) 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0259c640 1 -- 172.21.15.6:0/4189606757 learned_addr learned my addr 172.21.15.6:0/4189606757 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e0259c640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 0x7f3dec0b8d90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3df40058c0 tx=0x7f3df4005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9a96b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.330+0000 7f3e02d9d640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 -- 172.21.15.6:0/4189606757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 msgr2=0x5611d9a96650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 -- 172.21.15.6:0/4189606757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 msgr2=0x5611d9a970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 -- 172.21.15.6:0/4189606757 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d975a650 con 0x5611d96c61b0 2024-09-21T08:14:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e0259c640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.331+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9a96b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3df80e5260 tx=0x7f3df80ad530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a3bfea988d2e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.332+0000 7f3df0ff9640 1 -- 172.21.15.6:0/4189606757 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80b7380 con 0x5611d96c61b0 2024-09-21T08:14:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.332+0000 7f3df0ff9640 1 -- 172.21.15.6:0/4189606757 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df80b21f0 con 0x5611d96c61b0 2024-09-21T08:14:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.332+0000 7f3df0ff9640 1 -- 172.21.15.6:0/4189606757 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80e54e0 con 0x5611d96c61b0 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 -- 172.21.15.6:0/4189606757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 msgr2=0x5611d9a96b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9a96b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3df80e5260 tx=0x7f3df80ad530 comp rx=0 tx=0).stop 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 -- 172.21.15.6:0/4189606757 shutdown_connections 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9a96b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 --2- 172.21.15.6:0/4189606757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9a96650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.333+0000 7f3e0f082740 1 -- 172.21.15.6:0/4189606757 >> 172.21.15.6:0/4189606757 conn(0x5611d96e3460 msgr2=0x5611d9a94540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.334+0000 7f3e0f082740 1 -- 172.21.15.6:0/4189606757 shutdown_connections 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.334+0000 7f3e0f082740 1 -- 172.21.15.6:0/4189606757 wait complete. 2024-09-21T08:14:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.334+0000 7f3e0f082740 1 -- start start 2024-09-21T08:14:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 Processor -- start 2024-09-21T08:14:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ce390 0x5611d9aa2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 0x5611d9aae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5611d985d700 con 0x5611d96ef070 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5611d9997110 con 0x5611d96ce390 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5611d9aa4dd0 con 0x5611d96c61b0 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.335+0000 7f3e0f082740 10 client.0 _ll_register_callbacks cb 0x5611d99b0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43238/0 (socket says 172.21.15.6:43238) 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 -- 172.21.15.6:0/2489778471 learned_addr learned my addr 172.21.15.6:0/2489778471 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e02d9d640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 0x5611d9aae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ce390 0x5611d9aa2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 -- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ce390 msgr2=0x5611d9aa2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ce390 0x5611d9aa2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 -- 172.21.15.6:0/2489778471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 msgr2=0x5611d9aae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 0x5611d9aae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e0259c640 1 -- 172.21.15.6:0/2489778471 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d99c4c40 con 0x5611d96c61b0 2024-09-21T08:14:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.336+0000 7f3e02d9d640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 0x5611d9aae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.337+0000 7f3e0259c640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3df401d7b0 tx=0x7f3df40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385ae0ed4b5f4a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.337+0000 7f3de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.337+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4010c80 con 0x5611d96c61b0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.337+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f3df40253e0 con 0x5611d96c61b0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.337+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df80b21f0 con 0x5611d96c61b0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3df4010e20 con 0x5611d96c61b0 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3e0f082740 10 client.27169 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611d9ab0b70 con 0x5611d96c61b0 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df80b21f0 con 0x5611d96c61b0 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3df4024070 con 0x5611d96c61b0 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3e0f082740 10 client.27169 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3e0f082740 10 client.27169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.338+0000 7f3e0f082740 20 client.27169 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.339+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d96ad9f0 0x5611d9ab40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.339+0000 7f3e0f082740 4 client.27169 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.339+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611d9a0eda0 con 0x5611d96ad9f0 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.339+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d96ad9f0 0x5611d9ab40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.340+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d96ad9f0 0x5611d9ab40a0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e510313381659e server_cookie=d4106f91b5db6038 in_seq=0 out_seq=0 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.340+0000 7f3de9ffb640 10 client.27169 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3de9ffb640 1 -- 172.21.15.6:0/2489778471 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5611d9a0eda0 con 0x5611d96ad9f0 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3de9ffb640 10 client.27169 handle_command_reply: tid=0 2024-09-21T08:14:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 client.27169 shutdown 2024-09-21T08:14:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 msgr2=0x5611d9aa1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3df401d7b0 tx=0x7f3df40046c0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 shutdown_connections 2024-09-21T08:14:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d96ad9f0 0x5611d9ab40a0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ef070 0x5611d9aae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ce390 0x5611d9aa2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3de9ffb640 0 client.27169 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 --2- 172.21.15.6:0/2489778471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa1d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.341+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 >> 172.21.15.6:0/2489778471 conn(0x5611d96e3460 msgr2=0x5611d9a99830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.342+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 shutdown_connections 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.342+0000 7f3e0f082740 1 -- 172.21.15.6:0/2489778471 wait complete. 2024-09-21T08:14:26.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.342+0000 7f3e0f082740 20 client.27169 trim_cache size 0 max 16384 2024-09-21T08:14:26.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.371+0000 7f3e0f082740 1 Processor -- start 2024-09-21T08:14:26.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.371+0000 7f3e0f082740 1 -- start start 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a99750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ef070 0x5611d9a99c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041bddc0 con 0x5611d96ce390 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041c0620 con 0x5611d96ef070 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0f082740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041be410 con 0x5611d96c61b0 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43252/0 (socket says 172.21.15.6:43252) 2024-09-21T08:14:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.372+0000 7f3e0259c640 1 -- 172.21.15.6:0/564791536 learned_addr learned my addr 172.21.15.6:0/564791536 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 -- 172.21.15.6:0/564791536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ef070 msgr2=0x5611d9a99c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ef070 0x5611d9a99c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 -- 172.21.15.6:0/564791536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 msgr2=0x5611d9a99750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a99750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 -- 172.21.15.6:0/564791536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d9a9d5d0 con 0x5611d96c61b0 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3e0259c640 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3df400e720 tx=0x7f3df4009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9278b9191d9fae03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3debfff640 1 -- 172.21.15.6:0/564791536 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4039070 con 0x5611d96c61b0 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3debfff640 1 -- 172.21.15.6:0/564791536 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df40253e0 con 0x5611d96c61b0 2024-09-21T08:14:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.373+0000 7f3debfff640 1 -- 172.21.15.6:0/564791536 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4025630 con 0x5611d96c61b0 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.374+0000 7f3e0f082740 1 -- 172.21.15.6:0/564791536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 msgr2=0x5611d9aa2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3df400e720 tx=0x7f3df4009550 comp rx=0 tx=0).stop 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 -- 172.21.15.6:0/564791536 shutdown_connections 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96ef070 0x5611d9a99c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9a99750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 --2- 172.21.15.6:0/564791536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96c61b0 0x5611d9aa2200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 -- 172.21.15.6:0/564791536 >> 172.21.15.6:0/564791536 conn(0x5611d96e3460 msgr2=0x5611d9aa1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 -- 172.21.15.6:0/564791536 shutdown_connections 2024-09-21T08:14:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 -- 172.21.15.6:0/564791536 wait complete. 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.375+0000 7f3e0f082740 1 -- start start 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 Processor -- start 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9aa6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9b1da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041beae0 con 0x5611d96ce390 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041bff50 con 0x5611d96c61b0 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041bf1b0 con 0x5611d96ef070 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.376+0000 7f3e0f082740 10 client.0 _ll_register_callbacks cb 0x7f3df4009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e01d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9aa6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57086/0 (socket says 172.21.15.6:57086) 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 -- 172.21.15.6:0/1523507633 learned_addr learned my addr 172.21.15.6:0/1523507633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e01d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9aa6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49914/0 (socket says 172.21.15.6:49914) 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e02d9d640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9b1da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 -- 172.21.15.6:0/1523507633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 msgr2=0x5611d9b1da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9b1da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 -- 172.21.15.6:0/1523507633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 msgr2=0x5611d9aa6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9aa6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.377+0000 7f3e0259c640 1 -- 172.21.15.6:0/1523507633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d9aa7040 con 0x5611d96c61b0 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.378+0000 7f3e0259c640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3df4037040 tx=0x7f3df4005260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f375e8c5b65a8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.378+0000 7f3de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.378+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4039040 con 0x5611d96c61b0 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.378+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f3df40047a0 con 0x5611d96c61b0 2024-09-21T08:14:26.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.378+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df40253e0 con 0x5611d96c61b0 2024-09-21T08:14:26.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.380+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3df40049a0 con 0x5611d96c61b0 2024-09-21T08:14:26.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.380+0000 7f3e0f082740 10 client.27080 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:26.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.380+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611d9b1ef80 con 0x5611d96c61b0 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df4004b40 con 0x5611d96c61b0 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3df403c070 con 0x5611d96c61b0 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 10 client.27080 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 10 client.27080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 20 client.27080 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d9682da0 0x5611d9b21680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 4 client.27080 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.381+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3df40253e0 con 0x5611d9682da0 2024-09-21T08:14:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.382+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d9682da0 0x5611d9b21680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:26.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.383+0000 7f3de9ffb640 10 client.27080 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:26.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.384+0000 7f3e01d9b640 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d9682da0 0x5611d9b21680 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a46f25de6b0455 server_cookie=d215ac87d190df4c in_seq=0 out_seq=0 2024-09-21T08:14:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.385+0000 7f3de9ffb640 1 -- 172.21.15.6:0/1523507633 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x7f3df40253e0 con 0x5611d9682da0 2024-09-21T08:14:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.385+0000 7f3de9ffb640 10 client.27080 handle_command_reply: tid=0 2024-09-21T08:14:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.385+0000 7f3e0f082740 1 client.27080 shutdown 2024-09-21T08:14:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.385+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 msgr2=0x5611d9aa62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.385+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3df4037040 tx=0x7f3df4005260 comp rx=0 tx=0).stop 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 shutdown_connections 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611d9682da0 0x5611d9b21680 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611d96ef070 0x5611d9b1da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3de9ffb640 0 client.27080 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611d96ce390 0x5611d9aa6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 --2- 172.21.15.6:0/1523507633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611d96c61b0 0x5611d9aa62e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.386+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 >> 172.21.15.6:0/1523507633 conn(0x5611d96e3460 msgr2=0x5611d9a99750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.387+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 shutdown_connections 2024-09-21T08:14:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.387+0000 7f3e0f082740 1 -- 172.21.15.6:0/1523507633 wait complete. 2024-09-21T08:14:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.387+0000 7f3e0f082740 20 client.27080 trim_cache size 0 max 16384 2024-09-21T08:14:26.394 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:14:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:14:26.397 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.398 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.399 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:14:26.400 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:14:26.401 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.404 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:26.406 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 msgr2=0x7f3dec0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 0x7f3dec0b8d90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3df40058c0 tx=0x7f3df4005850 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 msgr2=0x7f3e041a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e9f0 tx=0x7f3df800eeb0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 shutdown_connections 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f3dec0b6880 0x7f3dec0b8d90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e04111f40 0x7f3e041a9710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e0411cc30 0x7f3e041ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 --2- 172.21.15.6:0/3285826055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e0410a9e0 0x7f3e041a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.393+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 >> 172.21.15.6:0/3285826055 conn(0x7f3e04070ec0 msgr2=0x7f3e0411e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.394+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 shutdown_connections 2024-09-21T08:14:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:26.395+0000 7f3e08b0e640 1 -- 172.21.15.6:0/3285826055 wait complete. 2024-09-21T08:14:26.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:26 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:14:26.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:26 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:14:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:26 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:14:27.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:14:27.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:14:27.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 690.0 s, 675.0 tps, lat 145.359 ms stddev 95.706 2024-09-21T08:14:27.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:27 smithi006 ceph-mon[30970]: pgmap v760: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.0 MiB/s wr, 696 op/s 2024-09-21T08:14:27.808 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:27 smithi119 ceph-mon[33564]: pgmap v760: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.0 MiB/s wr, 696 op/s 2024-09-21T08:14:27.843 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:27 smithi145 ceph-mon[34049]: pgmap v760: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.0 MiB/s wr, 696 op/s 2024-09-21T08:14:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.502+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1529249574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 msgr2=0x7fb9e810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.502+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1529249574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e810bb00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb9e001a910 tx=0x7fb9e003b470 comp rx=0 tx=0).stop 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.502+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1529249574 shutdown_connections 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.503+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1529249574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e810c040 0x7fb9e8112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.503+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1529249574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e810bb00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.503+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1529249574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e8105db0 0x7fb9e81061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.503+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1529249574 >> 172.21.15.6:0/1529249574 conn(0x7fb9e81017c0 msgr2=0x7fb9e8103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.506+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1529249574 shutdown_connections 2024-09-21T08:14:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.507+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1529249574 wait complete. 2024-09-21T08:14:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.508+0000 7fb9ee44b640 1 Processor -- start 2024-09-21T08:14:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.508+0000 7fb9ee44b640 1 -- start start 2024-09-21T08:14:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 0x7fb9e807b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 0x7fb9e8077980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806f520 con 0x7fb9e8105db0 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806f3a0 con 0x7fb9e810b6f0 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ee44b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806f6a0 con 0x7fb9e810c040 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9e77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57098/0 (socket says 172.21.15.6:57098) 2024-09-21T08:14:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9ec9e8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 0x7fb9e8077980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.509+0000 7fb9e77fe640 1 -- 172.21.15.6:0/1599461875 learned_addr learned my addr 172.21.15.6:0/1599461875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9e7fff640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 0x7fb9e807b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 -- 172.21.15.6:0/1599461875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 msgr2=0x7fb9e81126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 -- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 msgr2=0x7fb9e807b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 0x7fb9e807b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9e77fe640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 -- 172.21.15.6:0/1599461875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e80781a0 con 0x7fb9e810c040 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9e7fff640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 0x7fb9e807b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.510+0000 7fb9ec9e8640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 0x7fb9e8077980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e940 tx=0x7fb9d800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.511+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8004d20 con 0x7fb9e810c040 2024-09-21T08:14:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.511+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9d8005020 con 0x7fb9e810c040 2024-09-21T08:14:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.511+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80116d0 con 0x7fb9e810c040 2024-09-21T08:14:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.511+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e8078490 con 0x7fb9e810c040 2024-09-21T08:14:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.511+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81a4bd0 con 0x7fb9e810c040 2024-09-21T08:14:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.514+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e81061c0 con 0x7fb9e810c040 2024-09-21T08:14:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.515+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb9d800cb20 con 0x7fb9e810c040 2024-09-21T08:14:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.515+0000 7fb9e57fa640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 0x7fb9d40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.516+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fb9d80e7bd0 con 0x7fb9e810c040 2024-09-21T08:14:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.516+0000 7fb9e7fff640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 0x7fb9d40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.516+0000 7fb9e7fff640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 0x7fb9d40b8c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9e807b390 tx=0x7fb9d0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.526+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9d8016030 con 0x7fb9e810c040 2024-09-21T08:14:28.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:28 smithi006 ceph-mon[30970]: pgmap v761: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.4 MiB/s wr, 701 op/s 2024-09-21T08:14:28.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:28 smithi119 ceph-mon[33564]: pgmap v761: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.4 MiB/s wr, 701 op/s 2024-09-21T08:14:28.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:28 smithi145 ceph-mon[34049]: pgmap v761: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 7.4 MiB/s wr, 701 op/s 2024-09-21T08:14:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.960+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9e81a4eb0 con 0x7fb9e810c040 2024-09-21T08:14:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.961+0000 7fb9e57fa640 1 -- 172.21.15.6:0/1599461875 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fb9d80add40 con 0x7fb9e810c040 2024-09-21T08:14:28.965 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:14:28.965 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:14:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:14:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.966+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 msgr2=0x7fb9d40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.966+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 0x7fb9d40b8c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9e807b390 tx=0x7fb9d0005f90 comp rx=0 tx=0).stop 2024-09-21T08:14:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.966+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 msgr2=0x7fb9e8077980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.966+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 0x7fb9e8077980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e940 tx=0x7fb9d800ee00 comp rx=0 tx=0).stop 2024-09-21T08:14:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 shutdown_connections 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb9d40b6730 0x7fb9d40b8c40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb9e810c040 0x7fb9e8077980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9e810b6f0 0x7fb9e81126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 --2- 172.21.15.6:0/1599461875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e8105db0 0x7fb9e807b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.967+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 >> 172.21.15.6:0/1599461875 conn(0x7fb9e81017c0 msgr2=0x7fb9e8107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.968+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 shutdown_connections 2024-09-21T08:14:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:28.968+0000 7fb9ee44b640 1 -- 172.21.15.6:0/1599461875 wait complete. 2024-09-21T08:14:29.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1599461875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:29.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:14:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1599461875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1599461875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:30.301 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:30.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:30 smithi006 ceph-mon[30970]: pgmap v762: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-09-21T08:14:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:30 smithi119 ceph-mon[33564]: pgmap v762: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-09-21T08:14:30.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:30 smithi145 ceph-mon[34049]: pgmap v762: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-09-21T08:14:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 -- 172.21.15.6:0/2397644881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5218110420 msgr2=0x7f5218116c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 --2- 172.21.15.6:0/2397644881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5218110420 0x7f5218116c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5208009860 tx=0x7f520802a340 comp rx=0 tx=0).stop 2024-09-21T08:14:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 -- 172.21.15.6:0/2397644881 shutdown_connections 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 --2- 172.21.15.6:0/2397644881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5218110420 0x7f5218116c50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 --2- 172.21.15.6:0/2397644881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521810fad0 0x7f521810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 --2- 172.21.15.6:0/2397644881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810a190 0x7f521810a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.975+0000 7f521f459640 1 -- 172.21.15.6:0/2397644881 >> 172.21.15.6:0/2397644881 conn(0x7f52180780f0 msgr2=0x7f52181081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.976+0000 7f521f459640 1 -- 172.21.15.6:0/2397644881 shutdown_connections 2024-09-21T08:14:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.977+0000 7f521f459640 1 -- 172.21.15.6:0/2397644881 wait complete. 2024-09-21T08:14:30.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.978+0000 7f521f459640 1 Processor -- start 2024-09-21T08:14:30.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.978+0000 7f521f459640 1 -- start start 2024-09-21T08:14:30.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 0x7f5218083d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 0x7f521807d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5218110420 0x7f521807d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5218119ff0 con 0x7f5218110420 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5218119e70 con 0x7f521810a190 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521f459640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f521811a170 con 0x7f521810fad0 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 0x7f5218083d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 0x7f521807d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 0x7f5218083d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57112/0 (socket says 172.21.15.6:57112) 2024-09-21T08:14:30.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521d1f5640 1 -- 172.21.15.6:0/1037658233 learned_addr learned my addr 172.21.15.6:0/1037658233 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521c9f4640 1 -- 172.21.15.6:0/1037658233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 msgr2=0x7f5218083d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 0x7f5218083d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.979+0000 7f521c9f4640 1 -- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5218110420 msgr2=0x7f521807d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.980+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5218110420 0x7f521807d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.980+0000 7f521c9f4640 1 -- 172.21.15.6:0/1037658233 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52180829a0 con 0x7f521810fad0 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.980+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 0x7f521807d000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f521806bb30 tx=0x7f521400db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.980+0000 7f520e7fc640 1 -- 172.21.15.6:0/1037658233 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214017070 con 0x7f521810fad0 2024-09-21T08:14:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.981+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5218082c30 con 0x7f521810fad0 2024-09-21T08:14:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.981+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5218083170 con 0x7f521810fad0 2024-09-21T08:14:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.981+0000 7f520e7fc640 1 -- 172.21.15.6:0/1037658233 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5214009e30 con 0x7f521810fad0 2024-09-21T08:14:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.981+0000 7f520e7fc640 1 -- 172.21.15.6:0/1037658233 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214010e20 con 0x7f521810fad0 2024-09-21T08:14:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.984+0000 7f52259cd740 1 Processor -- start 2024-09-21T08:14:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.984+0000 7f52259cd740 1 -- start start 2024-09-21T08:14:30.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be2fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be2fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f520e7fc640 1 -- 172.21.15.6:0/1037658233 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f521401a070 con 0x7f521810fad0 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9be272ea0 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e9be2622d0 con 0x55e9bdf55070 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f52259cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e9be2660e0 con 0x55e9bdf34390 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be2fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43292/0 (socket says 172.21.15.6:43292) 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be2fc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49978/0 (socket says 172.21.15.6:49978) 2024-09-21T08:14:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521c9f4640 1 -- 172.21.15.6:0/57461753 learned_addr learned my addr 172.21.15.6:0/57461753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.985+0000 7f521d9f6640 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be2fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 -- 172.21.15.6:0/57461753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 msgr2=0x55e9be2fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be2fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 -- 172.21.15.6:0/57461753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 msgr2=0x55e9be2fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be2fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 -- 172.21.15.6:0/57461753 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9bdfc0650 con 0x55e9bdf34390 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.986+0000 7f521c9f4640 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f52140e4380 tx=0x7f52140ef910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=391e39497a0de9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.987+0000 7f52037fe640 1 -- 172.21.15.6:0/57461753 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140fa070 con 0x55e9bdf34390 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.987+0000 7f52037fe640 1 -- 172.21.15.6:0/57461753 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52140e79e0 con 0x55e9bdf34390 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.987+0000 7f52037fe640 1 -- 172.21.15.6:0/57461753 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140f5a90 con 0x55e9bdf34390 2024-09-21T08:14:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.987+0000 7f520e7fc640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 0x7f52040b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.987+0000 7f521d9f6640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 0x7f52040b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f520e7fc640 1 -- 172.21.15.6:0/1037658233 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f52140e70a0 con 0x7f521810fad0 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 -- 172.21.15.6:0/57461753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 msgr2=0x55e9be2fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f52140e4380 tx=0x7f52140ef910 comp rx=0 tx=0).stop 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 -- 172.21.15.6:0/57461753 shutdown_connections 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fcd40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be2fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 --2- 172.21.15.6:0/57461753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be2fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 -- 172.21.15.6:0/57461753 >> 172.21.15.6:0/57461753 conn(0x55e9bdf49460 msgr2=0x55e9be2fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.988+0000 7f52259cd740 1 -- 172.21.15.6:0/57461753 shutdown_connections 2024-09-21T08:14:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.989+0000 7f52259cd740 1 -- 172.21.15.6:0/57461753 wait complete. 2024-09-21T08:14:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.989+0000 7f521d9f6640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 0x7f52040b8d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5208009830 tx=0x7f520802a840 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.989+0000 7f52259cd740 1 -- start start 2024-09-21T08:14:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.989+0000 7f52259cd740 1 Processor -- start 2024-09-21T08:14:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be307f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e9be0c3700 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e9be1fd160 con 0x55e9bdf55070 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e9be30aaa0 con 0x55e9bdf34390 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.990+0000 7f52259cd740 10 client.0 _ll_register_callbacks cb 0x55e9be2169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be307f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49994/0 (socket says 172.21.15.6:49994) 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 -- 172.21.15.6:0/3364220466 learned_addr learned my addr 172.21.15.6:0/3364220466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d9f6640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 -- 172.21.15.6:0/3364220466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 msgr2=0x55e9be307f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be307f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 -- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 msgr2=0x55e9be313e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.991+0000 7f521d1f5640 1 -- 172.21.15.6:0/3364220466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9be22ac90 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.992+0000 7f521d1f5640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5210011ca0 tx=0x7f521000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174b7fa25e236605 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.992+0000 7f5200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.992+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521000fe10 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.992+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f5210015430 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.992+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52140e79e0 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.993+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5210026050 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.993+0000 7f52259cd740 10 client.17463 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.993+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e9be316900 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52140e79e0 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f521001d780 con 0x55e9bdf2c1b0 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 10 client.17463 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 20 client.17463 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdf139f0 0x55e9be319e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 4 client.17463 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9be274df0 con 0x55e9bdf139f0 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.994+0000 7f521c9f4640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdf139f0 0x55e9be319e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.995+0000 7f5200ff9640 10 client.17463 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.995+0000 7f521c9f4640 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdf139f0 0x55e9be319e80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696b796df836182d server_cookie=7bd6b79a2c06e96f in_seq=0 out_seq=0 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.996+0000 7f5200ff9640 1 -- 172.21.15.6:0/3364220466 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9be274df0 con 0x55e9bdf139f0 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.996+0000 7f5200ff9640 10 client.17463 handle_command_reply: tid=0 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.996+0000 7f52259cd740 1 client.17463 shutdown 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.996+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 msgr2=0x55e9be307a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.996+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5210011ca0 tx=0x7f521000f580 comp rx=0 tx=0).stop 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 shutdown_connections 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdf139f0 0x55e9be319e80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be307f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 --2- 172.21.15.6:0/3364220466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be307a10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 >> 172.21.15.6:0/3364220466 conn(0x55e9bdf49460 msgr2=0x55e9be2ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:30.998+0000 7f5200ff9640 0 client.17463 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.000+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 shutdown_connections 2024-09-21T08:14:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.000+0000 7f52259cd740 1 -- 172.21.15.6:0/3364220466 wait complete. 2024-09-21T08:14:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.001+0000 7f52259cd740 20 client.17463 trim_cache size 0 max 16384 2024-09-21T08:14:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.028+0000 7f52259cd740 1 Processor -- start 2024-09-21T08:14:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.029+0000 7f52259cd740 1 -- start start 2024-09-21T08:14:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.029+0000 7f52259cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be306900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.029+0000 7f52259cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.029+0000 7f52259cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.030+0000 7f52259cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc00e120 con 0x55e9bdf2c1b0 2024-09-21T08:14:31.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.030+0000 7f52259cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc010980 con 0x55e9bdf55070 2024-09-21T08:14:31.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.030+0000 7f52259cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc00e770 con 0x55e9bdf34390 2024-09-21T08:14:31.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.035+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.035+0000 7f521c9f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43304/0 (socket says 172.21.15.6:43304) 2024-09-21T08:14:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.035+0000 7f521c9f4640 1 -- 172.21.15.6:0/1793999857 learned_addr learned my addr 172.21.15.6:0/1793999857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.036+0000 7f521c9f4640 1 -- 172.21.15.6:0/1793999857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 msgr2=0x55e9be313d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.036+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.036+0000 7f521c9f4640 1 -- 172.21.15.6:0/1793999857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 msgr2=0x55e9be306900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.036+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be306900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.036+0000 7f521c9f4640 1 -- 172.21.15.6:0/1793999857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9be308ab0 con 0x55e9bdf34390 2024-09-21T08:14:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.037+0000 7f521c9f4640 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52140a9d80 tx=0x7f521400df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541aca368539b41f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:31.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.038+0000 7f5202ffd640 1 -- 172.21.15.6:0/1793999857 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214021040 con 0x55e9bdf34390 2024-09-21T08:14:31.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.038+0000 7f5202ffd640 1 -- 172.21.15.6:0/1793999857 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52140ac620 con 0x55e9bdf34390 2024-09-21T08:14:31.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.038+0000 7f5202ffd640 1 -- 172.21.15.6:0/1793999857 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140ac460 con 0x55e9bdf34390 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 -- 172.21.15.6:0/1793999857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 msgr2=0x55e9be2fa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52140a9d80 tx=0x7f521400df90 comp rx=0 tx=0).stop 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 -- 172.21.15.6:0/1793999857 shutdown_connections 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf34390 0x55e9be2fa200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be313d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 --2- 172.21.15.6:0/1793999857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf2c1b0 0x55e9be306900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.039+0000 7f52259cd740 1 -- 172.21.15.6:0/1793999857 >> 172.21.15.6:0/1793999857 conn(0x55e9bdf49460 msgr2=0x55e9be2f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.040+0000 7f52259cd740 1 -- 172.21.15.6:0/1793999857 shutdown_connections 2024-09-21T08:14:31.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.040+0000 7f52259cd740 1 -- 172.21.15.6:0/1793999857 wait complete. 2024-09-21T08:14:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.040+0000 7f52259cd740 1 -- start start 2024-09-21T08:14:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.040+0000 7f52259cd740 1 Processor -- start 2024-09-21T08:14:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf2c1b0 0x55e9be310510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf34390 0x55e9be30b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc00ee40 con 0x55e9bdf34390 2024-09-21T08:14:31.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0102b0 con 0x55e9bdf55070 2024-09-21T08:14:31.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc00f510 con 0x55e9bdf2c1b0 2024-09-21T08:14:31.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.041+0000 7f52259cd740 10 client.0 _ll_register_callbacks cb 0x7f5210009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57152/0 (socket says 172.21.15.6:57152) 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 -- 172.21.15.6:0/977358235 learned_addr learned my addr 172.21.15.6:0/977358235 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521c9f4640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf34390 0x55e9be30b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 -- 172.21.15.6:0/977358235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf2c1b0 msgr2=0x55e9be310510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf2c1b0 0x55e9be310510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 -- 172.21.15.6:0/977358235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf34390 msgr2=0x55e9be30b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf34390 0x55e9be30b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.042+0000 7f521d9f6640 1 -- 172.21.15.6:0/977358235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9be30c640 con 0x55e9bdf55070 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f521d9f6640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5208009860 tx=0x7f5208005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad85a6058cad4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:31.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f5200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:31.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208045040 con 0x55e9bdf55070 2024-09-21T08:14:31.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52140ac620 con 0x55e9bdf55070 2024-09-21T08:14:31.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f5208005040 con 0x55e9bdf55070 2024-09-21T08:14:31.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.043+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5208057050 con 0x55e9bdf55070 2024-09-21T08:14:31.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.045+0000 7f52259cd740 10 client.27098 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:31.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.045+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e9be3847f0 con 0x55e9bdf55070 2024-09-21T08:14:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.048+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52140ac620 con 0x55e9bdf55070 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5208004c90 con 0x55e9bdf55070 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 10 client.27098 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 10 client.27098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 20 client.27098 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdee8da0 0x55e9be386fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 4 client.27098 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:14:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.049+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9be3035c0 con 0x55e9bdee8da0 2024-09-21T08:14:31.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.051+0000 7f521d1f5640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdee8da0 0x55e9be386fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:31.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.055+0000 7f521d1f5640 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdee8da0 0x55e9be386fe0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7dfc243871a71fe server_cookie=7b2cddfd109268b9 in_seq=0 out_seq=0 2024-09-21T08:14:31.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.055+0000 7f5200ff9640 10 client.27098 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:31.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.056+0000 7f5200ff9640 1 -- 172.21.15.6:0/977358235 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9be3035c0 con 0x55e9bdee8da0 2024-09-21T08:14:31.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.056+0000 7f5200ff9640 10 client.27098 handle_command_reply: tid=0 2024-09-21T08:14:31.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.056+0000 7f52259cd740 1 client.27098 shutdown 2024-09-21T08:14:31.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 msgr2=0x55e9be30bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5208009860 tx=0x7f5208005c90 comp rx=0 tx=0).stop 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 shutdown_connections 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e9bdee8da0 0x55e9be386fe0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9bdf55070 0x55e9be30bf00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e9bdf34390 0x55e9be30b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 --2- 172.21.15.6:0/977358235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e9bdf2c1b0 0x55e9be310510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 >> 172.21.15.6:0/977358235 conn(0x55e9bdf49460 msgr2=0x55e9be2ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f5200ff9640 0 client.27098 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.057+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 shutdown_connections 2024-09-21T08:14:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.058+0000 7f52259cd740 1 -- 172.21.15.6:0/977358235 wait complete. 2024-09-21T08:14:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.058+0000 7f52259cd740 20 client.27098 trim_cache size 0 max 16384 2024-09-21T08:14:31.060 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.059+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 msgr2=0x7f52040b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.059+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 0x7f52040b8d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5208009830 tx=0x7f520802a840 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.059+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 msgr2=0x7f521807d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.059+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 0x7f521807d000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f521806bb30 tx=0x7f521400db30 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 shutdown_connections 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f52040b6800 0x7f52040b8d10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f521810fad0 0x7f521807d000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5218110420 0x7f521807d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 --2- 172.21.15.6:0/1037658233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f521810a190 0x7f5218083d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 >> 172.21.15.6:0/1037658233 conn(0x7f52180780f0 msgr2=0x7f5218108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.060+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 shutdown_connections 2024-09-21T08:14:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:31.061+0000 7f521f459640 1 -- 172.21.15.6:0/1037658233 wait complete. 2024-09-21T08:14:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 695.0 s, 751.0 tps, lat 136.322 ms stddev 97.996 2024-09-21T08:14:32.794 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:14:32.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:14:33.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:32 smithi006 ceph-mon[30970]: pgmap v763: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-09-21T08:14:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:32 smithi119 ceph-mon[33564]: pgmap v763: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-09-21T08:14:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:32 smithi145 ceph-mon[34049]: pgmap v763: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-09-21T08:14:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.926+0000 7ff47178c640 1 -- 172.21.15.6:0/1395009372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c1083a0 msgr2=0x7ff46c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.926+0000 7ff47178c640 1 --2- 172.21.15.6:0/1395009372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c1083a0 0x7ff46c1087b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009900 tx=0x7ff45c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.928+0000 7ff47178c640 1 -- 172.21.15.6:0/1395009372 shutdown_connections 2024-09-21T08:14:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.928+0000 7ff47178c640 1 --2- 172.21.15.6:0/1395009372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c1083a0 0x7ff46c1087b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.928+0000 7ff47178c640 1 --2- 172.21.15.6:0/1395009372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c108cf0 0x7ff46c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.928+0000 7ff47178c640 1 --2- 172.21.15.6:0/1395009372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c102a60 0x7ff46c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.928+0000 7ff47178c640 1 -- 172.21.15.6:0/1395009372 >> 172.21.15.6:0/1395009372 conn(0x7ff46c079730 msgr2=0x7ff46c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.929+0000 7ff47178c640 1 -- 172.21.15.6:0/1395009372 shutdown_connections 2024-09-21T08:14:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.930+0000 7ff47178c640 1 -- 172.21.15.6:0/1395009372 wait complete. 2024-09-21T08:14:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 Processor -- start 2024-09-21T08:14:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 -- start start 2024-09-21T08:14:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 0x7ff46c10bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c108cf0 0x7ff46c1ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c111750 con 0x7ff46c1083a0 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c1115d0 con 0x7ff46c108cf0 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.931+0000 7ff47178c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c1118d0 con 0x7ff46c102a60 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.932+0000 7ff46a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.932+0000 7ff46a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50046/0 (socket says 172.21.15.6:50046) 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.932+0000 7ff46a7fc640 1 -- 172.21.15.6:0/1515938152 learned_addr learned my addr 172.21.15.6:0/1515938152 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.932+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c108cf0 0x7ff46c1ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.932+0000 7ff46affd640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 0x7ff46c10bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 -- 172.21.15.6:0/1515938152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c108cf0 msgr2=0x7ff46c1ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c108cf0 0x7ff46c1ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 -- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 msgr2=0x7ff46c10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 -- 172.21.15.6:0/1515938152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c1acb70 con 0x7ff46c102a60 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.933+0000 7ff46affd640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 0x7ff46c10bc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff46400e9f0 tx=0x7ff46400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.934+0000 7ff453fff640 1 -- 172.21.15.6:0/1515938152 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46400ccc0 con 0x7ff46c102a60 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.934+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c1acda0 con 0x7ff46c102a60 2024-09-21T08:14:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.934+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c1ad2b0 con 0x7ff46c102a60 2024-09-21T08:14:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.934+0000 7ff453fff640 1 -- 172.21.15.6:0/1515938152 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff464005020 con 0x7ff46c102a60 2024-09-21T08:14:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.935+0000 7ff453fff640 1 -- 172.21.15.6:0/1515938152 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464004a00 con 0x7ff46c102a60 2024-09-21T08:14:33.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.939+0000 7ff477d00740 1 Processor -- start 2024-09-21T08:14:33.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.939+0000 7ff453fff640 1 -- 172.21.15.6:0/1515938152 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff464004ba0 con 0x7ff46c102a60 2024-09-21T08:14:33.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.941+0000 7ff453fff640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 0x7ff4540b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.941+0000 7ff453fff640 1 -- 172.21.15.6:0/1515938152 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7ff4640e7900 con 0x7ff46c102a60 2024-09-21T08:14:33.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.942+0000 7ff477d00740 1 -- start start 2024-09-21T08:14:33.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.942+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 0x7ff4540b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.942+0000 7ff477d00740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760c9350 0x55f476470430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff477d00740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f476470970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff477d00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476470eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff477d00740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f4763e6e60 con 0x55f4760a0490 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff477d00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f4763d6290 con 0x55f4760a8670 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff477d00740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f4763da0a0 con 0x55f4760c9350 2024-09-21T08:14:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff46a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f476470970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff46a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f476470970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50062/0 (socket says 172.21.15.6:50062) 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff46a7fc640 1 -- 172.21.15.6:0/1248028375 learned_addr learned my addr 172.21.15.6:0/1248028375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476470eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.943+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 0x7ff4540b8d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff460005fd0 tx=0x7ff4600097f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1248028375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760c9350 msgr2=0x55f476470430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760c9350 0x55f476470430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1248028375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 msgr2=0x55f476470970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f476470970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1248028375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f476134930 con 0x55f4760a8670 2024-09-21T08:14:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476470eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4600124a0 tx=0x7ff460013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8eb999403b4f23f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff4517fa640 1 -- 172.21.15.6:0/1248028375 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460023070 con 0x55f4760a8670 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff4517fa640 1 -- 172.21.15.6:0/1248028375 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff46001fae0 con 0x55f4760a8670 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.944+0000 7ff4517fa640 1 -- 172.21.15.6:0/1248028375 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46001ebc0 con 0x55f4760a8670 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 -- 172.21.15.6:0/1248028375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 msgr2=0x55f476470eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476470eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4600124a0 tx=0x7ff460013000 comp rx=0 tx=0).stop 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 -- 172.21.15.6:0/1248028375 shutdown_connections 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476470eb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f476470970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 --2- 172.21.15.6:0/1248028375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760c9350 0x55f476470430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.946+0000 7ff477d00740 1 -- 172.21.15.6:0/1248028375 >> 172.21.15.6:0/1248028375 conn(0x55f4760bd740 msgr2=0x55f47646e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.947+0000 7ff477d00740 1 -- 172.21.15.6:0/1248028375 shutdown_connections 2024-09-21T08:14:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.947+0000 7ff477d00740 1 -- 172.21.15.6:0/1248028375 wait complete. 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.947+0000 7ff477d00740 1 -- start start 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 Processor -- start 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a8670 0x55f47647c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f476237890 con 0x55f4760a0490 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f476370d40 con 0x55f4760c9350 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f47647ec10 con 0x55f4760a8670 2024-09-21T08:14:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff477d00740 10 client.0 _ll_register_callbacks cb 0x55f4763d4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:57192/0 (socket says 172.21.15.6:57192) 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.948+0000 7ff46b7fe640 1 -- 172.21.15.6:0/238760456 learned_addr learned my addr 172.21.15.6:0/238760456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a8670 0x55f47647c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 -- 172.21.15.6:0/238760456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a8670 msgr2=0x55f47647c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a8670 0x55f47647c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 -- 172.21.15.6:0/238760456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 msgr2=0x55f47647c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 -- 172.21.15.6:0/238760456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4764995e0 con 0x55f4760c9350 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff460012fd0 tx=0x7ff460004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f69505e989dd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.949+0000 7ff44eff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.950+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460023050 con 0x55f4760c9350 2024-09-21T08:14:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.950+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7ff46001f660 con 0x55f4760c9350 2024-09-21T08:14:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.950+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff46001fae0 con 0x55f4760c9350 2024-09-21T08:14:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.951+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff46001e3b0 con 0x55f4760c9350 2024-09-21T08:14:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.954+0000 7ff477d00740 10 client.27110 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.954+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f476485f80 con 0x55f4760c9350 2024-09-21T08:14:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff46001fae0 con 0x55f4760c9350 2024-09-21T08:14:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff46000f040 con 0x55f4760c9350 2024-09-21T08:14:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 10 client.27110 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 10 client.27110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 20 client.27110 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f476087cd0 0x55f4764892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 4 client.27110 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.955+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4763e8db0 con 0x55f476087cd0 2024-09-21T08:14:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.957+0000 7ff46affd640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f476087cd0 0x55f4764892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.959+0000 7ff44eff5640 10 client.27110 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.959+0000 7ff46affd640 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f476087cd0 0x55f4764892e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6352149db891f2 server_cookie=bd018dedee169fdc in_seq=0 out_seq=0 2024-09-21T08:14:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.960+0000 7ff44eff5640 1 -- 172.21.15.6:0/238760456 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4763e8db0 con 0x55f476087cd0 2024-09-21T08:14:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.960+0000 7ff44eff5640 10 client.27110 handle_command_reply: tid=0 2024-09-21T08:14:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.960+0000 7ff477d00740 1 client.27110 shutdown 2024-09-21T08:14:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.961+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 msgr2=0x55f476498fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.961+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff460012fd0 tx=0x7ff460004c70 comp rx=0 tx=0).stop 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 shutdown_connections 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f476087cd0 0x55f4764892e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff44eff5640 0 client.27110 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a8670 0x55f47647c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f476498fa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 --2- 172.21.15.6:0/238760456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.965+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 >> 172.21.15.6:0/238760456 conn(0x55f4760bd740 msgr2=0x55f4764735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.969+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 shutdown_connections 2024-09-21T08:14:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.969+0000 7ff477d00740 1 -- 172.21.15.6:0/238760456 wait complete. 2024-09-21T08:14:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:33.970+0000 7ff477d00740 20 client.27110 trim_cache size 0 max 16384 2024-09-21T08:14:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.008+0000 7ff477d00740 1 Processor -- start 2024-09-21T08:14:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 -- start start 2024-09-21T08:14:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 0x55f4764756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476475bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 0x55f476473530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff45800e090 con 0x55f4760c9350 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff4580108f0 con 0x55f4760a8670 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff477d00740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff45800e6e0 con 0x55f4760a0490 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 0x55f4764756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 0x55f476473530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 0x55f476473530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50084/0 (socket says 172.21.15.6:50084) 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46b7fe640 1 -- 172.21.15.6:0/4234095833 learned_addr learned my addr 172.21.15.6:0/4234095833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 0x55f4764756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43340/0 (socket says 172.21.15.6:43340) 2024-09-21T08:14:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.009+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476475bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 -- 172.21.15.6:0/4234095833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 msgr2=0x55f4764756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 0x55f4764756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 -- 172.21.15.6:0/4234095833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 msgr2=0x55f476473530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 0x55f476473530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 -- 172.21.15.6:0/4234095833 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f476477750 con 0x55f4760a8670 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.010+0000 7ff46a7fc640 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476475bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006010 tx=0x7ff45c0043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cfff2e6fb4a23d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.011+0000 7ff450ff9640 1 -- 172.21.15.6:0/4234095833 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c035040 con 0x55f4760a8670 2024-09-21T08:14:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.011+0000 7ff450ff9640 1 -- 172.21.15.6:0/4234095833 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff45c0046c0 con 0x55f4760a8670 2024-09-21T08:14:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.011+0000 7ff450ff9640 1 -- 172.21.15.6:0/4234095833 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c003850 con 0x55f4760a8670 2024-09-21T08:14:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 -- 172.21.15.6:0/4234095833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 msgr2=0x55f476475bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476475bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006010 tx=0x7ff45c0043f0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 -- 172.21.15.6:0/4234095833 shutdown_connections 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760c9350 0x55f476473530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760a8670 0x55f476475bf0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006010 tx=0x7ff45c0043f0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 --2- 172.21.15.6:0/4234095833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4760a0490 0x55f4764756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 -- 172.21.15.6:0/4234095833 >> 172.21.15.6:0/4234095833 conn(0x55f4760bd740 msgr2=0x55f47647a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 -- 172.21.15.6:0/4234095833 shutdown_connections 2024-09-21T08:14:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.012+0000 7ff477d00740 1 -- 172.21.15.6:0/4234095833 wait complete. 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.013+0000 7ff477d00740 1 -- start start 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.013+0000 7ff477d00740 1 Processor -- start 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.013+0000 7ff477d00740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.013+0000 7ff477d00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f47647f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff477d00740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff477d00740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff45800edb0 con 0x55f4760a0490 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff477d00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff458010220 con 0x55f4760c9350 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff477d00740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff45800f480 con 0x55f47605d080 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff477d00740 10 client.0 _ll_register_callbacks cb 0x7ff464005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43350/0 (socket says 172.21.15.6:43350) 2024-09-21T08:14:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1641821617 learned_addr learned my addr 172.21.15.6:0/1641821617 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46affd640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 msgr2=0x55f47647f5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f47647f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1641821617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 msgr2=0x55f47647f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.014+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff46b7fe640 1 -- 172.21.15.6:0/1641821617 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4764f8640 con 0x55f47605d080 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff46affd640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff46b7fe640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff460005330 tx=0x7ff460004ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e28c8e57697d304 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff44eff5640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460016070 con 0x55f47605d080 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff45c0046c0 con 0x55f47605d080 2024-09-21T08:14:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.015+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7ff46002e040 con 0x55f47605d080 2024-09-21T08:14:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.016+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff46004e050 con 0x55f47605d080 2024-09-21T08:14:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.016+0000 7ff477d00740 10 client.27208 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.016+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f4764f9890 con 0x55f47605d080 2024-09-21T08:14:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.016+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff45c0046c0 con 0x55f47605d080 2024-09-21T08:14:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff46001f870 con 0x55f47605d080 2024-09-21T08:14:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 10 client.27208 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 10 client.27208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 20 client.27208 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4764f9fb0 0x55f4764fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 4 client.27208 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:14:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f4763e4860 con 0x55f4764f9fb0 2024-09-21T08:14:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.018+0000 7ff46affd640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4764f9fb0 0x55f4764fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.019+0000 7ff44eff5640 10 client.27208 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.019+0000 7ff46affd640 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4764f9fb0 0x55f4764fc3d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d288716fad80412c server_cookie=c87e4c05956c283c in_seq=0 out_seq=0 2024-09-21T08:14:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff44eff5640 1 -- 172.21.15.6:0/1641821617 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f4763e4860 con 0x55f4764f9fb0 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff44eff5640 10 client.27208 handle_command_reply: tid=0 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 client.27208 shutdown 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 msgr2=0x55f4764f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff460005330 tx=0x7ff460004ce0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 shutdown_connections 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4764f9fb0 0x55f4764fc3d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f47605d080 0x55f4764f8100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4760c9350 0x55f47647f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 --2- 172.21.15.6:0/1641821617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4760a0490 0x55f47647f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.021+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 >> 172.21.15.6:0/1641821617 conn(0x55f4760bd740 msgr2=0x55f476473530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.022+0000 7ff44eff5640 0 client.27208 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.022+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 shutdown_connections 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.022+0000 7ff477d00740 1 -- 172.21.15.6:0/1641821617 wait complete. 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.022+0000 7ff477d00740 20 client.27208 trim_cache size 0 max 16384 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:34.024 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:14:34.025 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773", 2024-09-21T08:14:34.025 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:14:34.025 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 msgr2=0x7ff4540b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 0x7ff4540b8d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff460005fd0 tx=0x7ff4600097f0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 msgr2=0x7ff46c10bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 0x7ff46c10bc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff46400e9f0 tx=0x7ff46400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 shutdown_connections 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff4540b6800 0x7ff4540b8d10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.023+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46c108cf0 0x7ff46c1ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.024+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff46c1083a0 0x7ff46c10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.024+0000 7ff47178c640 1 --2- 172.21.15.6:0/1515938152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff46c102a60 0x7ff46c10bc80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.024+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 >> 172.21.15.6:0/1515938152 conn(0x7ff46c079730 msgr2=0x7ff46c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.024+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 shutdown_connections 2024-09-21T08:14:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:34.024+0000 7ff47178c640 1 -- 172.21.15.6:0/1515938152 wait complete. 2024-09-21T08:14:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:34 smithi119 ceph-mon[33564]: pgmap v764: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.3 MiB/s wr, 720 op/s 2024-09-21T08:14:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:34 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:14:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:34 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:34 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:14:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:34 smithi145 ceph-mon[34049]: pgmap v764: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.3 MiB/s wr, 720 op/s 2024-09-21T08:14:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:34 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:14:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:34 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:34 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:14:35.464 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:34 smithi006 ceph-mon[30970]: pgmap v764: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.3 MiB/s wr, 720 op/s 2024-09-21T08:14:35.464 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:34 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:14:35.464 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:34 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:35.464 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:34 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:14:35.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:14:36.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:35 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:36.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:35 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:36.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:35 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 -- 172.21.15.6:0/947596518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6018109320 msgr2=0x7f6018109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 --2- 172.21.15.6:0/947596518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6018109320 0x7f6018109730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6008009860 tx=0x7f600802a360 comp rx=0 tx=0).stop 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 -- 172.21.15.6:0/947596518 shutdown_connections 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 --2- 172.21.15.6:0/947596518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6018109c70 0x7f60181104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 --2- 172.21.15.6:0/947596518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6018109320 0x7f6018109730 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6008009860 tx=0x7f600802a360 comp rx=0 tx=0).stop 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 --2- 172.21.15.6:0/947596518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60181039e0 0x7f6018103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.071+0000 7f601ee03640 1 -- 172.21.15.6:0/947596518 >> 172.21.15.6:0/947596518 conn(0x7f60180ff430 msgr2=0x7f6018101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.075+0000 7f601ee03640 1 -- 172.21.15.6:0/947596518 shutdown_connections 2024-09-21T08:14:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.075+0000 7f601ee03640 1 -- 172.21.15.6:0/947596518 wait complete. 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.076+0000 7f601ee03640 1 Processor -- start 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 -- start start 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60181039e0 0x7f6018076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6018109c70 0x7f601806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6018113830 con 0x7f6018109c70 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f60181136b0 con 0x7f601806ea60 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.078+0000 7f601ee03640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60181139b0 con 0x7f60181039e0 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:42344/0 (socket says 172.21.15.6:42344) 2024-09-21T08:14:37.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 -- 172.21.15.6:0/2749359564 learned_addr learned my addr 172.21.15.6:0/2749359564 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 -- 172.21.15.6:0/2749359564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60181039e0 msgr2=0x7f6018076e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:14:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60181039e0 0x7f6018076e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 -- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6018109c70 msgr2=0x7f601806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6018109c70 0x7f601806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 -- 172.21.15.6:0/2749359564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601806ef20 con 0x7f601806ea60 2024-09-21T08:14:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.079+0000 7f601e602640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f601400d750 tx=0x7f601400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.080+0000 7f600effd640 1 -- 172.21.15.6:0/2749359564 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014017070 con 0x7f601806ea60 2024-09-21T08:14:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.080+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60180741e0 con 0x7f601806ea60 2024-09-21T08:14:37.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.080+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60180746f0 con 0x7f601806ea60 2024-09-21T08:14:37.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.081+0000 7f600effd640 1 -- 172.21.15.6:0/2749359564 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60140054b0 con 0x7f601806ea60 2024-09-21T08:14:37.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.081+0000 7f600effd640 1 -- 172.21.15.6:0/2749359564 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014004b90 con 0x7f601806ea60 2024-09-21T08:14:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.083+0000 7f60265d9740 1 Processor -- start 2024-09-21T08:14:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.086+0000 7f600effd640 1 -- 172.21.15.6:0/2749359564 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6014009bd0 con 0x7f601806ea60 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f600effd640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 0x7f60040b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 -- start start 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f600effd640 1 -- 172.21.15.6:0/2749359564 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f60140e73d0 con 0x7f601806ea60 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 0x562b8b6bd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b8b633e50 con 0x562b8b2f5390 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562b8b623280 con 0x562b8b316070 2024-09-21T08:14:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.088+0000 7f60265d9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562b8b627090 con 0x562b8b2ed1b0 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601e602640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601e602640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53282/0 (socket says 172.21.15.6:53282) 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601e602640 1 -- 172.21.15.6:0/2985578759 learned_addr learned my addr 172.21.15.6:0/2985578759 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601de01640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 0x562b8b6bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601d600640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 0x7f60040b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.089+0000 7f601d600640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 -- 172.21.15.6:0/2985578759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 msgr2=0x562b8b6bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 -- 172.21.15.6:0/2985578759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 msgr2=0x562b8b6bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 0x562b8b6bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 -- 172.21.15.6:0/2985578759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8b381650 con 0x562b8b2f5390 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601de01640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 0x562b8b6bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.090+0000 7f601e602640 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6014009fa0 tx=0x7f60140ac550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5979db113bab61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.091+0000 7f6003fff640 1 -- 172.21.15.6:0/2985578759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60140b0070 con 0x562b8b2f5390 2024-09-21T08:14:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.091+0000 7f6003fff640 1 -- 172.21.15.6:0/2985578759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60140b18c0 con 0x562b8b2f5390 2024-09-21T08:14:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.091+0000 7f6003fff640 1 -- 172.21.15.6:0/2985578759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014020040 con 0x562b8b2f5390 2024-09-21T08:14:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 -- 172.21.15.6:0/2985578759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 msgr2=0x562b8b6be290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6014009fa0 tx=0x7f60140ac550 comp rx=0 tx=0).stop 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 -- 172.21.15.6:0/2985578759 shutdown_connections 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6be290 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 --2- 172.21.15.6:0/2985578759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b316070 0x562b8b6bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f60265d9740 1 -- 172.21.15.6:0/2985578759 >> 172.21.15.6:0/2985578759 conn(0x562b8b30a460 msgr2=0x562b8b6bb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.092+0000 7f601d600640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 0x7f60040b8d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6018104430 tx=0x7f6008009490 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.093+0000 7f60265d9740 1 -- 172.21.15.6:0/2985578759 shutdown_connections 2024-09-21T08:14:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.093+0000 7f60265d9740 1 -- 172.21.15.6:0/2985578759 wait complete. 2024-09-21T08:14:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.094+0000 7f60265d9740 1 -- start start 2024-09-21T08:14:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.094+0000 7f60265d9740 1 Processor -- start 2024-09-21T08:14:37.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b316070 0x562b8b6d5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f601de01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f601d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f601d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:53958/0 (socket says 172.21.15.6:53958) 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f601d600640 1 -- 172.21.15.6:0/4102941119 learned_addr learned my addr 172.21.15.6:0/4102941119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b8b484700 con 0x562b8b316070 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562b8b5be110 con 0x562b8b2ed1b0 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562b8b6cbff0 con 0x562b8b2f5390 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.095+0000 7f60265d9740 10 client.0 _ll_register_callbacks cb 0x562b8b5d7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 -- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2ed1b0 msgr2=0x562b8b6c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 -- 172.21.15.6:0/4102941119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b316070 msgr2=0x562b8b6d5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b316070 0x562b8b6d5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8b5ebc40 con 0x562b8b2f5390 2024-09-21T08:14:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f601d600640 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ba91e24c988d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.096+0000 7f60017fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.098+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008051060 con 0x562b8b2f5390 2024-09-21T08:14:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.098+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f6008003d00 con 0x562b8b2f5390 2024-09-21T08:14:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.098+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60140b18c0 con 0x562b8b2f5390 2024-09-21T08:14:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.098+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6008037040 con 0x562b8b2f5390 2024-09-21T08:14:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.098+0000 7f60265d9740 10 client.27214 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.099+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562b8b6d7da0 con 0x562b8b2f5390 2024-09-21T08:14:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.099+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6008032970 con 0x562b8b2f5390 2024-09-21T08:14:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f600803e070 con 0x562b8b2f5390 2024-09-21T08:14:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 10 client.27214 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 10 client.27214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 20 client.27214 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b2d49f0 0x562b8b6db230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 4 client.27214 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.100+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f60140b18c0 con 0x562b8b2d49f0 2024-09-21T08:14:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.101+0000 7f601de01640 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b2d49f0 0x562b8b6db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.103+0000 7f601de01640 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b2d49f0 0x562b8b6db230 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8d55b073b778d4 server_cookie=f1256f365cbed2bf in_seq=0 out_seq=0 2024-09-21T08:14:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.103+0000 7f60017fa640 10 client.27214 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.105+0000 7f60017fa640 1 -- 172.21.15.6:0/4102941119 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f60140b18c0 con 0x562b8b2d49f0 2024-09-21T08:14:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.105+0000 7f60017fa640 10 client.27214 handle_command_reply: tid=0 2024-09-21T08:14:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.105+0000 7f60265d9740 1 client.27214 shutdown 2024-09-21T08:14:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.108+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 msgr2=0x562b8b6c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.108+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008005e10 comp rx=0 tx=0).stop 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 shutdown_connections 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b2d49f0 0x562b8b6db230 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60017fa640 0 client.27214 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b6c9450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b316070 0x562b8b6d5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 --2- 172.21.15.6:0/4102941119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.110+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 >> 172.21.15.6:0/4102941119 conn(0x562b8b30a460 msgr2=0x562b8b6c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.111+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 shutdown_connections 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.111+0000 7f60265d9740 1 -- 172.21.15.6:0/4102941119 wait complete. 2024-09-21T08:14:37.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.111+0000 7f60265d9740 20 client.27214 trim_cache size 0 max 16384 2024-09-21T08:14:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.148+0000 7f60265d9740 1 Processor -- start 2024-09-21T08:14:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.148+0000 7f60265d9740 1 -- start start 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f60265d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f60265d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f60265d9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f601d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f601de01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f601d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:53968/0 (socket says 172.21.15.6:53968) 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f601de01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:42368/0 (socket says 172.21.15.6:42368) 2024-09-21T08:14:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.149+0000 7f601d600640 1 -- 172.21.15.6:0/4037286250 learned_addr learned my addr 172.21.15.6:0/4037286250 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.150+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc00e130 con 0x562b8b2f5390 2024-09-21T08:14:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.150+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc010990 con 0x562b8b2d49f0 2024-09-21T08:14:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.150+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc00e780 con 0x562b8b2ed1b0 2024-09-21T08:14:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.150+0000 7f601e602640 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601e602640 1 -- 172.21.15.6:0/4037286250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 msgr2=0x562b8b6c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601e602640 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601e602640 1 -- 172.21.15.6:0/4037286250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 msgr2=0x562b8b6c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601e602640 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601e602640 1 -- 172.21.15.6:0/4037286250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8b6bfb00 con 0x562b8b2f5390 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.151+0000 7f601de01640 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.152+0000 7f601e602640 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6d5240 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f60140acae0 tx=0x7f60140ad5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77bc811e12bd49a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.153+0000 7f60037fe640 1 -- 172.21.15.6:0/4037286250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014020070 con 0x562b8b2f5390 2024-09-21T08:14:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.153+0000 7f60037fe640 1 -- 172.21.15.6:0/4037286250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60140b6800 con 0x562b8b2f5390 2024-09-21T08:14:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.153+0000 7f60037fe640 1 -- 172.21.15.6:0/4037286250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60140b0040 con 0x562b8b2f5390 2024-09-21T08:14:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 msgr2=0x562b8b6d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6d5240 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f60140acae0 tx=0x7f60140ad5a0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 shutdown_connections 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2ed1b0 0x562b8b6c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2f5390 0x562b8b6d5240 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 --2- 172.21.15.6:0/4037286250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 >> 172.21.15.6:0/4037286250 conn(0x562b8b30a460 msgr2=0x562b8b6c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 shutdown_connections 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.155+0000 7f60265d9740 1 -- 172.21.15.6:0/4037286250 wait complete. 2024-09-21T08:14:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.156+0000 7f60265d9740 1 -- start start 2024-09-21T08:14:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.157+0000 7f60265d9740 1 Processor -- start 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.157+0000 7f60265d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f60265d9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2ed1b0 0x562b8b6cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f601de01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f601de01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:42380/0 (socket says 172.21.15.6:42380) 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f601de01640 1 -- 172.21.15.6:0/2845986453 learned_addr learned my addr 172.21.15.6:0/2845986453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b744c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc00ee50 con 0x562b8b2ed1b0 2024-09-21T08:14:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f601e602640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b744c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.158+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc0102c0 con 0x562b8b2d49f0 2024-09-21T08:14:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.159+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc00f520 con 0x562b8b2f5390 2024-09-21T08:14:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.159+0000 7f60265d9740 10 client.0 _ll_register_callbacks cb 0x7f6008035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.159+0000 7f601d600640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2ed1b0 0x562b8b6cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 -- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 msgr2=0x562b8b6cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 -- 172.21.15.6:0/2845986453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2ed1b0 msgr2=0x562b8b6cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2ed1b0 0x562b8b6cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8b745170 con 0x562b8b2f5390 2024-09-21T08:14:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.160+0000 7f601e602640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b744c30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x562b8b6cb6b0 tx=0x7f60140a9280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c7f459d5d9c5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.161+0000 7f60017fa640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.161+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60140c7060 con 0x562b8b2f5390 2024-09-21T08:14:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.161+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f60140a8730 con 0x562b8b2f5390 2024-09-21T08:14:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.161+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60140b6800 con 0x562b8b2f5390 2024-09-21T08:14:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.162+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6014020070 con 0x562b8b2f5390 2024-09-21T08:14:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.162+0000 7f60265d9740 10 client.27220 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.162+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562b8b746300 con 0x562b8b2f5390 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.163+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60140d4380 con 0x562b8b2f5390 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.163+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f60140d00d0 con 0x562b8b2f5390 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.163+0000 7f60265d9740 10 client.27220 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.163+0000 7f60265d9740 10 client.27220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.163+0000 7f60265d9740 20 client.27220 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.164+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b316070 0x562b8b748310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.164+0000 7f60265d9740 4 client.27220 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:14:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.164+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f60140b6800 con 0x562b8b316070 2024-09-21T08:14:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.165+0000 7f601de01640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b316070 0x562b8b748310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:37.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.170+0000 7f601de01640 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b316070 0x562b8b748310 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f27263c51e2270c5 server_cookie=8991b66e547b5e73 in_seq=0 out_seq=0 2024-09-21T08:14:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.171+0000 7f60017fa640 10 client.27220 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.172+0000 7f60017fa640 1 -- 172.21.15.6:0/2845986453 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x7f60140b6800 con 0x562b8b316070 2024-09-21T08:14:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.172+0000 7f60017fa640 10 client.27220 handle_command_reply: tid=0 2024-09-21T08:14:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.172+0000 7f60265d9740 1 client.27220 shutdown 2024-09-21T08:14:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 msgr2=0x562b8b744c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b744c30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x562b8b6cb6b0 tx=0x7f60140a9280 comp rx=0 tx=0).stop 2024-09-21T08:14:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 shutdown_connections 2024-09-21T08:14:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562b8b316070 0x562b8b748310 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562b8b2f5390 0x562b8b744c30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b8b2ed1b0 0x562b8b6cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 --2- 172.21.15.6:0/2845986453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562b8b2d49f0 0x562b8b6cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 >> 172.21.15.6:0/2845986453 conn(0x562b8b30a460 msgr2=0x562b8b6bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.176+0000 7f60017fa640 0 client.27220 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:37.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.177+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 shutdown_connections 2024-09-21T08:14:37.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.178+0000 7f60265d9740 1 -- 172.21.15.6:0/2845986453 wait complete. 2024-09-21T08:14:37.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.178+0000 7f60265d9740 20 client.27220 trim_cache size 0 max 16384 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.181 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.182 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.184 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:14:37.185 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.186 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.188 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:14:37.190 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:37.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:37.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:37.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:37.193 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.179+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 msgr2=0x7f60040b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.179+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 0x7f60040b8d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6018104430 tx=0x7f6008009490 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.179+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 msgr2=0x7f6018073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.179+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f601400d750 tx=0x7f601400dc10 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 shutdown_connections 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f60040b6880 0x7f60040b8d90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f601806ea60 0x7f6018073ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6018109c70 0x7f601806e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 --2- 172.21.15.6:0/2749359564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60181039e0 0x7f6018076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 >> 172.21.15.6:0/2749359564 conn(0x7f60180ff430 msgr2=0x7f6018101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 shutdown_connections 2024-09-21T08:14:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:37.180+0000 7f601ee03640 1 -- 172.21.15.6:0/2749359564 wait complete. 2024-09-21T08:14:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:36 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:14:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:36 smithi119 ceph-mon[33564]: pgmap v765: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.9 MiB/s wr, 681 op/s 2024-09-21T08:14:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:36 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:14:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:36 smithi145 ceph-mon[34049]: pgmap v765: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.9 MiB/s wr, 681 op/s 2024-09-21T08:14:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:36 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:14:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:36 smithi006 ceph-mon[30970]: pgmap v765: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.9 MiB/s wr, 681 op/s 2024-09-21T08:14:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 700.0 s, 821.8 tps, lat 121.112 ms stddev 59.772 2024-09-21T08:14:38.027 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:14:38.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:14:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 -- 172.21.15.6:0/2999397903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94102240 msgr2=0x7efd94102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 --2- 172.21.15.6:0/2999397903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94102240 0x7efd94102650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009be0 tx=0x7efd8c02c920 comp rx=0 tx=0).stop 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 -- 172.21.15.6:0/2999397903 shutdown_connections 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 --2- 172.21.15.6:0/2999397903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd941084d0 0x7efd9410ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 --2- 172.21.15.6:0/2999397903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd94107b80 0x7efd94107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 --2- 172.21.15.6:0/2999397903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94102240 0x7efd94102650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.160+0000 7efd9b881640 1 -- 172.21.15.6:0/2999397903 >> 172.21.15.6:0/2999397903 conn(0x7efd94079f90 msgr2=0x7efd9407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.161+0000 7efd9b881640 1 -- 172.21.15.6:0/2999397903 shutdown_connections 2024-09-21T08:14:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.162+0000 7efd9b881640 1 -- 172.21.15.6:0/2999397903 wait complete. 2024-09-21T08:14:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.163+0000 7efd9b881640 1 Processor -- start 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.164+0000 7efd9b881640 1 -- start start 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94107b80 0x7efd9410e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd941084d0 0x7efd941a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd94110df0 con 0x7efd94102240 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd94110c70 con 0x7efd941084d0 2024-09-21T08:14:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9b881640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd94110f70 con 0x7efd94107b80 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9961d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9961d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53322/0 (socket says 172.21.15.6:53322) 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd9961d640 1 -- 172.21.15.6:0/3432075651 learned_addr learned my addr 172.21.15.6:0/3432075651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd98e1c640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94107b80 0x7efd9410e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.165+0000 7efd99e1e640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd941084d0 0x7efd941a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 -- 172.21.15.6:0/3432075651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94107b80 msgr2=0x7efd9410e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94107b80 0x7efd9410e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 -- 172.21.15.6:0/3432075651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd941084d0 msgr2=0x7efd941a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd941084d0 0x7efd941a5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 -- 172.21.15.6:0/3432075651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd941a5870 con 0x7efd94102240 2024-09-21T08:14:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.166+0000 7efd9961d640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c0315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.168+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c032610 con 0x7efd94102240 2024-09-21T08:14:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.168+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd8c031920 con 0x7efd94102240 2024-09-21T08:14:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.168+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c03a3e0 con 0x7efd94102240 2024-09-21T08:14:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.168+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941a5b00 con 0x7efd94102240 2024-09-21T08:14:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.168+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd941ad3b0 con 0x7efd94102240 2024-09-21T08:14:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.170+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd780052c0 con 0x7efd94102240 2024-09-21T08:14:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.173+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7efd8c03b430 con 0x7efd94102240 2024-09-21T08:14:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.174+0000 7efd8a7fc640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 0x7efd800b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.174+0000 7efd98e1c640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 0x7efd800b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.174+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efd8c108a90 con 0x7efd94102240 2024-09-21T08:14:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.175+0000 7efd98e1c640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 0x7efd800b8ce0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd94105150 tx=0x7efd9000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.181+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd8c02f070 con 0x7efd94102240 2024-09-21T08:14:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:38 smithi119 ceph-mon[33564]: pgmap v766: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-21T08:14:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:38 smithi145 ceph-mon[34049]: pgmap v766: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-21T08:14:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:38 smithi006 ceph-mon[30970]: pgmap v766: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-21T08:14:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.621+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd78005880 con 0x7efd94102240 2024-09-21T08:14:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.623+0000 7efd8a7fc640 1 -- 172.21.15.6:0/3432075651 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7efd8c0cec00 con 0x7efd94102240 2024-09-21T08:14:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:14:39.625 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:14:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:14:39.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.626+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 msgr2=0x7efd800b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.626+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 0x7efd800b8ce0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd94105150 tx=0x7efd9000b390 comp rx=0 tx=0).stop 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.626+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 msgr2=0x7efd9410db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.626+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c0315a0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 shutdown_connections 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd800b67d0 0x7efd800b8ce0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd94107b80 0x7efd9410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd941084d0 0x7efd941a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 --2- 172.21.15.6:0/3432075651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd94102240 0x7efd9410db90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:39.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 >> 172.21.15.6:0/3432075651 conn(0x7efd94079f90 msgr2=0x7efd94107090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:39.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 shutdown_connections 2024-09-21T08:14:39.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:39.627+0000 7efd9b881640 1 -- 172.21.15.6:0/3432075651 wait complete. 2024-09-21T08:14:40.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:40 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3432075651' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:40 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3432075651' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:40.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:40 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3432075651' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:14:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:41 smithi119 ceph-mon[33564]: pgmap v767: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.3 MiB/s wr, 725 op/s 2024-09-21T08:14:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:41 smithi145 ceph-mon[34049]: pgmap v767: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.3 MiB/s wr, 725 op/s 2024-09-21T08:14:41.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:41 smithi006 ceph-mon[30970]: pgmap v767: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 7.3 MiB/s wr, 725 op/s 2024-09-21T08:14:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 705.0 s, 673.0 tps, lat 144.171 ms stddev 70.219 2024-09-21T08:14:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:43 smithi119 ceph-mon[33564]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-09-21T08:14:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:43 smithi145 ceph-mon[34049]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-09-21T08:14:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:43 smithi006 ceph-mon[30970]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-09-21T08:14:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:45 smithi119 ceph-mon[33564]: pgmap v769: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.7 MiB/s wr, 782 op/s 2024-09-21T08:14:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:45 smithi145 ceph-mon[34049]: pgmap v769: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.7 MiB/s wr, 782 op/s 2024-09-21T08:14:45.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:45 smithi006 ceph-mon[30970]: pgmap v769: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.7 MiB/s wr, 782 op/s 2024-09-21T08:14:47.215 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:47 smithi006 ceph-mon[30970]: pgmap v770: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-21T08:14:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:47 smithi119 ceph-mon[33564]: pgmap v770: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-21T08:14:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:47 smithi145 ceph-mon[34049]: pgmap v770: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-21T08:14:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 710.0 s, 644.6 tps, lat 159.483 ms stddev 97.909 2024-09-21T08:14:48.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:14:49.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:49 smithi006 ceph-mon[30970]: pgmap v771: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.6 MiB/s wr, 767 op/s 2024-09-21T08:14:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:49.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:49 smithi119 ceph-mon[33564]: pgmap v771: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.6 MiB/s wr, 767 op/s 2024-09-21T08:14:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:49 smithi145 ceph-mon[34049]: pgmap v771: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 7.6 MiB/s wr, 767 op/s 2024-09-21T08:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.599+0000 7fa790344640 1 -- 172.21.15.6:0/2190043780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78009ba80 msgr2=0x7fa78009be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.599+0000 7fa790344640 1 --2- 172.21.15.6:0/2190043780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78009ba80 0x7fa78009be90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa778009900 tx=0x7fa77802a440 comp rx=0 tx=0).stop 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.600+0000 7fa790344640 1 -- 172.21.15.6:0/2190043780 shutdown_connections 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.600+0000 7fa790344640 1 --2- 172.21.15.6:0/2190043780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa7800a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.600+0000 7fa790344640 1 --2- 172.21.15.6:0/2190043780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa78009ba80 0x7fa78009be90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.600+0000 7fa790344640 1 --2- 172.21.15.6:0/2190043780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa780096140 0x7fa780096550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.600+0000 7fa790344640 1 -- 172.21.15.6:0/2190043780 >> 172.21.15.6:0/2190043780 conn(0x7fa78000de70 msgr2=0x7fa78000e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.601+0000 7fa790344640 1 -- 172.21.15.6:0/2190043780 shutdown_connections 2024-09-21T08:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.601+0000 7fa790344640 1 -- 172.21.15.6:0/2190043780 wait complete. 2024-09-21T08:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.602+0000 7fa790344640 1 Processor -- start 2024-09-21T08:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.602+0000 7fa790344640 1 -- start start 2024-09-21T08:14:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 0x7fa78013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa78009ba80 0x7fa78013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa780143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800a5f80 con 0x7fa78009c3d0 2024-09-21T08:14:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800a5e00 con 0x7fa780096140 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa790344640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800a6100 con 0x7fa78009ba80 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa78e8e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa780143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa78e8e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa780143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52850/0 (socket says 172.21.15.6:52850) 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.603+0000 7fa78e8e1640 1 -- 172.21.15.6:0/1447508420 learned_addr learned my addr 172.21.15.6:0/1447508420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 0x7fa78013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 -- 172.21.15.6:0/1447508420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa78009ba80 msgr2=0x7fa78013dfa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa78009ba80 0x7fa78013dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 -- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 msgr2=0x7fa780143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa780143240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 -- 172.21.15.6:0/1447508420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780143970 con 0x7fa780096140 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.604+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 0x7fa78013da00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa784009fd0 tx=0x7fa78400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.605+0000 7fa77f7fe640 1 -- 172.21.15.6:0/1447508420 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784015020 con 0x7fa780096140 2024-09-21T08:14:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.605+0000 7fa77f7fe640 1 -- 172.21.15.6:0/1447508420 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa784011cc0 con 0x7fa780096140 2024-09-21T08:14:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.605+0000 7fa77f7fe640 1 -- 172.21.15.6:0/1447508420 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784015020 con 0x7fa780096140 2024-09-21T08:14:50.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.606+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa780143c60 con 0x7fa780096140 2024-09-21T08:14:50.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.606+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78014a3c0 con 0x7fa780096140 2024-09-21T08:14:50.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 Processor -- start 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 -- start start 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdaa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdaa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdb2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bd22ea0 con 0x55bf0b9e4390 2024-09-21T08:14:50.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bd122d0 con 0x55bf0ba05070 2024-09-21T08:14:50.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.613+0000 7fa7968b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bd160e0 con 0x55bf0b9dc1b0 2024-09-21T08:14:50.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.614+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdb2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.614+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdb2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52856/0 (socket says 172.21.15.6:52856) 2024-09-21T08:14:50.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.614+0000 7fa78d8df640 1 -- 172.21.15.6:0/1965181149 learned_addr learned my addr 172.21.15.6:0/1965181149 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:50.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.614+0000 7fa77f7fe640 1 -- 172.21.15.6:0/1447508420 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa784018020 con 0x7fa780096140 2024-09-21T08:14:50.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.615+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdaa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.616+0000 7fa77f7fe640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 0x7fa7740b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.616+0000 7fa77f7fe640 1 -- 172.21.15.6:0/1447508420 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fa784011630 con 0x7fa780096140 2024-09-21T08:14:50.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 -- 172.21.15.6:0/1965181149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9dc1b0 msgr2=0x55bf0bdaa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdaa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdaa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 -- 172.21.15.6:0/1965181149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 msgr2=0x55bf0bdb2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdb2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 -- 172.21.15.6:0/1965181149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf0ba70650 con 0x55bf0ba05070 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 0x7fa7740b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.617+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdaa260 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa788052860 tx=0x7fa78806a4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c01a5a3903d3c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.618+0000 7fa77cd9a640 1 -- 172.21.15.6:0/1965181149 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78807f6c0 con 0x55bf0ba05070 2024-09-21T08:14:50.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.618+0000 7fa77cd9a640 1 -- 172.21.15.6:0/1965181149 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78807fd70 con 0x55bf0ba05070 2024-09-21T08:14:50.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.618+0000 7fa77cd9a640 1 -- 172.21.15.6:0/1965181149 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788089e20 con 0x55bf0ba05070 2024-09-21T08:14:50.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.619+0000 7fa7968b8740 1 -- 172.21.15.6:0/1965181149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 msgr2=0x55bf0bdaa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.619+0000 7fa7968b8740 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdaa260 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa788052860 tx=0x7fa78806a4f0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 -- 172.21.15.6:0/1965181149 shutdown_connections 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdaa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdb2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 --2- 172.21.15.6:0/1965181149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdaa260 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 -- 172.21.15.6:0/1965181149 >> 172.21.15.6:0/1965181149 conn(0x55bf0b9f9460 msgr2=0x55bf0bdac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 -- 172.21.15.6:0/1965181149 shutdown_connections 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 -- 172.21.15.6:0/1965181149 wait complete. 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.621+0000 7fa7968b8740 1 -- start start 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 Processor -- start 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 0x7fa7740b8f90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55bf0bdb2ae0 tx=0x7fa78807e810 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdcdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bb73700 con 0x55bf0b9e4390 2024-09-21T08:14:50.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bcad160 con 0x55bf0b9dc1b0 2024-09-21T08:14:50.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bf0bdb2e90 con 0x55bf0ba05070 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.622+0000 7fa7968b8740 10 client.0 _ll_register_callbacks cb 0x55bf0bcc69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.623+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.623+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52866/0 (socket says 172.21.15.6:52866) 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.623+0000 7fa78d8df640 1 -- 172.21.15.6:0/4187790807 learned_addr learned my addr 172.21.15.6:0/4187790807 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.623+0000 7fa78e8e1640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdcdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.623+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 -- 172.21.15.6:0/4187790807 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 msgr2=0x55bf0bdcdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdcdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 -- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 msgr2=0x55bf0bdceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 -- 172.21.15.6:0/4187790807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf0bcdac90 con 0x55bf0b9e4390 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa78d8df640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa77802a960 tx=0x7fa778004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecf857619499f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.624+0000 7fa771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.625+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778035020 con 0x55bf0b9e4390 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.625+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa78807fd70 con 0x55bf0b9e4390 2024-09-21T08:14:50.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.625+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fa7780046c0 con 0x55bf0b9e4390 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.626+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa778009510 con 0x55bf0b9e4390 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.626+0000 7fa7968b8740 10 client.17511 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.626+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bf0bdd7c70 con 0x55bf0b9e4390 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78807fd70 con 0x55bf0b9e4390 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa77803a040 con 0x55bf0b9e4390 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 10 client.17511 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 20 client.17511 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b9c39f0 0x55bf0bddb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 4 client.17511 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.627+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf0bd24df0 con 0x55bf0b9c39f0 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.629+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b9c39f0 0x55bf0bddb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.629+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b9c39f0 0x55bf0bddb550 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a9acf00e8d8064 server_cookie=e62d191c1ce65455 in_seq=0 out_seq=0 2024-09-21T08:14:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.630+0000 7fa771ffb640 10 client.17511 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.630+0000 7fa771ffb640 1 -- 172.21.15.6:0/4187790807 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf0bd24df0 con 0x55bf0b9c39f0 2024-09-21T08:14:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.630+0000 7fa771ffb640 10 client.17511 handle_command_reply: tid=0 2024-09-21T08:14:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.630+0000 7fa7968b8740 1 client.17511 shutdown 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 msgr2=0x55bf0bdcf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa77802a960 tx=0x7fa778004270 comp rx=0 tx=0).stop 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 shutdown_connections 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b9c39f0 0x55bf0bddb550 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdcdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9e4390 0x55bf0bdcf480 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 --2- 172.21.15.6:0/4187790807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa771ffb640 0 client.17511 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:50.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 >> 172.21.15.6:0/4187790807 conn(0x55bf0b9f9460 msgr2=0x55bf0bda96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 shutdown_connections 2024-09-21T08:14:50.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.631+0000 7fa7968b8740 1 -- 172.21.15.6:0/4187790807 wait complete. 2024-09-21T08:14:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.632+0000 7fa7968b8740 20 client.17511 trim_cache size 0 max 16384 2024-09-21T08:14:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.658+0000 7fa7968b8740 1 Processor -- start 2024-09-21T08:14:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.659+0000 7fa7968b8740 1 -- start start 2024-09-21T08:14:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.659+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.659+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.659+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdb3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa7968b8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801503b0 con 0x55bf0b9dc1b0 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43682/0 (socket says 172.21.15.6:43682) 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 -- 172.21.15.6:0/2069724628 learned_addr learned my addr 172.21.15.6:0/2069724628 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa780152c10 con 0x55bf0ba05070 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa780150a00 con 0x55bf0b9e4390 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 -- 172.21.15.6:0/2069724628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 msgr2=0x55bf0bdb3600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdb3600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 -- 172.21.15.6:0/2069724628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 msgr2=0x55bf0bdad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.660+0000 7fa78d8df640 1 -- 172.21.15.6:0/2069724628 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf0bdb69c0 con 0x55bf0b9e4390 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.661+0000 7fa78d8df640 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa778031bb0 tx=0x7fa778000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dbf3e6436373fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.661+0000 7fa773fff640 1 -- 172.21.15.6:0/2069724628 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778058070 con 0x55bf0b9e4390 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.661+0000 7fa773fff640 1 -- 172.21.15.6:0/2069724628 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa778041070 con 0x55bf0b9e4390 2024-09-21T08:14:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.661+0000 7fa773fff640 1 -- 172.21.15.6:0/2069724628 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778035040 con 0x55bf0b9e4390 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.662+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 msgr2=0x55bf0bdac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.662+0000 7fa7968b8740 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa778031bb0 tx=0x7fa778000bc0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 shutdown_connections 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0b9e4390 0x55bf0bdac6b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0ba05070 0x55bf0bdb3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 --2- 172.21.15.6:0/2069724628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 >> 172.21.15.6:0/2069724628 conn(0x55bf0b9f9460 msgr2=0x55bf0bdceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 shutdown_connections 2024-09-21T08:14:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.663+0000 7fa7968b8740 1 -- 172.21.15.6:0/2069724628 wait complete. 2024-09-21T08:14:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.664+0000 7fa7968b8740 1 -- start start 2024-09-21T08:14:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.664+0000 7fa7968b8740 1 Processor -- start 2024-09-21T08:14:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.665+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdd5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa7968b8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 0x55bf0bdd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa78e0e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdd5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa78e0e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdd5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52892/0 (socket says 172.21.15.6:52892) 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa78e0e0640 1 -- 172.21.15.6:0/143637022 learned_addr learned my addr 172.21.15.6:0/143637022 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdd0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.666+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801510d0 con 0x55bf0b9dc1b0 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa780152540 con 0x55bf0b9e4390 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801517a0 con 0x55bf0ba05070 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 0x55bf0bdd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa7968b8740 10 client.0 _ll_register_callbacks cb 0x7fa778005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 -- 172.21.15.6:0/143637022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 msgr2=0x55bf0bdd0e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdd0e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 -- 172.21.15.6:0/143637022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 msgr2=0x55bf0bdd5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdd5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.667+0000 7fa78d8df640 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf0bdd13b0 con 0x55bf0b9e4390 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.668+0000 7fa78d8df640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 0x55bf0bdd0930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa778031da0 tx=0x7fa778031a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7f07fe71d24b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.668+0000 7fa771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.668+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778035070 con 0x55bf0b9e4390 2024-09-21T08:14:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.668+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fa778003a70 con 0x55bf0b9e4390 2024-09-21T08:14:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.669+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa778041070 con 0x55bf0b9e4390 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.669+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa778058040 con 0x55bf0b9e4390 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.669+0000 7fa7968b8740 10 client.27149 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.669+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bf0be45c20 con 0x55bf0b9e4390 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.669+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa778003c90 con 0x55bf0b9e4390 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa778065030 con 0x55bf0b9e4390 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 10 client.27149 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 10 client.27149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 20 client.27149 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b998da0 0x55bf0be48150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 4 client.27149 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:14:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.670+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa778041070 con 0x55bf0b998da0 2024-09-21T08:14:50.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.676+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b998da0 0x55bf0be48150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.680+0000 7fa78e0e0640 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b998da0 0x55bf0be48150 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaf4acb61f1dcb28 server_cookie=9dfb6d87d3bcaee8 in_seq=0 out_seq=0 2024-09-21T08:14:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.680+0000 7fa771ffb640 10 client.27149 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.680+0000 7fa771ffb640 1 -- 172.21.15.6:0/143637022 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa778041070 con 0x55bf0b998da0 2024-09-21T08:14:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.680+0000 7fa771ffb640 10 client.27149 handle_command_reply: tid=0 2024-09-21T08:14:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.681+0000 7fa7968b8740 1 client.27149 shutdown 2024-09-21T08:14:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.681+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 msgr2=0x55bf0bdd0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.681+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 0x55bf0bdd0930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa778031da0 tx=0x7fa778031a10 comp rx=0 tx=0).stop 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 shutdown_connections 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55bf0b998da0 0x55bf0be48150 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bf0ba05070 0x55bf0bdd0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf0b9e4390 0x55bf0bdd0930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 --2- 172.21.15.6:0/143637022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf0b9dc1b0 0x55bf0bdd5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.682+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 >> 172.21.15.6:0/143637022 conn(0x55bf0b9f9460 msgr2=0x55bf0bdb3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.686+0000 7fa771ffb640 0 client.27149 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:50.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.686+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 shutdown_connections 2024-09-21T08:14:50.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.686+0000 7fa7968b8740 1 -- 172.21.15.6:0/143637022 wait complete. 2024-09-21T08:14:50.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.686+0000 7fa7968b8740 20 client.27149 trim_cache size 0 max 16384 2024-09-21T08:14:50.688 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:14:50.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.687+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 msgr2=0x7fa7740b8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.687+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 0x7fa7740b8f90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55bf0bdb2ae0 tx=0x7fa78807e810 comp rx=0 tx=0).stop 2024-09-21T08:14:50.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.687+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 msgr2=0x7fa78013da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:50.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.687+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 0x7fa78013da00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa784009fd0 tx=0x7fa78400b870 comp rx=0 tx=0).stop 2024-09-21T08:14:50.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 shutdown_connections 2024-09-21T08:14:50.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa7740b6a80 0x7fa7740b8f90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa78009ba80 0x7fa78013dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa78009c3d0 0x7fa780143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 --2- 172.21.15.6:0/1447508420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa780096140 0x7fa78013da00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:50.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 >> 172.21.15.6:0/1447508420 conn(0x7fa78000de70 msgr2=0x7fa780099b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:50.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 shutdown_connections 2024-09-21T08:14:50.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:50.689+0000 7fa790344640 1 -- 172.21.15.6:0/1447508420 wait complete. 2024-09-21T08:14:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:51 smithi119 ceph-mon[33564]: pgmap v772: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.2 MiB/s wr, 656 op/s 2024-09-21T08:14:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:51 smithi145 ceph-mon[34049]: pgmap v772: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.2 MiB/s wr, 656 op/s 2024-09-21T08:14:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:51 smithi006 ceph-mon[30970]: pgmap v772: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.2 MiB/s wr, 656 op/s 2024-09-21T08:14:52.551 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:14:52.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:14:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 715.0 s, 633.8 tps, lat 157.786 ms stddev 77.185 2024-09-21T08:14:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:53.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:53 smithi006 ceph-mon[30970]: pgmap v773: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-09-21T08:14:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:53 smithi119 ceph-mon[33564]: pgmap v773: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-09-21T08:14:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:53 smithi145 ceph-mon[34049]: pgmap v773: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 -- 172.21.15.6:0/1699266580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd1409b2b0 msgr2=0x7efd140a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 --2- 172.21.15.6:0/1699266580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd1409b2b0 0x7efd140a1ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd1c069e80 tx=0x7efd1c099e40 comp rx=0 tx=0).stop 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 -- 172.21.15.6:0/1699266580 shutdown_connections 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 --2- 172.21.15.6:0/1699266580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd1409b2b0 0x7efd140a1ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 --2- 172.21.15.6:0/1699266580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd1409a960 0x7efd1409ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 --2- 172.21.15.6:0/1699266580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd14095020 0x7efd14095430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 -- 172.21.15.6:0/1699266580 >> 172.21.15.6:0/1699266580 conn(0x7efd1400cd70 msgr2=0x7efd1400d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 -- 172.21.15.6:0/1699266580 shutdown_connections 2024-09-21T08:14:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.734+0000 7efd209c1640 1 -- 172.21.15.6:0/1699266580 wait complete. 2024-09-21T08:14:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.735+0000 7efd209c1640 1 Processor -- start 2024-09-21T08:14:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 -- start start 2024-09-21T08:14:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 0x7efd140a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd1409a960 0x7efd140af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 0x7efd140a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd140a3630 con 0x7efd1409a960 2024-09-21T08:14:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd140a34b0 con 0x7efd140a0740 2024-09-21T08:14:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd209c1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd140a37b0 con 0x7efd14095020 2024-09-21T08:14:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 0x7efd140a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 0x7efd140a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43724/0 (socket says 172.21.15.6:43724) 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.736+0000 7efd1b7fe640 1 -- 172.21.15.6:0/257910608 learned_addr learned my addr 172.21.15.6:0/257910608 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 0x7efd140a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 -- 172.21.15.6:0/257910608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 msgr2=0x7efd140a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 0x7efd140a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 -- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd1409a960 msgr2=0x7efd140af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd1409a960 0x7efd140af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.737+0000 7efd1bfff640 1 -- 172.21.15.6:0/257910608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd141478a0 con 0x7efd140a0740 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd1bfff640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 0x7efd140a0bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd1c02ebd0 tx=0x7efd1c09c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd18ff9640 1 -- 172.21.15.6:0/257910608 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c06ae30 con 0x7efd140a0740 2024-09-21T08:14:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd14147ad0 con 0x7efd140a0740 2024-09-21T08:14:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd14147fd0 con 0x7efd140a0740 2024-09-21T08:14:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd18ff9640 1 -- 172.21.15.6:0/257910608 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd1c09e040 con 0x7efd140a0740 2024-09-21T08:14:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.738+0000 7efd18ff9640 1 -- 172.21.15.6:0/257910608 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c09adc0 con 0x7efd140a0740 2024-09-21T08:14:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.745+0000 7efd28197740 1 Processor -- start 2024-09-21T08:14:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 -- start start 2024-09-21T08:14:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd18ff9640 1 -- 172.21.15.6:0/257910608 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7efd1c0a36d0 con 0x7efd140a0740 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51aa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4de2670 0x55e2f51ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e2f5120e60 con 0x55e2f4de2670 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e2f5110290 con 0x55e2f4e03350 2024-09-21T08:14:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.746+0000 7efd28197740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e2f51140a0 con 0x55e2f4dda490 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43734/0 (socket says 172.21.15.6:43734) 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 -- 172.21.15.6:0/3679643774 learned_addr learned my addr 172.21.15.6:0/3679643774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 -- 172.21.15.6:0/3679643774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 msgr2=0x55e2f51aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 -- 172.21.15.6:0/3679643774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4de2670 msgr2=0x55e2f51ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4de2670 0x55e2f51ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.747+0000 7efd1b7fe640 1 -- 172.21.15.6:0/3679643774 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2f4e6e930 con 0x55e2f4dda490 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.750+0000 7efd18ff9640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 0x7efd0c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.750+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd1000bd60 tx=0x7efd100107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35aa2f7399a8735 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.750+0000 7efd18ff9640 1 -- 172.21.15.6:0/257910608 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efd1c16c970 con 0x7efd140a0740 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.751+0000 7efd1affd640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 0x7efd0c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.751+0000 7efd05ffb640 1 -- 172.21.15.6:0/3679643774 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10011640 con 0x55e2f4dda490 2024-09-21T08:14:53.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.751+0000 7efd05ffb640 1 -- 172.21.15.6:0/3679643774 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd10011c70 con 0x55e2f4dda490 2024-09-21T08:14:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.752+0000 7efd05ffb640 1 -- 172.21.15.6:0/3679643774 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1001bb30 con 0x55e2f4dda490 2024-09-21T08:14:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.752+0000 7efd28197740 1 -- 172.21.15.6:0/3679643774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 msgr2=0x55e2f51aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.752+0000 7efd28197740 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd1000bd60 tx=0x7efd100107a0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 -- 172.21.15.6:0/3679643774 shutdown_connections 2024-09-21T08:14:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51aab50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4de2670 0x55e2f51ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 --2- 172.21.15.6:0/3679643774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 -- 172.21.15.6:0/3679643774 >> 172.21.15.6:0/3679643774 conn(0x55e2f4df7740 msgr2=0x55e2f51a8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd1affd640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 0x7efd0c0c9cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd08005dc0 tx=0x7efd08005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 -- 172.21.15.6:0/3679643774 shutdown_connections 2024-09-21T08:14:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.753+0000 7efd28197740 1 -- 172.21.15.6:0/3679643774 wait complete. 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.754+0000 7efd28197740 1 -- start start 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.754+0000 7efd28197740 1 Processor -- start 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4de2670 0x55e2f51b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 0x55e2f51c2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e2f4f71890 con 0x55e2f4e03350 2024-09-21T08:14:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:43740/0 (socket says 172.21.15.6:43740) 2024-09-21T08:14:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd1b7fe640 1 -- 172.21.15.6:0/2372023443 learned_addr learned my addr 172.21.15.6:0/2372023443 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e2f50aad40 con 0x55e2f4de2670 2024-09-21T08:14:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e2f51b8e40 con 0x55e2f4dda490 2024-09-21T08:14:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.755+0000 7efd1affd640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4de2670 0x55e2f51b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd28197740 10 client.0 _ll_register_callbacks cb 0x55e2f510ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 0x55e2f51c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 -- 172.21.15.6:0/2372023443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 msgr2=0x55e2f51b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 -- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4de2670 msgr2=0x55e2f51b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4de2670 0x55e2f51b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.756+0000 7efd1bfff640 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2f51c2780 con 0x55e2f4e03350 2024-09-21T08:14:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.757+0000 7efd1bfff640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 0x55e2f51c2210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efd1c169c80 tx=0x7efd1c12fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb05c6408439bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.758+0000 7efcfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.758+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c132ca0 con 0x55e2f4e03350 2024-09-21T08:14:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.759+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd10011c70 con 0x55e2f4e03350 2024-09-21T08:14:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.758+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efd1c159640 con 0x55e2f4e03350 2024-09-21T08:14:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.759+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd1c0a3470 con 0x55e2f4e03350 2024-09-21T08:14:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.760+0000 7efd28197740 10 client.17520 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:53.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.760+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e2f51c50b0 con 0x55e2f4e03350 2024-09-21T08:14:53.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.762+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd10011c70 con 0x55e2f4e03350 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.763+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efd1c0aa070 con 0x55e2f4e03350 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 10 client.17520 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 10 client.17520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 20 client.17520 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4dc1cd0 0x55e2f51c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 4 client.17520 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2f5122db0 con 0x55e2f4dc1cd0 2024-09-21T08:14:53.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.764+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4dc1cd0 0x55e2f51c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.766+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4dc1cd0 0x55e2f51c8670 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1611095398b2c4ec server_cookie=6dd15a31dfad6158 in_seq=0 out_seq=0 2024-09-21T08:14:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.766+0000 7efcfaffd640 10 client.17520 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efcfaffd640 1 -- 172.21.15.6:0/2372023443 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2f5122db0 con 0x55e2f4dc1cd0 2024-09-21T08:14:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efcfaffd640 10 client.17520 handle_command_reply: tid=0 2024-09-21T08:14:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 client.17520 shutdown 2024-09-21T08:14:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 msgr2=0x55e2f51c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 0x55e2f51c2210 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efd1c169c80 tx=0x7efd1c12fa60 comp rx=0 tx=0).stop 2024-09-21T08:14:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 shutdown_connections 2024-09-21T08:14:53.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4dc1cd0 0x55e2f51c8670 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.767+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4e03350 0x55e2f51c2210 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4de2670 0x55e2f51b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 1 --2- 172.21.15.6:0/2372023443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4dda490 0x55e2f51b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 >> 172.21.15.6:0/2372023443 conn(0x55e2f4df7740 msgr2=0x55e2f51ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efcfaffd640 0 client.17520 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 shutdown_connections 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 1 -- 172.21.15.6:0/2372023443 wait complete. 2024-09-21T08:14:53.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.768+0000 7efd28197740 20 client.17520 trim_cache size 0 max 16384 2024-09-21T08:14:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.802+0000 7efd28197740 1 Processor -- start 2024-09-21T08:14:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 -- start start 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51a83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd0000e0a0 con 0x55e2f4dda490 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd00010900 con 0x55e2f4e03350 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd28197740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd0000e6f0 con 0x55e2f4de2670 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:42506/0 (socket says 172.21.15.6:42506) 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd1bfff640 1 -- 172.21.15.6:0/2842651006 learned_addr learned my addr 172.21.15.6:0/2842651006 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.803+0000 7efd1affd640 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51a83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 -- 172.21.15.6:0/2842651006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 msgr2=0x55e2f51b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 -- 172.21.15.6:0/2842651006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 msgr2=0x55e2f51a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 -- 172.21.15.6:0/2842651006 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2f51ac900 con 0x55e2f4de2670 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.804+0000 7efd1affd640 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51a83a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd140a6ad0 tx=0x7efd08011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c76c900235676b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.805+0000 7efd057fa640 1 -- 172.21.15.6:0/2842651006 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08026430 con 0x55e2f4de2670 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.805+0000 7efd057fa640 1 -- 172.21.15.6:0/2842651006 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd0801d8c0 con 0x55e2f4de2670 2024-09-21T08:14:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.805+0000 7efd057fa640 1 -- 172.21.15.6:0/2842651006 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0801c690 con 0x55e2f4de2670 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 -- 172.21.15.6:0/2842651006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 msgr2=0x55e2f51a83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51a83a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd140a6ad0 tx=0x7efd08011000 comp rx=0 tx=0).stop 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 -- 172.21.15.6:0/2842651006 shutdown_connections 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51a83a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 --2- 172.21.15.6:0/2842651006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 -- 172.21.15.6:0/2842651006 >> 172.21.15.6:0/2842651006 conn(0x55e2f4df7740 msgr2=0x55e2f51b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 -- 172.21.15.6:0/2842651006 shutdown_connections 2024-09-21T08:14:53.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.807+0000 7efd28197740 1 -- 172.21.15.6:0/2842651006 wait complete. 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.808+0000 7efd28197740 1 -- start start 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.808+0000 7efd28197740 1 Processor -- start 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd0000edc0 con 0x55e2f4dda490 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd00010230 con 0x55e2f4e03350 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd0000f490 con 0x55e2f4de2670 2024-09-21T08:14:53.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd1affd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.809+0000 7efd28197740 10 client.0 _ll_register_callbacks cb 0x7efd1c051960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:42520/0 (socket says 172.21.15.6:42520) 2024-09-21T08:14:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 -- 172.21.15.6:0/4219819958 learned_addr learned my addr 172.21.15.6:0/4219819958 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 -- 172.21.15.6:0/4219819958 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 msgr2=0x55e2f51be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 -- 172.21.15.6:0/4219819958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 msgr2=0x55e2f51be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51be410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.810+0000 7efd1bfff640 1 -- 172.21.15.6:0/4219819958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2f51b98c0 con 0x55e2f4e03350 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.811+0000 7efd1bfff640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0690c0 tx=0x7efd1c064940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc49306f00f42f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.811+0000 7efcfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:14:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.811+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c132ac0 con 0x55e2f4e03350 2024-09-21T08:14:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.811+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7efd1c138fc0 con 0x55e2f4e03350 2024-09-21T08:14:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.811+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd0801d8c0 con 0x55e2f4e03350 2024-09-21T08:14:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.812+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd1c132ca0 con 0x55e2f4e03350 2024-09-21T08:14:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.813+0000 7efd28197740 10 client.27164 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.813+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e2f5233a90 con 0x55e2f4e03350 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.813+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd1c11aa90 con 0x55e2f4e03350 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efd1c0aa040 con 0x55e2f4e03350 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 10 client.27164 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 10 client.27164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 20 client.27164 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4d97080 0x55e2f5236090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 4 client.27164 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:14:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7efd0801d8c0 con 0x55e2f4d97080 2024-09-21T08:14:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4d97080 0x55e2f5236090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.814+0000 7efcfaffd640 10 client.27164 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.815+0000 7efd1b7fe640 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4d97080 0x55e2f5236090 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0dba2d423d887e server_cookie=7d92d5bf6fd490e8 in_seq=0 out_seq=0 2024-09-21T08:14:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.817+0000 7efcfaffd640 1 -- 172.21.15.6:0/4219819958 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7efd0801d8c0 con 0x55e2f4d97080 2024-09-21T08:14:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.817+0000 7efcfaffd640 10 client.27164 handle_command_reply: tid=0 2024-09-21T08:14:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.817+0000 7efd28197740 1 client.27164 shutdown 2024-09-21T08:14:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 msgr2=0x55e2f51b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0690c0 tx=0x7efd1c064940 comp rx=0 tx=0).stop 2024-09-21T08:14:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 shutdown_connections 2024-09-21T08:14:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55e2f4d97080 0x55e2f5236090 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e2f4de2670 0x55e2f51be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.818+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2f4e03350 0x55e2f51b9130 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efd28197740 1 --2- 172.21.15.6:0/4219819958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2f4dda490 0x55e2f51be410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 >> 172.21.15.6:0/4219819958 conn(0x55e2f4df7740 msgr2=0x55e2f51a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efcfaffd640 0 client.27164 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 shutdown_connections 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efd28197740 1 -- 172.21.15.6:0/4219819958 wait complete. 2024-09-21T08:14:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.819+0000 7efd28197740 20 client.27164 trim_cache size 0 max 16384 2024-09-21T08:14:53.822 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:53.822 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:14:53.822 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "58447fde-13ac-41a1-b590-2b49810bc95b", 2024-09-21T08:14:53.822 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:14:53.822 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 msgr2=0x7efd0c0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 0x7efd0c0c9cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd08005dc0 tx=0x7efd08005d50 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 msgr2=0x7efd140a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 0x7efd140a0bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd1c02ebd0 tx=0x7efd1c09c990 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 shutdown_connections 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7efd0c0c77c0 0x7efd0c0c9cd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd140a0740 0x7efd140a0bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd1409a960 0x7efd140af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 --2- 172.21.15.6:0/257910608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd14095020 0x7efd140a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.820+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 >> 172.21.15.6:0/257910608 conn(0x7efd1400cd70 msgr2=0x7efd140978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.821+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 shutdown_connections 2024-09-21T08:14:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:53.821+0000 7efd209c1640 1 -- 172.21.15.6:0/257910608 wait complete. 2024-09-21T08:14:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:55 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:14:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:55 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:55 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:14:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:55 smithi119 ceph-mon[33564]: pgmap v774: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.6 MiB/s wr, 680 op/s 2024-09-21T08:14:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:55 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:14:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:55 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:55 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:14:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:55 smithi145 ceph-mon[34049]: pgmap v774: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.6 MiB/s wr, 680 op/s 2024-09-21T08:14:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:55 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:14:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:55 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:55 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:14:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:55 smithi006 ceph-mon[30970]: pgmap v774: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.6 MiB/s wr, 680 op/s 2024-09-21T08:14:56.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:56 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:56.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:56 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:56.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:56 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:14:56.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:14:57.037 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:14:57.308 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:57 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:14:57.308 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:57 smithi119 ceph-mon[33564]: pgmap v775: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-21T08:14:57.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:57 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:14:57.333 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:57 smithi006 ceph-mon[30970]: pgmap v775: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-21T08:14:57.343 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:57 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:14:57.343 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:57 smithi145 ceph-mon[34049]: pgmap v775: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 6.1 MiB/s wr, 616 op/s 2024-09-21T08:14:57.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 720.0 s, 617.8 tps, lat 159.458 ms stddev 70.955 2024-09-21T08:14:59.314 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:14:59 smithi006 ceph-mon[30970]: pgmap v776: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T08:14:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:14:59 smithi119 ceph-mon[33564]: pgmap v776: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T08:14:59.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:14:59 smithi145 ceph-mon[34049]: pgmap v776: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.299+0000 7fca789a6640 1 -- 172.21.15.6:0/244691504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108b60 msgr2=0x7fca7410f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.299+0000 7fca789a6640 1 --2- 172.21.15.6:0/244691504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108b60 0x7fca7410f390 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009ca0 tx=0x7fca6c02a8f0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.300+0000 7fca789a6640 1 -- 172.21.15.6:0/244691504 shutdown_connections 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.300+0000 7fca789a6640 1 --2- 172.21.15.6:0/244691504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca74108210 0x7fca74108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.300+0000 7fca789a6640 1 --2- 172.21.15.6:0/244691504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108b60 0x7fca7410f390 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.300+0000 7fca789a6640 1 --2- 172.21.15.6:0/244691504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca741028d0 0x7fca74102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.300+0000 7fca789a6640 1 -- 172.21.15.6:0/244691504 >> 172.21.15.6:0/244691504 conn(0x7fca740fe380 msgr2=0x7fca741007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.302+0000 7fca789a6640 1 -- 172.21.15.6:0/244691504 shutdown_connections 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.302+0000 7fca789a6640 1 -- 172.21.15.6:0/244691504 wait complete. 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.303+0000 7fca789a6640 1 Processor -- start 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.303+0000 7fca789a6640 1 -- start start 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.303+0000 7fca789a6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca741028d0 0x7fca7419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.303+0000 7fca789a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.303+0000 7fca789a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca74108b60 0x7fca741a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca789a6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fca74111690 con 0x7fca74108210 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca789a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca74111510 con 0x7fca74108b60 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca789a6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fca74111810 con 0x7fca741028d0 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52746/0 (socket says 172.21.15.6:52746) 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca72ffd640 1 -- 172.21.15.6:0/4070422273 learned_addr learned my addr 172.21.15.6:0/4070422273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.304+0000 7fca73fff640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca74108b60 0x7fca741a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.305+0000 7fca72ffd640 1 -- 172.21.15.6:0/4070422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca741028d0 msgr2=0x7fca7419c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.305+0000 7fca72ffd640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca741028d0 0x7fca7419c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.305+0000 7fca72ffd640 1 -- 172.21.15.6:0/4070422273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca74108b60 msgr2=0x7fca741a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.305+0000 7fca72ffd640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca74108b60 0x7fca741a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.305+0000 7fca72ffd640 1 -- 172.21.15.6:0/4070422273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca741a2360 con 0x7fca74108210 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.306+0000 7fca72ffd640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d740 tx=0x7fca6400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.306+0000 7fca70ff9640 1 -- 172.21.15.6:0/4070422273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64017070 con 0x7fca74108210 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.306+0000 7fca70ff9640 1 -- 172.21.15.6:0/4070422273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca6400de50 con 0x7fca74108210 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.306+0000 7fca70ff9640 1 -- 172.21.15.6:0/4070422273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6400f620 con 0x7fca74108210 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.307+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca741a2650 con 0x7fca74108210 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.307+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7406cde0 con 0x7fca74108210 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 Processor -- start 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 -- start start 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254dad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fc25450e50 con 0x55fc2510a1b0 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fc25440280 con 0x55fc25133070 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.312+0000 7fca8017c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fc25444090 con 0x55fc25112390 2024-09-21T08:14:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:37306/0 (socket says 172.21.15.6:37306) 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 -- 172.21.15.6:0/309572751 learned_addr learned my addr 172.21.15.6:0/309572751 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 -- 172.21.15.6:0/309572751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 msgr2=0x55fc254db290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254db290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 -- 172.21.15.6:0/309572751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 msgr2=0x55fc254dad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca737fe640 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.313+0000 7fca73fff640 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254dad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.314+0000 7fca73fff640 1 -- 172.21.15.6:0/309572751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc2519e650 con 0x55fc25133070 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.314+0000 7fca73fff640 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca6c035000 tx=0x7fca6c003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa7bd03bc398788 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.315+0000 7fca737fe640 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254dad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.315+0000 7fca59ffb640 1 -- 172.21.15.6:0/309572751 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c003e40 con 0x55fc25133070 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.315+0000 7fca59ffb640 1 -- 172.21.15.6:0/309572751 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca6c036040 con 0x55fc25133070 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.315+0000 7fca70ff9640 1 -- 172.21.15.6:0/4070422273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fca6401a070 con 0x7fca74108210 2024-09-21T08:14:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.317+0000 7fca59ffb640 1 -- 172.21.15.6:0/309572751 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c030c30 con 0x55fc25133070 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.318+0000 7fca8017c740 1 -- 172.21.15.6:0/309572751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 msgr2=0x55fc254da810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.318+0000 7fca8017c740 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca6c035000 tx=0x7fca6c003b20 comp rx=0 tx=0).stop 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.320+0000 7fca8017c740 1 -- 172.21.15.6:0/309572751 shutdown_connections 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.320+0000 7fca8017c740 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.320+0000 7fca8017c740 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254dad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.320+0000 7fca8017c740 1 --2- 172.21.15.6:0/309572751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254da810 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.320+0000 7fca8017c740 1 -- 172.21.15.6:0/309572751 >> 172.21.15.6:0/309572751 conn(0x55fc25127460 msgr2=0x55fc254d8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.321+0000 7fca70ff9640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 0x7fca5c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.322+0000 7fca70ff9640 1 -- 172.21.15.6:0/4070422273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fca640e7160 con 0x7fca74108210 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.323+0000 7fca8017c740 1 -- 172.21.15.6:0/309572751 shutdown_connections 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.323+0000 7fca8017c740 1 -- 172.21.15.6:0/309572751 wait complete. 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.324+0000 7fca8017c740 1 -- start start 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.324+0000 7fca737fe640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 0x7fca5c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.324+0000 7fca8017c740 1 Processor -- start 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc2510a1b0 0x55fc254e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25133070 0x55fc254f2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fc252a1700 con 0x55fc25112390 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fc253db110 con 0x55fc2510a1b0 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fc254e8fe0 con 0x55fc25133070 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca8017c740 10 client.0 _ll_register_callbacks cb 0x55fc253f4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca73fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25133070 0x55fc254f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52770/0 (socket says 172.21.15.6:52770) 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.325+0000 7fca72ffd640 1 -- 172.21.15.6:0/3090848752 learned_addr learned my addr 172.21.15.6:0/3090848752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 -- 172.21.15.6:0/3090848752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25133070 msgr2=0x55fc254f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25133070 0x55fc254f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 -- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc2510a1b0 msgr2=0x55fc254e5f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc2510a1b0 0x55fc254e5f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 -- 172.21.15.6:0/3090848752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc25408c40 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca72ffd640 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca640ac870 tx=0x7fca640a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7387b7cfd84c50e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.326+0000 7fca52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.327+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64021070 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.328+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca6c036040 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.328+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fca640e4bc0 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.328+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fca640e48f0 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.329+0000 7fca737fe640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 0x7fca5c0b8d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55fc254dccb0 tx=0x7fca68008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.330+0000 7fca8017c740 10 client.17535 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.330+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fc254fd520 con 0x55fc25112390 2024-09-21T08:14:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.330+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca6c036040 con 0x55fc25112390 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fca64024060 con 0x55fc25112390 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 10 client.17535 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 20 client.17535 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250f19f0 0x55fc25500ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 4 client.17535 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.331+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc25452da0 con 0x55fc250f19f0 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.332+0000 7fca737fe640 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250f19f0 0x55fc25500ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.332+0000 7fca737fe640 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250f19f0 0x55fc25500ed0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e281389b996ab12 server_cookie=85a5db3f8125337d in_seq=0 out_seq=0 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.332+0000 7fca52ffd640 10 client.17535 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.333+0000 7fca52ffd640 1 -- 172.21.15.6:0/3090848752 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc25452da0 con 0x55fc250f19f0 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.333+0000 7fca52ffd640 10 client.17535 handle_command_reply: tid=0 2024-09-21T08:14:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.333+0000 7fca8017c740 1 client.17535 shutdown 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.333+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 msgr2=0x55fc254e64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.333+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca640ac870 tx=0x7fca640a9070 comp rx=0 tx=0).stop 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 shutdown_connections 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250f19f0 0x55fc25500ed0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25133070 0x55fc254f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e64d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 --2- 172.21.15.6:0/3090848752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc2510a1b0 0x55fc254e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 >> 172.21.15.6:0/3090848752 conn(0x55fc25127460 msgr2=0x55fc254dd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca52ffd640 0 client.17535 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 shutdown_connections 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 1 -- 172.21.15.6:0/3090848752 wait complete. 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.334+0000 7fca8017c740 20 client.17535 trim_cache size 0 max 16384 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.369+0000 7fca8017c740 1 Processor -- start 2024-09-21T08:14:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.369+0000 7fca8017c740 1 -- start start 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc2510a1b0 0x55fc254de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fca74070bb0 con 0x55fc25112390 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca740733f0 con 0x55fc25133070 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca8017c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fca74071200 con 0x55fc2510a1b0 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52778/0 (socket says 172.21.15.6:52778) 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca72ffd640 1 -- 172.21.15.6:0/284585143 learned_addr learned my addr 172.21.15.6:0/284585143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca73fff640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca737fe640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc2510a1b0 0x55fc254de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca72ffd640 1 -- 172.21.15.6:0/284585143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc2510a1b0 msgr2=0x55fc254de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.370+0000 7fca72ffd640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc2510a1b0 0x55fc254de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca72ffd640 1 -- 172.21.15.6:0/284585143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 msgr2=0x55fc254e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca72ffd640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca72ffd640 1 -- 172.21.15.6:0/284585143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc254de560 con 0x55fc25112390 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca73fff640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca72ffd640 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fca640d2040 tx=0x7fca640ac9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbbd7e10dc84f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.371+0000 7fca597fa640 1 -- 172.21.15.6:0/284585143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640ac680 con 0x55fc25112390 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.372+0000 7fca597fa640 1 -- 172.21.15.6:0/284585143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca640ad270 con 0x55fc25112390 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.372+0000 7fca597fa640 1 -- 172.21.15.6:0/284585143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640e4900 con 0x55fc25112390 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- 172.21.15.6:0/284585143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 msgr2=0x55fc254e31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fca640d2040 tx=0x7fca640ac9b0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- 172.21.15.6:0/284585143 shutdown_connections 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc254e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc25112390 0x55fc254e31a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 --2- 172.21.15.6:0/284585143 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc2510a1b0 0x55fc254de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- 172.21.15.6:0/284585143 >> 172.21.15.6:0/284585143 conn(0x55fc25127460 msgr2=0x55fc254dd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- 172.21.15.6:0/284585143 shutdown_connections 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- 172.21.15.6:0/284585143 wait complete. 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.373+0000 7fca8017c740 1 -- start start 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.374+0000 7fca8017c740 1 Processor -- start 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc2556a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fca740718b0 con 0x55fc2510a1b0 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca74072d20 con 0x55fc25133070 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca8017c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fca74071f80 con 0x55fc25112390 2024-09-21T08:14:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.375+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50346/0 (socket says 172.21.15.6:50346) 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 -- 172.21.15.6:0/2485119538 learned_addr learned my addr 172.21.15.6:0/2485119538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca73fff640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc2556a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca8017c740 10 client.0 _ll_register_callbacks cb 0x7fca64010b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 -- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 msgr2=0x55fc2556a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc2556a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 -- 172.21.15.6:0/2485119538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 msgr2=0x55fc254ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca72ffd640 1 -- 172.21.15.6:0/2485119538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc2556ae10 con 0x55fc25112390 2024-09-21T08:14:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.376+0000 7fca737fe640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca72ffd640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca640a9de0 tx=0x7fca640e4df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61d7b943ac68504 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640c6020 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7fca640abfd0 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca640ad270 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fca640ac680 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca8017c740 10 client.27262 fetch_fsmap learned FSMap version 21 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.377+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fc2556c010 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca640ab840 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fca640b27e0 con 0x55fc25112390 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 10 client.27262 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 10 client.27262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:14:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 20 client.27262 populate_metadata read hostname 'smithi006' 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250c6da0 0x55fc2556e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 4 client.27262 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.378+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fca640ad270 con 0x55fc250c6da0 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.379+0000 7fca737fe640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250c6da0 0x55fc2556e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.379+0000 7fca52ffd640 10 client.27262 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.379+0000 7fca737fe640 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250c6da0 0x55fc2556e700 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49da4c748e3b0987 server_cookie=fac90bcf5f2c6bdc in_seq=0 out_seq=0 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.380+0000 7fca52ffd640 1 -- 172.21.15.6:0/2485119538 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x7fca640ad270 con 0x55fc250c6da0 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.380+0000 7fca52ffd640 10 client.27262 handle_command_reply: tid=0 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.380+0000 7fca8017c740 1 client.27262 shutdown 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 msgr2=0x55fc254eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca640a9de0 tx=0x7fca640e4df0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 shutdown_connections 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fc250c6da0 0x55fc2556e700 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fc25112390 0x55fc254eaeb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fc25133070 0x55fc2556a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 --2- 172.21.15.6:0/2485119538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc2510a1b0 0x55fc254ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 >> 172.21.15.6:0/2485119538 conn(0x55fc25127460 msgr2=0x55fc254db840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca52ffd640 0 client.27262 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 shutdown_connections 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 1 -- 172.21.15.6:0/2485119538 wait complete. 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.381+0000 7fca8017c740 20 client.27262 trim_cache size 0 max 16384 2024-09-21T08:14:59.900 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.902 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:14:59.903 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.904 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.905 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:14:59.906 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.907 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.908 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:14:59.909 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:14:59.913 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.914 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:14:59.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.383+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 msgr2=0x7fca5c0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.383+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 0x7fca5c0b8d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55fc254dccb0 tx=0x7fca68008040 comp rx=0 tx=0).stop 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.383+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 msgr2=0x7fca7419c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.383+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d740 tx=0x7fca6400dc00 comp rx=0 tx=0).stop 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 shutdown_connections 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fca5c0b6880 0x7fca5c0b8d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca74108b60 0x7fca741a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca74108210 0x7fca7419c990 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 --2- 172.21.15.6:0/4070422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca741028d0 0x7fca7419c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:14:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 >> 172.21.15.6:0/4070422273 conn(0x7fca740fe380 msgr2=0x7fca741067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:14:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 shutdown_connections 2024-09-21T08:14:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:14:59.384+0000 7fca789a6640 1 -- 172.21.15.6:0/4070422273 wait complete. 2024-09-21T08:15:00.723 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:15:00.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:01.342 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:01 smithi006 ceph-mon[30970]: pgmap v777: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 5.6 MiB/s wr, 605 op/s 2024-09-21T08:15:01.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:01 smithi119 ceph-mon[33564]: pgmap v777: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 5.6 MiB/s wr, 605 op/s 2024-09-21T08:15:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:01 smithi145 ceph-mon[34049]: pgmap v777: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 5.6 MiB/s wr, 605 op/s 2024-09-21T08:15:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 725.0 s, 719.6 tps, lat 137.174 ms stddev 96.757 2024-09-21T08:15:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:03 smithi119 ceph-mon[33564]: pgmap v778: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-21T08:15:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:03 smithi145 ceph-mon[34049]: pgmap v778: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-21T08:15:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:03 smithi006 ceph-mon[30970]: pgmap v778: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.902+0000 7f9dde429640 1 -- 172.21.15.6:0/3292585737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd81081c0 msgr2=0x7f9dd81085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.902+0000 7f9dde429640 1 --2- 172.21.15.6:0/3292585737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd81081c0 0x7f9dd81085d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009900 tx=0x7f9dd402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.904+0000 7f9dde429640 1 -- 172.21.15.6:0/3292585737 shutdown_connections 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.904+0000 7f9dde429640 1 --2- 172.21.15.6:0/3292585737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.904+0000 7f9dde429640 1 --2- 172.21.15.6:0/3292585737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd81081c0 0x7f9dd81085d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.904+0000 7f9dde429640 1 --2- 172.21.15.6:0/3292585737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd8102880 0x7f9dd8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.904+0000 7f9dde429640 1 -- 172.21.15.6:0/3292585737 >> 172.21.15.6:0/3292585737 conn(0x7f9dd80fe2b0 msgr2=0x7f9dd8100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.905+0000 7f9dde429640 1 -- 172.21.15.6:0/3292585737 shutdown_connections 2024-09-21T08:15:03.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.905+0000 7f9dde429640 1 -- 172.21.15.6:0/3292585737 wait complete. 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 Processor -- start 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 -- start start 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd8102880 0x7f9dd806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd81081c0 0x7f9dd806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd806cf60 con 0x7f9dd8102880 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd806cde0 con 0x7f9dd81081c0 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.906+0000 7f9dde429640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd806d0e0 con 0x7f9dd8108b10 2024-09-21T08:15:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50368/0 (socket says 172.21.15.6:50368) 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 -- 172.21.15.6:0/797615545 learned_addr learned my addr 172.21.15.6:0/797615545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9ddcc26640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd81081c0 0x7f9dd806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9ddd427640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd8102880 0x7f9dd806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 -- 172.21.15.6:0/797615545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd81081c0 msgr2=0x7f9dd806f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:03.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd81081c0 0x7f9dd806f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 -- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd8102880 msgr2=0x7f9dd806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd8102880 0x7f9dd806eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.907+0000 7f9dddc28640 1 -- 172.21.15.6:0/797615545 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd8074990 con 0x7f9dd8108b10 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dddc28640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c970 tx=0x7f9dc800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8007bb0 con 0x7f9dd8108b10 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dc8007d50 con 0x7f9dd8108b10 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004d50 con 0x7f9dd8108b10 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd8074c80 con 0x7f9dd8108b10 2024-09-21T08:15:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.908+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd8075190 con 0x7f9dd8108b10 2024-09-21T08:15:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.911+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dbc0052c0 con 0x7f9dd8108b10 2024-09-21T08:15:03.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.914+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9dc8004ef0 con 0x7f9dd8108b10 2024-09-21T08:15:03.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.916+0000 7f9dce7fc640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 0x7f9dc40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:03.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.916+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9511+0+0 (secure 0 0 0) 0x7f9dc80e7930 con 0x7f9dd8108b10 2024-09-21T08:15:03.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.917+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9dc8014030 con 0x7f9dd8108b10 2024-09-21T08:15:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.919+0000 7f9ddd427640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 0x7f9dc40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:03.920+0000 7f9ddd427640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 0x7f9dc40b8d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.362+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dbc0055b0 con 0x7f9dd8108b10 2024-09-21T08:15:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.363+0000 7f9dce7fc640 1 -- 172.21.15.6:0/797615545 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f9dc80adb40 con 0x7f9dd8108b10 2024-09-21T08:15:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:04.365 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 msgr2=0x7f9dc40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 0x7f9dc40b8d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0009500 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 msgr2=0x7f9dd8074350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c970 tx=0x7f9dc800ce30 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 shutdown_connections 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9dc40b6880 0x7f9dc40b8d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9dd8108b10 0x7f9dd8074350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dd81081c0 0x7f9dd806f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 --2- 172.21.15.6:0/797615545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd8102880 0x7f9dd806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.367+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 >> 172.21.15.6:0/797615545 conn(0x7f9dd80fe2b0 msgr2=0x7f9dd8105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.368+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 shutdown_connections 2024-09-21T08:15:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:04.368+0000 7f9dde429640 1 -- 172.21.15.6:0/797615545 wait complete. 2024-09-21T08:15:05.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:15:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:05 smithi119 ceph-mon[33564]: pgmap v779: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.3 MiB/s wr, 679 op/s 2024-09-21T08:15:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:05 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/797615545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:05 smithi145 ceph-mon[34049]: pgmap v779: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.3 MiB/s wr, 679 op/s 2024-09-21T08:15:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:05 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/797615545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:05 smithi006 ceph-mon[30970]: pgmap v779: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 6.3 MiB/s wr, 679 op/s 2024-09-21T08:15:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:05 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/797615545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.275+0000 7f4e2d649640 1 -- 172.21.15.6:0/1863883330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 msgr2=0x7f4e2810d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.275+0000 7f4e2d649640 1 --2- 172.21.15.6:0/1863883330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 0x7f4e2810d6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009900 tx=0x7f4e1c02a440 comp rx=0 tx=0).stop 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 -- 172.21.15.6:0/1863883330 shutdown_connections 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 --2- 172.21.15.6:0/1863883330 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2810dbf0 0x7f4e2810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 --2- 172.21.15.6:0/1863883330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2811cba0 0x7f4e2811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 --2- 172.21.15.6:0/1863883330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 0x7f4e2810d6b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 -- 172.21.15.6:0/1863883330 >> 172.21.15.6:0/1863883330 conn(0x7f4e2806e9f0 msgr2=0x7f4e2806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 -- 172.21.15.6:0/1863883330 shutdown_connections 2024-09-21T08:15:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.276+0000 7f4e2d649640 1 -- 172.21.15.6:0/1863883330 wait complete. 2024-09-21T08:15:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.277+0000 7f4e2d649640 1 Processor -- start 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 -- start start 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2810dbf0 0x7f4e2811c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 0x7f4e28115790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28122620 con 0x7f4e2810dbf0 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4e281224a0 con 0x7f4e28111cd0 2024-09-21T08:15:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.280+0000 7f4e2d649640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4e281227a0 con 0x7f4e2811cba0 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.283+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.283+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50382/0 (socket says 172.21.15.6:50382) 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.283+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3029965465 learned_addr learned my addr 172.21.15.6:0/3029965465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.283+0000 7f4e27fff640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2810dbf0 0x7f4e2811c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3029965465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 msgr2=0x7f4e28115790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 0x7f4e28115790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2810dbf0 msgr2=0x7f4e2811c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2810dbf0 0x7f4e2811c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3029965465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2811b130 con 0x7f4e2811cba0 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.284+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000eaa0 tx=0x7f4e2000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.285+0000 7f4e257fa640 1 -- 172.21.15.6:0/3029965465 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000cdb0 con 0x7f4e2811cba0 2024-09-21T08:15:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.285+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2811b420 con 0x7f4e2811cba0 2024-09-21T08:15:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.285+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2811b960 con 0x7f4e2811cba0 2024-09-21T08:15:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.285+0000 7f4e257fa640 1 -- 172.21.15.6:0/3029965465 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e20005020 con 0x7f4e2811cba0 2024-09-21T08:15:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.285+0000 7f4e257fa640 1 -- 172.21.15.6:0/3029965465 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e200116d0 con 0x7f4e2811cba0 2024-09-21T08:15:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.290+0000 7f4e34e1f740 1 Processor -- start 2024-09-21T08:15:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.291+0000 7f4e257fa640 1 -- 172.21.15.6:0/3029965465 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4e20011870 con 0x7f4e2811cba0 2024-09-21T08:15:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.293+0000 7f4e257fa640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 0x7f4e100b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e257fa640 1 -- 172.21.15.6:0/3029965465 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7f4e200e9010 con 0x7f4e2811cba0 2024-09-21T08:15:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 -- start start 2024-09-21T08:15:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95db070 0x5561e9982460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95b21b0 0x5561e99829a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561e98f8ea0 con 0x5561e95b21b0 2024-09-21T08:15:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561e98e82d0 con 0x5561e95db070 2024-09-21T08:15:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.294+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5561e98ec0e0 con 0x5561e95ba390 2024-09-21T08:15:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.295+0000 7f4e277fe640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 0x7f4e100b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.296+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.296+0000 7f4e27fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95db070 0x5561e9982460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.296+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:50396/0 (socket says 172.21.15.6:50396) 2024-09-21T08:15:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.296+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3859369793 learned_addr learned my addr 172.21.15.6:0/3859369793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.299+0000 7f4e277fe640 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95b21b0 0x5561e99829a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3859369793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95db070 msgr2=0x5561e9982460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95db070 0x5561e9982460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3859369793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95b21b0 msgr2=0x5561e99829a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95b21b0 0x5561e99829a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 -- 172.21.15.6:0/3859369793 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e9646650 con 0x5561e95ba390 2024-09-21T08:15:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.300+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000efd0 tx=0x7f4e200ae8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da4dfec50411cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.303+0000 7f4e0e7fc640 1 -- 172.21.15.6:0/3859369793 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2001f070 con 0x5561e95ba390 2024-09-21T08:15:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.303+0000 7f4e0e7fc640 1 -- 172.21.15.6:0/3859369793 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e200b83f0 con 0x5561e95ba390 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.304+0000 7f4e34e1f740 1 -- 172.21.15.6:0/3859369793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 msgr2=0x5561e9982ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.304+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000efd0 tx=0x7f4e200ae8d0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.306+0000 7f4e277fe640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 0x7f4e100b8cc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4e28111140 tx=0x7f4e18009170 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.307+0000 7f4e34e1f740 1 -- 172.21.15.6:0/3859369793 shutdown_connections 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.307+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e9982ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.307+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95b21b0 0x5561e99829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.307+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/3859369793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95db070 0x5561e9982460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.307+0000 7f4e34e1f740 1 -- 172.21.15.6:0/3859369793 >> 172.21.15.6:0/3859369793 conn(0x5561e95cf460 msgr2=0x5561e9980350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.314+0000 7f4e34e1f740 1 -- 172.21.15.6:0/3859369793 shutdown_connections 2024-09-21T08:15:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.317+0000 7f4e34e1f740 1 -- 172.21.15.6:0/3859369793 wait complete. 2024-09-21T08:15:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.317+0000 7f4e34e1f740 1 -- start start 2024-09-21T08:15:06.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.317+0000 7f4e34e1f740 1 Processor -- start 2024-09-21T08:15:06.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e998d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e998df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561e9749700 con 0x5561e95db070 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561e9883160 con 0x5561e95b21b0 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5561e9990ce0 con 0x5561e95ba390 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.318+0000 7f4e34e1f740 10 client.0 _ll_register_callbacks cb 0x5561e989c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.319+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.319+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35134/0 (socket says 172.21.15.6:35134) 2024-09-21T08:15:06.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.319+0000 7f4e2ce48640 1 -- 172.21.15.6:0/1760632811 learned_addr learned my addr 172.21.15.6:0/1760632811 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.320+0000 7f4e2ce48640 1 -- 172.21.15.6:0/1760632811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 msgr2=0x5561e998df30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.320+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e998df30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.320+0000 7f4e2ce48640 1 -- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 msgr2=0x5561e998d9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.320+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e998d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.320+0000 7f4e2ce48640 1 -- 172.21.15.6:0/1760632811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e98b0c90 con 0x5561e95db070 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.321+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b3420 tx=0x7f4e200e6270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a74dda69335fb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.321+0000 7f4e077fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.321+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2001f040 con 0x5561e95db070 2024-09-21T08:15:06.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.321+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e200b83f0 con 0x5561e95db070 2024-09-21T08:15:06.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.322+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7f4e200ad6a0 con 0x5561e95db070 2024-09-21T08:15:06.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.323+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e200c9050 con 0x5561e95db070 2024-09-21T08:15:06.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.323+0000 7f4e34e1f740 10 client.17556 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:06.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.323+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5561e999c910 con 0x5561e95db070 2024-09-21T08:15:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.327+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e200b83f0 con 0x5561e95db070 2024-09-21T08:15:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4e2000f040 con 0x5561e95db070 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 10 client.17556 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 20 client.17556 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e95999f0 0x5561e999fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 4 client.17556 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.328+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561e98fadf0 con 0x5561e95999f0 2024-09-21T08:15:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.330+0000 7f4e27fff640 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e95999f0 0x5561e999fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.334+0000 7f4e27fff640 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e95999f0 0x5561e999fe80 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241bd494add5611 server_cookie=aeee7bef9a5e225b in_seq=0 out_seq=0 2024-09-21T08:15:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.334+0000 7f4e077fe640 10 client.17556 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:06.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.336+0000 7f4e077fe640 1 -- 172.21.15.6:0/1760632811 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561e98fadf0 con 0x5561e95999f0 2024-09-21T08:15:06.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.336+0000 7f4e077fe640 10 client.17556 handle_command_reply: tid=0 2024-09-21T08:15:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.337+0000 7f4e34e1f740 1 client.17556 shutdown 2024-09-21T08:15:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.340+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 msgr2=0x5561e998e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.340+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b3420 tx=0x7f4e200e6270 comp rx=0 tx=0).stop 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 shutdown_connections 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e95999f0 0x5561e999fe80 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95ba390 0x5561e998df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998e470 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/1760632811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e998d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 >> 172.21.15.6:0/1760632811 conn(0x5561e95cf460 msgr2=0x5561e9983e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.345+0000 7f4e077fe640 0 client.17556 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:06.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.350+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 shutdown_connections 2024-09-21T08:15:06.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.353+0000 7f4e34e1f740 1 -- 172.21.15.6:0/1760632811 wait complete. 2024-09-21T08:15:06.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.353+0000 7f4e34e1f740 20 client.17556 trim_cache size 0 max 16384 2024-09-21T08:15:06.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.383+0000 7f4e34e1f740 1 Processor -- start 2024-09-21T08:15:06.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.385+0000 7f4e34e1f740 1 -- start start 2024-09-21T08:15:06.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 0x5561e998abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95ba390 0x5561e998b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1400e0b0 con 0x5561e95db070 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14010880 con 0x5561e95ba390 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1400e670 con 0x5561e95b21b0 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e27fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 0x5561e998abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.386+0000 7f4e277fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95ba390 0x5561e998b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.387+0000 7f4e27fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 0x5561e998abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37774/0 (socket says 172.21.15.6:37774) 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.387+0000 7f4e27fff640 1 -- 172.21.15.6:0/2386162504 learned_addr learned my addr 172.21.15.6:0/2386162504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.387+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 -- 172.21.15.6:0/2386162504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 msgr2=0x5561e998abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 0x5561e998abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 -- 172.21.15.6:0/2386162504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95ba390 msgr2=0x5561e998b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95ba390 0x5561e998b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 -- 172.21.15.6:0/2386162504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e99a0450 con 0x5561e95db070 2024-09-21T08:15:06.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.388+0000 7f4e2ce48640 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998ef10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b33f0 tx=0x7f4e200ab150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55459ef946a54eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.390+0000 7f4e0dffb640 1 -- 172.21.15.6:0/2386162504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2001f070 con 0x5561e95db070 2024-09-21T08:15:06.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.390+0000 7f4e0dffb640 1 -- 172.21.15.6:0/2386162504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e200b83f0 con 0x5561e95db070 2024-09-21T08:15:06.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.391+0000 7f4e34e1f740 1 -- 172.21.15.6:0/2386162504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 msgr2=0x5561e998ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.391+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998ef10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b33f0 tx=0x7f4e200ab150 comp rx=0 tx=0).stop 2024-09-21T08:15:06.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.393+0000 7f4e34e1f740 1 -- 172.21.15.6:0/2386162504 shutdown_connections 2024-09-21T08:15:06.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.393+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95db070 0x5561e998ef10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.393+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95ba390 0x5561e998b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.393+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/2386162504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95b21b0 0x5561e998abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.393+0000 7f4e34e1f740 1 -- 172.21.15.6:0/2386162504 >> 172.21.15.6:0/2386162504 conn(0x5561e95cf460 msgr2=0x5561e998c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.400+0000 7f4e34e1f740 1 -- 172.21.15.6:0/2386162504 shutdown_connections 2024-09-21T08:15:06.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.400+0000 7f4e34e1f740 1 -- 172.21.15.6:0/2386162504 wait complete. 2024-09-21T08:15:06.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.400+0000 7f4e34e1f740 1 -- start start 2024-09-21T08:15:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.400+0000 7f4e34e1f740 1 Processor -- start 2024-09-21T08:15:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e9992dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95ba390 0x5561e9993370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 0x5561e9a02840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1400ed40 con 0x5561e95ba390 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140101b0 con 0x5561e95b21b0 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1400f410 con 0x5561e95db070 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.401+0000 7f4e34e1f740 10 client.0 _ll_register_callbacks cb 0x7f4e18006ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 0x5561e9a02840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e2ce48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 0x5561e9a02840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37782/0 (socket says 172.21.15.6:37782) 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e2ce48640 1 -- 172.21.15.6:0/666895539 learned_addr learned my addr 172.21.15.6:0/666895539 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e9992dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 -- 172.21.15.6:0/666895539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 msgr2=0x5561e9a02840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 0x5561e9a02840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 -- 172.21.15.6:0/666895539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95ba390 msgr2=0x5561e9993370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95ba390 0x5561e9993370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.402+0000 7f4e27fff640 1 -- 172.21.15.6:0/666895539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e9a02e80 con 0x5561e95b21b0 2024-09-21T08:15:06.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.410+0000 7f4e27fff640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e9992dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009230 tx=0x7f4e1c0314d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c3f8beb0f26eed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.414+0000 7f4e077fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:15:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.414+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c035040 con 0x5561e95b21b0 2024-09-21T08:15:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.414+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e200b83f0 con 0x5561e95b21b0 2024-09-21T08:15:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.414+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7f4e1c004040 con 0x5561e95b21b0 2024-09-21T08:15:06.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.416+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e1c004240 con 0x5561e95b21b0 2024-09-21T08:15:06.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.417+0000 7f4e34e1f740 10 client.27194 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:06.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.417+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5561e9a0a210 con 0x5561e95b21b0 2024-09-21T08:15:06.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.419+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e200b83f0 con 0x5561e95b21b0 2024-09-21T08:15:06.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.419+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4e1c046070 con 0x5561e95b21b0 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 10 client.27194 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 10 client.27194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 20 client.27194 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e956eda0 0x5561e9a0c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 4 client.27194 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.420+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561e98f68a0 con 0x5561e956eda0 2024-09-21T08:15:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.422+0000 7f4e277fe640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e956eda0 0x5561e9a0c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:06.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.428+0000 7f4e077fe640 10 client.27194 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:06.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.428+0000 7f4e277fe640 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e956eda0 0x5561e9a0c980 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c561f4aa2e871218 server_cookie=b2ad0d8833f545c7 in_seq=0 out_seq=0 2024-09-21T08:15:06.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.429+0000 7f4e077fe640 1 -- 172.21.15.6:0/666895539 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561e98f68a0 con 0x5561e956eda0 2024-09-21T08:15:06.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.429+0000 7f4e077fe640 10 client.27194 handle_command_reply: tid=0 2024-09-21T08:15:06.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.429+0000 7f4e34e1f740 1 client.27194 shutdown 2024-09-21T08:15:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.431+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 msgr2=0x5561e9992dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.431+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e9992dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009230 tx=0x7f4e1c0314d0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 shutdown_connections 2024-09-21T08:15:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5561e956eda0 0x5561e9a0c980 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5561e95db070 0x5561e9a02840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561e95ba390 0x5561e9993370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 --2- 172.21.15.6:0/666895539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561e95b21b0 0x5561e9992dd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 >> 172.21.15.6:0/666895539 conn(0x5561e95cf460 msgr2=0x5561e9983490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e077fe640 0 client.27194 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 shutdown_connections 2024-09-21T08:15:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 1 -- 172.21.15.6:0/666895539 wait complete. 2024-09-21T08:15:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.433+0000 7f4e34e1f740 20 client.27194 trim_cache size 0 max 16384 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.434+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 msgr2=0x7f4e100b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 0x7f4e100b8cc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4e28111140 tx=0x7f4e18009170 comp rx=0 tx=0).stop 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 msgr2=0x7f4e28115ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000eaa0 tx=0x7f4e2000ef60 comp rx=0 tx=0).stop 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 shutdown_connections 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f4e100b67b0 0x7f4e100b8cc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4e2811cba0 0x7f4e28115ed0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e28111cd0 0x7f4e28115790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 --2- 172.21.15.6:0/3029965465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2810dbf0 0x7f4e2811c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 >> 172.21.15.6:0/3029965465 conn(0x7f4e2806e9f0 msgr2=0x7f4e2810c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 shutdown_connections 2024-09-21T08:15:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:06.435+0000 7f4e2d649640 1 -- 172.21.15.6:0/3029965465 wait complete. 2024-09-21T08:15:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:07 smithi119 ceph-mon[33564]: pgmap v780: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-09-21T08:15:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:07 smithi119 ceph-mon[33564]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:15:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:07 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:15:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:07 smithi145 ceph-mon[34049]: pgmap v780: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-09-21T08:15:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:07 smithi145 ceph-mon[34049]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:15:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:07 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:15:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:07 smithi006 ceph-mon[30970]: pgmap v780: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-09-21T08:15:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:07 smithi006 ceph-mon[30970]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:15:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:07 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:15:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 730.0 s, 584.7 tps, lat 174.274 ms stddev 148.746 2024-09-21T08:15:08.202 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:15:08.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:15:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:08 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:15:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:08 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:15:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:08 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:15:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:08 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:15:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:08 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:15:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:08 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:15:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:08 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:15:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:08 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:15:08.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:08 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:15:08.689 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:09 smithi119 ceph-mon[33564]: pgmap v782: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.6 MiB/s wr, 686 op/s 2024-09-21T08:15:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:09 smithi145 ceph-mon[34049]: pgmap v782: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.6 MiB/s wr, 686 op/s 2024-09-21T08:15:09.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:09 smithi006 ceph-mon[30970]: pgmap v782: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.6 MiB/s wr, 686 op/s 2024-09-21T08:15:11.271 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:15:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T08:15:11.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:11 smithi119 ceph-mon[33564]: pgmap v783: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-09-21T08:15:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:11 smithi145 ceph-mon[34049]: pgmap v783: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-09-21T08:15:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:11 smithi006 ceph-mon[30970]: pgmap v783: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-09-21T08:15:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 735.0 s, 583.3 tps, lat 171.598 ms stddev 141.309 2024-09-21T08:15:13.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:13 smithi006 ceph-mon[30970]: pgmap v784: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-09-21T08:15:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:13 smithi119 ceph-mon[33564]: pgmap v784: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-09-21T08:15:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:13 smithi145 ceph-mon[34049]: pgmap v784: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-09-21T08:15:13.620 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:15:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8", 2024-09-21T08:15:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:15:13.621 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 -- 172.21.15.6:0/3920912843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 msgr2=0x7fddfc11efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 --2- 172.21.15.6:0/3920912843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc11efc0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fddf001a910 tx=0x7fddf003b420 comp rx=0 tx=0).stop 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 -- 172.21.15.6:0/3920912843 shutdown_connections 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 --2- 172.21.15.6:0/3920912843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc11efc0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 --2- 172.21.15.6:0/3920912843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddfc10ab80 0x7fddfc10af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 --2- 172.21.15.6:0/3920912843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc111d40 0x7fddfc10a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.324+0000 7fde0173e640 1 -- 172.21.15.6:0/3920912843 >> 172.21.15.6:0/3920912843 conn(0x7fddfc06d950 msgr2=0x7fddfc06dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.325+0000 7fde0173e640 1 -- 172.21.15.6:0/3920912843 shutdown_connections 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.325+0000 7fde0173e640 1 -- 172.21.15.6:0/3920912843 wait complete. 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.326+0000 7fde0173e640 1 Processor -- start 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.326+0000 7fde0173e640 1 -- start start 2024-09-21T08:15:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc10ab80 0x7fddfc11c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddfc111d40 0x7fddfc118680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc114af0 con 0x7fddfc11cba0 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc114970 con 0x7fddfc111d40 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fde0173e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc114c70 con 0x7fddfc10ab80 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35186/0 (socket says 172.21.15.6:35186) 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.327+0000 7fddfb7fe640 1 -- 172.21.15.6:0/3221283026 learned_addr learned my addr 172.21.15.6:0/3221283026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfaffd640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc10ab80 0x7fddfc11c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfb7fe640 1 -- 172.21.15.6:0/3221283026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc10ab80 msgr2=0x7fddfc11c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc10ab80 0x7fddfc11c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfb7fe640 1 -- 172.21.15.6:0/3221283026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddfc111d40 msgr2=0x7fddfc118680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:15:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddfc111d40 0x7fddfc118680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.328+0000 7fddfb7fe640 1 -- 172.21.15.6:0/3221283026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc119300 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fddf00051c0 tx=0x7fddf00051f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fdde3fff640 1 -- 172.21.15.6:0/3221283026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf004f070 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc1acc00 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc1ad0d0 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fdde3fff640 1 -- 172.21.15.6:0/3221283026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddf0040bb0 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.329+0000 7fdde3fff640 1 -- 172.21.15.6:0/3221283026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0046030 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.334+0000 7fdde3fff640 1 -- 172.21.15.6:0/3221283026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fddf0052070 con 0x7fddfc11cba0 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 Processor -- start 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 -- start start 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4cc2350 0x5618d5069610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c99490 0x5618d5069b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5618d4fdfe60 con 0x5618d4cc2350 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5618d4fcf290 con 0x5618d4c99490 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.336+0000 7fde07cb2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5618d4fd30a0 con 0x5618d4ca1670 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37806/0 (socket says 172.21.15.6:37806) 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 -- 172.21.15.6:0/986324892 learned_addr learned my addr 172.21.15.6:0/986324892 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfaffd640 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c99490 0x5618d5069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 -- 172.21.15.6:0/986324892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c99490 msgr2=0x5618d5069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c99490 0x5618d5069b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 -- 172.21.15.6:0/986324892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4cc2350 msgr2=0x5618d5069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4cc2350 0x5618d5069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.337+0000 7fddfa7fc640 1 -- 172.21.15.6:0/986324892 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d4d2d930 con 0x5618d4ca1670 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.338+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009da0 tx=0x7fddf400e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f29b59271f8a8543 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.338+0000 7fdde17fa640 1 -- 172.21.15.6:0/986324892 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4015070 con 0x5618d4ca1670 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.338+0000 7fdde17fa640 1 -- 172.21.15.6:0/986324892 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddf4005020 con 0x5618d4ca1670 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.338+0000 7fdde17fa640 1 -- 172.21.15.6:0/986324892 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf40116d0 con 0x5618d4ca1670 2024-09-21T08:15:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.338+0000 7fdde3fff640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 0x7fdde40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.339+0000 7fdde3fff640 1 -- 172.21.15.6:0/3221283026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7fddf0118ed0 con 0x7fddfc11cba0 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.340+0000 7fddfaffd640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 0x7fdde40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 -- 172.21.15.6:0/986324892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 msgr2=0x5618d506a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009da0 tx=0x7fddf400e6c0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 -- 172.21.15.6:0/986324892 shutdown_connections 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4ca1670 0x5618d506a090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c99490 0x5618d5069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 --2- 172.21.15.6:0/986324892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4cc2350 0x5618d5069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.341+0000 7fde07cb2740 1 -- 172.21.15.6:0/986324892 >> 172.21.15.6:0/986324892 conn(0x5618d4cb6740 msgr2=0x5618d5067500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.342+0000 7fde07cb2740 1 -- 172.21.15.6:0/986324892 shutdown_connections 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.342+0000 7fde07cb2740 1 -- 172.21.15.6:0/986324892 wait complete. 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.343+0000 7fddfaffd640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 0x7fdde40b8c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5618d5068290 tx=0x7fddec009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.343+0000 7fde07cb2740 1 -- start start 2024-09-21T08:15:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.343+0000 7fde07cb2740 1 Processor -- start 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.344+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.344+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d50757b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.344+0000 7fddfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.344+0000 7fddfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35202/0 (socket says 172.21.15.6:35202) 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.344+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4cc2350 0x5618d5081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fddfaffd640 1 -- 172.21.15.6:0/1960320242 learned_addr learned my addr 172.21.15.6:0/1960320242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5618d4e30890 con 0x5618d4c99490 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5618d4f69d40 con 0x5618d4ca1670 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5618d5077df0 con 0x5618d4cc2350 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d50757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4cc2350 0x5618d5081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.345+0000 7fde07cb2740 10 client.0 _ll_register_callbacks cb 0x5618d4fcdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 -- 172.21.15.6:0/1960320242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4cc2350 msgr2=0x5618d5081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4cc2350 0x5618d5081170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 -- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 msgr2=0x5618d50757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d50757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d5081760 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fddfaffd640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fddec0149f0 tx=0x7fddec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fbde8cdbb44d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fdddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec025070 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.346+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7fddec021600 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.347+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddf4005020 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.347+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fddec02f050 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.347+0000 7fde07cb2740 10 client.17568 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.347+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5618d5084100 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.348+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddec01b070 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.349+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fddec020070 con 0x5618d4c99490 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.349+0000 7fde07cb2740 10 client.17568 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.349+0000 7fde07cb2740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.349+0000 7fde07cb2740 20 client.17568 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.350+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4c80cd0 0x5618d5087700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.350+0000 7fde07cb2740 4 client.17568 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.350+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fddf4005020 con 0x5618d4c80cd0 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.350+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4c80cd0 0x5618d5087700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.351+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4c80cd0 0x5618d5087700 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7789346fc65636 server_cookie=6fe0ba835668ef84 in_seq=0 out_seq=0 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.351+0000 7fdddeff5640 10 client.17568 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.352+0000 7fdddeff5640 1 -- 172.21.15.6:0/1960320242 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fddf4005020 con 0x5618d4c80cd0 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.352+0000 7fdddeff5640 10 client.17568 handle_command_reply: tid=0 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.352+0000 7fde07cb2740 1 client.17568 shutdown 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 msgr2=0x5618d5075250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fddec0149f0 tx=0x7fddec0046c0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 shutdown_connections 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4c80cd0 0x5618d5087700 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4cc2350 0x5618d5081170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fdddeff5640 0 client.17568 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d50757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 --2- 172.21.15.6:0/1960320242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5075250 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 >> 172.21.15.6:0/1960320242 conn(0x5618d4cb6740 msgr2=0x5618d506c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 shutdown_connections 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.353+0000 7fde07cb2740 1 -- 172.21.15.6:0/1960320242 wait complete. 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.354+0000 7fde07cb2740 20 client.17568 trim_cache size 0 max 16384 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.382+0000 7fde07cb2740 1 Processor -- start 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.382+0000 7fde07cb2740 1 -- start start 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c99490 0x5618d50748e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 0x5618d506ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800e1c0 con 0x5618d4ca1670 2024-09-21T08:15:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8010a20 con 0x5618d4c80cd0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fde07cb2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800e810 con 0x5618d4c99490 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47248/0 (socket says 172.21.15.6:47248) 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 -- 172.21.15.6:0/242807939 learned_addr learned my addr 172.21.15.6:0/242807939 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 0x5618d506ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c99490 0x5618d50748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 -- 172.21.15.6:0/242807939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c99490 msgr2=0x5618d50748e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c99490 0x5618d50748e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 -- 172.21.15.6:0/242807939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 msgr2=0x5618d506ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 0x5618d506ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfaffd640 1 -- 172.21.15.6:0/242807939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d50760f0 con 0x5618d4c80cd0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.383+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 0x5618d506ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.384+0000 7fddfaffd640 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fddec016040 tx=0x7fddec029de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344211836a10136a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.384+0000 7fdde0ff9640 1 -- 172.21.15.6:0/242807939 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec018030 con 0x5618d4c80cd0 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.384+0000 7fdde0ff9640 1 -- 172.21.15.6:0/242807939 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddec01b070 con 0x5618d4c80cd0 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.384+0000 7fdde0ff9640 1 -- 172.21.15.6:0/242807939 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec025040 con 0x5618d4c80cd0 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 -- 172.21.15.6:0/242807939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 msgr2=0x5618d506ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fddec016040 tx=0x7fddec029de0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 -- 172.21.15.6:0/242807939 shutdown_connections 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c99490 0x5618d50748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4ca1670 0x5618d506ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.385+0000 7fde07cb2740 1 --2- 172.21.15.6:0/242807939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4c80cd0 0x5618d506ed90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.386+0000 7fde07cb2740 1 -- 172.21.15.6:0/242807939 >> 172.21.15.6:0/242807939 conn(0x5618d4cb6740 msgr2=0x5618d506a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.386+0000 7fde07cb2740 1 -- 172.21.15.6:0/242807939 shutdown_connections 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.386+0000 7fde07cb2740 1 -- 172.21.15.6:0/242807939 wait complete. 2024-09-21T08:15:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.386+0000 7fde07cb2740 1 -- start start 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.386+0000 7fde07cb2740 1 Processor -- start 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c80cd0 0x5618d507d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d507a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800eee0 con 0x5618d4c99490 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8010350 con 0x5618d4ca1670 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800f5b0 con 0x5618d4c80cd0 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35220/0 (socket says 172.21.15.6:35220) 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 -- 172.21.15.6:0/909574770 learned_addr learned my addr 172.21.15.6:0/909574770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d507a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfaffd640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c80cd0 0x5618d507d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fde07cb2740 10 client.0 _ll_register_callbacks cb 0x7fddec009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 -- 172.21.15.6:0/909574770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c80cd0 msgr2=0x5618d507d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c80cd0 0x5618d507d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 -- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 msgr2=0x5618d507a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d507a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfa7fc640 1 -- 172.21.15.6:0/909574770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d507a580 con 0x5618d4c99490 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.387+0000 7fddfb7fe640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d507a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fddfa7fc640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009d40 tx=0x7fddf4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0c9c97edc87408 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fdddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4015040 con 0x5618d4c99490 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9599+0+0 (secure 0 0 0) 0x7fddf4011880 con 0x5618d4c99490 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddec01b070 con 0x5618d4c99490 2024-09-21T08:15:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fddf403a050 con 0x5618d4c99490 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fde07cb2740 10 client.17574 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.388+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5618d50f2dd0 con 0x5618d4c99490 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddec01b070 con 0x5618d4c99490 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fddf400f040 con 0x5618d4c99490 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 10 client.17574 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 20 client.17574 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4cc2350 0x5618d50f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 4 client.17574 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.389+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618d4fe1db0 con 0x5618d4cc2350 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.390+0000 7fddfaffd640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4cc2350 0x5618d50f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.390+0000 7fdddeff5640 10 client.17574 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.390+0000 7fddfaffd640 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4cc2350 0x5618d50f5300 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c914c4bdc0b13606 server_cookie=7d2339d5b2c90277 in_seq=0 out_seq=0 2024-09-21T08:15:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fdddeff5640 1 -- 172.21.15.6:0/909574770 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618d4fe1db0 con 0x5618d4cc2350 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fdddeff5640 10 client.17574 handle_command_reply: tid=0 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 client.17574 shutdown 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 msgr2=0x5618d5079b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009d40 tx=0x7fddf4005fd0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 shutdown_connections 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5618d4cc2350 0x5618d50f5300 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5618d4ca1670 0x5618d507a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618d4c99490 0x5618d5079b00 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 --2- 172.21.15.6:0/909574770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5618d4c80cd0 0x5618d507d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 >> 172.21.15.6:0/909574770 conn(0x5618d4cb6740 msgr2=0x5618d5076500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fdddeff5640 0 client.17574 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 shutdown_connections 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 1 -- 172.21.15.6:0/909574770 wait complete. 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.392+0000 7fde07cb2740 20 client.17574 trim_cache size 0 max 16384 2024-09-21T08:15:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 msgr2=0x7fdde40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 0x7fdde40b8c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5618d5068290 tx=0x7fddec009110 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 msgr2=0x7fddfc118bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fddf00051c0 tx=0x7fddf00051f0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 shutdown_connections 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fdde40b6730 0x7fdde40b8c40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddfc11cba0 0x7fddfc118bc0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddfc111d40 0x7fddfc118680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 --2- 172.21.15.6:0/3221283026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddfc10ab80 0x7fddfc11c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 >> 172.21.15.6:0/3221283026 conn(0x7fddfc06d950 msgr2=0x7fddfc1109d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 shutdown_connections 2024-09-21T08:15:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:13.393+0000 7fde0173e640 1 -- 172.21.15.6:0/3221283026 wait complete. 2024-09-21T08:15:14.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:15:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:14.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:14 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:15:14.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:14 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:14 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:15:14.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:14 smithi006 ceph-mon[30970]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:15:14.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:14 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:14 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:15:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:14 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:14 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:15:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:14 smithi119 ceph-mon[33564]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:15:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:14 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:14 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:15:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:14 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:14 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:15:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:14 smithi145 ceph-mon[34049]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:15:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:14 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:14.996+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/979988472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810aee0 msgr2=0x7f0c38115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:14.996+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/979988472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810aee0 0x7f0c38115fd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009860 tx=0x7f0c2c02a340 comp rx=0 tx=0).stop 2024-09-21T08:15:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/979988472 shutdown_connections 2024-09-21T08:15:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/979988472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810aee0 0x7f0c38115fd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/979988472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c38116640 0x7f0c38118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/979988472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3810a590 0x7f0c3810a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/979988472 >> 172.21.15.6:0/979988472 conn(0x7f0c380712f0 msgr2=0x7f0c38073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/979988472 shutdown_connections 2024-09-21T08:15:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.000+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/979988472 wait complete. 2024-09-21T08:15:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.001+0000 7f0c3cc5a640 1 Processor -- start 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 -- start start 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 0x7f0c3811d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 0x7f0c38119710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3811e3b0 con 0x7f0c38116640 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.004+0000 7f0c3cc5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3811e230 con 0x7f0c3810aee0 2024-09-21T08:15:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.005+0000 7f0c3cc5a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3811e530 con 0x7f0c3810a590 2024-09-21T08:15:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.006+0000 7f0c36d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.006+0000 7f0c36d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35238/0 (socket says 172.21.15.6:35238) 2024-09-21T08:15:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.006+0000 7f0c36d9d640 1 -- 172.21.15.6:0/1763770744 learned_addr learned my addr 172.21.15.6:0/1763770744 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c3659c640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 0x7f0c3811d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c35d9b640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 0x7f0c38119710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c36d9d640 1 -- 172.21.15.6:0/1763770744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 msgr2=0x7f0c3811d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c36d9d640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 0x7f0c3811d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c36d9d640 1 -- 172.21.15.6:0/1763770744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 msgr2=0x7f0c38119710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c36d9d640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 0x7f0c38119710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c36d9d640 1 -- 172.21.15.6:0/1763770744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c381a4b90 con 0x7f0c38116640 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c3659c640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 0x7f0c3811d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.007+0000 7f0c35d9b640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 0x7f0c38119710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.008+0000 7f0c36d9d640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000b970 tx=0x7f0c3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.008+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30019070 con 0x7f0c38116640 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.008+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c381a4e80 con 0x7f0c38116640 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.009+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c381a5390 con 0x7f0c38116640 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.009+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c30014440 con 0x7f0c38116640 2024-09-21T08:15:15.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.009+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c300075d0 con 0x7f0c38116640 2024-09-21T08:15:15.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.012+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c180052c0 con 0x7f0c38116640 2024-09-21T08:15:15.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.015+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0c3001c070 con 0x7f0c38116640 2024-09-21T08:15:15.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.016+0000 7f0c277fe640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 0x7f0c200b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.017+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9511+0+0 (secure 0 0 0) 0x7f0c300e6dd0 con 0x7f0c38116640 2024-09-21T08:15:15.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.018+0000 7f0c3659c640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 0x7f0c200b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.019+0000 7f0c3659c640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 0x7f0c200b8d60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0c3811d180 tx=0x7f0c28009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.026+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c300ea030 con 0x7f0c38116640 2024-09-21T08:15:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:15.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.469+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c18005880 con 0x7f0c38116640 2024-09-21T08:15:15.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.470+0000 7f0c277fe640 1 -- 172.21.15.6:0/1763770744 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f0c300acee0 con 0x7f0c38116640 2024-09-21T08:15:15.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:15.471 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:15.472 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:15.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 msgr2=0x7f0c200b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 0x7f0c200b8d60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0c3811d180 tx=0x7f0c28009260 comp rx=0 tx=0).stop 2024-09-21T08:15:15.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 msgr2=0x7f0c38119e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000b970 tx=0x7f0c3000be30 comp rx=0 tx=0).stop 2024-09-21T08:15:15.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 shutdown_connections 2024-09-21T08:15:15.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0c200b6850 0x7f0c200b8d60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c38116640 0x7f0c38119e30 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c3810aee0 0x7f0c38119710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 --2- 172.21.15.6:0/1763770744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c3810a590 0x7f0c3811d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.472+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 >> 172.21.15.6:0/1763770744 conn(0x7f0c380712f0 msgr2=0x7f0c38072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.473+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 shutdown_connections 2024-09-21T08:15:15.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.473+0000 7f0c3cc5a640 1 -- 172.21.15.6:0/1763770744 wait complete. 2024-09-21T08:15:15.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:15 smithi006 ceph-mon[30970]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T08:15:15.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:15 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1763770744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:15 smithi119 ceph-mon[33564]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T08:15:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:15 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1763770744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:15.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 -- 172.21.15.6:0/1083730317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424077380 msgr2=0x7f24240757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 --2- 172.21.15.6:0/1083730317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424077380 0x7f24240757b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2414009900 tx=0x7f241402a420 comp rx=0 tx=0).stop 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 -- 172.21.15.6:0/1083730317 shutdown_connections 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 --2- 172.21.15.6:0/1083730317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 0x7f24240761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 --2- 172.21.15.6:0/1083730317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424114460 0x7f2424116930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 --2- 172.21.15.6:0/1083730317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424077380 0x7f24240757b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.727+0000 7f24295a1640 1 -- 172.21.15.6:0/1083730317 >> 172.21.15.6:0/1083730317 conn(0x7f24240ff600 msgr2=0x7f2424101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.728+0000 7f24295a1640 1 -- 172.21.15.6:0/1083730317 shutdown_connections 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.728+0000 7f24295a1640 1 -- 172.21.15.6:0/1083730317 wait complete. 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.728+0000 7f24295a1640 1 Processor -- start 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 -- start start 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 0x7f24241a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424114460 0x7f24241a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2424119fb0 con 0x7f2424114460 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2424119e30 con 0x7f2424077380 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24295a1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f242411a130 con 0x7f2424075dd0 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.729+0000 7f24227fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47282/0 (socket says 172.21.15.6:47282) 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 -- 172.21.15.6:0/1703507027 learned_addr learned my addr 172.21.15.6:0/1703507027 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f2422ffd640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 0x7f24241a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24237fe640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424114460 0x7f24241a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 -- 172.21.15.6:0/1703507027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 msgr2=0x7f24241a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 0x7f24241a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 -- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424114460 msgr2=0x7f24241a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424114460 0x7f24241a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 -- 172.21.15.6:0/1703507027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24241a6980 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.730+0000 7f24227fc640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f241c00ba10 tx=0x7f241c00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.731+0000 7f241bfff640 1 -- 172.21.15.6:0/1703507027 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c019070 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.732+0000 7f241bfff640 1 -- 172.21.15.6:0/1703507027 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f241c00cbd0 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.732+0000 7f241bfff640 1 -- 172.21.15.6:0/1703507027 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c0125a0 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.732+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24241a6c70 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.732+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2424107b50 con 0x7f2424077380 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.737+0000 7f242fb15740 1 Processor -- start 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.738+0000 7f242fb15740 1 -- start start 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.738+0000 7f242fb15740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f242fb15740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e393b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f242fb15740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfcb390 0x560b8e3940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f242fb15740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560b8e309e50 con 0x560b8dfc31b0 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f242fb15740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b8e2f9280 con 0x560b8dfcb390 2024-09-21T08:15:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f242fb15740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560b8e2fd090 con 0x560b8dfec070 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f24237fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f24237fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37878/0 (socket says 172.21.15.6:37878) 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f24237fe640 1 -- 172.21.15.6:0/963592700 learned_addr learned my addr 172.21.15.6:0/963592700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.739+0000 7f2422ffd640 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e393b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.743+0000 7f24237fe640 1 -- 172.21.15.6:0/963592700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfcb390 msgr2=0x560b8e3940d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.743+0000 7f24237fe640 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfcb390 0x560b8e3940d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.743+0000 7f24237fe640 1 -- 172.21.15.6:0/963592700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 msgr2=0x560b8e393b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.743+0000 7f24237fe640 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e393b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.743+0000 7f24237fe640 1 -- 172.21.15.6:0/963592700 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8e057650 con 0x560b8dfec070 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.745+0000 7f24237fe640 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f240c009b40 tx=0x7f240c00e2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85abd17d9010d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.747+0000 7f24197fa640 1 -- 172.21.15.6:0/963592700 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c016070 con 0x560b8dfec070 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.747+0000 7f24197fa640 1 -- 172.21.15.6:0/963592700 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f240c00ed20 con 0x560b8dfec070 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.747+0000 7f24197fa640 1 -- 172.21.15.6:0/963592700 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0106c0 con 0x560b8dfec070 2024-09-21T08:15:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.747+0000 7f241bfff640 1 -- 172.21.15.6:0/1703507027 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f241c01c070 con 0x7f2424077380 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.748+0000 7f241bfff640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 0x7f24100b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.749+0000 7f241bfff640 1 -- 172.21.15.6:0/1703507027 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9511+0+0 (secure 0 0 0) 0x7f241c0e6f20 con 0x7f2424077380 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.749+0000 7f242fb15740 1 -- 172.21.15.6:0/963592700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 msgr2=0x560b8e393650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.749+0000 7f242fb15740 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f240c009b40 tx=0x7f240c00e2f0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f242fb15740 1 -- 172.21.15.6:0/963592700 shutdown_connections 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f242fb15740 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfcb390 0x560b8e3940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f242fb15740 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e393b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f242fb15740 1 --2- 172.21.15.6:0/963592700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfec070 0x560b8e393650 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f242fb15740 1 -- 172.21.15.6:0/963592700 >> 172.21.15.6:0/963592700 conn(0x560b8dfe0460 msgr2=0x560b8e391540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.750+0000 7f2422ffd640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 0x7f24100b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.751+0000 7f242fb15740 1 -- 172.21.15.6:0/963592700 shutdown_connections 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.751+0000 7f242fb15740 1 -- 172.21.15.6:0/963592700 wait complete. 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.752+0000 7f2422ffd640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 0x7f24100b8d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24140057c0 tx=0x7f24140058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.752+0000 7f242fb15740 1 -- start start 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.752+0000 7f242fb15740 1 Processor -- start 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e39ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e39f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560b8e15a700 con 0x560b8dfcb390 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b8e294110 con 0x560b8dfec070 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.753+0000 7f242fb15740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560b8e3a1e30 con 0x560b8dfc31b0 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e39ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e39ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:37884/0 (socket says 172.21.15.6:37884) 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f2422ffd640 1 -- 172.21.15.6:0/459995648 learned_addr learned my addr 172.21.15.6:0/459995648 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f242fb15740 10 client.0 _ll_register_callbacks cb 0x560b8e2ad990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 -- 172.21.15.6:0/459995648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 msgr2=0x560b8e39ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e39ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 -- 172.21.15.6:0/459995648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 msgr2=0x560b8e39f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e39f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 -- 172.21.15.6:0/459995648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8e2c1c40 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.754+0000 7f24237fe640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f240c011f10 tx=0x7f240c0056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47797567d0348bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f240a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c016070 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9511+0+0 (secure 0 0 0) 0x7f240c004240 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f240c00ed20 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f240c009740 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f242fb15740 10 client.27215 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560b8e3adc40 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.755+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f240c00ed20 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f240c00f040 con 0x560b8dfec070 2024-09-21T08:15:15.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 10 client.27215 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 10 client.27215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 20 client.27215 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8dfaa9f0 0x560b8e3b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 4 client.27215 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.756+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b8e30bda0 con 0x560b8dfaa9f0 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.757+0000 7f2422ffd640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8dfaa9f0 0x560b8e3b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.757+0000 7f2422ffd640 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8dfaa9f0 0x560b8e3b0fa0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde7519883a213b0 server_cookie=9158f50b891e1875 in_seq=0 out_seq=0 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.757+0000 7f240a7fc640 10 client.27215 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.761+0000 7f240a7fc640 1 -- 172.21.15.6:0/459995648 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b8e30bda0 con 0x560b8dfaa9f0 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.761+0000 7f240a7fc640 10 client.27215 handle_command_reply: tid=0 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.761+0000 7f242fb15740 1 client.27215 shutdown 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 msgr2=0x560b8e3ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f240c011f10 tx=0x7f240c0056e0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 shutdown_connections 2024-09-21T08:15:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8dfaa9f0 0x560b8e3b0fa0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e39f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 --2- 172.21.15.6:0/459995648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e39ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 >> 172.21.15.6:0/459995648 conn(0x560b8dfe0460 msgr2=0x560b8e3967e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.762+0000 7f240a7fc640 0 client.27215 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.763+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 shutdown_connections 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.763+0000 7f242fb15740 1 -- 172.21.15.6:0/459995648 wait complete. 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.765+0000 7f242fb15740 20 client.27215 trim_cache size 0 max 16384 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.802+0000 7f242fb15740 1 Processor -- start 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 -- start start 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e395040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfcb390 0x560b8e3a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f242410fe30 con 0x560b8dfc31b0 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f24241c0740 con 0x560b8dfec070 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.805+0000 7f242fb15740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f24241be530 con 0x560b8dfcb390 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.806+0000 7f24237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.806+0000 7f24237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47302/0 (socket says 172.21.15.6:47302) 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.806+0000 7f24237fe640 1 -- 172.21.15.6:0/2704325891 learned_addr learned my addr 172.21.15.6:0/2704325891 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.806+0000 7f2422ffd640 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e395040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.806+0000 7f24227fc640 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfcb390 0x560b8e3a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 -- 172.21.15.6:0/2704325891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfcb390 msgr2=0x560b8e3a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfcb390 0x560b8e3a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 -- 172.21.15.6:0/2704325891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 msgr2=0x560b8e395040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e395040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 -- 172.21.15.6:0/2704325891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8dfaac20 con 0x560b8dfec070 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f24237fe640 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f240c005880 tx=0x7f240c009a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6552b84d9e3a9f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f2418ff9640 1 -- 172.21.15.6:0/2704325891 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c036070 con 0x560b8dfec070 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f2418ff9640 1 -- 172.21.15.6:0/2704325891 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f240c0035f0 con 0x560b8dfec070 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.807+0000 7f2418ff9640 1 -- 172.21.15.6:0/2704325891 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c016070 con 0x560b8dfec070 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.809+0000 7f242fb15740 1 -- 172.21.15.6:0/2704325891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 msgr2=0x560b8e3ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.809+0000 7f242fb15740 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f240c005880 tx=0x7f240c009a40 comp rx=0 tx=0).stop 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 -- 172.21.15.6:0/2704325891 shutdown_connections 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfcb390 0x560b8e3a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e3ab090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 --2- 172.21.15.6:0/2704325891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfc31b0 0x560b8e395040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 -- 172.21.15.6:0/2704325891 >> 172.21.15.6:0/2704325891 conn(0x560b8dfe0460 msgr2=0x560b8e3a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.811+0000 7f242fb15740 1 -- 172.21.15.6:0/2704325891 shutdown_connections 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.812+0000 7f242fb15740 1 -- 172.21.15.6:0/2704325891 wait complete. 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.812+0000 7f242fb15740 1 -- start start 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.812+0000 7f242fb15740 1 Processor -- start 2024-09-21T08:15:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e40f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e40fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e410130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f24241bec00 con 0x560b8dfcb390 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f24241c0070 con 0x560b8dfec070 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f24241bf2d0 con 0x560b8dfc31b0 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.813+0000 7f242fb15740 10 client.0 _ll_register_callbacks cb 0x7f2414005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.815+0000 7f24227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e40fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.815+0000 7f24227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e40fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35298/0 (socket says 172.21.15.6:35298) 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.815+0000 7f24227fc640 1 -- 172.21.15.6:0/3459490509 learned_addr learned my addr 172.21.15.6:0/3459490509 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.816+0000 7f2422ffd640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e40f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.816+0000 7f24237fe640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e410130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.817+0000 7f2422ffd640 1 -- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 msgr2=0x560b8e410130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.817+0000 7f2422ffd640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e410130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.817+0000 7f2422ffd640 1 -- 172.21.15.6:0/3459490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 msgr2=0x560b8e40fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.817+0000 7f2422ffd640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e40fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.817+0000 7f2422ffd640 1 -- 172.21.15.6:0/3459490509 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8e41a730 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.819+0000 7f2422ffd640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e40f6b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x560b8e2941d0 tx=0x7f241403f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f0b308973487f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.819+0000 7f240a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.819+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414035040 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.819+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f240c0035f0 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.819+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9511+0+0 (secure 0 0 0) 0x7f2414003a00 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.820+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2414061050 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.823+0000 7f242fb15740 10 client.27310 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.823+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560b8e41ba00 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.824+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f240c0035f0 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.824+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2414044040 con 0x560b8dfc31b0 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.825+0000 7f242fb15740 10 client.27310 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.825+0000 7f242fb15740 10 client.27310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.826+0000 7f242fb15740 20 client.27310 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.826+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8df7fda0 0x560b8e41e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.826+0000 7f242fb15740 4 client.27310 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.826+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b8e307850 con 0x560b8df7fda0 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.826+0000 7f24227fc640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8df7fda0 0x560b8e41e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.827+0000 7f24227fc640 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8df7fda0 0x560b8e41e1e0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6801069096a98a32 server_cookie=b49a16f20e4b3e65 in_seq=0 out_seq=0 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.827+0000 7f240a7fc640 10 client.27310 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f240a7fc640 1 -- 172.21.15.6:0/3459490509 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x560b8e307850 con 0x560b8df7fda0 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f240a7fc640 10 client.27310 handle_command_reply: tid=0 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 client.27310 shutdown 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 msgr2=0x560b8e40f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e40f6b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x560b8e2941d0 tx=0x7f241403f040 comp rx=0 tx=0).stop 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 shutdown_connections 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x560b8df7fda0 0x560b8e41e1e0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b8dfec070 0x560b8e410130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560b8dfcb390 0x560b8e40fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 --2- 172.21.15.6:0/3459490509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560b8dfc31b0 0x560b8e40f6b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 >> 172.21.15.6:0/3459490509 conn(0x560b8dfe0460 msgr2=0x560b8e3a0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:15:15.927 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:15:15.929 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.930 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.931 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.932 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:15:15.933 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:15:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.937 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.938 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:15:15.939 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f240a7fc640 0 client.27310 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.828+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 shutdown_connections 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.829+0000 7f242fb15740 1 -- 172.21.15.6:0/3459490509 wait complete. 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.829+0000 7f242fb15740 20 client.27310 trim_cache size 0 max 16384 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 msgr2=0x7f24100b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 0x7f24100b8d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24140057c0 tx=0x7f24140058d0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 msgr2=0x7f24241a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f241c00ba10 tx=0x7f241c00bed0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 shutdown_connections 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f24100b6850 0x7f24100b8d60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2424114460 0x7f24241a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2424077380 0x7f24241a0fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 --2- 172.21.15.6:0/1703507027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2424075dd0 0x7f24241a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.830+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 >> 172.21.15.6:0/1703507027 conn(0x7f24240ff600 msgr2=0x7f2424110360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.831+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 shutdown_connections 2024-09-21T08:15:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:15.831+0000 7f24295a1640 1 -- 172.21.15.6:0/1703507027 wait complete. 2024-09-21T08:15:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:15 smithi145 ceph-mon[34049]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T08:15:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:15 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1763770744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:16.659 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:15:16.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:16.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:16 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:15:16.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:16 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:15:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:16 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:15:17.202 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T08:15:17.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T08:15:17.289 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 740.0 s, 503.0 tps, lat 196.110 ms stddev 179.292 2024-09-21T08:15:17.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:17 smithi006 ceph-mon[30970]: pgmap v787: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.1 MiB/s wr, 551 op/s 2024-09-21T08:15:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:17 smithi119 ceph-mon[33564]: pgmap v787: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.1 MiB/s wr, 551 op/s 2024-09-21T08:15:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:17 smithi145 ceph-mon[34049]: pgmap v787: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.1 MiB/s wr, 551 op/s 2024-09-21T08:15:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 -- 172.21.15.6:0/392976630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac109f70 msgr2=0x7f61ac1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 --2- 172.21.15.6:0/392976630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac109f70 0x7f61ac1106d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009be0 tx=0x7f61a402a6c0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 -- 172.21.15.6:0/392976630 shutdown_connections 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 --2- 172.21.15.6:0/392976630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac109f70 0x7f61ac1106d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 --2- 172.21.15.6:0/392976630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109620 0x7f61ac109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 --2- 172.21.15.6:0/392976630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac101be0 0x7f61ac101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 -- 172.21.15.6:0/392976630 >> 172.21.15.6:0/392976630 conn(0x7f61ac077800 msgr2=0x7f61ac077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 -- 172.21.15.6:0/392976630 shutdown_connections 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.470+0000 7f61b0baf640 1 -- 172.21.15.6:0/392976630 wait complete. 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.471+0000 7f61b0baf640 1 Processor -- start 2024-09-21T08:15:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.471+0000 7f61b0baf640 1 -- start start 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 0x7f61ac1a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109f70 0x7f61ac1a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac1139a0 con 0x7f61ac109f70 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac113820 con 0x7f61ac101be0 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61b0baf640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac113b20 con 0x7f61ac109620 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:37016/0 (socket says 172.21.15.6:37016) 2024-09-21T08:15:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.472+0000 7f61aa59c640 1 -- 172.21.15.6:0/1320826402 learned_addr learned my addr 172.21.15.6:0/1320826402 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aad9d640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109f70 0x7f61ac1a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61a9d9b640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 0x7f61ac1a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aa59c640 1 -- 172.21.15.6:0/1320826402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 msgr2=0x7f61ac1a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aa59c640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 0x7f61ac1a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aa59c640 1 -- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109f70 msgr2=0x7f61ac1a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aa59c640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109f70 0x7f61ac1a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61aa59c640 1 -- 172.21.15.6:0/1320826402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac1ac8c0 con 0x7f61ac101be0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.473+0000 7f61a9d9b640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 0x7f61ac1a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61aa59c640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f619c00b4a0 tx=0x7f619c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c014070 con 0x7f61ac101be0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f619c010aa0 con 0x7f61ac101be0 2024-09-21T08:15:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac1acbb0 con 0x7f61ac101be0 2024-09-21T08:15:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c017b70 con 0x7f61ac101be0 2024-09-21T08:15:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.474+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac1ad0e0 con 0x7f61ac101be0 2024-09-21T08:15:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.476+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac1087e0 con 0x7f61ac101be0 2024-09-21T08:15:18.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.478+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f619c017070 con 0x7f61ac101be0 2024-09-21T08:15:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.480+0000 7f61a37fe640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 0x7f61980b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.480+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9511+0+0 (secure 0 0 0) 0x7f619c0e7040 con 0x7f61ac101be0 2024-09-21T08:15:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.481+0000 7f61a9d9b640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 0x7f61980b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.481+0000 7f61a9d9b640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 0x7f61980b8c40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ff820 tx=0x7f6194009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.483+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f619c0ad1b0 con 0x7f61ac101be0 2024-09-21T08:15:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:18.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.921+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61ac1ad630 con 0x7f61ac101be0 2024-09-21T08:15:18.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.923+0000 7f61a37fe640 1 -- 172.21.15.6:0/1320826402 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f619c0a8070 con 0x7f61ac101be0 2024-09-21T08:15:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:18.929 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 msgr2=0x7f61980b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 0x7f61980b8c40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ff820 tx=0x7f6194009260 comp rx=0 tx=0).stop 2024-09-21T08:15:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 msgr2=0x7f61ac1a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f619c00b4a0 tx=0x7f619c00b960 comp rx=0 tx=0).stop 2024-09-21T08:15:18.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 shutdown_connections 2024-09-21T08:15:18.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f61980b6730 0x7f61980b8c40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f61ac109620 0x7f61ac1a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ac109f70 0x7f61ac1a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.927+0000 7f61b0baf640 1 --2- 172.21.15.6:0/1320826402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac101be0 0x7f61ac1a1680 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:18.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.928+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 >> 172.21.15.6:0/1320826402 conn(0x7f61ac077800 msgr2=0x7f61ac10a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:18.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.928+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 shutdown_connections 2024-09-21T08:15:18.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:18.928+0000 7f61b0baf640 1 -- 172.21.15.6:0/1320826402 wait complete. 2024-09-21T08:15:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.198+0000 7f257559a640 1 -- 172.21.15.6:0/670635086 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600307b0 con 0x7f2578108d10 2024-09-21T08:15:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 -- 172.21.15.6:0/670635086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 msgr2=0x7f257810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 --2- 172.21.15.6:0/670635086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f257810f540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2560009860 tx=0x7f256002a340 comp rx=0 tx=0).stop 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 -- 172.21.15.6:0/670635086 shutdown_connections 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 --2- 172.21.15.6:0/670635086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f257810f540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 --2- 172.21.15.6:0/670635086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25781083c0 0x7f25781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 --2- 172.21.15.6:0/670635086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2578102a80 0x7f2578102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.199+0000 7f257cdd1640 1 -- 172.21.15.6:0/670635086 >> 172.21.15.6:0/670635086 conn(0x7f2578079760 msgr2=0x7f2578079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.200+0000 7f257cdd1640 1 -- 172.21.15.6:0/670635086 shutdown_connections 2024-09-21T08:15:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.200+0000 7f257cdd1640 1 -- 172.21.15.6:0/670635086 wait complete. 2024-09-21T08:15:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.201+0000 7f257cdd1640 1 Processor -- start 2024-09-21T08:15:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.201+0000 7f257cdd1640 1 -- start start 2024-09-21T08:15:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2578102a80 0x7f25781a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f25781ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2578113980 con 0x7f2578102a80 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2578113800 con 0x7f25781083c0 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257cdd1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2578113b00 con 0x7f2578108d10 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f2575d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f2575d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:37042/0 (socket says 172.21.15.6:37042) 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f2575d9b640 1 -- 172.21.15.6:0/1548578749 learned_addr learned my addr 172.21.15.6:0/1548578749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f257659c640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2578102a80 0x7f25781a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.202+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f25781ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2575d9b640 1 -- 172.21.15.6:0/1548578749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 msgr2=0x7f25781ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2575d9b640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f25781ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2575d9b640 1 -- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2578102a80 msgr2=0x7f25781a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2575d9b640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2578102a80 0x7f25781a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2575d9b640 1 -- 172.21.15.6:0/1548578749 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25781a2410 con 0x7f25781083c0 2024-09-21T08:15:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.203+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f25781ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.204+0000 7f2575d9b640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f256800e9c0 tx=0x7f256800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.204+0000 7f256f7fe640 1 -- 172.21.15.6:0/1548578749 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256800cd80 con 0x7f25781083c0 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.204+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25781acce0 con 0x7f25781083c0 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.204+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25781ad190 con 0x7f25781083c0 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.204+0000 7f256f7fe640 1 -- 172.21.15.6:0/1548578749 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25680054b0 con 0x7f25781083c0 2024-09-21T08:15:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.205+0000 7f256f7fe640 1 -- 172.21.15.6:0/1548578749 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568010430 con 0x7f25781083c0 2024-09-21T08:15:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.208+0000 7f2583345740 1 Processor -- start 2024-09-21T08:15:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 -- start start 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd08e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fc7fbb0 con 0x55ca0f941b70 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fc6efe0 con 0x55ca0f962850 2024-09-21T08:15:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.209+0000 7f2583345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fc72df0 con 0x55ca0f939990 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:33166/0 (socket says 172.21.15.6:33166) 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 -- 172.21.15.6:0/4283496614 learned_addr learned my addr 172.21.15.6:0/4283496614 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f256f7fe640 1 -- 172.21.15.6:0/1548578749 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f25680105d0 con 0x7f25781083c0 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 -- 172.21.15.6:0/4283496614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 msgr2=0x55ca0fd08e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd08e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 -- 172.21.15.6:0/4283496614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 msgr2=0x55ca0fd098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.210+0000 7f257659c640 1 -- 172.21.15.6:0/4283496614 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca0f9dcba0 con 0x55ca0f939990 2024-09-21T08:15:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.211+0000 7f257659c640 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f50 tx=0x7f257000f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edecd0747523a55d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.211+0000 7f256cff9640 1 -- 172.21.15.6:0/4283496614 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570004b20 con 0x55ca0f939990 2024-09-21T08:15:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.213+0000 7f256cff9640 1 -- 172.21.15.6:0/4283496614 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2570004cc0 con 0x55ca0f939990 2024-09-21T08:15:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.213+0000 7f256cff9640 1 -- 172.21.15.6:0/4283496614 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25700053e0 con 0x55ca0f939990 2024-09-21T08:15:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.213+0000 7f256f7fe640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 0x7f25640b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.213+0000 7f256f7fe640 1 -- 172.21.15.6:0/1548578749 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f25680e7f10 con 0x7f25781083c0 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.217+0000 7f2583345740 1 -- 172.21.15.6:0/4283496614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 msgr2=0x55ca0fd093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.217+0000 7f2583345740 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f50 tx=0x7f257000f890 comp rx=0 tx=0).stop 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.217+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 0x7f25640b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 -- 172.21.15.6:0/4283496614 shutdown_connections 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd093b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 --2- 172.21.15.6:0/4283496614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd08e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 -- 172.21.15.6:0/4283496614 >> 172.21.15.6:0/4283496614 conn(0x55ca0f956c40 msgr2=0x55ca0fd06d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 -- 172.21.15.6:0/4283496614 shutdown_connections 2024-09-21T08:15:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 -- 172.21.15.6:0/4283496614 wait complete. 2024-09-21T08:15:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.218+0000 7f2583345740 1 -- start start 2024-09-21T08:15:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 Processor -- start 2024-09-21T08:15:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd14a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd14fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fad07b0 con 0x55ca0f939990 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fc09e90 con 0x55ca0f962850 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ca0fd17650 con 0x55ca0f941b70 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.219+0000 7f2583345740 10 client.0 _ll_register_callbacks cb 0x55ca0fc6c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.220+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 0x7f25640b8c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2560009830 tx=0x7f256002cca0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.220+0000 7f2576d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.220+0000 7f2576d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:37046/0 (socket says 172.21.15.6:37046) 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.220+0000 7f2576d9d640 1 -- 172.21.15.6:0/1784871019 learned_addr learned my addr 172.21.15.6:0/1784871019 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.220+0000 7f2575d9b640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd14fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.221+0000 7f257659c640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd14a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.222+0000 7f2576d9d640 1 -- 172.21.15.6:0/1784871019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 msgr2=0x55ca0fd14fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.222+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd14fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.222+0000 7f2576d9d640 1 -- 172.21.15.6:0/1784871019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 msgr2=0x55ca0fd14a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.222+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd14a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.222+0000 7f2576d9d640 1 -- 172.21.15.6:0/1784871019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca0fd31f70 con 0x55ca0f962850 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.223+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2560034000 tx=0x7f2560005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36ccff80be3d184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.223+0000 7f255dffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:15:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.223+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256004d070 con 0x55ca0f962850 2024-09-21T08:15:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.223+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2570004cc0 con 0x55ca0f962850 2024-09-21T08:15:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.223+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f2560030750 con 0x55ca0f962850 2024-09-21T08:15:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.224+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2560059050 con 0x55ca0f962850 2024-09-21T08:15:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.225+0000 7f2583345740 10 client.27236 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ca0fd348d0 con 0x55ca0f962850 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2570004cc0 con 0x55ca0f962850 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2560048070 con 0x55ca0f962850 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 10 client.27236 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 10 client.27236 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 20 client.27236 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f9211d0 0x55ca0fd382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 4 client.27236 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.226+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca0fc81b00 con 0x55ca0f9211d0 2024-09-21T08:15:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.227+0000 7f257659c640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f9211d0 0x55ca0fd382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.228+0000 7f257659c640 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f9211d0 0x55ca0fd382a0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97f4ea84410c844 server_cookie=505b77eb08cf43f4 in_seq=0 out_seq=0 2024-09-21T08:15:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.228+0000 7f255dffb640 10 client.27236 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.229+0000 7f255dffb640 1 -- 172.21.15.6:0/1784871019 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca0fc81b00 con 0x55ca0f9211d0 2024-09-21T08:15:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.229+0000 7f255dffb640 10 client.27236 handle_command_reply: tid=0 2024-09-21T08:15:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.229+0000 7f2583345740 1 client.27236 shutdown 2024-09-21T08:15:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 msgr2=0x55ca0fd209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2560034000 tx=0x7f2560005f90 comp rx=0 tx=0).stop 2024-09-21T08:15:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 shutdown_connections 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f9211d0 0x55ca0fd382a0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd14fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd209d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 --2- 172.21.15.6:0/1784871019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd14a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.230+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 >> 172.21.15.6:0/1784871019 conn(0x55ca0f956c40 msgr2=0x55ca0fd0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.231+0000 7f255dffb640 0 client.27236 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:19.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.236+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 shutdown_connections 2024-09-21T08:15:19.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.236+0000 7f2583345740 1 -- 172.21.15.6:0/1784871019 wait complete. 2024-09-21T08:15:19.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.236+0000 7f2583345740 20 client.27236 trim_cache size 0 max 16384 2024-09-21T08:15:19.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.272+0000 7f2583345740 1 Processor -- start 2024-09-21T08:15:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.272+0000 7f2583345740 1 -- start start 2024-09-21T08:15:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd10010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd0ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f255800e090 con 0x55ca0f941b70 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25580108f0 con 0x55ca0f962850 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2583345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f255800e6e0 con 0x55ca0f939990 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2576d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f257659c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd10010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2576d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:37048/0 (socket says 172.21.15.6:37048) 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.273+0000 7f2576d9d640 1 -- 172.21.15.6:0/1292787361 learned_addr learned my addr 172.21.15.6:0/1292787361 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.274+0000 7f2576d9d640 1 -- 172.21.15.6:0/1292787361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 msgr2=0x55ca0fd10010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.274+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd10010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.274+0000 7f2576d9d640 1 -- 172.21.15.6:0/1292787361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 msgr2=0x55ca0fd0ef90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.274+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd0ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.274+0000 7f2576d9d640 1 -- 172.21.15.6:0/1292787361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca0fd38810 con 0x55ca0f962850 2024-09-21T08:15:19.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.275+0000 7f2576d9d640 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f256002d020 tx=0x7f2560004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655e33b401b1be41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.276+0000 7f255ffff640 1 -- 172.21.15.6:0/1292787361 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560056030 con 0x55ca0f962850 2024-09-21T08:15:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.276+0000 7f255ffff640 1 -- 172.21.15.6:0/1292787361 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2560043070 con 0x55ca0f962850 2024-09-21T08:15:19.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.276+0000 7f255ffff640 1 -- 172.21.15.6:0/1292787361 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256004d070 con 0x55ca0f962850 2024-09-21T08:15:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 -- 172.21.15.6:0/1292787361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 msgr2=0x55ca0fd16490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f256002d020 tx=0x7f2560004510 comp rx=0 tx=0).stop 2024-09-21T08:15:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 -- 172.21.15.6:0/1292787361 shutdown_connections 2024-09-21T08:15:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd16490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f941b70 0x55ca0fd0ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 --2- 172.21.15.6:0/1292787361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f939990 0x55ca0fd10010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.277+0000 7f2583345740 1 -- 172.21.15.6:0/1292787361 >> 172.21.15.6:0/1292787361 conn(0x55ca0f956c40 msgr2=0x55ca0fd15d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.278+0000 7f2583345740 1 -- 172.21.15.6:0/1292787361 shutdown_connections 2024-09-21T08:15:19.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.279+0000 7f2583345740 1 -- 172.21.15.6:0/1292787361 wait complete. 2024-09-21T08:15:19.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.279+0000 7f2583345740 1 -- start start 2024-09-21T08:15:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 Processor -- start 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd18940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd18e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f255800edb0 con 0x55ca0f939990 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2558010220 con 0x55ca0f962850 2024-09-21T08:15:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f255800f480 con 0x55ca0f941b70 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.280+0000 7f2583345740 10 client.0 _ll_register_callbacks cb 0x7f25600096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f257659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd18940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd18e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f257659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd18940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39316/0 (socket says 172.21.15.6:39316) 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f257659c640 1 -- 172.21.15.6:0/2370928206 learned_addr learned my addr 172.21.15.6:0/2370928206 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2576d9d640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 -- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 msgr2=0x55ca0fd193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 -- 172.21.15.6:0/2370928206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 msgr2=0x55ca0fd18940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd18940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 -- 172.21.15.6:0/2370928206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca0fda1c40 con 0x55ca0f941b70 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f2575d9b640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd18e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25680e5250 tx=0x7f2568004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b1beb5a5fa6401 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.281+0000 7f255dffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680ad2a0 con 0x55ca0f941b70 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f25680a94a0 con 0x55ca0f941b70 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2560043070 con 0x55ca0f941b70 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f25680c8050 con 0x55ca0f941b70 2024-09-21T08:15:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f2583345740 10 client.27331 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ca0fda2ee0 con 0x55ca0f941b70 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.282+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2560043070 con 0x55ca0f941b70 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f25680ac620 con 0x55ca0f941b70 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 10 client.27331 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 10 client.27331 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 20 client.27331 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f8f6580 0x55ca0fda5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 4 client.27331 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.283+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x55ca0fc7d5b0 con 0x55ca0f8f6580 2024-09-21T08:15:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.284+0000 7f257659c640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f8f6580 0x55ca0fda5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.289+0000 7f255dffb640 10 client.27331 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.289+0000 7f257659c640 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f8f6580 0x55ca0fda5760 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=801ee092d5da30cf server_cookie=845a1f44600f28f5 in_seq=0 out_seq=0 2024-09-21T08:15:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f255dffb640 1 -- 172.21.15.6:0/2370928206 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ca0fc7d5b0 con 0x55ca0f8f6580 2024-09-21T08:15:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f255dffb640 10 client.27331 handle_command_reply: tid=0 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 client.27331 shutdown 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 msgr2=0x55ca0fd18e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd18e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25680e5250 tx=0x7f2568004a90 comp rx=0 tx=0).stop 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 shutdown_connections 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ca0f8f6580 0x55ca0fda5760 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca0f941b70 0x55ca0fd18e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca0f962850 0x55ca0fd193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 --2- 172.21.15.6:0/2370928206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ca0f939990 0x55ca0fd18940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f255dffb640 0 client.27331 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 >> 172.21.15.6:0/2370928206 conn(0x55ca0f956c40 msgr2=0x55ca0fd0a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 shutdown_connections 2024-09-21T08:15:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 1 -- 172.21.15.6:0/2370928206 wait complete. 2024-09-21T08:15:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.641+0000 7f2583345740 20 client.27331 trim_cache size 0 max 16384 2024-09-21T08:15:19.647 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:19.647 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 54, 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "12578a36": { 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 54, 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:15:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 138.8, 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:15:19.649 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:19.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:19.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:19.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:19.651 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 msgr2=0x7f25640b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 0x7f25640b8c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2560009830 tx=0x7f256002cca0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 msgr2=0x7f25781a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f256800e9c0 tx=0x7f256800ee80 comp rx=0 tx=0).stop 2024-09-21T08:15:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 shutdown_connections 2024-09-21T08:15:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25640b6730 0x7f25640b8c40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2578108d10 0x7f25781ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25781083c0 0x7f25781a1b40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 --2- 172.21.15.6:0/1548578749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2578102a80 0x7f25781a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 >> 172.21.15.6:0/1548578749 conn(0x7f2578079760 msgr2=0x7f2578104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 shutdown_connections 2024-09-21T08:15:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:19.642+0000 7f257cdd1640 1 -- 172.21.15.6:0/1548578749 wait complete. 2024-09-21T08:15:19.832 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:19 smithi006 ceph-mon[30970]: pgmap v788: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-21T08:15:19.832 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:19 smithi006 ceph-mon[30970]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:15:19.832 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1320826402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:19.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:15:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:19 smithi119 ceph-mon[33564]: pgmap v788: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-21T08:15:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:19 smithi119 ceph-mon[33564]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:15:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1320826402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:19 smithi145 ceph-mon[34049]: pgmap v788: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-21T08:15:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:19 smithi145 ceph-mon[34049]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:15:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1320826402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:20.536 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:20.565 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '12578a36', quiesce took 9.3 seconds. Will release after: 9.55 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 -- 172.21.15.6:0/558364638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 msgr2=0x7f9ff8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 --2- 172.21.15.6:0/558364638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff8110640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009ca0 tx=0x7f9ff002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 -- 172.21.15.6:0/558364638 shutdown_connections 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 --2- 172.21.15.6:0/558364638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 0x7f9ff81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 --2- 172.21.15.6:0/558364638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff8110640 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 --2- 172.21.15.6:0/558364638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 0x7f9ff8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 -- 172.21.15.6:0/558364638 >> 172.21.15.6:0/558364638 conn(0x7f9ff80ff610 msgr2=0x7f9ff8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 -- 172.21.15.6:0/558364638 shutdown_connections 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.086+0000 7fa0003f3640 1 -- 172.21.15.6:0/558364638 wait complete. 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 Processor -- start 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 -- start start 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 0x7f9ff819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 0x7f9ff819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81139d0 con 0x7f9ff8109e10 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff8113850 con 0x7f9ff8103b80 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7fa0003f3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff8113b50 con 0x7f9ff81094c0 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.087+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39328/0 (socket says 172.21.15.6:39328) 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 -- 172.21.15.6:0/3526704754 learned_addr learned my addr 172.21.15.6:0/3526704754 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 0x7f9ff819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 0x7f9ff819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 -- 172.21.15.6:0/3526704754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 msgr2=0x7f9ff819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 0x7f9ff819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 -- 172.21.15.6:0/3526704754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 msgr2=0x7f9ff819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 0x7f9ff819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 -- 172.21.15.6:0/3526704754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff81a02f0 con 0x7f9ff8109e10 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0005cc0 tx=0x7f9ff0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9fef7fe640 1 -- 172.21.15.6:0/3526704754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0032e00 con 0x7f9ff8109e10 2024-09-21T08:15:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9fef7fe640 1 -- 172.21.15.6:0/3526704754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff00044d0 con 0x7f9ff8109e10 2024-09-21T08:15:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff81a0580 con 0x7f9ff8109e10 2024-09-21T08:15:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7f9fef7fe640 1 -- 172.21.15.6:0/3526704754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0030b70 con 0x7f9ff8109e10 2024-09-21T08:15:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.088+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff81a6d40 con 0x7f9ff8109e10 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.091+0000 7f9fef7fe640 1 -- 172.21.15.6:0/3526704754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9ff0004680 con 0x7f9ff8109e10 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 Processor -- start 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 -- start start 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9fef7fe640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 0x7f9fe40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658c31b0 0x563265c93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 0x563265c94120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563265c09ea0 con 0x5632658ec070 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563265bf92d0 con 0x5632658cb390 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7fa006967740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563265bfd0e0 con 0x5632658c31b0 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 0x7f9fe40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9fef7fe640 1 -- 172.21.15.6:0/3526704754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f9ff0108df0 con 0x7f9ff8109e10 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9ffe18f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9ffe18f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39334/0 (socket says 172.21.15.6:39334) 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.092+0000 7f9ffe18f640 1 -- 172.21.15.6:0/3810495116 learned_addr learned my addr 172.21.15.6:0/3810495116 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 0x563265c94120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658c31b0 0x563265c93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 -- 172.21.15.6:0/3810495116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658c31b0 msgr2=0x563265c93be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658c31b0 0x563265c93be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 -- 172.21.15.6:0/3810495116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 msgr2=0x563265c94120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 0x563265c94120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 -- 172.21.15.6:0/3810495116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563265957650 con 0x5632658ec070 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 0x7f9fe40b8b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8102ea0 tx=0x7f9fe800ba60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 0x563265c94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400bcb0 tx=0x7f9ff400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beca363020314c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9fecd9a640 1 -- 172.21.15.6:0/3810495116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4015070 con 0x5632658ec070 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9fecd9a640 1 -- 172.21.15.6:0/3810495116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff401a8f0 con 0x5632658ec070 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.093+0000 7f9fecd9a640 1 -- 172.21.15.6:0/3810495116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40118a0 con 0x5632658ec070 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 -- 172.21.15.6:0/3810495116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 msgr2=0x563265c936a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400bcb0 tx=0x7f9ff400f730 comp rx=0 tx=0).stop 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 -- 172.21.15.6:0/3810495116 shutdown_connections 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658c31b0 0x563265c93be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658cb390 0x563265c94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 --2- 172.21.15.6:0/3810495116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c936a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.094+0000 7fa006967740 1 -- 172.21.15.6:0/3810495116 >> 172.21.15.6:0/3810495116 conn(0x5632658e0460 msgr2=0x563265c91590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- 172.21.15.6:0/3810495116 shutdown_connections 2024-09-21T08:15:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- 172.21.15.6:0/3810495116 wait complete. 2024-09-21T08:15:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- start start 2024-09-21T08:15:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 Processor -- start 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c9f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563265a5a700 con 0x5632658ec070 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563265b94160 con 0x5632658c31b0 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563265ca1e80 con 0x5632658cb390 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.095+0000 7fa006967740 10 client.0 _ll_register_callbacks cb 0x563265bad9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39336/0 (socket says 172.21.15.6:39336) 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 -- 172.21.15.6:0/3716599375 learned_addr learned my addr 172.21.15.6:0/3716599375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c9f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 -- 172.21.15.6:0/3716599375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 msgr2=0x563265c9f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c9f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 -- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 msgr2=0x563265c9ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c9ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 -- 172.21.15.6:0/3716599375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563265bc1c90 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c9ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9ff002ae80 tx=0x7f9ff00ca6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32633e13599d694 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9fe1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00cdfa0 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f9ff00d7fc0 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.096+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff401a8f0 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9ff00ce340 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 10 client.17622 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563265cadaa0 con 0x5632658ec070 2024-09-21T08:15:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff401a8f0 con 0x5632658ec070 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9ff00cfb60 con 0x5632658ec070 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 10 client.17622 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 10 client.17622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 20 client.17622 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5632658aa9f0 0x563265cb0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 4 client.17622 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563265c0bdf0 con 0x5632658aa9f0 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.097+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5632658aa9f0 0x563265cb0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.098+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5632658aa9f0 0x563265cb0f90 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958427e0d89e0ef3 server_cookie=cd86909dc4e9c955 in_seq=0 out_seq=0 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.098+0000 7f9fe1ffb640 10 client.17622 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3716599375 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563265c0bdf0 con 0x5632658aa9f0 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7f9fe1ffb640 10 client.17622 handle_command_reply: tid=0 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 client.17622 shutdown 2024-09-21T08:15:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 msgr2=0x563265cab1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9ff002ae80 tx=0x7f9ff00ca6d0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 shutdown_connections 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5632658aa9f0 0x563265cb0f90 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c9f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265cab1d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 --2- 172.21.15.6:0/3716599375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c9ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 >> 172.21.15.6:0/3716599375 conn(0x5632658e0460 msgr2=0x563265c96880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7f9fe1ffb640 0 client.17622 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 shutdown_connections 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 1 -- 172.21.15.6:0/3716599375 wait complete. 2024-09-21T08:15:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.099+0000 7fa006967740 20 client.17622 trim_cache size 0 max 16384 2024-09-21T08:15:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.112+0000 7fa006967740 1 Processor -- start 2024-09-21T08:15:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.112+0000 7fa006967740 1 -- start start 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c94de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c90bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81aedb0 con 0x5632658ec070 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b1610 con 0x5632658c31b0 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7fa006967740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81af400 con 0x5632658cb390 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 -- 172.21.15.6:0/4091118661 learned_addr learned my addr 172.21.15.6:0/4091118661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c94de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c90bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 -- 172.21.15.6:0/4091118661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 msgr2=0x563265c90bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c90bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 -- 172.21.15.6:0/4091118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 msgr2=0x563265c94de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c94de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.113+0000 7f9ffe990640 1 -- 172.21.15.6:0/4091118661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632658aac20 con 0x5632658ec070 2024-09-21T08:15:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.114+0000 7f9ffe990640 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d8410 tx=0x7f9ff002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2520a4e76fd2cacd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.114+0000 7f9fe3fff640 1 -- 172.21.15.6:0/4091118661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00cdfa0 con 0x5632658ec070 2024-09-21T08:15:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.114+0000 7f9fe3fff640 1 -- 172.21.15.6:0/4091118661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff0036070 con 0x5632658ec070 2024-09-21T08:15:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.114+0000 7f9fe3fff640 1 -- 172.21.15.6:0/4091118661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00ce600 con 0x5632658ec070 2024-09-21T08:15:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- 172.21.15.6:0/4091118661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 msgr2=0x563265c91100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d8410 tx=0x7f9ff002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- 172.21.15.6:0/4091118661 shutdown_connections 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658cb390 0x563265c90bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658ec070 0x563265c91100 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 --2- 172.21.15.6:0/4091118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265c94de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- 172.21.15.6:0/4091118661 >> 172.21.15.6:0/4091118661 conn(0x5632658e0460 msgr2=0x563265c946d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- 172.21.15.6:0/4091118661 shutdown_connections 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- 172.21.15.6:0/4091118661 wait complete. 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 -- start start 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.115+0000 7fa006967740 1 Processor -- start 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265ca7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658ec070 0x563265ca3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81afad0 con 0x5632658cb390 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b0f40 con 0x5632658c31b0 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b01a0 con 0x5632658ec070 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7fa006967740 10 client.0 _ll_register_callbacks cb 0x7f9ff0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39356/0 (socket says 172.21.15.6:39356) 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 -- 172.21.15.6:0/3541067583 learned_addr learned my addr 172.21.15.6:0/3541067583 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265ca7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffe990640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658ec070 0x563265ca3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 -- 172.21.15.6:0/3541067583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658ec070 msgr2=0x563265ca3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658ec070 0x563265ca3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 -- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 msgr2=0x563265ca7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265ca7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.116+0000 7f9ffd98e640 1 -- 172.21.15.6:0/3541067583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563265d1ed60 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9ffd98e640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8020460 tx=0x7f9fe8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fc5f798bd2819d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe802e060 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f9fe8011710 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff0036070 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9fe8035050 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7fa006967740 10 client.17628 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563265d1feb0 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff0036070 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.117+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9fe8029940 con 0x5632658cb390 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 10 client.17628 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 20 client.17628 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56326587fda0 0x563265d226d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 4 client.17628 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563265c8c9e0 con 0x56326587fda0 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56326587fda0 0x563265d226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7f9ffe18f640 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56326587fda0 0x563265d226d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b5fbf3108850d8c server_cookie=8fb32021333a8b7b in_seq=0 out_seq=0 2024-09-21T08:15:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.118+0000 7f9fe1ffb640 10 client.17628 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7f9fe1ffb640 1 -- 172.21.15.6:0/3541067583 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563265c8c9e0 con 0x56326587fda0 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7f9fe1ffb640 10 client.17628 handle_command_reply: tid=0 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 client.17628 shutdown 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 msgr2=0x563265ca2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8020460 tx=0x7f9fe8004730 comp rx=0 tx=0).stop 2024-09-21T08:15:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 shutdown_connections 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56326587fda0 0x563265d226d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632658ec070 0x563265ca3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5632658cb390 0x563265ca2f70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 --2- 172.21.15.6:0/3541067583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632658c31b0 0x563265ca7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 >> 172.21.15.6:0/3541067583 conn(0x5632658e0460 msgr2=0x563265ca00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7f9fe1ffb640 0 client.17628 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 shutdown_connections 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 1 -- 172.21.15.6:0/3541067583 wait complete. 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.119+0000 7fa006967740 20 client.17628 trim_cache size 0 max 16384 2024-09-21T08:15:21.126 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 msgr2=0x7f9fe40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 0x7f9fe40b8b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8102ea0 tx=0x7f9fe800ba60 comp rx=0 tx=0).stop 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 msgr2=0x7f9ff819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0005cc0 tx=0x7f9ff0032a10 comp rx=0 tx=0).stop 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 shutdown_connections 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9fe40b6680 0x7f9fe40b8b90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff81094c0 0x7f9ff819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff8109e10 0x7f9ff819fbc0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 --2- 172.21.15.6:0/3526704754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff8103b80 0x7f9ff819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 >> 172.21.15.6:0/3526704754 conn(0x7f9ff80ff610 msgr2=0x7f9ff8107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 shutdown_connections 2024-09-21T08:15:21.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:21.120+0000 7fa0003f3640 1 -- 172.21.15.6:0/3526704754 wait complete. 2024-09-21T08:15:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:21 smithi006 ceph-mon[30970]: pgmap v790: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-09-21T08:15:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:21 smithi119 ceph-mon[33564]: pgmap v790: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-09-21T08:15:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:21 smithi145 ceph-mon[34049]: pgmap v790: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-09-21T08:15:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 745.0 s, 250.7 tps, lat 154.580 ms stddev 154.055 2024-09-21T08:15:22.820 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:15:22.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:15:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 -- 172.21.15.6:0/2121697782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108d00 msgr2=0x7f071010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 --2- 172.21.15.6:0/2121697782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108d00 0x7f071010f530 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0708009ca0 tx=0x7f070802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 -- 172.21.15.6:0/2121697782 shutdown_connections 2024-09-21T08:15:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 --2- 172.21.15.6:0/2121697782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108d00 0x7f071010f530 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 --2- 172.21.15.6:0/2121697782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101083b0 0x7f07101087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 --2- 172.21.15.6:0/2121697782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0710102ac0 0x7f0710102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 -- 172.21.15.6:0/2121697782 >> 172.21.15.6:0/2121697782 conn(0x7f0710079790 msgr2=0x7f0710079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 -- 172.21.15.6:0/2121697782 shutdown_connections 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.650+0000 7f0716340640 1 -- 172.21.15.6:0/2121697782 wait complete. 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.651+0000 7f0716340640 1 Processor -- start 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.651+0000 7f0716340640 1 -- start start 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.651+0000 7f0716340640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 0x7f071019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 0x7f071019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07101128c0 con 0x7f0710102ac0 2024-09-21T08:15:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112740 con 0x7f0710108d00 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112a40 con 0x7f07101083b0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39364/0 (socket says 172.21.15.6:39364) 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 -- 172.21.15.6:0/3461731797 learned_addr learned my addr 172.21.15.6:0/3461731797 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f07148dd640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 0x7f071019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0707fff640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 0x7f071019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 -- 172.21.15.6:0/3461731797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 msgr2=0x7f071019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 0x7f071019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 -- 172.21.15.6:0/3461731797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 msgr2=0x7f071019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 0x7f071019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 -- 172.21.15.6:0/3461731797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101a02d0 con 0x7f0710102ac0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0707fff640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 0x7f071019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f07148dd640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 0x7f071019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070ffff640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f070000c890 tx=0x7f070000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070dffb640 1 -- 172.21.15.6:0/3461731797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700004220 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070dffb640 1 -- 172.21.15.6:0/3461731797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0700007e40 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101a05c0 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f070dffb640 1 -- 172.21.15.6:0/3461731797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700004a00 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.652+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101a6d20 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.655+0000 7f070dffb640 1 -- 172.21.15.6:0/3461731797 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f07000079b0 con 0x7f0710102ac0 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 Processor -- start 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 -- start start 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a671490 0x55627aa41970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55627a9b7e60 con 0x55627a679670 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55627a9a7290 con 0x55627a69a350 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f071c8b4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55627a9ab0a0 con 0x55627a671490 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f070dffb640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.656+0000 7f0707fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39370/0 (socket says 172.21.15.6:39370) 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f07148dd640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 -- 172.21.15.6:0/2814426047 learned_addr learned my addr 172.21.15.6:0/2814426047 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f07148dd640 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f070dffb640 1 -- 172.21.15.6:0/3461731797 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f07000e78e0 con 0x7f0710102ac0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f070ffff640 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a671490 0x55627aa41970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 -- 172.21.15.6:0/2814426047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a671490 msgr2=0x55627aa41970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a671490 0x55627aa41970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 -- 172.21.15.6:0/2814426047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 msgr2=0x55627aa41430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa41430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 -- 172.21.15.6:0/2814426047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627a705930 con 0x55627a679670 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f07148dd640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0708009a60 tx=0x7f07080099f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f0707fff640 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009bc0 tx=0x7f06f800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b1fbe7075cb7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.657+0000 7f07067fc640 1 -- 172.21.15.6:0/2814426047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8016070 con 0x55627a679670 2024-09-21T08:15:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.658+0000 7f07067fc640 1 -- 172.21.15.6:0/2814426047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06f8011900 con 0x55627a679670 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.658+0000 7f07067fc640 1 -- 172.21.15.6:0/2814426047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f80106c0 con 0x55627a679670 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.658+0000 7f071c8b4740 1 -- 172.21.15.6:0/2814426047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 msgr2=0x55627aa41eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.658+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009bc0 tx=0x7f06f800e6c0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 -- 172.21.15.6:0/2814426047 shutdown_connections 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a671490 0x55627aa41970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa41eb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2814426047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 -- 172.21.15.6:0/2814426047 >> 172.21.15.6:0/2814426047 conn(0x55627a68e740 msgr2=0x55627aa3f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 -- 172.21.15.6:0/2814426047 shutdown_connections 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 -- 172.21.15.6:0/2814426047 wait complete. 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 -- start start 2024-09-21T08:15:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.659+0000 7f071c8b4740 1 Processor -- start 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 0x55627aa58f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55627a808890 con 0x55627a679670 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55627a941d40 con 0x55627a671490 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55627aa4fc10 con 0x55627a69a350 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f071c8b4740 10 client.0 _ll_register_callbacks cb 0x55627a9a5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39386/0 (socket says 172.21.15.6:39386) 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 -- 172.21.15.6:0/3181444438 learned_addr learned my addr 172.21.15.6:0/3181444438 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f070ffff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f07148dd640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 0x55627aa58f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 -- 172.21.15.6:0/3181444438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 msgr2=0x55627aa58f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 0x55627aa58f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 -- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 msgr2=0x55627aa4cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa4cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 -- 172.21.15.6:0/3181444438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627aa594f0 con 0x55627a679670 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f07148dd640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 0x55627aa58f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f0707fff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f06f8005940 tx=0x7f06f8011840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac15663cb18926a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.660+0000 7f06ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8016030 con 0x55627a679670 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f06f8004020 con 0x55627a679670 2024-09-21T08:15:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f8011900 con 0x55627a679670 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f06f8004260 con 0x55627a679670 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 10 client.17640 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55627aa5be00 con 0x55627a679670 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06f8011900 con 0x55627a679670 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f06f800f040 con 0x55627a679670 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 10 client.17640 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 10 client.17640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 20 client.17640 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a658cd0 0x55627aa5f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 4 client.17640 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.661+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55627a9b9db0 con 0x55627a658cd0 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.662+0000 7f070ffff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a658cd0 0x55627aa5f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.662+0000 7f06ef7fe640 10 client.17640 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.662+0000 7f070ffff640 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a658cd0 0x55627aa5f1c0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5938b06bcce3097 server_cookie=7f1ad12d76cc8a46 in_seq=0 out_seq=0 2024-09-21T08:15:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f06ef7fe640 1 -- 172.21.15.6:0/3181444438 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55627a9b9db0 con 0x55627a658cd0 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f06ef7fe640 10 client.17640 handle_command_reply: tid=0 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 client.17640 shutdown 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 msgr2=0x55627aa4d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f06f8005940 tx=0x7f06f8011840 comp rx=0 tx=0).stop 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 shutdown_connections 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a658cd0 0x55627aa5f1c0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f06ef7fe640 0 client.17640 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a69a350 0x55627aa58f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a679670 0x55627aa4d530 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 --2- 172.21.15.6:0/3181444438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa4cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 >> 172.21.15.6:0/3181444438 conn(0x55627a68e740 msgr2=0x55627aa44610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 shutdown_connections 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 1 -- 172.21.15.6:0/3181444438 wait complete. 2024-09-21T08:15:23.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.663+0000 7f071c8b4740 20 client.17640 trim_cache size 0 max 16384 2024-09-21T08:15:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 Processor -- start 2024-09-21T08:15:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 -- start start 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07101aee80 con 0x55627a671490 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07101b16e0 con 0x55627a69a350 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f071c8b4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f07101af4d0 con 0x55627a679670 2024-09-21T08:15:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39396/0 (socket says 172.21.15.6:39396) 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 -- 172.21.15.6:0/2237918277 learned_addr learned my addr 172.21.15.6:0/2237918277 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f0707fff640 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f07148dd640 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 -- 172.21.15.6:0/2237918277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 msgr2=0x55627aa466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 -- 172.21.15.6:0/2237918277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 msgr2=0x55627aa46bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa46bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.682+0000 7f070ffff640 1 -- 172.21.15.6:0/2237918277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627aa3f600 con 0x55627a671490 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.683+0000 7f070ffff640 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f07000ad060 tx=0x7f070001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b88fbc26ea1684 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.683+0000 7f0705ffb640 1 -- 172.21.15.6:0/2237918277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070001d040 con 0x55627a671490 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.683+0000 7f0705ffb640 1 -- 172.21.15.6:0/2237918277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07000b1e40 con 0x55627a671490 2024-09-21T08:15:23.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.683+0000 7f0705ffb640 1 -- 172.21.15.6:0/2237918277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07000a8cb0 con 0x55627a671490 2024-09-21T08:15:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- 172.21.15.6:0/2237918277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 msgr2=0x55627aa58e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f07000ad060 tx=0x7f070001a040 comp rx=0 tx=0).stop 2024-09-21T08:15:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- 172.21.15.6:0/2237918277 shutdown_connections 2024-09-21T08:15:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a69a350 0x55627aa46bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 --2- 172.21.15.6:0/2237918277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a671490 0x55627aa58e70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- 172.21.15.6:0/2237918277 >> 172.21.15.6:0/2237918277 conn(0x55627a68e740 msgr2=0x55627aa47fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- 172.21.15.6:0/2237918277 shutdown_connections 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- 172.21.15.6:0/2237918277 wait complete. 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 -- start start 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.684+0000 7f071c8b4740 1 Processor -- start 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa5e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa5e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07101afba0 con 0x55627a69a350 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07101b1010 con 0x55627a671490 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f07101b0270 con 0x55627a679670 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f071c8b4740 10 client.0 _ll_register_callbacks cb 0x7f0708009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:23.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39408/0 (socket says 172.21.15.6:39408) 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 -- 172.21.15.6:0/281432186 learned_addr learned my addr 172.21.15.6:0/281432186 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f070ffff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa5e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f0707fff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa5e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 -- 172.21.15.6:0/281432186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 msgr2=0x55627aa5e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa5e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 -- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 msgr2=0x55627aa5e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa5e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 -- 172.21.15.6:0/281432186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627aac8ab0 con 0x55627a69a350 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f0707fff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa5e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f070ffff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa5e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f07148dd640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0708035000 tx=0x7f0708047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53db9e359faa1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:23.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.685+0000 7f06ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708004040 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f07080041e0 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07000b1e40 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f07080043e0 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 10 client.17646 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55627aac9da0 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07000b1e40 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0708030ce0 con 0x55627a69a350 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 10 client.17646 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 20 client.17646 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a62e080 0x55627aacc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 4 client.17646 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:15:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.686+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55627a9b5860 con 0x55627a62e080 2024-09-21T08:15:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.687+0000 7f070ffff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a62e080 0x55627aacc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.687+0000 7f06ef7fe640 10 client.17646 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.687+0000 7f070ffff640 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a62e080 0x55627aacc5c0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519d7e84af45ba1d server_cookie=eba212880c58b726 in_seq=0 out_seq=0 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.688+0000 7f06ef7fe640 1 -- 172.21.15.6:0/281432186 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55627a9b5860 con 0x55627a62e080 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f06ef7fe640 10 client.17646 handle_command_reply: tid=0 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 client.17646 shutdown 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 msgr2=0x55627aa5edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0708035000 tx=0x7f0708047000 comp rx=0 tx=0).stop 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 shutdown_connections 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55627a62e080 0x55627aacc5c0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55627a679670 0x55627aa5e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55627a69a350 0x55627aa5edd0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 --2- 172.21.15.6:0/281432186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55627a671490 0x55627aa5e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f06ef7fe640 0 client.17646 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 >> 172.21.15.6:0/281432186 conn(0x55627a68e740 msgr2=0x55627aa4e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 shutdown_connections 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 1 -- 172.21.15.6:0/281432186 wait complete. 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.689+0000 7f071c8b4740 20 client.17646 trim_cache size 0 max 16384 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "898d22e2-15cf-48c0-b2c4-9819dd84c550", 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:15:23.695 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 msgr2=0x7f06fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0708009a60 tx=0x7f07080099f0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 msgr2=0x7f071019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f070000c890 tx=0x7f070000cd50 comp rx=0 tx=0).stop 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 shutdown_connections 2024-09-21T08:15:23.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101083b0 0x7f071019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0710108d00 0x7f071019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 --2- 172.21.15.6:0/3461731797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710102ac0 0x7f071019a360 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 >> 172.21.15.6:0/3461731797 conn(0x7f0710079790 msgr2=0x7f0710101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 shutdown_connections 2024-09-21T08:15:23.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:23.690+0000 7f0716340640 1 -- 172.21.15.6:0/3461731797 wait complete. 2024-09-21T08:15:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:23 smithi119 ceph-mon[33564]: pgmap v791: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2024-09-21T08:15:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:23 smithi145 ceph-mon[34049]: pgmap v791: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2024-09-21T08:15:23.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:23 smithi006 ceph-mon[30970]: pgmap v791: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2024-09-21T08:15:24.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:15:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:24.826 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:24 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:15:24.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:24 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:24.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:24 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:15:24.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:24 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:24 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:15:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:24 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:24 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:15:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:24 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:24 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:15:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:24 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:24 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:15:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:24 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 -- 172.21.15.6:0/446201300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2701049b0 msgr2=0x7ff270104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 --2- 172.21.15.6:0/446201300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2701049b0 0x7ff270104dc0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff260009ca0 tx=0x7ff26002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 -- 172.21.15.6:0/446201300 shutdown_connections 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 --2- 172.21.15.6:0/446201300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff27010de10 0x7ff270110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 --2- 172.21.15.6:0/446201300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff270105300 0x7ff27010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 --2- 172.21.15.6:0/446201300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2701049b0 0x7ff270104dc0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 -- 172.21.15.6:0/446201300 >> 172.21.15.6:0/446201300 conn(0x7ff270079730 msgr2=0x7ff270079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 -- 172.21.15.6:0/446201300 shutdown_connections 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.206+0000 7ff2752eb640 1 -- 172.21.15.6:0/446201300 wait complete. 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 Processor -- start 2024-09-21T08:15:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 -- start start 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2701049b0 0x7ff27019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 0x7ff27019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff270113990 con 0x7ff270105300 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff270113810 con 0x7ff27010de10 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff2752eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff270113b10 con 0x7ff2701049b0 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39412/0 (socket says 172.21.15.6:39412) 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff26e7fc640 1 -- 172.21.15.6:0/3305260878 learned_addr learned my addr 172.21.15.6:0/3305260878 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff26effd640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2701049b0 0x7ff27019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.207+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 0x7ff27019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 -- 172.21.15.6:0/3305260878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2701049b0 msgr2=0x7ff27019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2701049b0 0x7ff27019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 -- 172.21.15.6:0/3305260878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 msgr2=0x7ff27019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 0x7ff27019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 -- 172.21.15.6:0/3305260878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2701a02f0 con 0x7ff270105300 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 0x7ff27019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff26400c8c0 tx=0x7ff26400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff257fff640 1 -- 172.21.15.6:0/3305260878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264007bb0 con 0x7ff270105300 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff257fff640 1 -- 172.21.15.6:0/3305260878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff264007d50 con 0x7ff270105300 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2701a05e0 con 0x7ff270105300 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff257fff640 1 -- 172.21.15.6:0/3305260878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2640186a0 con 0x7ff270105300 2024-09-21T08:15:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.208+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701a6e00 con 0x7ff270105300 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.211+0000 7ff27b85f740 1 Processor -- start 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.211+0000 7ff27b85f740 1 -- start start 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff257fff640 1 -- 172.21.15.6:0/3305260878 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff26400fa00 con 0x7ff270105300 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f1445270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f1445cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5615f13bbe50 con 0x5615f10751b0 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5615f13ab280 con 0x5615f107d390 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff27b85f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5615f13af090 con 0x5615f109e070 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39428/0 (socket says 172.21.15.6:39428) 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 -- 172.21.15.6:0/1482966123 learned_addr learned my addr 172.21.15.6:0/1482966123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f1445270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f1445cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 -- 172.21.15.6:0/1482966123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 msgr2=0x5615f1445270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f1445270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 -- 172.21.15.6:0/1482966123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 msgr2=0x5615f1445cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f1445cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.212+0000 7ff26effd640 1 -- 172.21.15.6:0/1482966123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615f1109650 con 0x5615f10751b0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff26effd640 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff260009ca0 tx=0x7ff260009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc528e38aee003d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff257fff640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 0x7ff2580b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff2557fa640 1 -- 172.21.15.6:0/1482966123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260031b80 con 0x5615f10751b0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff2557fa640 1 -- 172.21.15.6:0/1482966123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff260036030 con 0x5615f10751b0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff2557fa640 1 -- 172.21.15.6:0/1482966123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004410 con 0x5615f10751b0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 0x7ff2580b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.213+0000 7ff257fff640 1 -- 172.21.15.6:0/3305260878 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff2640e7b60 con 0x7ff270105300 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- 172.21.15.6:0/1482966123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 msgr2=0x5615f14457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff260009ca0 tx=0x7ff260009a20 comp rx=0 tx=0).stop 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 0x7ff2580b8bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff26800bce0 tx=0x7ff26800b4d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- 172.21.15.6:0/1482966123 shutdown_connections 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f1445cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f14457b0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 --2- 172.21.15.6:0/1482966123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f1445270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- 172.21.15.6:0/1482966123 >> 172.21.15.6:0/1482966123 conn(0x5615f1092460 msgr2=0x5615f1443160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- 172.21.15.6:0/1482966123 shutdown_connections 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- 172.21.15.6:0/1482966123 wait complete. 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.214+0000 7ff27b85f740 1 -- start start 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 Processor -- start 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f144cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f144d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5615f120c700 con 0x5615f10751b0 2024-09-21T08:15:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5615f1346110 con 0x5615f107d390 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5615f14481f0 con 0x5615f109e070 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff27b85f740 10 client.0 _ll_register_callbacks cb 0x5615f135f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39440/0 (socket says 172.21.15.6:39440) 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f144d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 -- 172.21.15.6:0/3425794260 learned_addr learned my addr 172.21.15.6:0/3425794260 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f144cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 -- 172.21.15.6:0/3425794260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 msgr2=0x5615f144d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f144d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 -- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 msgr2=0x5615f144cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f144cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26effd640 1 -- 172.21.15.6:0/3425794260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615f1373c40 con 0x5615f10751b0 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f144cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.215+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f144d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff26effd640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf4212fc18ff5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26004a040 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff260004190 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260036030 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff26005e050 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff27b85f740 10 client.17658 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5615f1467c60 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.216+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff260036030 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff26004d030 con 0x5615f10751b0 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 10 client.17658 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 20 client.17658 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f105c9f0 0x5615f146afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 4 client.17658 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615f13bdda0 con 0x5615f105c9f0 2024-09-21T08:15:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.217+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f105c9f0 0x5615f146afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.218+0000 7ff252ff5640 10 client.17658 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.218+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f105c9f0 0x5615f146afc0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c32e47d51d5389 server_cookie=260af9c39cfbe755 in_seq=0 out_seq=0 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.218+0000 7ff252ff5640 1 -- 172.21.15.6:0/3425794260 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615f13bdda0 con 0x5615f105c9f0 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.218+0000 7ff252ff5640 10 client.17658 handle_command_reply: tid=0 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.218+0000 7ff27b85f740 1 client.17658 shutdown 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 msgr2=0x5615f144c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260003c20 comp rx=0 tx=0).stop 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 shutdown_connections 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f105c9f0 0x5615f146afc0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f144d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f144cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff252ff5640 0 client.17658 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3425794260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144c7f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 >> 172.21.15.6:0/3425794260 conn(0x5615f1092460 msgr2=0x5615f1446c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 shutdown_connections 2024-09-21T08:15:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 1 -- 172.21.15.6:0/3425794260 wait complete. 2024-09-21T08:15:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.219+0000 7ff27b85f740 20 client.17658 trim_cache size 0 max 16384 2024-09-21T08:15:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.236+0000 7ff27b85f740 1 Processor -- start 2024-09-21T08:15:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.236+0000 7ff27b85f740 1 -- start start 2024-09-21T08:15:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f14469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f14499e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701acb40 con 0x5615f10751b0 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701af3a0 con 0x5615f107d390 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff27b85f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ad190 con 0x5615f109e070 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39452/0 (socket says 172.21.15.6:39452) 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 -- 172.21.15.6:0/3390391661 learned_addr learned my addr 172.21.15.6:0/3390391661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f14499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 -- 172.21.15.6:0/3390391661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 msgr2=0x5615f14499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f14499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f14469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 -- 172.21.15.6:0/3390391661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 msgr2=0x5615f14469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f14469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 -- 172.21.15.6:0/3390391661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615f144ef30 con 0x5615f10751b0 2024-09-21T08:15:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff26effd640 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff26002ade0 tx=0x7ff260031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5fb095e1062b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff254ff9640 1 -- 172.21.15.6:0/3390391661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600305c0 con 0x5615f10751b0 2024-09-21T08:15:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff254ff9640 1 -- 172.21.15.6:0/3390391661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff260036070 con 0x5615f10751b0 2024-09-21T08:15:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.237+0000 7ff254ff9640 1 -- 172.21.15.6:0/3390391661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600508d0 con 0x5615f10751b0 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 -- 172.21.15.6:0/3390391661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 msgr2=0x5615f144e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff26002ade0 tx=0x7ff260031680 comp rx=0 tx=0).stop 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 -- 172.21.15.6:0/3390391661 shutdown_connections 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f109e070 0x5615f14499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f107d390 0x5615f14469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 --2- 172.21.15.6:0/3390391661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f10751b0 0x5615f144e6d0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 -- 172.21.15.6:0/3390391661 >> 172.21.15.6:0/3390391661 conn(0x5615f1092460 msgr2=0x5615f14462a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 -- 172.21.15.6:0/3390391661 shutdown_connections 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.238+0000 7ff27b85f740 1 -- 172.21.15.6:0/3390391661 wait complete. 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 -- start start 2024-09-21T08:15:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 Processor -- start 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f10751b0 0x5615f1461be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f107d390 0x5615f145f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ad860 con 0x5615f109e070 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701aecd0 con 0x5615f10751b0 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701adf30 con 0x5615f107d390 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff27b85f740 10 client.0 _ll_register_callbacks cb 0x7ff26800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39456/0 (socket says 172.21.15.6:39456) 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff26f7fe640 1 -- 172.21.15.6:0/81804073 learned_addr learned my addr 172.21.15.6:0/81804073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff26effd640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f10751b0 0x5615f1461be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.239+0000 7ff26e7fc640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f107d390 0x5615f145f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 -- 172.21.15.6:0/81804073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f107d390 msgr2=0x5615f145f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f107d390 0x5615f145f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 -- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f10751b0 msgr2=0x5615f1461be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f10751b0 0x5615f1461be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 -- 172.21.15.6:0/81804073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615f145ff10 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff26f7fe640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff26801eb50 tx=0x7ff2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb8ce5ff30728ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26801d950 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff26801daf0 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260036070 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff268036050 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff27b85f740 10 client.17664 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5615f14d5980 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.240+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff260036070 con 0x5615f109e070 2024-09-21T08:15:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff2680313b0 con 0x5615f109e070 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 10 client.17664 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 20 client.17664 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f1031da0 0x5615f14d81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 4 client.17664 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615f13b9850 con 0x5615f1031da0 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff26effd640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f1031da0 0x5615f14d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff26effd640 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f1031da0 0x5615f14d81f0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6846d09ce13a5797 server_cookie=b7540fef0276b153 in_seq=0 out_seq=0 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.241+0000 7ff252ff5640 10 client.17664 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff252ff5640 1 -- 172.21.15.6:0/81804073 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7386 (crc 0 0 0) 0x5615f13b9850 con 0x5615f1031da0 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff252ff5640 10 client.17664 handle_command_reply: tid=0 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 client.17664 shutdown 2024-09-21T08:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 msgr2=0x5615f145f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff26801eb50 tx=0x7ff2680046c0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 shutdown_connections 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5615f1031da0 0x5615f14d81f0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5615f107d390 0x5615f145f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615f109e070 0x5615f145f780 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff252ff5640 0 client.17664 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 --2- 172.21.15.6:0/81804073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5615f10751b0 0x5615f1461be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 >> 172.21.15.6:0/81804073 conn(0x5615f1092460 msgr2=0x5615f144e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 shutdown_connections 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 1 -- 172.21.15.6:0/81804073 wait complete. 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.242+0000 7ff27b85f740 20 client.17664 trim_cache size 0 max 16384 2024-09-21T08:15:25.249 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "898d22e2-15cf-48c0-b2c4-9819dd84c550", 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:15:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:15:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:15:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:15:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 msgr2=0x7ff2580b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 0x7ff2580b8bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff26800bce0 tx=0x7ff26800b4d0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 msgr2=0x7ff27019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff26400c8c0 tx=0x7ff26400cd80 comp rx=0 tx=0).stop 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 shutdown_connections 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff2580b66b0 0x7ff2580b8bc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27010de10 0x7ff27019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff270105300 0x7ff27019a9e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 --2- 172.21.15.6:0/3305260878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2701049b0 0x7ff27019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 >> 172.21.15.6:0/3305260878 conn(0x7ff270079730 msgr2=0x7ff270100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 shutdown_connections 2024-09-21T08:15:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:25.243+0000 7ff2752eb640 1 -- 172.21.15.6:0/3305260878 wait complete. 2024-09-21T08:15:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:25 smithi119 ceph-mon[33564]: pgmap v792: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.2 MiB/s wr, 433 op/s 2024-09-21T08:15:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:25 smithi145 ceph-mon[34049]: pgmap v792: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.2 MiB/s wr, 433 op/s 2024-09-21T08:15:25.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:25 smithi006 ceph-mon[30970]: pgmap v792: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.2 MiB/s wr, 433 op/s 2024-09-21T08:15:26.007 INFO:tasks.cephfs.filesystem:scrub status for tag:898d22e2-15cf-48c0-b2c4-9819dd84c550 - {'path': '/', 'tag': '898d22e2-15cf-48c0-b2c4-9819dd84c550', 'options': 'recursive,force'} 2024-09-21T08:15:26.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:26 smithi119 ceph-mon[33564]: pgmap v793: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 380 op/s 2024-09-21T08:15:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:26 smithi145 ceph-mon[34049]: pgmap v793: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 380 op/s 2024-09-21T08:15:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:26 smithi006 ceph-mon[30970]: pgmap v793: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 380 op/s 2024-09-21T08:15:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:15:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:28 smithi119 ceph-mon[33564]: pgmap v794: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.5 MiB/s wr, 261 op/s 2024-09-21T08:15:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:28 smithi145 ceph-mon[34049]: pgmap v794: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.5 MiB/s wr, 261 op/s 2024-09-21T08:15:29.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:28 smithi006 ceph-mon[30970]: pgmap v794: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.5 MiB/s wr, 261 op/s 2024-09-21T08:15:30.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:30.389 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 -- 172.21.15.6:0/3236082150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd868105310 msgr2=0x7fd86810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 --2- 172.21.15.6:0/3236082150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd868105310 0x7fd86810d860 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009900 tx=0x7fd85c02a410 comp rx=0 tx=0).stop 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 -- 172.21.15.6:0/3236082150 shutdown_connections 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 --2- 172.21.15.6:0/3236082150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd86810de20 0x7fd868110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 --2- 172.21.15.6:0/3236082150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd868105310 0x7fd86810d860 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 --2- 172.21.15.6:0/3236082150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8681049c0 0x7fd868104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 -- 172.21.15.6:0/3236082150 >> 172.21.15.6:0/3236082150 conn(0x7fd868079730 msgr2=0x7fd868079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 -- 172.21.15.6:0/3236082150 shutdown_connections 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.879+0000 7fd86d617640 1 -- 172.21.15.6:0/3236082150 wait complete. 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 Processor -- start 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 -- start start 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 0x7fd86819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 0x7fd86819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd868113930 con 0x7fd8681049c0 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681137b0 con 0x7fd868105310 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd86d617640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd868113ab0 con 0x7fd86810de20 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd866ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd866ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56470/0 (socket says 172.21.15.6:56470) 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd866ffd640 1 -- 172.21.15.6:0/3340417837 learned_addr learned my addr 172.21.15.6:0/3340417837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd8677fe640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 0x7fd86819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.880+0000 7fd8667fc640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 0x7fd86819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 -- 172.21.15.6:0/3340417837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 msgr2=0x7fd86819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 0x7fd86819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 -- 172.21.15.6:0/3340417837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 msgr2=0x7fd86819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 0x7fd86819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 -- 172.21.15.6:0/3340417837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8681a0330 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd8677fe640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 0x7fd86819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd8667fc640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 0x7fd86819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd866ffd640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd85800eaa0 tx=0x7fd85800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858016070 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd85800ce10 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681a0620 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858011470 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.881+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a6d80 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.882+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86806c1e0 con 0x7fd8681049c0 2024-09-21T08:15:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.884+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd858019070 con 0x7fd8681049c0 2024-09-21T08:15:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.884+0000 7fd84ffff640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 0x7fd8500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.885+0000 7fd8667fc640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 0x7fd8500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.885+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fd8580e8020 con 0x7fd8681049c0 2024-09-21T08:15:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.885+0000 7fd8667fc640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 0x7fd8500b8b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006010 tx=0x7fd85c000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:30.888+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8580ae1c0 con 0x7fd8681049c0 2024-09-21T08:15:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.116+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd868104dd0 con 0x7fd8681049c0 2024-09-21T08:15:31.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:30 smithi006 ceph-mon[30970]: pgmap v795: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-09-21T08:15:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.116+0000 7fd84ffff640 1 -- 172.21.15.6:0/3340417837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fd8580b25a0 con 0x7fd8681049c0 2024-09-21T08:15:31.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:31.119 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 msgr2=0x7fd8500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 0x7fd8500b8b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006010 tx=0x7fd85c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 msgr2=0x7fd86819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd85800eaa0 tx=0x7fd85800ef60 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 shutdown_connections 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fd8500b6680 0x7fd8500b8b90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd86810de20 0x7fd86819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868105310 0x7fd86819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 --2- 172.21.15.6:0/3340417837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8681049c0 0x7fd86819a3c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.119+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 >> 172.21.15.6:0/3340417837 conn(0x7fd868079730 msgr2=0x7fd868100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.120+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 shutdown_connections 2024-09-21T08:15:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:31.120+0000 7fd86d617640 1 -- 172.21.15.6:0/3340417837 wait complete. 2024-09-21T08:15:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:30 smithi119 ceph-mon[33564]: pgmap v795: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-09-21T08:15:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:30 smithi145 ceph-mon[34049]: pgmap v795: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-09-21T08:15:31.821 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id 12578a36 --release --await' 2024-09-21T08:15:31.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id 12578a36 --release --await 2024-09-21T08:15:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:32.208 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:32 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3340417837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:32.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:32 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3340417837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:32 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3340417837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 -- 172.21.15.6:0/402806588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 msgr2=0x7f8be4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 --2- 172.21.15.6:0/402806588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be4102e90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009900 tx=0x7f8bd402a410 comp rx=0 tx=0).stop 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 -- 172.21.15.6:0/402806588 shutdown_connections 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 --2- 172.21.15.6:0/402806588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be4108d10 0x7f8be410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 --2- 172.21.15.6:0/402806588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be41083c0 0x7f8be41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 --2- 172.21.15.6:0/402806588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be4102e90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 -- 172.21.15.6:0/402806588 >> 172.21.15.6:0/402806588 conn(0x7f8be4079740 msgr2=0x7f8be4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 -- 172.21.15.6:0/402806588 shutdown_connections 2024-09-21T08:15:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.574+0000 7f8be9a75640 1 -- 172.21.15.6:0/402806588 wait complete. 2024-09-21T08:15:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 Processor -- start 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 -- start start 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be41083c0 0x7f8be419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be4108d10 0x7f8be419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4112830 con 0x7f8be4102a80 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41126b0 con 0x7f8be4108d10 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be9a75640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41129b0 con 0x7f8be41083c0 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56490/0 (socket says 172.21.15.6:56490) 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8be37fe640 1 -- 172.21.15.6:0/1949000552 learned_addr learned my addr 172.21.15.6:0/1949000552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.575+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be41083c0 0x7f8be419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be3fff640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be4108d10 0x7f8be419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 -- 172.21.15.6:0/1949000552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be41083c0 msgr2=0x7f8be419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be41083c0 0x7f8be419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 -- 172.21.15.6:0/1949000552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be4108d10 msgr2=0x7f8be419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be4108d10 0x7f8be419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 -- 172.21.15.6:0/1949000552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be41a0360 con 0x7f8be4102a80 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be37fe640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009230 tx=0x7f8bd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be17fa640 1 -- 172.21.15.6:0/1949000552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd403f030 con 0x7f8be4102a80 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be41a05f0 con 0x7f8be4102a80 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be17fa640 1 -- 172.21.15.6:0/1949000552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bd4003a80 con 0x7f8be4102a80 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be17fa640 1 -- 172.21.15.6:0/1949000552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4035070 con 0x7f8be4102a80 2024-09-21T08:15:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.576+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be41a6db0 con 0x7f8be4102a80 2024-09-21T08:15:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 Processor -- start 2024-09-21T08:15:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 -- start start 2024-09-21T08:15:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x565446099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x565446099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x565446099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x565445f84dc0 con 0x565445cca660 2024-09-21T08:15:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5654460111f0 con 0x565445cf3520 2024-09-21T08:15:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.579+0000 7f8beffe9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x565446000620 con 0x565445cd2840 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be17fa640 1 -- 172.21.15.6:0/1949000552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8bd4042030 con 0x7f8be4102a80 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x565446099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x565446099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x565446099510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58250/0 (socket says 172.21.15.6:58250) 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be3fff640 1 -- 172.21.15.6:0/4058206765 learned_addr learned my addr 172.21.15.6:0/4058206765 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be37fe640 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x565446099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 -- 172.21.15.6:0/4058206765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 msgr2=0x565446099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x565446099510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 -- 172.21.15.6:0/4058206765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 msgr2=0x565446099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x565446099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 -- 172.21.15.6:0/4058206765 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565445fc8fd0 con 0x565445cd2840 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x565446099f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8be406b6c0 tx=0x7f8bcc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584c00ac6a51d888 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8be17fa640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 0x7f8bd00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.580+0000 7f8bd9ffb640 1 -- 172.21.15.6:0/4058206765 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc004030 con 0x565445cd2840 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.581+0000 7f8be3fff640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 0x7f8bd00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.581+0000 7f8bd9ffb640 1 -- 172.21.15.6:0/4058206765 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bcc0035f0 con 0x565445cd2840 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.581+0000 7f8bd9ffb640 1 -- 172.21.15.6:0/4058206765 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0116a0 con 0x565445cd2840 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.581+0000 7f8be17fa640 1 -- 172.21.15.6:0/1949000552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f8bd4108250 con 0x7f8be4102a80 2024-09-21T08:15:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:15:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- 172.21.15.6:0/4058206765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 msgr2=0x565446099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x565446099f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8be406b6c0 tx=0x7f8bcc0107a0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8be3fff640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 0x7f8bd00b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc008f00 tx=0x7f8bdc0086b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- 172.21.15.6:0/4058206765 shutdown_connections 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x565446099f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x565446099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 --2- 172.21.15.6:0/4058206765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x565446099510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- 172.21.15.6:0/4058206765 >> 172.21.15.6:0/4058206765 conn(0x565445ce7910 msgr2=0x565446097400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- 172.21.15.6:0/4058206765 shutdown_connections 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- 172.21.15.6:0/4058206765 wait complete. 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.582+0000 7f8beffe9740 1 -- start start 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 Processor -- start 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x5654460b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x565445f9b300 con 0x565445cca660 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565446004430 con 0x565445cf3520 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x565445e61bb0 con 0x565445cd2840 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8beffe9740 10 client.0 _ll_register_callbacks cb 0x565445fb5120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56500/0 (socket says 172.21.15.6:56500) 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 -- 172.21.15.6:0/2532886539 learned_addr learned my addr 172.21.15.6:0/2532886539 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be3fff640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x5654460b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 -- 172.21.15.6:0/2532886539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 msgr2=0x5654460a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 -- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 msgr2=0x5654460b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x5654460b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.583+0000 7f8be37fe640 1 -- 172.21.15.6:0/2532886539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565445f8a780 con 0x565445cca660 2024-09-21T08:15:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8be37fe640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40caf60 tx=0x7f8bd410b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6810935493bac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4049030 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f8bd403bc30 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bcc0035f0 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bd40ca340 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 10 client.17682 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565445d5eb00 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bcc0035f0 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bd40d7280 con 0x565445cca660 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 10 client.17682 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 10 client.17682 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 20 client.17682 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445cb1ea0 0x5654460b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 4 client.17682 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.584+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565446013140 con 0x565445cb1ea0 2024-09-21T08:15:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.585+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445cb1ea0 0x5654460b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.585+0000 7f8bc2ffd640 10 client.17682 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.585+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445cb1ea0 0x5654460b6eb0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61617bf2889c97bb server_cookie=eb45abdb291881c5 in_seq=0 out_seq=0 2024-09-21T08:15:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/2532886539 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565446013140 con 0x565445cb1ea0 2024-09-21T08:15:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8bc2ffd640 10 client.17682 handle_command_reply: tid=0 2024-09-21T08:15:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 client.17682 shutdown 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 msgr2=0x5654460a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40caf60 tx=0x7f8bd410b990 comp rx=0 tx=0).stop 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 shutdown_connections 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445cb1ea0 0x5654460b6eb0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cf3520 0x5654460b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8bc2ffd640 0 client.17682 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 --2- 172.21.15.6:0/2532886539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x5654460a4bc0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 >> 172.21.15.6:0/2532886539 conn(0x565445ce7910 msgr2=0x56544609c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 shutdown_connections 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.586+0000 7f8beffe9740 1 -- 172.21.15.6:0/2532886539 wait complete. 2024-09-21T08:15:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.587+0000 7f8beffe9740 20 client.17682 trim_cache size 0 max 16384 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 Processor -- start 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 -- start start 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 0x5654460b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41aee90 con 0x565445cf3520 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41b16f0 con 0x565445cca660 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8beffe9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41af4e0 con 0x565445cd2840 2024-09-21T08:15:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56502/0 (socket says 172.21.15.6:56502) 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.604+0000 7f8be3fff640 1 -- 172.21.15.6:0/729532453 learned_addr learned my addr 172.21.15.6:0/729532453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be37fe640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 0x5654460b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 -- 172.21.15.6:0/729532453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 msgr2=0x5654460a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 -- 172.21.15.6:0/729532453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 msgr2=0x5654460b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 0x5654460b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 -- 172.21.15.6:0/729532453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565445dd5960 con 0x565445cf3520 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be37fe640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 0x5654460b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8be3fff640 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e6c0 tx=0x7f8bdc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a0143b8ca102ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8bd97fa640 1 -- 172.21.15.6:0/729532453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc02b070 con 0x565445cf3520 2024-09-21T08:15:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8bd97fa640 1 -- 172.21.15.6:0/729532453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bdc0268a0 con 0x565445cf3520 2024-09-21T08:15:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.605+0000 7f8bd97fa640 1 -- 172.21.15.6:0/729532453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc01d8b0 con 0x565445cf3520 2024-09-21T08:15:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- 172.21.15.6:0/729532453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 msgr2=0x56544609e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e6c0 tx=0x7f8bdc014000 comp rx=0 tx=0).stop 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- 172.21.15.6:0/729532453 shutdown_connections 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cd2840 0x5654460a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cf3520 0x56544609e5f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 --2- 172.21.15.6:0/729532453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cca660 0x5654460b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- 172.21.15.6:0/729532453 >> 172.21.15.6:0/729532453 conn(0x565445ce7910 msgr2=0x5654460a60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- 172.21.15.6:0/729532453 shutdown_connections 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- 172.21.15.6:0/729532453 wait complete. 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.606+0000 7f8beffe9740 1 -- start start 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 Processor -- start 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 0x56544611f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cf3520 0x56544611b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41afbb0 con 0x565445cca660 2024-09-21T08:15:32.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41b1020 con 0x565445cd2840 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41b0280 con 0x565445cf3520 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8beffe9740 10 client.0 _ll_register_callbacks cb 0x7f8bd410bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56508/0 (socket says 172.21.15.6:56508) 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 -- 172.21.15.6:0/3708475713 learned_addr learned my addr 172.21.15.6:0/3708475713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be3fff640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cf3520 0x56544611b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 0x56544611f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 -- 172.21.15.6:0/3708475713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cf3520 msgr2=0x56544611b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cf3520 0x56544611b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 -- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 msgr2=0x56544611f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 0x56544611f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8be37fe640 1 -- 172.21.15.6:0/3708475713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56544611c090 con 0x565445cca660 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.607+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 0x56544611f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40d7680 tx=0x7f8bd403be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea008d59f066f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4049070 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f8bd410ba30 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bdc0268a0 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bd40cd460 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 10 client.17688 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5654460ac840 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bdc0268a0 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bd40d5b50 con 0x565445cca660 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 10 client.17688 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 10 client.17688 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 20 client.17688 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445c87250 0x5654460ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 4 client.17688 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "12578a36", "release": true, "await": true}] 2024-09-21T08:15:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.608+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "12578a36", "release": true, "await": true}) -- 0x56544600ebf0 con 0x565445c87250 2024-09-21T08:15:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.609+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445c87250 0x5654460ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.609+0000 7f8bc2ffd640 10 client.17688 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:32.609+0000 7f8bdaffd640 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445c87250 0x5654460ace90 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4e3b22d2e013e55 server_cookie=bccae380e5139522 in_seq=0 out_seq=0 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8bc2ffd640 1 -- 172.21.15.6:0/3708475713 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56544600ebf0 con 0x565445c87250 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8bc2ffd640 10 client.17688 handle_command_reply: tid=0 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 client.17688 shutdown 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 msgr2=0x56544611ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40d7680 tx=0x7f8bd403be60 comp rx=0 tx=0).stop 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 shutdown_connections 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x565445c87250 0x5654460ace90 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565445cf3520 0x56544611b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565445cd2840 0x56544611f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 --2- 172.21.15.6:0/3708475713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x565445cca660 0x56544611ec10 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8bc2ffd640 0 client.17688 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.015+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 >> 172.21.15.6:0/3708475713 conn(0x565445ce7910 msgr2=0x565446097320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 shutdown_connections 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8beffe9740 1 -- 172.21.15.6:0/3708475713 wait complete. 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8beffe9740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:15:33.019 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 56, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "12578a36": { 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 56, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 138.8, 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:15:33.020 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:33.021 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 msgr2=0x7f8bd00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 0x7f8bd00b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc008f00 tx=0x7f8bdc0086b0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 msgr2=0x7f8be419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.016+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009230 tx=0x7f8bd4004270 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 shutdown_connections 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8bd00b6680 0x7f8bd00b8b90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8be41083c0 0x7f8be419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8be4108d10 0x7f8be419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 --2- 172.21.15.6:0/1949000552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4102a80 0x7f8be419a3f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 >> 172.21.15.6:0/1949000552 conn(0x7f8be4079740 msgr2=0x7f8be4101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:33.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 shutdown_connections 2024-09-21T08:15:33.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:33.017+0000 7f8be9a75640 1 -- 172.21.15.6:0/1949000552 wait complete. 2024-09-21T08:15:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:33 smithi006 ceph-mon[30970]: pgmap v796: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-21T08:15:33.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:33 smithi119 ceph-mon[33564]: pgmap v796: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-21T08:15:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:33 smithi145 ceph-mon[34049]: pgmap v796: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2024-09-21T08:15:33.803 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '12578a36', total seconds elapsed: 22.5 2024-09-21T08:15:33.803 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T08:15:33.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 -- 172.21.15.6:0/1147239290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 msgr2=0x7f41f810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 --2- 172.21.15.6:0/1147239290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 0x7f41f810a3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41f401a910 tx=0x7f41f403b450 comp rx=0 tx=0).stop 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 -- 172.21.15.6:0/1147239290 shutdown_connections 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 --2- 172.21.15.6:0/1147239290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 --2- 172.21.15.6:0/1147239290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f810a9e0 0x7f41f810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 --2- 172.21.15.6:0/1147239290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 0x7f41f810a3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.845+0000 7f41fff45640 1 -- 172.21.15.6:0/1147239290 >> 172.21.15.6:0/1147239290 conn(0x7f41f8070ec0 msgr2=0x7f41f80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.848+0000 7f41fff45640 1 -- 172.21.15.6:0/1147239290 shutdown_connections 2024-09-21T08:15:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.848+0000 7f41fff45640 1 -- 172.21.15.6:0/1147239290 wait complete. 2024-09-21T08:15:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.849+0000 7f41fff45640 1 Processor -- start 2024-09-21T08:15:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.849+0000 7f41fff45640 1 -- start start 2024-09-21T08:15:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f810a9e0 0x7f41f811c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 0x7f41f8118610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41f8114ac0 con 0x7f41f811cc30 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41f8114940 con 0x7f41f810a9e0 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fff45640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f41f8114c40 con 0x7f41f8111f40 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fe4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fe4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56528/0 (socket says 172.21.15.6:56528) 2024-09-21T08:15:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.850+0000 7f41fe4e2640 1 -- 172.21.15.6:0/976305754 learned_addr learned my addr 172.21.15.6:0/976305754 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.851+0000 7f41fe4e2640 1 -- 172.21.15.6:0/976305754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 msgr2=0x7f41f8118610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.851+0000 7f41fe4e2640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 0x7f41f8118610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.851+0000 7f41fe4e2640 1 -- 172.21.15.6:0/976305754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f810a9e0 msgr2=0x7f41f811c330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.851+0000 7f41fe4e2640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f810a9e0 0x7f41f811c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.851+0000 7f41fe4e2640 1 -- 172.21.15.6:0/976305754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f81192d0 con 0x7f41f811cc30 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.852+0000 7f41fe4e2640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f41f000eb10 tx=0x7f41f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.852+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0004b20 con 0x7f41f811cc30 2024-09-21T08:15:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.852+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f81acdd0 con 0x7f41f811cc30 2024-09-21T08:15:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.852+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f81ad2b0 con 0x7f41f811cc30 2024-09-21T08:15:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.852+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41f0004cc0 con 0x7f41f811cc30 2024-09-21T08:15:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.853+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0010690 con 0x7f41f811cc30 2024-09-21T08:15:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.854+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc0052c0 con 0x7f41f811cc30 2024-09-21T08:15:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.859+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f41f0010830 con 0x7f41f811cc30 2024-09-21T08:15:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.860+0000 7f41eeffd640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 0x7f41e40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.861+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f41f00e8300 con 0x7f41f811cc30 2024-09-21T08:15:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.861+0000 7f41fdce1640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 0x7f41e40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.862+0000 7f41fdce1640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 0x7f41e40b8c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f41f401a860 tx=0x7f41f4005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:34.866+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41f0056710 con 0x7f41f811cc30 2024-09-21T08:15:35.287 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:35 smithi006 ceph-mon[30970]: pgmap v797: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-09-21T08:15:35.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.284+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41dc0055b0 con 0x7f41f811cc30 2024-09-21T08:15:35.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.287+0000 7f41eeffd640 1 -- 172.21.15.6:0/976305754 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f41f00ae4a0 con 0x7f41f811cc30 2024-09-21T08:15:35.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:35.290 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:35.290 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 msgr2=0x7f41e40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 0x7f41e40b8c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f41f401a860 tx=0x7f41f4005fd0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 msgr2=0x7f41f8118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f41f000eb10 tx=0x7f41f000c2d0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 shutdown_connections 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f41e40b6730 0x7f41e40b8c40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41f8111f40 0x7f41f8118610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41f811cc30 0x7f41f8118b50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 --2- 172.21.15.6:0/976305754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41f810a9e0 0x7f41f811c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.291+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 >> 172.21.15.6:0/976305754 conn(0x7f41f8070ec0 msgr2=0x7f41f8073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.292+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 shutdown_connections 2024-09-21T08:15:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:35.292+0000 7f41fff45640 1 -- 172.21.15.6:0/976305754 wait complete. 2024-09-21T08:15:35.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:35 smithi119 ceph-mon[33564]: pgmap v797: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-09-21T08:15:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:35 smithi145 ceph-mon[34049]: pgmap v797: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 121 op/s 2024-09-21T08:15:35.998 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T08:15:35.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T08:15:36.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:36 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/976305754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:36.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:36 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/976305754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:36.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:36 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/976305754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:36.478 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:37 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:15:37.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:37 smithi006 ceph-mon[30970]: pgmap v798: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 857 KiB/s wr, 96 op/s 2024-09-21T08:15:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:37 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:15:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:37 smithi119 ceph-mon[33564]: pgmap v798: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 857 KiB/s wr, 96 op/s 2024-09-21T08:15:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:37 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:15:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:37 smithi145 ceph-mon[34049]: pgmap v798: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 857 KiB/s wr, 96 op/s 2024-09-21T08:15:37.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.112+0000 7f25e4833640 1 -- 172.21.15.6:0/4253840340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e011d0e0 msgr2=0x7f25e011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.112+0000 7f25e4833640 1 --2- 172.21.15.6:0/4253840340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e011d0e0 0x7f25e011f500 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009900 tx=0x7f25d802a420 comp rx=0 tx=0).stop 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.115+0000 7f25e4833640 1 -- 172.21.15.6:0/4253840340 shutdown_connections 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.115+0000 7f25e4833640 1 --2- 172.21.15.6:0/4253840340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010ad10 0x7f25e011cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.115+0000 7f25e4833640 1 --2- 172.21.15.6:0/4253840340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e011d0e0 0x7f25e011f500 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.115+0000 7f25e4833640 1 --2- 172.21.15.6:0/4253840340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e010a3c0 0x7f25e010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.115+0000 7f25e4833640 1 -- 172.21.15.6:0/4253840340 >> 172.21.15.6:0/4253840340 conn(0x7f25e0070e80 msgr2=0x7f25e0071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.121+0000 7f25e4833640 1 -- 172.21.15.6:0/4253840340 shutdown_connections 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.123+0000 7f25e4833640 1 -- 172.21.15.6:0/4253840340 wait complete. 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.124+0000 7f25e4833640 1 Processor -- start 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.124+0000 7f25e4833640 1 -- start start 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.124+0000 7f25e4833640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25e4833640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e010ad10 0x7f25e01a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25e4833640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e011d0e0 0x7f25e01aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25e4833640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01227f0 con 0x7f25e010ad10 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25e4833640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0122670 con 0x7f25e011d0e0 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25e4833640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0122970 con 0x7f25e010a3c0 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:52738/0 (socket says 172.21.15.6:52738) 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 -- 172.21.15.6:0/773676394 learned_addr learned my addr 172.21.15.6:0/773676394 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25ded9d640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e011d0e0 0x7f25e01aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e010ad10 0x7f25e01a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 -- 172.21.15.6:0/773676394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e011d0e0 msgr2=0x7f25e01aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e011d0e0 0x7f25e01aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.125+0000 7f25de59c640 1 -- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e010ad10 msgr2=0x7f25e01a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.126+0000 7f25de59c640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e010ad10 0x7f25e01a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.126+0000 7f25de59c640 1 -- 172.21.15.6:0/773676394 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01af170 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.126+0000 7f25de59c640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f25d000b9e0 tx=0x7f25d000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.127+0000 7f25cf7fe640 1 -- 172.21.15.6:0/773676394 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0019070 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.127+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e01af460 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.127+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01b5bc0 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.127+0000 7f25cf7fe640 1 -- 172.21.15.6:0/773676394 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d000cba0 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.127+0000 7f25cf7fe640 1 -- 172.21.15.6:0/773676394 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0019070 con 0x7f25e010a3c0 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.133+0000 7f25eada7740 1 Processor -- start 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.133+0000 7f25eada7740 1 -- start start 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea71e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563f7e9e8bb0 con 0x563f7e6a2990 2024-09-21T08:15:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f7e9d7fe0 con 0x563f7e6aab70 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.134+0000 7f25eada7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563f7e9dbdf0 con 0x563f7e6cb850 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:59826/0 (socket says 172.21.15.6:59826) 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 -- 172.21.15.6:0/2433837099 learned_addr learned my addr 172.21.15.6:0/2433837099 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25de59c640 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 -- 172.21.15.6:0/2433837099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 msgr2=0x563f7ea71e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea71e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 -- 172.21.15.6:0/2433837099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 msgr2=0x563f7ea723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.135+0000 7f25ddd9b640 1 -- 172.21.15.6:0/2433837099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7e745ba0 con 0x563f7e6aab70 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.137+0000 7f25cf7fe640 1 -- 172.21.15.6:0/773676394 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f25d001c070 con 0x7f25e010a3c0 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.137+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bc30 tx=0x7f25d40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5f1d21356a121b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.138+0000 7f25cf7fe640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 0x7f25c80b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.138+0000 7f25cf7fe640 1 -- 172.21.15.6:0/773676394 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f25d00e6a10 con 0x7f25e010a3c0 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.140+0000 7f25ccff9640 1 -- 172.21.15.6:0/2433837099 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d401c480 con 0x563f7e6aab70 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.140+0000 7f25ccff9640 1 -- 172.21.15.6:0/2433837099 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d401cab0 con 0x563f7e6aab70 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.141+0000 7f25eada7740 1 -- 172.21.15.6:0/2433837099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 msgr2=0x563f7ea728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.141+0000 7f25eada7740 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bc30 tx=0x7f25d40107a0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25ded9d640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 0x7f25c80b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25eada7740 1 -- 172.21.15.6:0/2433837099 shutdown_connections 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25eada7740 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea728f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25eada7740 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25eada7740 1 --2- 172.21.15.6:0/2433837099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea71e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.142+0000 7f25eada7740 1 -- 172.21.15.6:0/2433837099 >> 172.21.15.6:0/2433837099 conn(0x563f7e6bfc40 msgr2=0x563f7ea6fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.143+0000 7f25eada7740 1 -- 172.21.15.6:0/2433837099 shutdown_connections 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.143+0000 7f25eada7740 1 -- 172.21.15.6:0/2433837099 wait complete. 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.143+0000 7f25eada7740 1 -- start start 2024-09-21T08:15:37.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.143+0000 7f25eada7740 1 Processor -- start 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6a2990 0x563f7ea8e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6aab70 0x563f7ea8ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563f7e8397b0 con 0x563f7e6cb850 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f7e972e90 con 0x563f7e6a2990 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563f7ea915a0 con 0x563f7e6aab70 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25eada7740 10 client.0 _ll_register_callbacks cb 0x563f7e9d5710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.144+0000 7f25ded9d640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 0x7f25c80b8ed0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f25d802a990 tx=0x7f25d802a920 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.145+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6aab70 0x563f7ea8ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.145+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.145+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55508/0 (socket says 172.21.15.6:55508) 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.145+0000 7f25ded9d640 1 -- 172.21.15.6:0/2347852509 learned_addr learned my addr 172.21.15.6:0/2347852509 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.145+0000 7f25de59c640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6a2990 0x563f7ea8e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 -- 172.21.15.6:0/2347852509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6aab70 msgr2=0x563f7ea8ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6aab70 0x563f7ea8ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 -- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6a2990 msgr2=0x563f7ea8e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6a2990 0x563f7ea8e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 -- 172.21.15.6:0/2347852509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f7ea9aef0 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25ded9d640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f25d8033000 tx=0x7f25d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b469d2a24f105a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.146+0000 7f25c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.147+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d804d020 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.147+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f25d8049480 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.147+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d401cab0 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.148+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f25d8035040 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.149+0000 7f25eada7740 10 client.17706 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.149+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563f7ea9d820 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.149+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d401cab0 con 0x563f7e6cb850 2024-09-21T08:15:37.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f25d803c730 con 0x563f7e6cb850 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 10 client.17706 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 10 client.17706 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 20 client.17706 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e68a1d0 0x563f7eaa1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 4 client.17706 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.150+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f7e9eab00 con 0x563f7e68a1d0 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.151+0000 7f25de59c640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e68a1d0 0x563f7eaa1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.152+0000 7f25c5ffb640 10 client.17706 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.152+0000 7f25de59c640 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e68a1d0 0x563f7eaa1160 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa79fa57325f9e34 server_cookie=2b924b6274dde1f7 in_seq=0 out_seq=0 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.152+0000 7f25c5ffb640 1 -- 172.21.15.6:0/2347852509 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f7e9eab00 con 0x563f7e68a1d0 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.152+0000 7f25c5ffb640 10 client.17706 handle_command_reply: tid=0 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 client.17706 shutdown 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 msgr2=0x563f7ea9a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f25d8033000 tx=0x7f25d8009260 comp rx=0 tx=0).stop 2024-09-21T08:15:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 shutdown_connections 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e68a1d0 0x563f7eaa1160 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6aab70 0x563f7ea8ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6cb850 0x563f7ea9a9b0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 --2- 172.21.15.6:0/2347852509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6a2990 0x563f7ea8e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 >> 172.21.15.6:0/2347852509 conn(0x563f7e6bfc40 msgr2=0x563f7ea6e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.153+0000 7f25c5ffb640 0 client.17706 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.154+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 shutdown_connections 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.154+0000 7f25eada7740 1 -- 172.21.15.6:0/2347852509 wait complete. 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.154+0000 7f25eada7740 20 client.17706 trim_cache size 0 max 16384 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.186+0000 7f25eada7740 1 Processor -- start 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 -- start start 2024-09-21T08:15:37.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6a2990 0x563f7ea8d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 0x563f7ea8d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 0x563f7ea6e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f25c000e140 con 0x563f7e6aab70 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00109a0 con 0x563f7e6cb850 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25eada7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f25c000e790 con 0x563f7e6a2990 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 0x563f7ea8d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 0x563f7ea8d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55516/0 (socket says 172.21.15.6:55516) 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25ddd9b640 1 -- 172.21.15.6:0/3454712893 learned_addr learned my addr 172.21.15.6:0/3454712893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.187+0000 7f25ded9d640 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 0x563f7ea6e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25de59c640 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6a2990 0x563f7ea8d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 -- 172.21.15.6:0/3454712893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6a2990 msgr2=0x563f7ea8d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6a2990 0x563f7ea8d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 -- 172.21.15.6:0/3454712893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 msgr2=0x563f7ea8d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 0x563f7ea8d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 -- 172.21.15.6:0/3454712893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f7ea8f0a0 con 0x563f7e6cb850 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25ded9d640 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 0x563f7ea6e240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25d803cb20 tx=0x7f25d802a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452fe9a3846ac9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25c7fff640 1 -- 172.21.15.6:0/3454712893 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8060070 con 0x563f7e6cb850 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25c7fff640 1 -- 172.21.15.6:0/3454712893 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d8004290 con 0x563f7e6cb850 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.188+0000 7f25c7fff640 1 -- 172.21.15.6:0/3454712893 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d804d040 con 0x563f7e6cb850 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 -- 172.21.15.6:0/3454712893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 msgr2=0x563f7ea6e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 0x563f7ea6e240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25d803cb20 tx=0x7f25d802a420 comp rx=0 tx=0).stop 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 -- 172.21.15.6:0/3454712893 shutdown_connections 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6cb850 0x563f7ea6e240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6aab70 0x563f7ea8d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 --2- 172.21.15.6:0/3454712893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6a2990 0x563f7ea8d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 -- 172.21.15.6:0/3454712893 >> 172.21.15.6:0/3454712893 conn(0x563f7e6bfc40 msgr2=0x563f7ea8dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 -- 172.21.15.6:0/3454712893 shutdown_connections 2024-09-21T08:15:37.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.190+0000 7f25eada7740 1 -- 172.21.15.6:0/3454712893 wait complete. 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.191+0000 7f25eada7740 1 -- start start 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.191+0000 7f25eada7740 1 Processor -- start 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea96e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f25c000ee60 con 0x563f7e6a2990 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00102d0 con 0x563f7e6aab70 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f25c000f530 con 0x563f7e6cb850 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25eada7740 10 client.0 _ll_register_callbacks cb 0x7f25d8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25de59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25de59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55526/0 (socket says 172.21.15.6:55526) 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25de59c640 1 -- 172.21.15.6:0/4133356298 learned_addr learned my addr 172.21.15.6:0/4133356298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.192+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea96e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 -- 172.21.15.6:0/4133356298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 msgr2=0x563f7ea918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea918d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 -- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 msgr2=0x563f7ea96e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea96e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 -- 172.21.15.6:0/4133356298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f7eaa1730 con 0x563f7e6a2990 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25de59c640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f25d000b9b0 tx=0x7f25d00ea3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d07486a5e2a302f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.193+0000 7f25c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00d0e60 con 0x563f7e6a2990 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f25d00a9800 con 0x563f7e6a2990 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d8004290 con 0x563f7e6a2990 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f25d00b1fc0 con 0x563f7e6a2990 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25eada7740 10 client.17712 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:37.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.194+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563f7eb0c080 con 0x563f7e6a2990 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d00b6f00 con 0x563f7e6a2990 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f25d00a9040 con 0x563f7e6a2990 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 10 client.17712 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 10 client.17712 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 20 client.17712 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e65f580 0x563f7eb0e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 4 client.17712 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.195+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x7f25d8004290 con 0x563f7e65f580 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.196+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e65f580 0x563f7eb0e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.197+0000 7f25ddd9b640 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e65f580 0x563f7eb0e860 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea60069ce32bdbb server_cookie=ceb57fda20e6e789 in_seq=0 out_seq=0 2024-09-21T08:15:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.197+0000 7f25c5ffb640 10 client.17712 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25c5ffb640 1 -- 172.21.15.6:0/4133356298 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f25d8004290 con 0x563f7e65f580 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25c5ffb640 10 client.17712 handle_command_reply: tid=0 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 client.17712 shutdown 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 msgr2=0x563f7ea96920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f25d000b9b0 tx=0x7f25d00ea3f0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 shutdown_connections 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563f7e65f580 0x563f7eb0e860 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563f7e6cb850 0x563f7ea918d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25c5ffb640 0 client.17712 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f7e6aab70 0x563f7ea96e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 --2- 172.21.15.6:0/4133356298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563f7e6a2990 0x563f7ea96920 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 >> 172.21.15.6:0/4133356298 conn(0x563f7e6bfc40 msgr2=0x563f7ea8dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 shutdown_connections 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 1 -- 172.21.15.6:0/4133356298 wait complete. 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.512+0000 7f25eada7740 20 client.17712 trim_cache size 0 max 16384 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 58, 2024-09-21T08:15:37.516 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "b443caa5": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 58, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 138.8, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:37.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:37.518 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 msgr2=0x7f25c80b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 0x7f25c80b8ed0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f25d802a990 tx=0x7f25d802a920 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 msgr2=0x7f25e01a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f25d000b9e0 tx=0x7f25d000bea0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 shutdown_connections 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f25c80b69c0 0x7f25c80b8ed0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25e011d0e0 0x7f25e01aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e010ad10 0x7f25e01a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 --2- 172.21.15.6:0/773676394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25e010a3c0 0x7f25e01a9200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 >> 172.21.15.6:0/773676394 conn(0x7f25e0070e80 msgr2=0x7f25e011e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 shutdown_connections 2024-09-21T08:15:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:37.513+0000 7f25e4833640 1 -- 172.21.15.6:0/773676394 wait complete. 2024-09-21T08:15:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 760.0 s, 662.7 tps, lat 538.083 ms stddev 2367.435 2024-09-21T08:15:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:39 smithi119 ceph-mon[33564]: pgmap v799: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T08:15:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:39 smithi145 ceph-mon[34049]: pgmap v799: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T08:15:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:39 smithi006 ceph-mon[30970]: pgmap v799: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 156 op/s 2024-09-21T08:15:41.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:41 smithi006 ceph-mon[30970]: pgmap v800: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-21T08:15:41.404 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b443caa5', quiesce took 7.6 seconds. Will release after: 11.250000000000002 2024-09-21T08:15:41.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:41 smithi119 ceph-mon[33564]: pgmap v800: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-21T08:15:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:41 smithi145 ceph-mon[34049]: pgmap v800: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-21T08:15:42.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:15:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:43 smithi119 ceph-mon[33564]: pgmap v801: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-21T08:15:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:43 smithi145 ceph-mon[34049]: pgmap v801: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-21T08:15:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:43 smithi006 ceph-mon[30970]: pgmap v801: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-21T08:15:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:45 smithi119 ceph-mon[33564]: pgmap v802: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-09-21T08:15:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:45 smithi145 ceph-mon[34049]: pgmap v802: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-09-21T08:15:45.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:45 smithi006 ceph-mon[30970]: pgmap v802: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-09-21T08:15:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:47 smithi119 ceph-mon[33564]: pgmap v803: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T08:15:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:47 smithi145 ceph-mon[34049]: pgmap v803: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T08:15:47.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:47 smithi006 ceph-mon[30970]: pgmap v803: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T08:15:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:15:49.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:49 smithi119 ceph-mon[33564]: pgmap v804: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-09-21T08:15:49.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:49 smithi145 ceph-mon[34049]: pgmap v804: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-09-21T08:15:49.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:49 smithi006 ceph-mon[30970]: pgmap v804: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-09-21T08:15:51.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:51 smithi119 ceph-mon[33564]: pgmap v805: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1008 KiB/s wr, 98 op/s 2024-09-21T08:15:51.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:51 smithi145 ceph-mon[34049]: pgmap v805: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1008 KiB/s wr, 98 op/s 2024-09-21T08:15:51.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:51 smithi006 ceph-mon[30970]: pgmap v805: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1008 KiB/s wr, 98 op/s 2024-09-21T08:15:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:15:52.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:53.658 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:53 smithi006 ceph-mon[30970]: pgmap v806: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-09-21T08:15:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 -- 172.21.15.6:0/2674344979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c1083c0 msgr2=0x7f514c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 --2- 172.21.15.6:0/2674344979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c1083c0 0x7f514c1087d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f513c009900 tx=0x7f513c02a410 comp rx=0 tx=0).stop 2024-09-21T08:15:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 -- 172.21.15.6:0/2674344979 shutdown_connections 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 --2- 172.21.15.6:0/2674344979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c108d10 0x7f514c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 --2- 172.21.15.6:0/2674344979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c1083c0 0x7f514c1087d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 --2- 172.21.15.6:0/2674344979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c102a80 0x7f514c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.416+0000 7f51540c2640 1 -- 172.21.15.6:0/2674344979 >> 172.21.15.6:0/2674344979 conn(0x7f514c079740 msgr2=0x7f514c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 -- 172.21.15.6:0/2674344979 shutdown_connections 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 -- 172.21.15.6:0/2674344979 wait complete. 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 Processor -- start 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 -- start start 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c102a80 0x7f514c0ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.417+0000 7f51540c2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c1083c0 0x7f514c0ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f51540c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f51540c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f514c112830 con 0x7f514c108d10 2024-09-21T08:15:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f51540c2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1126b0 con 0x7f514c102a80 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f51540c2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1129b0 con 0x7f514c1083c0 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46044/0 (socket says 172.21.15.6:46044) 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 -- 172.21.15.6:0/2638671400 learned_addr learned my addr 172.21.15.6:0/2638671400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f5151e5e640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c102a80 0x7f514c0ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515165d640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c1083c0 0x7f514c0ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 -- 172.21.15.6:0/2638671400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c1083c0 msgr2=0x7f514c0ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c1083c0 0x7f514c0ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 -- 172.21.15.6:0/2638671400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c102a80 msgr2=0x7f514c0ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c102a80 0x7f514c0ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 -- 172.21.15.6:0/2638671400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c1a8670 con 0x7f514c108d10 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f515265f640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f514400eaa0 tx=0x7f514400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.418+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514400cdb0 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.419+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5144005020 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.419+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c1a8960 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.419+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51440116d0 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.419+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c1a8e20 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.420+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514c103d00 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.421+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f51440051d0 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.422+0000 7f5142ffd640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 0x7f51380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.423+0000 7f5151e5e640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 0x7f51380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.423+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f51440e8020 con 0x7f514c108d10 2024-09-21T08:15:53.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.423+0000 7f5151e5e640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 0x7f51380b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f514c1010e0 tx=0x7f5148005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.426+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5144016030 con 0x7f514c108d10 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.656+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f514c102e90 con 0x7f514c108d10 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.657+0000 7f5142ffd640 1 -- 172.21.15.6:0/2638671400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f514c102e90 con 0x7f514c108d10 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 msgr2=0x7f51380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 0x7f51380b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f514c1010e0 tx=0x7f5148005f90 comp rx=0 tx=0).stop 2024-09-21T08:15:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 msgr2=0x7f514c100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f514400eaa0 tx=0x7f514400ef60 comp rx=0 tx=0).stop 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 shutdown_connections 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f51380b6680 0x7f51380b8b90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514c1083c0 0x7f514c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f514c108d10 0x7f514c100110 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 --2- 172.21.15.6:0/2638671400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c102a80 0x7f514c0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 >> 172.21.15.6:0/2638671400 conn(0x7f514c079740 msgr2=0x7f514c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 shutdown_connections 2024-09-21T08:15:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:53.659+0000 7f51540c2640 1 -- 172.21.15.6:0/2638671400 wait complete. 2024-09-21T08:15:53.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:53 smithi119 ceph-mon[33564]: pgmap v806: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-09-21T08:15:53.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:53 smithi145 ceph-mon[34049]: pgmap v806: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-09-21T08:15:54.524 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id b443caa5 --release --await' 2024-09-21T08:15:54.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id b443caa5 --release --await 2024-09-21T08:15:54.792 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:54.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2638671400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:54.913 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2638671400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:54.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2638671400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:55.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 -- 172.21.15.6:0/3546790421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c10de10 msgr2=0x7f713c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 --2- 172.21.15.6:0/3546790421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c10de10 0x7f713c110300 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ca0 tx=0x7f713402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 -- 172.21.15.6:0/3546790421 shutdown_connections 2024-09-21T08:15:55.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 --2- 172.21.15.6:0/3546790421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c10de10 0x7f713c110300 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 --2- 172.21.15.6:0/3546790421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c105300 0x7f713c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 --2- 172.21.15.6:0/3546790421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c1049b0 0x7f713c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 -- 172.21.15.6:0/3546790421 >> 172.21.15.6:0/3546790421 conn(0x7f713c079730 msgr2=0x7f713c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 -- 172.21.15.6:0/3546790421 shutdown_connections 2024-09-21T08:15:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.371+0000 7f7143935640 1 -- 172.21.15.6:0/3546790421 wait complete. 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 Processor -- start 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 -- start start 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 0x7f713c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c10de10 0x7f713c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f713c113990 con 0x7f713c105300 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f713c113810 con 0x7f713c1049b0 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7143935640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f713c113b10 con 0x7f713c10de10 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7140ed0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f71416d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 0x7f713c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7140ed0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46068/0 (socket says 172.21.15.6:46068) 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7141ed2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c10de10 0x7f713c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f7140ed0640 1 -- 172.21.15.6:0/4043513651 learned_addr learned my addr 172.21.15.6:0/4043513651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.372+0000 7f71416d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 0x7f713c19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:47856/0 (socket says 172.21.15.6:47856) 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 -- 172.21.15.6:0/4043513651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c10de10 msgr2=0x7f713c19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c10de10 0x7f713c19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 -- 172.21.15.6:0/4043513651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 msgr2=0x7f713c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 0x7f713c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 -- 172.21.15.6:0/4043513651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c1a02d0 con 0x7f713c105300 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7140ed0640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f712c00d740 tx=0x7f712c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f71327fc640 1 -- 172.21.15.6:0/4043513651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c017070 con 0x7f713c105300 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f71327fc640 1 -- 172.21.15.6:0/4043513651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f712c00de50 con 0x7f713c105300 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c1a05c0 con 0x7f713c105300 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f71327fc640 1 -- 172.21.15.6:0/4043513651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c00f620 con 0x7f713c105300 2024-09-21T08:15:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.373+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c1a6d20 con 0x7f713c105300 2024-09-21T08:15:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.376+0000 7f71327fc640 1 -- 172.21.15.6:0/4043513651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f712c01a070 con 0x7f713c105300 2024-09-21T08:15:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.376+0000 7f7149ea9740 1 Processor -- start 2024-09-21T08:15:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.376+0000 7f7149ea9740 1 -- start start 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 0x55d5097aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d509696dc0 con 0x55d509405520 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d5097231f0 con 0x55d5093dc660 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7149ea9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d509712620 con 0x55d5093e4840 2024-09-21T08:15:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46072/0 (socket says 172.21.15.6:46072) 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 -- 172.21.15.6:0/3106887096 learned_addr learned my addr 172.21.15.6:0/3106887096 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7140ed0640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f71416d1640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 0x55d5097aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 -- 172.21.15.6:0/3106887096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 msgr2=0x55d5097abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 -- 172.21.15.6:0/3106887096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 msgr2=0x55d5097aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 0x55d5097aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f7141ed2640 1 -- 172.21.15.6:0/3106887096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5096dafd0 con 0x55d509405520 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.377+0000 7f71416d1640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 0x55d5097aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71327fc640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 0x7f71280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71416d1640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 0x7f71280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ca0 tx=0x7f71340094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c020b5ea46b5208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71327fc640 1 -- 172.21.15.6:0/4043513651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f712c0e7230 con 0x7f713c105300 2024-09-21T08:15:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71277fe640 1 -- 172.21.15.6:0/3106887096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134031980 con 0x55d509405520 2024-09-21T08:15:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71277fe640 1 -- 172.21.15.6:0/3106887096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7134036030 con 0x55d509405520 2024-09-21T08:15:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.378+0000 7f71277fe640 1 -- 172.21.15.6:0/3106887096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134004590 con 0x55d509405520 2024-09-21T08:15:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 -- 172.21.15.6:0/3106887096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 msgr2=0x55d5097ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f71416d1640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 0x7f71280b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55d5097aa190 tx=0x7f713800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ca0 tx=0x7f71340094a0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 -- 172.21.15.6:0/3106887096 shutdown_connections 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093dc660 0x55d5097aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3106887096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097ab510 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 -- 172.21.15.6:0/3106887096 >> 172.21.15.6:0/3106887096 conn(0x55d5093f9910 msgr2=0x55d5097a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 -- 172.21.15.6:0/3106887096 shutdown_connections 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.379+0000 7f7149ea9740 1 -- 172.21.15.6:0/3106887096 wait complete. 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 -- start start 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 Processor -- start 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d5096ad300 con 0x55d5093dc660 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d509716430 con 0x55d509405520 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d509573bb0 con 0x55d5093e4840 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7149ea9740 10 client.0 _ll_register_callbacks cb 0x55d5096c7120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f71416d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f71416d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46074/0 (socket says 172.21.15.6:46074) 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f71416d1640 1 -- 172.21.15.6:0/2194518932 learned_addr learned my addr 172.21.15.6:0/2194518932 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.380+0000 7f7141ed2640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 -- 172.21.15.6:0/2194518932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 msgr2=0x55d5097b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 -- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 msgr2=0x55d5097b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 -- 172.21.15.6:0/2194518932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50969c780 con 0x55d5093dc660 2024-09-21T08:15:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f71416d1640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f713801f550 tx=0x7f7138004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb64ea6b6f3a762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713802c060 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f7138017030 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134036030 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7138033050 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7149ea9740 10 client.17730 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.381+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d509470b00 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7134036030 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7138010730 con 0x55d5093dc660 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 10 client.17730 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 10 client.17730 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 20 client.17730 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d5093c3ea0 0x55d5097c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 4 client.17730 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d509725140 con 0x55d5093c3ea0 2024-09-21T08:15:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.382+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d5093c3ea0 0x55d5097c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.383+0000 7f7124ff9640 10 client.17730 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.383+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d5093c3ea0 0x55d5097c8ed0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3365f1d409afe7 server_cookie=ce5cf688390a3f7a in_seq=0 out_seq=0 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.383+0000 7f7124ff9640 1 -- 172.21.15.6:0/2194518932 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d509725140 con 0x55d5093c3ea0 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.383+0000 7f7124ff9640 10 client.17730 handle_command_reply: tid=0 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.383+0000 7f7149ea9740 1 client.17730 shutdown 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 msgr2=0x55d5097b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f713801f550 tx=0x7f7138004730 comp rx=0 tx=0).stop 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 shutdown_connections 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d5093c3ea0 0x55d5097c8ed0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093e4840 0x55d5097b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2194518932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093dc660 0x55d5097b6b50 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7124ff9640 0 client.17730 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 >> 172.21.15.6:0/2194518932 conn(0x55d5093f9910 msgr2=0x55d5097ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 shutdown_connections 2024-09-21T08:15:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 1 -- 172.21.15.6:0/2194518932 wait complete. 2024-09-21T08:15:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.384+0000 7f7149ea9740 20 client.17730 trim_cache size 0 max 16384 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.401+0000 7f7149ea9740 1 Processor -- start 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 -- start start 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 0x55d5097ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f712000dfd0 con 0x55d509405520 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7120010830 con 0x55d5093e4840 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7149ea9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f712000e620 con 0x55d5093dc660 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46082/0 (socket says 172.21.15.6:46082) 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 -- 172.21.15.6:0/3028261724 learned_addr learned my addr 172.21.15.6:0/3028261724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7140ed0640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 0x55d5097ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f71416d1640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 -- 172.21.15.6:0/3028261724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 msgr2=0x55d5097b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 -- 172.21.15.6:0/3028261724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 msgr2=0x55d5097ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 0x55d5097ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7141ed2640 1 -- 172.21.15.6:0/3028261724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5094e7960 con 0x55d509405520 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.402+0000 7f7140ed0640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 0x55d5097ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7141ed2640 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7134005e30 tx=0x7f7134000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc2932cf790ece9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7126ffd640 1 -- 172.21.15.6:0/3028261724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134055070 con 0x55d509405520 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7126ffd640 1 -- 172.21.15.6:0/3028261724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7134036040 con 0x55d509405520 2024-09-21T08:15:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7126ffd640 1 -- 172.21.15.6:0/3028261724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713404a040 con 0x55d509405520 2024-09-21T08:15:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7149ea9740 1 -- 172.21.15.6:0/3028261724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 msgr2=0x55d5097cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.403+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7134005e30 tx=0x7f7134000f40 comp rx=0 tx=0).stop 2024-09-21T08:15:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 -- 172.21.15.6:0/3028261724 shutdown_connections 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d509405520 0x55d5097cec10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d5093e4840 0x55d5097ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 --2- 172.21.15.6:0/3028261724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 -- 172.21.15.6:0/3028261724 >> 172.21.15.6:0/3028261724 conn(0x55d5093f9910 msgr2=0x55d5097b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 -- 172.21.15.6:0/3028261724 shutdown_connections 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 -- 172.21.15.6:0/3028261724 wait complete. 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 -- start start 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.404+0000 7f7149ea9740 1 Processor -- start 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097bf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f712000ecf0 con 0x55d5093e4840 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7120010160 con 0x55d509405520 2024-09-21T08:15:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f712000f3c0 con 0x55d5093dc660 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7149ea9740 10 client.0 _ll_register_callbacks cb 0x7f713800b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46092/0 (socket says 172.21.15.6:46092) 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 -- 172.21.15.6:0/2309473229 learned_addr learned my addr 172.21.15.6:0/2309473229 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f71416d1640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7141ed2640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 -- 172.21.15.6:0/2309473229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 msgr2=0x55d5097bf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097bf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 -- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 msgr2=0x55d5097bdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097bdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 -- 172.21.15.6:0/2309473229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5097be480 con 0x55d5093e4840 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7140ed0640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f712c0e4bd0 tx=0x7f712c0ead80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a427c6754e0ff264 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.405+0000 7f7124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c021040 con 0x55d5093e4840 2024-09-21T08:15:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7f712c0d00b0 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134036040 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f712c0ac6d0 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 10 client.17736 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d509834780 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7134036040 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f712c0cece0 con 0x55d5093e4840 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 10 client.17736 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 10 client.17736 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 20 client.17736 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d509399250 0x55d509836e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 4 client.17736 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b443caa5", "release": true, "await": true}] 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b443caa5", "release": true, "await": true}) -- 0x55d509720bf0 con 0x55d509399250 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.406+0000 7f71416d1640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d509399250 0x55d509836e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.407+0000 7f71416d1640 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d509399250 0x55d509836e70 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92d119257087b1b server_cookie=9d2c91fe3d99dbd5 in_seq=0 out_seq=0 2024-09-21T08:15:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.407+0000 7f7124ff9640 10 client.17736 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.467+0000 7f7124ff9640 1 -- 172.21.15.6:0/2309473229 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d509720bf0 con 0x55d509399250 2024-09-21T08:15:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.467+0000 7f7124ff9640 10 client.17736 handle_command_reply: tid=0 2024-09-21T08:15:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.467+0000 7f7149ea9740 1 client.17736 shutdown 2024-09-21T08:15:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 msgr2=0x55d5097bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f712c0e4bd0 tx=0x7f712c0ead80 comp rx=0 tx=0).stop 2024-09-21T08:15:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 shutdown_connections 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d509399250 0x55d509836e70 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7124ff9640 0 client.17736 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d509405520 0x55d5097bdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5093e4840 0x55d5097bd8a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 --2- 172.21.15.6:0/2309473229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d5093dc660 0x55d5097bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 >> 172.21.15.6:0/2309473229 conn(0x55d5093f9910 msgr2=0x55d5097a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 shutdown_connections 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.468+0000 7f7149ea9740 1 -- 172.21.15.6:0/2309473229 wait complete. 2024-09-21T08:15:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.469+0000 7f7149ea9740 20 client.17736 trim_cache size 0 max 16384 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 60, 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "b443caa5": { 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 60, 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:55.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 138.8, 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:55.472 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 msgr2=0x7f71280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 0x7f71280b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55d5097aa190 tx=0x7f713800b390 comp rx=0 tx=0).stop 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 msgr2=0x7f713c19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f712c00d740 tx=0x7f712c00dc00 comp rx=0 tx=0).stop 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 shutdown_connections 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f71280b6680 0x7f71280b8b90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f713c10de10 0x7f713c19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f713c105300 0x7f713c19a900 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 --2- 172.21.15.6:0/4043513651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f713c1049b0 0x7f713c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 >> 172.21.15.6:0/4043513651 conn(0x7f713c079730 msgr2=0x7f713c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 shutdown_connections 2024-09-21T08:15:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:55.470+0000 7f7143935640 1 -- 172.21.15.6:0/4043513651 wait complete. 2024-09-21T08:15:55.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:55 smithi119 ceph-mon[33564]: pgmap v807: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 201 KiB/s wr, 24 op/s 2024-09-21T08:15:55.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:55 smithi145 ceph-mon[34049]: pgmap v807: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 201 KiB/s wr, 24 op/s 2024-09-21T08:15:55.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:55 smithi006 ceph-mon[30970]: pgmap v807: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 201 KiB/s wr, 24 op/s 2024-09-21T08:15:56.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:15:56.196 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b443caa5', total seconds elapsed: 22.4 2024-09-21T08:15:56.493 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.120+0000 7ff9063d1640 1 -- 172.21.15.6:0/4116746937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010f150 msgr2=0x7ff90010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.120+0000 7ff9063d1640 1 --2- 172.21.15.6:0/4116746937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010f150 0x7ff90010f560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8005fd0 tx=0x7ff8f802b430 comp rx=0 tx=0).stop 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 -- 172.21.15.6:0/4116746937 shutdown_connections 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 --2- 172.21.15.6:0/4116746937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010ad10 0x7ff900116fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 --2- 172.21.15.6:0/4116746937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 0x7ff90010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 --2- 172.21.15.6:0/4116746937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010f150 0x7ff90010f560 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 -- 172.21.15.6:0/4116746937 >> 172.21.15.6:0/4116746937 conn(0x7ff9000712f0 msgr2=0x7ff900073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 -- 172.21.15.6:0/4116746937 shutdown_connections 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.123+0000 7ff9063d1640 1 -- 172.21.15.6:0/4116746937 wait complete. 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.124+0000 7ff9063d1640 1 Processor -- start 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.124+0000 7ff9063d1640 1 -- start start 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 0x7ff9001a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010f150 0x7ff9001a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff900119f50 con 0x7ff90010a3c0 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff900119dd0 con 0x7ff90010f150 2024-09-21T08:15:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff9063d1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff90011a0d0 con 0x7ff90010ad10 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff8ff7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff8ff7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38890/0 (socket says 172.21.15.6:38890) 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.125+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1369269942 learned_addr learned my addr 172.21.15.6:0/1369269942 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff90496e640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010f150 0x7ff9001a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8fffff640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 0x7ff9001a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1369269942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010f150 msgr2=0x7ff9001a61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010f150 0x7ff9001a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 msgr2=0x7ff9001a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 0x7ff9001a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1369269942 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9001a66e0 con 0x7ff90010ad10 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.126+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9f0 tx=0x7ff8ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.127+0000 7ff8fd7fa640 1 -- 172.21.15.6:0/1369269942 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00ccc0 con 0x7ff90010ad10 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.127+0000 7ff8fd7fa640 1 -- 172.21.15.6:0/1369269942 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ec0035f0 con 0x7ff90010ad10 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.127+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9001a69d0 con 0x7ff90010ad10 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.127+0000 7ff8fd7fa640 1 -- 172.21.15.6:0/1369269942 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00ce60 con 0x7ff90010ad10 2024-09-21T08:15:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.127+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9001a6f10 con 0x7ff90010ad10 2024-09-21T08:15:57.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.130+0000 7ff8fd7fa640 1 -- 172.21.15.6:0/1369269942 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff8ec010690 con 0x7ff90010ad10 2024-09-21T08:15:57.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 Processor -- start 2024-09-21T08:15:57.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 -- start start 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 0x55fe6e00e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e00eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e00f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fe6df84e50 con 0x55fe6dc67070 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fe6df74280 con 0x55fe6dc46390 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.131+0000 7ff90c945740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fe6df78090 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff90496e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 0x55fe6e00e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff90496e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 0x55fe6e00e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55956/0 (socket says 172.21.15.6:55956) 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff90496e640 1 -- 172.21.15.6:0/3760432901 learned_addr learned my addr 172.21.15.6:0/3760432901 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e00eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 -- 172.21.15.6:0/3760432901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 msgr2=0x55fe6e00f0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:15:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e00f0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 -- 172.21.15.6:0/3760432901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 msgr2=0x55fe6e00e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 0x55fe6e00e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.132+0000 7ff8fffff640 1 -- 172.21.15.6:0/3760432901 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6dcd2650 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e00eb90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8007780 tx=0x7ff8f8007370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6081d7db56ff218a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff8fd7fa640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 0x7ff8e40b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff8f67fc640 1 -- 172.21.15.6:0/3760432901 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8041070 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff8f67fc640 1 -- 172.21.15.6:0/3760432901 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f8032a80 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff8f67fc640 1 -- 172.21.15.6:0/3760432901 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8037040 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.133+0000 7ff90496e640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 0x7ff8e40b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.134+0000 7ff90c945740 1 -- 172.21.15.6:0/3760432901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 msgr2=0x55fe6e00eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.134+0000 7ff90c945740 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e00eb90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8007780 tx=0x7ff8f8007370 comp rx=0 tx=0).stop 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff8fd7fa640 1 -- 172.21.15.6:0/1369269942 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff8ec0e7ea0 con 0x7ff90010ad10 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90496e640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 0x7ff8e40b8d40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009cd0 tx=0x7ff8f0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90c945740 1 -- 172.21.15.6:0/3760432901 shutdown_connections 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90c945740 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e00eb90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90c945740 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e00f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90c945740 1 --2- 172.21.15.6:0/3760432901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc67070 0x55fe6e00e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.135+0000 7ff90c945740 1 -- 172.21.15.6:0/3760432901 >> 172.21.15.6:0/3760432901 conn(0x55fe6dc5b460 msgr2=0x55fe6e00c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.136+0000 7ff90c945740 1 -- 172.21.15.6:0/3760432901 shutdown_connections 2024-09-21T08:15:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.136+0000 7ff90c945740 1 -- 172.21.15.6:0/3760432901 wait complete. 2024-09-21T08:15:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.137+0000 7ff90c945740 1 -- start start 2024-09-21T08:15:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.138+0000 7ff90c945740 1 Processor -- start 2024-09-21T08:15:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e019d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e01a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fe6ddd5700 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fe6df0f110 con 0x55fe6dc46390 2024-09-21T08:15:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fe6e01cdd0 con 0x55fe6dc67070 2024-09-21T08:15:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff90c945740 10 client.0 _ll_register_callbacks cb 0x55fe6df28990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.139+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e019d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.141+0000 7ff90496e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.141+0000 7ff90496e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38904/0 (socket says 172.21.15.6:38904) 2024-09-21T08:15:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.141+0000 7ff90496e640 1 -- 172.21.15.6:0/3668043622 learned_addr learned my addr 172.21.15.6:0/3668043622 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.141+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e01a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 -- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 msgr2=0x55fe6e01a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e01a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 -- 172.21.15.6:0/3668043622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 msgr2=0x55fe6e019d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e019d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 -- 172.21.15.6:0/3668043622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6df3cc40 con 0x55fe6dc67070 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e019d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:15:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.142+0000 7ff90496e640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f001e6b0 tx=0x7ff8f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc73dfa7050704a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.143+0000 7ff8e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:15:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.143+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f002b060 con 0x55fe6dc67070 2024-09-21T08:15:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.143+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff8f001c670 con 0x55fe6dc67070 2024-09-21T08:15:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.144+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f8032a80 con 0x55fe6dc67070 2024-09-21T08:15:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.144+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff8f001c870 con 0x55fe6dc67070 2024-09-21T08:15:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.144+0000 7ff90c945740 10 client.27448 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.144+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fe6e028b90 con 0x55fe6dc67070 2024-09-21T08:15:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f00114a0 con 0x55fe6dc67070 2024-09-21T08:15:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff8f001a040 con 0x55fe6dc67070 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 10 client.27448 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 10 client.27448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 20 client.27448 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc259f0 0x55fe6e02c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 4 client.27448 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8f8032a80 con 0x55fe6dc259f0 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.145+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc259f0 0x55fe6e02c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.146+0000 7ff8fffff640 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc259f0 0x55fe6e02c030 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35b2a977f289b75 server_cookie=431213292308d03f in_seq=0 out_seq=0 2024-09-21T08:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.146+0000 7ff8e37fe640 10 client.27448 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.147+0000 7ff8e37fe640 1 -- 172.21.15.6:0/3668043622 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ff8f8032a80 con 0x55fe6dc259f0 2024-09-21T08:15:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.147+0000 7ff8e37fe640 10 client.27448 handle_command_reply: tid=0 2024-09-21T08:15:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.147+0000 7ff90c945740 1 client.27448 shutdown 2024-09-21T08:15:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 msgr2=0x55fe6e0260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f001e6b0 tx=0x7ff8f00046c0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 shutdown_connections 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc259f0 0x55fe6e02c030 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff8e37fe640 0 client.27448 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc67070 0x55fe6e0260f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc46390 0x55fe6e01a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.148+0000 7ff90c945740 1 --2- 172.21.15.6:0/3668043622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e019d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.149+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 >> 172.21.15.6:0/3668043622 conn(0x55fe6dc5b460 msgr2=0x55fe6e011830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.150+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 shutdown_connections 2024-09-21T08:15:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.150+0000 7ff90c945740 1 -- 172.21.15.6:0/3668043622 wait complete. 2024-09-21T08:15:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.150+0000 7ff90c945740 20 client.27448 trim_cache size 0 max 16384 2024-09-21T08:15:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.184+0000 7ff90c945740 1 Processor -- start 2024-09-21T08:15:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 -- start start 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 0x55fe6e019af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc46390 0x55fe6e00bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b53f0 con 0x55fe6dc46390 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b7c50 con 0x55fe6dc259f0 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.185+0000 7ff90c945740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b5a40 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 0x55fe6e019af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 0x55fe6e019af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:45572/0 (socket says 172.21.15.6:45572) 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8fffff640 1 -- 172.21.15.6:0/1057993980 learned_addr learned my addr 172.21.15.6:0/1057993980 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1057993980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 msgr2=0x55fe6e019af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 0x55fe6e019af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1057993980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc46390 msgr2=0x55fe6e00bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc46390 0x55fe6e00bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.186+0000 7ff8ff7fe640 1 -- 172.21.15.6:0/1057993980 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6e018240 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.187+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01a030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0e51e0 tx=0x7ff8ec0ad7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=774c50060903f659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.187+0000 7ff8f5ffb640 1 -- 172.21.15.6:0/1057993980 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec08c120 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.187+0000 7ff8f5ffb640 1 -- 172.21.15.6:0/1057993980 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ec0b2030 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.188+0000 7ff8f5ffb640 1 -- 172.21.15.6:0/1057993980 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0b7300 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.189+0000 7ff90c945740 1 -- 172.21.15.6:0/1057993980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 msgr2=0x55fe6e01a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.189+0000 7ff90c945740 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01a030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0e51e0 tx=0x7ff8ec0ad7b0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 -- 172.21.15.6:0/1057993980 shutdown_connections 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01a030 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc46390 0x55fe6e00bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 --2- 172.21.15.6:0/1057993980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc259f0 0x55fe6e019af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 -- 172.21.15.6:0/1057993980 >> 172.21.15.6:0/1057993980 conn(0x55fe6dc5b460 msgr2=0x55fe6e014ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 -- 172.21.15.6:0/1057993980 shutdown_connections 2024-09-21T08:15:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 -- 172.21.15.6:0/1057993980 wait complete. 2024-09-21T08:15:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.191+0000 7ff90c945740 1 -- start start 2024-09-21T08:15:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 Processor -- start 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 0x55fe6e01e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 0x55fe6e01ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b6110 con 0x55fe6dc259f0 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b7580 con 0x55fe6dc3e1b0 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b67e0 con 0x55fe6dc46390 2024-09-21T08:15:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.192+0000 7ff90c945740 10 client.0 _ll_register_callbacks cb 0x7ff8f0013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:15:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.193+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 0x55fe6e01e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.193+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 0x55fe6e01e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55992/0 (socket says 172.21.15.6:55992) 2024-09-21T08:15:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.193+0000 7ff8fffff640 1 -- 172.21.15.6:0/1298526697 learned_addr learned my addr 172.21.15.6:0/1298526697 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.193+0000 7ff90496e640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 0x55fe6e01ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.193+0000 7ff8ff7fe640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 -- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc3e1b0 msgr2=0x55fe6e01e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 -- 172.21.15.6:0/1298526697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 msgr2=0x55fe6e01e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 0x55fe6e01e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 -- 172.21.15.6:0/1298526697 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6e095c30 con 0x55fe6dc46390 2024-09-21T08:15:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff90496e640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 0x55fe6e01ec70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0018040 tx=0x7ff8f001c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2788eb32fdefc198 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.194+0000 7ff8e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0035080 con 0x55fe6dc46390 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7ff8f0005590 con 0x55fe6dc46390 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ec0b2030 con 0x55fe6dc46390 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff8f002b020 con 0x55fe6dc46390 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff90c945740 10 client.27454 fetch_fsmap learned FSMap version 21 2024-09-21T08:15:57.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.195+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fe6e096f10 con 0x55fe6dc46390 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ec0b2030 con 0x55fe6dc46390 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff8f001a070 con 0x55fe6dc46390 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 10 client.27454 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 10 client.27454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 20 client.27454 populate_metadata read hostname 'smithi006' 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc67070 0x55fe6e0996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 4 client.27454 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe6df86da0 con 0x55fe6dc67070 2024-09-21T08:15:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.196+0000 7ff8fffff640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc67070 0x55fe6e0996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.197+0000 7ff8fffff640 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc67070 0x55fe6e0996b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9113301bc12c9c73 server_cookie=35d82016a8e5c62e in_seq=0 out_seq=0 2024-09-21T08:15:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.197+0000 7ff8e37fe640 10 client.27454 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.198+0000 7ff8e37fe640 1 -- 172.21.15.6:0/1298526697 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x55fe6df86da0 con 0x55fe6dc67070 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.198+0000 7ff8e37fe640 10 client.27454 handle_command_reply: tid=0 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.198+0000 7ff90c945740 1 client.27454 shutdown 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.198+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 msgr2=0x55fe6e01ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 0x55fe6e01ec70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0018040 tx=0x7ff8f001c760 comp rx=0 tx=0).stop 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 shutdown_connections 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55fe6dc67070 0x55fe6e0996b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fe6dc46390 0x55fe6e01ec70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fe6dc3e1b0 0x55fe6e01e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 --2- 172.21.15.6:0/1298526697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe6dc259f0 0x55fe6e01e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 >> 172.21.15.6:0/1298526697 conn(0x55fe6dc5b460 msgr2=0x55fe6e019af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff8e37fe640 0 client.27454 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 shutdown_connections 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.199+0000 7ff90c945740 1 -- 172.21.15.6:0/1298526697 wait complete. 2024-09-21T08:15:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.200+0000 7ff90c945740 20 client.27454 trim_cache size 0 max 16384 2024-09-21T08:15:57.202 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:15:57.202 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:15:57.204 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:15:57.205 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.207 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.208 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.210 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:15:57.211 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:15:57.212 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:15:57.213 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.214 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:15:57.216 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:15:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.203+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 msgr2=0x7ff8e40b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.203+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 0x7ff8e40b8d40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009cd0 tx=0x7ff8f0005f90 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.203+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 msgr2=0x7ff9001a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.203+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9f0 tx=0x7ff8ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 shutdown_connections 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff8e40b6830 0x7ff8e40b8d40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff90010ad10 0x7ff9001a0da0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff90010f150 0x7ff9001a61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 --2- 172.21.15.6:0/1369269942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff90010a3c0 0x7ff9001a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 >> 172.21.15.6:0/1369269942 conn(0x7ff9000712f0 msgr2=0x7ff90010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 shutdown_connections 2024-09-21T08:15:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:57.204+0000 7ff9063d1640 1 -- 172.21.15.6:0/1369269942 wait complete. 2024-09-21T08:15:57.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 780.0 s, 313.5 tps, lat 1298.904 ms stddev 4466.192 2024-09-21T08:15:57.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:57 smithi119 ceph-mon[33564]: pgmap v808: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 232 KiB/s wr, 25 op/s 2024-09-21T08:15:57.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:57 smithi145 ceph-mon[34049]: pgmap v808: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 232 KiB/s wr, 25 op/s 2024-09-21T08:15:57.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:57 smithi006 ceph-mon[30970]: pgmap v808: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 232 KiB/s wr, 25 op/s 2024-09-21T08:15:58.042 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:15:58.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:15:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:15:58.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:58 smithi006 ceph-mon[30970]: pgmap v809: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 556 KiB/s wr, 65 op/s 2024-09-21T08:15:58.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:58 smithi119 ceph-mon[33564]: pgmap v809: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 556 KiB/s wr, 65 op/s 2024-09-21T08:15:58.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:58 smithi145 ceph-mon[34049]: pgmap v809: 129 pgs: 129 active+clean; 3.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 556 KiB/s wr, 65 op/s 2024-09-21T08:15:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.174+0000 7fa8eb59e640 1 -- 172.21.15.6:0/1980372309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec109fc0 msgr2=0x7fa8ec10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:59.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.174+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/1980372309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec10a3d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009900 tx=0x7fa8dc02a420 comp rx=0 tx=0).stop 2024-09-21T08:15:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.176+0000 7fa8eb59e640 1 -- 172.21.15.6:0/1980372309 shutdown_connections 2024-09-21T08:15:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.176+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/1980372309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec110250 0x7fa8ec116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.176+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/1980372309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 0x7fa8ec10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.176+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/1980372309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec10a3d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.176+0000 7fa8eb59e640 1 -- 172.21.15.6:0/1980372309 >> 172.21.15.6:0/1980372309 conn(0x7fa8ec079650 msgr2=0x7fa8ec1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.178+0000 7fa8eb59e640 1 -- 172.21.15.6:0/1980372309 shutdown_connections 2024-09-21T08:15:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.178+0000 7fa8eb59e640 1 -- 172.21.15.6:0/1980372309 wait complete. 2024-09-21T08:15:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.179+0000 7fa8eb59e640 1 Processor -- start 2024-09-21T08:15:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 -- start start 2024-09-21T08:15:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 0x7fa8ec06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec06d540 con 0x7fa8ec109fc0 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec06d3c0 con 0x7fa8ec10f900 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8eb59e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec06d6c0 con 0x7fa8ec110250 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.180+0000 7fa8ead9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.181+0000 7fa8ead9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38954/0 (socket says 172.21.15.6:38954) 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.181+0000 7fa8ead9d640 1 -- 172.21.15.6:0/2880314457 learned_addr learned my addr 172.21.15.6:0/2880314457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.181+0000 7fa8e9d9b640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 0x7fa8ec06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ea59c640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 -- 172.21.15.6:0/2880314457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 msgr2=0x7fa8ec06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 0x7fa8ec06f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 -- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 msgr2=0x7fa8ec074d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec074d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 -- 172.21.15.6:0/2880314457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec06fd10 con 0x7fa8ec110250 2024-09-21T08:15:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ea59c640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec074d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:15:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.182+0000 7fa8ead9d640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400eb10 tx=0x7fa8e400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.183+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4004b20 con 0x7fa8ec110250 2024-09-21T08:15:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.183+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8e4004cc0 con 0x7fa8ec110250 2024-09-21T08:15:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.183+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4010690 con 0x7fa8ec110250 2024-09-21T08:15:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.183+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec07bc10 con 0x7fa8ec110250 2024-09-21T08:15:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.183+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec07c0a0 con 0x7fa8ec110250 2024-09-21T08:15:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.184+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec10b240 con 0x7fa8ec110250 2024-09-21T08:15:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.187+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa8e4005000 con 0x7fa8ec110250 2024-09-21T08:15:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.189+0000 7fa8db7fe640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 0x7fa8d40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:15:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.189+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fa8e40e82c0 con 0x7fa8ec110250 2024-09-21T08:15:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.190+0000 7fa8ea59c640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 0x7fa8d40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:15:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.191+0000 7fa8ea59c640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 0x7fa8d40b8d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009850 tx=0x7fa8dc000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:15:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.193+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8e4056710 con 0x7fa8ec110250 2024-09-21T08:15:59.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.637+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8ec10a3d0 con 0x7fa8ec110250 2024-09-21T08:15:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.641+0000 7fa8db7fe640 1 -- 172.21.15.6:0/2880314457 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fa8e40ae480 con 0x7fa8ec110250 2024-09-21T08:15:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:15:59.643 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:15:59.643 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:15:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 msgr2=0x7fa8d40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 0x7fa8d40b8d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009850 tx=0x7fa8dc000bc0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 msgr2=0x7fa8ec06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:15:59.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400eb10 tx=0x7fa8e400c2d0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 shutdown_connections 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa8d40b6880 0x7fa8d40b8d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8ec110250 0x7fa8ec06f590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.645+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8ec10f900 0x7fa8ec06f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.646+0000 7fa8eb59e640 1 --2- 172.21.15.6:0/2880314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ec109fc0 0x7fa8ec074d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.646+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 >> 172.21.15.6:0/2880314457 conn(0x7fa8ec079650 msgr2=0x7fa8ec10ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.646+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 shutdown_connections 2024-09-21T08:15:59.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:15:59.646+0000 7fa8eb59e640 1 -- 172.21.15.6:0/2880314457 wait complete. 2024-09-21T08:15:59.908 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:15:59 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2880314457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:15:59.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:15:59 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2880314457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:00.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:15:59 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2880314457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:00.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:16:00.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:00 smithi006 ceph-mon[30970]: pgmap v810: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 859 KiB/s wr, 101 op/s 2024-09-21T08:16:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:01.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:00 smithi119 ceph-mon[33564]: pgmap v810: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 859 KiB/s wr, 101 op/s 2024-09-21T08:16:01.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:00 smithi145 ceph-mon[34049]: pgmap v810: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 859 KiB/s wr, 101 op/s 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.514+0000 7fb058f4a640 1 -- 172.21.15.6:0/3796537171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410ccd0 msgr2=0x7fb05410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.514+0000 7fb058f4a640 1 --2- 172.21.15.6:0/3796537171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410ccd0 0x7fb05410d0e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007380 tx=0x7fb03c02afb0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.514+0000 7fb058f4a640 1 -- 172.21.15.6:0/3796537171 shutdown_connections 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 --2- 172.21.15.6:0/3796537171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410d620 0x7fb054117090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 --2- 172.21.15.6:0/3796537171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410ccd0 0x7fb05410d0e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 --2- 172.21.15.6:0/3796537171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410a650 0x7fb05410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 -- 172.21.15.6:0/3796537171 >> 172.21.15.6:0/3796537171 conn(0x7fb054070ec0 msgr2=0x7fb0540712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 -- 172.21.15.6:0/3796537171 shutdown_connections 2024-09-21T08:16:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.515+0000 7fb058f4a640 1 -- 172.21.15.6:0/3796537171 wait complete. 2024-09-21T08:16:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.517+0000 7fb058f4a640 1 Processor -- start 2024-09-21T08:16:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.517+0000 7fb058f4a640 1 -- start start 2024-09-21T08:16:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.517+0000 7fb058f4a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410a650 0x7fb0541a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb058f4a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb058f4a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410d620 0x7fb0541a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb04bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb04bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38978/0 (socket says 172.21.15.6:38978) 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb04bfff640 1 -- 172.21.15.6:0/2259279487 learned_addr learned my addr 172.21.15.6:0/2259279487 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb05259c640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410a650 0x7fb0541a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb052d9d640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410d620 0x7fb0541a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb054119f20 con 0x7fb05410d620 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb054119da0 con 0x7fb05410a650 2024-09-21T08:16:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.518+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb05411a0a0 con 0x7fb05410ccd0 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 -- 172.21.15.6:0/2259279487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410a650 msgr2=0x7fb0541a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410a650 0x7fb0541a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 -- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410d620 msgr2=0x7fb0541a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410d620 0x7fb0541a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0541a66f0 con 0x7fb05410ccd0 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.519+0000 7fb04bfff640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb03c035040 tx=0x7fb03c00a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.520+0000 7fb04b7fe640 1 -- 172.21.15.6:0/2259279487 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00a930 con 0x7fb05410ccd0 2024-09-21T08:16:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.520+0000 7fb04b7fe640 1 -- 172.21.15.6:0/2259279487 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb03c005070 con 0x7fb05410ccd0 2024-09-21T08:16:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.520+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0541a6980 con 0x7fb05410ccd0 2024-09-21T08:16:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.520+0000 7fb04b7fe640 1 -- 172.21.15.6:0/2259279487 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c004920 con 0x7fb05410ccd0 2024-09-21T08:16:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.522+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0541ad140 con 0x7fb05410ccd0 2024-09-21T08:16:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.524+0000 7fb04b7fe640 1 -- 172.21.15.6:0/2259279487 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb03c042020 con 0x7fb05410ccd0 2024-09-21T08:16:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.526+0000 7fb05f4be740 1 Processor -- start 2024-09-21T08:16:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.527+0000 7fb05f4be740 1 -- start start 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.529+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.529+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.529+0000 7fb04b7fe640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 0x7fb040003c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe9390 0x5587affb2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb05f4be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5587aff27ea0 con 0x5587afbe9390 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb05f4be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5587aff172d0 con 0x5587afbe11b0 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb05f4be740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5587aff1b0e0 con 0x5587afc0a070 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb04bfff640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 0x7fb040003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:38986/0 (socket says 172.21.15.6:38986) 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 -- 172.21.15.6:0/1446185184 learned_addr learned my addr 172.21.15.6:0/1446185184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb04b7fe640 1 -- 172.21.15.6:0/2259279487 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fb03c106540 con 0x7fb05410ccd0 2024-09-21T08:16:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 -- 172.21.15.6:0/1446185184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 msgr2=0x5587affb1be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb1be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 -- 172.21.15.6:0/1446185184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe9390 msgr2=0x5587affb2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe9390 0x5587affb2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.530+0000 7fb052d9d640 1 -- 172.21.15.6:0/1446185184 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587afc75650 con 0x5587afc0a070 2024-09-21T08:16:01.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.531+0000 7fb052d9d640 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009fd0 tx=0x7fb04c0139f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb7b2fb2db39008 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.532+0000 7fb048ff9640 1 -- 172.21.15.6:0/1446185184 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x5587afc0a070 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.532+0000 7fb048ff9640 1 -- 172.21.15.6:0/1446185184 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb04c017030 con 0x5587afc0a070 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.532+0000 7fb048ff9640 1 -- 172.21.15.6:0/1446185184 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00f700 con 0x5587afc0a070 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 -- 172.21.15.6:0/1446185184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 msgr2=0x5587affb16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009fd0 tx=0x7fb04c0139f0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb04bfff640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 0x7fb040003c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb0541a66c0 tx=0x7fb03c00a040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 -- 172.21.15.6:0/1446185184 shutdown_connections 2024-09-21T08:16:01.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe9390 0x5587affb2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 --2- 172.21.15.6:0/1446185184 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affb16a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.533+0000 7fb05f4be740 1 -- 172.21.15.6:0/1446185184 >> 172.21.15.6:0/1446185184 conn(0x5587afbfe460 msgr2=0x5587affaf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.534+0000 7fb05f4be740 1 -- 172.21.15.6:0/1446185184 shutdown_connections 2024-09-21T08:16:01.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.534+0000 7fb05f4be740 1 -- 172.21.15.6:0/1446185184 wait complete. 2024-09-21T08:16:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.535+0000 7fb05f4be740 1 -- start start 2024-09-21T08:16:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.535+0000 7fb05f4be740 1 Processor -- start 2024-09-21T08:16:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe9390 0x5587affbb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affcd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5587afd78700 con 0x5587afbe11b0 2024-09-21T08:16:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5587afeb2160 con 0x5587afbe9390 2024-09-21T08:16:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe9390 0x5587affbb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56024/0 (socket says 172.21.15.6:56024) 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb052d9d640 1 -- 172.21.15.6:0/3696104812 learned_addr learned my addr 172.21.15.6:0/3696104812 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5587affc4330 con 0x5587afc0a070 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.536+0000 7fb052d9d640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affcd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb05f4be740 10 client.0 _ll_register_callbacks cb 0x5587afecb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:01.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb052d9d640 1 -- 172.21.15.6:0/3696104812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 msgr2=0x5587affcd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb052d9d640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affcd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb052d9d640 1 -- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe9390 msgr2=0x5587affbb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb052d9d640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe9390 0x5587affbb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.537+0000 7fb052d9d640 1 -- 172.21.15.6:0/3696104812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587afedfc90 con 0x5587afbe11b0 2024-09-21T08:16:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.541+0000 7fb052d9d640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00fab0 tx=0x7fb04c004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdcbe220b1cbaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.541+0000 7fb039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x5587afbe11b0 2024-09-21T08:16:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fb04c003b10 con 0x5587afbe11b0 2024-09-21T08:16:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c017030 con 0x5587afbe11b0 2024-09-21T08:16:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb04c003d10 con 0x5587afbe11b0 2024-09-21T08:16:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb05f4be740 10 client.17763 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:01.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.542+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5587affd0040 con 0x5587afbe11b0 2024-09-21T08:16:01.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.543+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb04c026040 con 0x5587afbe11b0 2024-09-21T08:16:01.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb04c010850 con 0x5587afbe11b0 2024-09-21T08:16:01.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 10 client.17763 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 20 client.17763 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afbc89f0 0x5587affd3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 4 client.17763 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.544+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb04c017030 con 0x5587afbc89f0 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.545+0000 7fb05259c640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afbc89f0 0x5587affd3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.545+0000 7fb05259c640 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afbc89f0 0x5587affd3400 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe3d08fcb945bfd server_cookie=339ab01c92d635f8 in_seq=0 out_seq=0 2024-09-21T08:16:01.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.545+0000 7fb039ffb640 10 client.17763 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:01.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.546+0000 7fb039ffb640 1 -- 172.21.15.6:0/3696104812 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb04c017030 con 0x5587afbc89f0 2024-09-21T08:16:01.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.546+0000 7fb039ffb640 10 client.17763 handle_command_reply: tid=0 2024-09-21T08:16:01.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.546+0000 7fb05f4be740 1 client.17763 shutdown 2024-09-21T08:16:01.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.547+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 msgr2=0x5587affbad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.547+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00fab0 tx=0x7fb04c004780 comp rx=0 tx=0).stop 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.547+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 shutdown_connections 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.547+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afbc89f0 0x5587affd3400 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.547+0000 7fb039ffb640 0 client.17763 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afc0a070 0x5587affcd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe9390 0x5587affbb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 --2- 172.21.15.6:0/3696104812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbe11b0 0x5587affbad10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 >> 172.21.15.6:0/3696104812 conn(0x5587afbfe460 msgr2=0x5587affb4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 shutdown_connections 2024-09-21T08:16:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 1 -- 172.21.15.6:0/3696104812 wait complete. 2024-09-21T08:16:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.548+0000 7fb05f4be740 20 client.17763 trim_cache size 0 max 16384 2024-09-21T08:16:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.573+0000 7fb05f4be740 1 Processor -- start 2024-09-21T08:16:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.573+0000 7fb05f4be740 1 -- start start 2024-09-21T08:16:01.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affcd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affb8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b5370 con 0x5587afbc89f0 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b7bd0 con 0x5587afbe11b0 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05f4be740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b59c0 con 0x5587afbe9390 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affcd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb052d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affcd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56032/0 (socket says 172.21.15.6:56032) 2024-09-21T08:16:01.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb052d9d640 1 -- 172.21.15.6:0/2203778154 learned_addr learned my addr 172.21.15.6:0/2203778154 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.574+0000 7fb05259c640 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb052d9d640 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affb8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb05259c640 1 -- 172.21.15.6:0/2203778154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 msgr2=0x5587affb8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb05259c640 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affb8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb05259c640 1 -- 172.21.15.6:0/2203778154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 msgr2=0x5587affcd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb05259c640 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affcd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.575+0000 7fb05259c640 1 -- 172.21.15.6:0/2203778154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587affbbfd0 con 0x5587afbe11b0 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.576+0000 7fb05259c640 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb7f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5587affd3970 tx=0x7fb044004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f488ac72a33fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.576+0000 7fb03bfff640 1 -- 172.21.15.6:0/2203778154 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044003d20 con 0x5587afbe11b0 2024-09-21T08:16:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.576+0000 7fb03bfff640 1 -- 172.21.15.6:0/2203778154 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb04401c8b0 con 0x5587afbe11b0 2024-09-21T08:16:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.576+0000 7fb03bfff640 1 -- 172.21.15.6:0/2203778154 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044010820 con 0x5587afbe11b0 2024-09-21T08:16:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.577+0000 7fb05f4be740 1 -- 172.21.15.6:0/2203778154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 msgr2=0x5587affb7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.577+0000 7fb05f4be740 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb7f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5587affd3970 tx=0x7fb044004410 comp rx=0 tx=0).stop 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 -- 172.21.15.6:0/2203778154 shutdown_connections 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affb8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affb7f00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 --2- 172.21.15.6:0/2203778154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affcd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 -- 172.21.15.6:0/2203778154 >> 172.21.15.6:0/2203778154 conn(0x5587afbfe460 msgr2=0x5587affb9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 -- 172.21.15.6:0/2203778154 shutdown_connections 2024-09-21T08:16:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.578+0000 7fb05f4be740 1 -- 172.21.15.6:0/2203778154 wait complete. 2024-09-21T08:16:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.579+0000 7fb05f4be740 1 -- start start 2024-09-21T08:16:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.579+0000 7fb05f4be740 1 Processor -- start 2024-09-21T08:16:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affc95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affbefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b6090 con 0x5587afbc89f0 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:45650/0 (socket says 172.21.15.6:45650) 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05259c640 1 -- 172.21.15.6:0/529353358 learned_addr learned my addr 172.21.15.6:0/529353358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b7500 con 0x5587afbe11b0 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.580+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b6760 con 0x5587afbe9390 2024-09-21T08:16:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05f4be740 10 client.0 _ll_register_callbacks cb 0x7fb04c013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 -- 172.21.15.6:0/529353358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 msgr2=0x5587affbefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affbefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 -- 172.21.15.6:0/529353358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 msgr2=0x5587affc95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affc95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587affca210 con 0x5587afbe11b0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04401c8b0 con 0x5587afbe11b0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb05259c640 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb04401c770 tx=0x7fb04401c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5314893c862afcce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb039ffb640 10 client.27377 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb039ffb640 1 -- 172.21.15.6:0/529353358 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04401ca60 con 0x5587afbe11b0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.581+0000 7fb039ffb640 1 -- 172.21.15.6:0/529353358 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fb04401cc00 con 0x5587afbe11b0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb039ffb640 1 -- 172.21.15.6:0/529353358 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb044023450 con 0x5587afbe11b0 2024-09-21T08:16:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 10 client.27377 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5587b00426a0 con 0x5587afbe11b0 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb039ffb640 1 -- 172.21.15.6:0/529353358 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb0440235f0 con 0x5587afbe11b0 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 10 client.27377 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 10 client.27377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 20 client.27377 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afc0a070 0x5587b0044bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 4 client.27377 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.582+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb04401c8b0 con 0x5587afc0a070 2024-09-21T08:16:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb052d9d640 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afc0a070 0x5587b0044bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb039ffb640 10 client.27377 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb052d9d640 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afc0a070 0x5587b0044bc0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6600c83ee2b38e70 server_cookie=2f963e3ca347a719 in_seq=0 out_seq=0 2024-09-21T08:16:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb039ffb640 1 -- 172.21.15.6:0/529353358 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb04401c8b0 con 0x5587afc0a070 2024-09-21T08:16:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb039ffb640 10 client.27377 handle_command_reply: tid=0 2024-09-21T08:16:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.583+0000 7fb05f4be740 1 client.27377 shutdown 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 msgr2=0x5587affc9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb04401c770 tx=0x7fb04401c7a0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 shutdown_connections 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5587afc0a070 0x5587b0044bc0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5587afbe9390 0x5587affbefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5587afbe11b0 0x5587affc9b20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 --2- 172.21.15.6:0/529353358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587afbc89f0 0x5587affc95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 >> 172.21.15.6:0/529353358 conn(0x5587afbfe460 msgr2=0x5587affb26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb039ffb640 0 client.27377 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 shutdown_connections 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.584+0000 7fb05f4be740 1 -- 172.21.15.6:0/529353358 wait complete. 2024-09-21T08:16:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.585+0000 7fb05f4be740 20 client.27377 trim_cache size 0 max 16384 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 msgr2=0x7fb040003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 0x7fb040003c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb0541a66c0 tx=0x7fb03c00a040 comp rx=0 tx=0).stop 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 msgr2=0x7fb0541a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb03c035040 tx=0x7fb03c00a530 comp rx=0 tx=0).stop 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 shutdown_connections 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb040003770 0x7fb040003c70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb05410ccd0 0x7fb0541a0d20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05410d620 0x7fb0541a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 --2- 172.21.15.6:0/2259279487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05410a650 0x7fb0541a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.586+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 >> 172.21.15.6:0/2259279487 conn(0x7fb054070ec0 msgr2=0x7fb05410de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.587+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 shutdown_connections 2024-09-21T08:16:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:01.587+0000 7fb058f4a640 1 -- 172.21.15.6:0/2259279487 wait complete. 2024-09-21T08:16:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 785.0 s, 574.0 tps, lat 166.127 ms stddev 150.193 2024-09-21T08:16:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:03 smithi119 ceph-mon[33564]: pgmap v811: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.2 MiB/s wr, 218 op/s 2024-09-21T08:16:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:03 smithi145 ceph-mon[34049]: pgmap v811: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.2 MiB/s wr, 218 op/s 2024-09-21T08:16:03.450 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:16:03.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:16:03.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:03 smithi006 ceph-mon[30970]: pgmap v811: 129 pgs: 129 active+clean; 3.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.2 MiB/s wr, 218 op/s 2024-09-21T08:16:03.918 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:05 smithi119 ceph-mon[33564]: pgmap v812: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.3 MiB/s wr, 362 op/s 2024-09-21T08:16:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:05 smithi145 ceph-mon[34049]: pgmap v812: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.3 MiB/s wr, 362 op/s 2024-09-21T08:16:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:05 smithi006 ceph-mon[30970]: pgmap v812: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.3 MiB/s wr, 362 op/s 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 -- 172.21.15.6:0/2545804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820108cf0 msgr2=0x7fe82010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 --2- 172.21.15.6:0/2545804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820108cf0 0x7fe82010f520 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe81802a410 comp rx=0 tx=0).stop 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 -- 172.21.15.6:0/2545804466 shutdown_connections 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 --2- 172.21.15.6:0/2545804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820108cf0 0x7fe82010f520 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 --2- 172.21.15.6:0/2545804466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8201083a0 0x7fe8201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 --2- 172.21.15.6:0/2545804466 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe820102a60 0x7fe820102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 -- 172.21.15.6:0/2545804466 >> 172.21.15.6:0/2545804466 conn(0x7fe820079730 msgr2=0x7fe820079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 -- 172.21.15.6:0/2545804466 shutdown_connections 2024-09-21T08:16:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.578+0000 7fe82484f640 1 -- 172.21.15.6:0/2545804466 wait complete. 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.580+0000 7fe82484f640 1 Processor -- start 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.580+0000 7fe82484f640 1 -- start start 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 0x7fe82019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8201083a0 0x7fe82019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 0x7fe8201a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 0x7fe82019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 0x7fe82019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48526/0 (socket says 172.21.15.6:48526) 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe81e59c640 1 -- 172.21.15.6:0/2671153077 learned_addr learned my addr 172.21.15.6:0/2671153077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe820115b20 con 0x7fe820102a60 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201159a0 con 0x7fe820108cf0 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe820115ca0 con 0x7fe8201083a0 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8201083a0 0x7fe82019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.581+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 0x7fe8201a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.582+0000 7fe81ed9d640 1 -- 172.21.15.6:0/2671153077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8201083a0 msgr2=0x7fe82019cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.582+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8201083a0 0x7fe82019cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.582+0000 7fe81ed9d640 1 -- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 msgr2=0x7fe82019c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.582+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 0x7fe82019c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.582+0000 7fe81ed9d640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201a24a0 con 0x7fe820108cf0 2024-09-21T08:16:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 0x7fe8201a1d70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe818009850 tx=0x7fe818003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe80f7fe640 1 -- 172.21.15.6:0/2671153077 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81803f070 con 0x7fe820108cf0 2024-09-21T08:16:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe80f7fe640 1 -- 172.21.15.6:0/2671153077 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81803baf0 con 0x7fe820108cf0 2024-09-21T08:16:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe80f7fe640 1 -- 172.21.15.6:0/2671153077 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818035030 con 0x7fe820108cf0 2024-09-21T08:16:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201a2730 con 0x7fe820108cf0 2024-09-21T08:16:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.583+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a2ad0 con 0x7fe820108cf0 2024-09-21T08:16:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.587+0000 7fe82adc3740 1 Processor -- start 2024-09-21T08:16:06.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.587+0000 7fe82adc3740 1 -- start start 2024-09-21T08:16:06.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f8828c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f88296c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5637f8796e60 con 0x5637f8479350 2024-09-21T08:16:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5637f8786290 con 0x5637f8450490 2024-09-21T08:16:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.588+0000 7fe82adc3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5637f878a0a0 con 0x5637f8458670 2024-09-21T08:16:06.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.589+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56554/0 (socket says 172.21.15.6:56554) 2024-09-21T08:16:06.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 -- 172.21.15.6:0/2972577480 learned_addr learned my addr 172.21.15.6:0/2972577480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:06.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f8828c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 -- 172.21.15.6:0/2972577480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 msgr2=0x5637f88296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f88296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 -- 172.21.15.6:0/2972577480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 msgr2=0x5637f8828c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f8828c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.590+0000 7fe81e59c640 1 -- 172.21.15.6:0/2972577480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f84e4930 con 0x5637f8450490 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.591+0000 7fe80f7fe640 1 -- 172.21.15.6:0/2671153077 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe818042070 con 0x7fe820108cf0 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.591+0000 7fe81e59c640 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe8100115c0 tx=0x7fe810011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70516e26a2e94615 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.592+0000 7fe80cff9640 1 -- 172.21.15.6:0/2972577480 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81000f6c0 con 0x5637f8450490 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.592+0000 7fe80cff9640 1 -- 172.21.15.6:0/2972577480 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81000fcf0 con 0x5637f8450490 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.592+0000 7fe80cff9640 1 -- 172.21.15.6:0/2972577480 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810019dc0 con 0x5637f8450490 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe80f7fe640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 0x7fe8080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 -- 172.21.15.6:0/2972577480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 msgr2=0x5637f8829180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe8100115c0 tx=0x7fe810011a80 comp rx=0 tx=0).stop 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe80f7fe640 1 -- 172.21.15.6:0/2671153077 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fe8181080d0 con 0x7fe820108cf0 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 0x7fe8080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 -- 172.21.15.6:0/2972577480 shutdown_connections 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f88296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8450490 0x5637f8829180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 --2- 172.21.15.6:0/2972577480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f8828c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 -- 172.21.15.6:0/2972577480 >> 172.21.15.6:0/2972577480 conn(0x5637f846d740 msgr2=0x5637f8826b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.593+0000 7fe82adc3740 1 -- 172.21.15.6:0/2972577480 shutdown_connections 2024-09-21T08:16:06.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.594+0000 7fe82adc3740 1 -- 172.21.15.6:0/2972577480 wait complete. 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.594+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 0x7fe8080b8bc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe820105eb0 tx=0x7fe814005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.594+0000 7fe82adc3740 1 -- start start 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.594+0000 7fe82adc3740 1 Processor -- start 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f8834840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8458670 0x5637f8834d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8851770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5637f85e7890 con 0x5637f8458670 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5637f8720d40 con 0x5637f8479350 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5637f8848430 con 0x5637f8450490 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe82adc3740 10 client.0 _ll_register_callbacks cb 0x5637f8784c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.595+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8851770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8851770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56558/0 (socket says 172.21.15.6:56558) 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81ed9d640 1 -- 172.21.15.6:0/458361910 learned_addr learned my addr 172.21.15.6:0/458361910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f8834840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 -- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 msgr2=0x5637f8851770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8851770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 -- 172.21.15.6:0/458361910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8458670 msgr2=0x5637f8834d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8458670 0x5637f8834d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.596+0000 7fe81e59c640 1 -- 172.21.15.6:0/458361910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f8851d30 con 0x5637f8450490 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.597+0000 7fe81e59c640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f8834840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe81001b040 tx=0x7fe810019d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a976e22cd23330d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.597+0000 7fe805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.597+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810026020 con 0x5637f8450490 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.597+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe81000fcf0 con 0x5637f8450490 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.597+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fe81000f8d0 con 0x5637f8450490 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.598+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe810031050 con 0x5637f8450490 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.598+0000 7fe82adc3740 10 client.27484 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.598+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5637f8854660 con 0x5637f8450490 2024-09-21T08:16:06.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.600+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81000fcf0 con 0x5637f8450490 2024-09-21T08:16:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe810022b10 con 0x5637f8450490 2024-09-21T08:16:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 10 client.27484 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 10 client.27484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 20 client.27484 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f8437cd0 0x5637f8857e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 4 client.27484 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.601+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637f8798db0 con 0x5637f8437cd0 2024-09-21T08:16:06.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.605+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f8437cd0 0x5637f8857e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.606+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f8437cd0 0x5637f8857e40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73703616ca1f264e server_cookie=a9e95e8388d557fd in_seq=0 out_seq=0 2024-09-21T08:16:06.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.606+0000 7fe805ffb640 10 client.27484 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:06.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe805ffb640 1 -- 172.21.15.6:0/458361910 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637f8798db0 con 0x5637f8437cd0 2024-09-21T08:16:06.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe805ffb640 10 client.27484 handle_command_reply: tid=0 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 client.27484 shutdown 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 msgr2=0x5637f8834840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f8834840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe81001b040 tx=0x7fe810019d70 comp rx=0 tx=0).stop 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 shutdown_connections 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f8437cd0 0x5637f8857e40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8851770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8458670 0x5637f8834d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 --2- 172.21.15.6:0/458361910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f8834840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 >> 172.21.15.6:0/458361910 conn(0x5637f846d740 msgr2=0x5637f882be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe805ffb640 0 client.27484 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.607+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 shutdown_connections 2024-09-21T08:16:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.608+0000 7fe82adc3740 1 -- 172.21.15.6:0/458361910 wait complete. 2024-09-21T08:16:06.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.608+0000 7fe82adc3740 20 client.27484 trim_cache size 0 max 16384 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 Processor -- start 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 -- start start 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f8832ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8833400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe820070b00 con 0x5637f8450490 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8200732d0 con 0x5637f8479350 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe82adc3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8200710c0 con 0x5637f8458670 2024-09-21T08:16:06.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48556/0 (socket says 172.21.15.6:48556) 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe81e59c640 1 -- 172.21.15.6:0/4100521702 learned_addr learned my addr 172.21.15.6:0/4100521702 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8833400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.640+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f8832ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 -- 172.21.15.6:0/4100521702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 msgr2=0x5637f8832ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f8832ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 -- 172.21.15.6:0/4100521702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 msgr2=0x5637f8833400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8833400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 -- 172.21.15.6:0/4100521702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f88351e0 con 0x5637f8450490 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8833400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:16:06.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe81e59c640 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe810014040 tx=0x7fe810005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e6448a7facd5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe807fff640 1 -- 172.21.15.6:0/4100521702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810019e60 con 0x5637f8450490 2024-09-21T08:16:06.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe807fff640 1 -- 172.21.15.6:0/4100521702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe810009d60 con 0x5637f8450490 2024-09-21T08:16:06.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.641+0000 7fe807fff640 1 -- 172.21.15.6:0/4100521702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810026040 con 0x5637f8450490 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.642+0000 7fe82adc3740 1 -- 172.21.15.6:0/4100521702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 msgr2=0x5637f8851670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.642+0000 7fe82adc3740 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe810014040 tx=0x7fe810005bd0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.642+0000 7fe82adc3740 1 -- 172.21.15.6:0/4100521702 shutdown_connections 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8458670 0x5637f8832ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8479350 0x5637f8833400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 --2- 172.21.15.6:0/4100521702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8450490 0x5637f8851670 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 -- 172.21.15.6:0/4100521702 >> 172.21.15.6:0/4100521702 conn(0x5637f846d740 msgr2=0x5637f882f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 -- 172.21.15.6:0/4100521702 shutdown_connections 2024-09-21T08:16:06.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.643+0000 7fe82adc3740 1 -- 172.21.15.6:0/4100521702 wait complete. 2024-09-21T08:16:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.644+0000 7fe82adc3740 1 -- start start 2024-09-21T08:16:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.644+0000 7fe82adc3740 1 Processor -- start 2024-09-21T08:16:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f884dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe82adc3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 0x5637f88491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f884dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f884dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:40050/0 (socket says 172.21.15.6:40050) 2024-09-21T08:16:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe81e59c640 1 -- 172.21.15.6:0/3785140619 learned_addr learned my addr 172.21.15.6:0/3785140619 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 0x5637f88491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.645+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f88496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe820071790 con 0x5637f8479350 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe820072c00 con 0x5637f8458670 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81ed9d640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f88496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe820071e60 con 0x5637f8450490 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe82adc3740 10 client.0 _ll_register_callbacks cb 0x7fe81400b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81dd9b640 1 -- 172.21.15.6:0/3785140619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 msgr2=0x5637f884dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f884dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81dd9b640 1 -- 172.21.15.6:0/3785140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 msgr2=0x5637f88496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f88496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.646+0000 7fe81dd9b640 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f8849ca0 con 0x5637f8458670 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe81dd9b640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 0x5637f88491a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5637f88585e0 tx=0x7fe81400d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6a06e6962ffeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:06.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814028440 con 0x5637f8458670 2024-09-21T08:16:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe810009d60 con 0x5637f8458670 2024-09-21T08:16:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9467+0+0 (secure 0 0 0) 0x7fe814009040 con 0x5637f8458670 2024-09-21T08:16:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe814038050 con 0x5637f8458670 2024-09-21T08:16:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe82adc3740 10 client.27395 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.647+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5637f88c2610 con 0x5637f8458670 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81402a070 con 0x5637f8458670 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe81402f6b0 con 0x5637f8458670 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 10 client.27395 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 10 client.27395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 20 client.27395 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:06.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f840d080 0x5637f88c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 4 client.27395 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fe810009d60 con 0x5637f840d080 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.648+0000 7fe81e59c640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f840d080 0x5637f88c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.649+0000 7fe805ffb640 10 client.27395 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.649+0000 7fe81e59c640 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f840d080 0x5637f88c4d80 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd61c7fd479e5dd2 server_cookie=f59382d17898d318 in_seq=0 out_seq=0 2024-09-21T08:16:06.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.651+0000 7fe805ffb640 1 -- 172.21.15.6:0/3785140619 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fe810009d60 con 0x5637f840d080 2024-09-21T08:16:06.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.651+0000 7fe805ffb640 10 client.27395 handle_command_reply: tid=0 2024-09-21T08:16:06.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.651+0000 7fe82adc3740 1 client.27395 shutdown 2024-09-21T08:16:06.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.651+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 msgr2=0x5637f88491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.651+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 0x5637f88491a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5637f88585e0 tx=0x7fe81400d040 comp rx=0 tx=0).stop 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 shutdown_connections 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5637f840d080 0x5637f88c4d80 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe805ffb640 0 client.27395 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637f8479350 0x5637f88496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5637f8458670 0x5637f88491a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 --2- 172.21.15.6:0/3785140619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637f8450490 0x5637f884dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 >> 172.21.15.6:0/3785140619 conn(0x5637f846d740 msgr2=0x5637f882dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 shutdown_connections 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 1 -- 172.21.15.6:0/3785140619 wait complete. 2024-09-21T08:16:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.652+0000 7fe82adc3740 20 client.27395 trim_cache size 0 max 16384 2024-09-21T08:16:06.655 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:06.655 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:16:06.655 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "5fa4ff92-89ea-4420-8179-4009a709c8cc", 2024-09-21T08:16:06.655 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:16:06.655 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 msgr2=0x7fe8080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 0x7fe8080b8bc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe820105eb0 tx=0x7fe814005f90 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 msgr2=0x7fe8201a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 0x7fe8201a1d70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe818009850 tx=0x7fe818003b90 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 shutdown_connections 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fe8080b66b0 0x7fe8080b8bc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8201083a0 0x7fe82019cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820108cf0 0x7fe8201a1d70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 --2- 172.21.15.6:0/2671153077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe820102a60 0x7fe82019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 >> 172.21.15.6:0/2671153077 conn(0x7fe820079730 msgr2=0x7fe820104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 shutdown_connections 2024-09-21T08:16:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:06.654+0000 7fe82484f640 1 -- 172.21.15.6:0/2671153077 wait complete. 2024-09-21T08:16:07.336 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:07 smithi006 ceph-mon[30970]: pgmap v813: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-21T08:16:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:07 smithi119 ceph-mon[33564]: pgmap v813: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-21T08:16:07.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:07 smithi145 ceph-mon[34049]: pgmap v813: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-21T08:16:07.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:16:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 790.0 s, 774.4 tps, lat 135.787 ms stddev 119.715 2024-09-21T08:16:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:08.319 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:08 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:16:08.319 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:08 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:08.319 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:08 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:16:08.319 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:08 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:16:08.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:08 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:16:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:08 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:08 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:16:08.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:08 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:16:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:08 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:16:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:08 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:08 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:16:08.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:08 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:16:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:09 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:09 smithi119 ceph-mon[33564]: pgmap v814: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.0 MiB/s wr, 540 op/s 2024-09-21T08:16:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:16:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:16:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:16:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:09 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:09 smithi145 ceph-mon[34049]: pgmap v814: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.0 MiB/s wr, 540 op/s 2024-09-21T08:16:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:16:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:16:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:16:09.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:09 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:09 smithi006 ceph-mon[30970]: pgmap v814: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.0 MiB/s wr, 540 op/s 2024-09-21T08:16:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:16:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:16:09.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:16:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:11 smithi119 ceph-mon[33564]: pgmap v815: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-09-21T08:16:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:11 smithi145 ceph-mon[34049]: pgmap v815: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-09-21T08:16:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:11 smithi006 ceph-mon[30970]: pgmap v815: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-09-21T08:16:12.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:12 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:16:12.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:12 smithi006 ceph-mon[30970]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:16:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:12 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:16:12.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:12 smithi119 ceph-mon[33564]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:16:12.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:12 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:16:12.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:12 smithi145 ceph-mon[34049]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:16:12.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 795.0 s, 486.1 tps, lat 197.605 ms stddev 184.362 2024-09-21T08:16:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:13 smithi119 ceph-mon[33564]: pgmap v817: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 5.6 MiB/s wr, 630 op/s 2024-09-21T08:16:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:13 smithi145 ceph-mon[34049]: pgmap v817: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 5.6 MiB/s wr, 630 op/s 2024-09-21T08:16:13.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:13 smithi006 ceph-mon[30970]: pgmap v817: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 5.6 MiB/s wr, 630 op/s 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:16:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:16:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:15.046 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.621+0000 7fbefe325640 1 -- 172.21.15.6:0/4280237163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 msgr2=0x7fbef810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.621+0000 7fbefe325640 1 --2- 172.21.15.6:0/4280237163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef810d930 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009900 tx=0x7fbeec02a410 comp rx=0 tx=0).stop 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 -- 172.21.15.6:0/4280237163 shutdown_connections 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 --2- 172.21.15.6:0/4280237163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef810de70 0x7fbef8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 --2- 172.21.15.6:0/4280237163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef810d930 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 --2- 172.21.15.6:0/4280237163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef81048c0 0x7fbef8104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 -- 172.21.15.6:0/4280237163 >> 172.21.15.6:0/4280237163 conn(0x7fbef8079740 msgr2=0x7fbef8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 -- 172.21.15.6:0/4280237163 shutdown_connections 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 -- 172.21.15.6:0/4280237163 wait complete. 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 Processor -- start 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.622+0000 7fbefe325640 1 -- start start 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 0x7fbef819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 0x7fbef819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8113980 con 0x7fbef81052f0 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8113800 con 0x7fbef81048c0 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefe325640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8113b00 con 0x7fbef810de70 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48578/0 (socket says 172.21.15.6:48578) 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 -- 172.21.15.6:0/1437400361 learned_addr learned my addr 172.21.15.6:0/1437400361 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef7fff640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 0x7fbef819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 0x7fbef819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 -- 172.21.15.6:0/1437400361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 msgr2=0x7fbef819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 0x7fbef819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 -- 172.21.15.6:0/1437400361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 msgr2=0x7fbef819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 0x7fbef819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef77fe640 1 -- 172.21.15.6:0/1437400361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef81a0360 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbef7fff640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 0x7fbef819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.623+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 0x7fbef819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbef77fe640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbeec02a930 tx=0x7fbeec003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbef57fa640 1 -- 172.21.15.6:0/1437400361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec03f070 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbef57fa640 1 -- 172.21.15.6:0/1437400361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeec03baf0 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81a05f0 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbef57fa640 1 -- 172.21.15.6:0/1437400361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec035030 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.624+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a6db0 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.626+0000 7fbf04899740 1 Processor -- start 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.626+0000 7fbf04899740 1 -- start start 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.626+0000 7fbef57fa640 1 -- 172.21.15.6:0/1437400361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbeec042070 con 0x7fbef81052f0 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178a914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561178a02e50 con 0x5611786e5070 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5611789f2280 con 0x5611786bc1b0 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbf04899740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5611789f6090 con 0x5611786c4390 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48594/0 (socket says 172.21.15.6:48594) 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2850784545 learned_addr learned my addr 172.21.15.6:0/2850784545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbef77fe640 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178a914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2850784545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 msgr2=0x561178a914e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178a914e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2850784545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 msgr2=0x561178a90fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a90fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2850784545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561178750650 con 0x5611786e5070 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.627+0000 7fbef57fa640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 0x7fbee00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbef7fff640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 0x7fbee00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbef00107e0 tx=0x7fbef0010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b847bf15fb884893 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbef57fa640 1 -- 172.21.15.6:0/1437400361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9599+0+0 (secure 0 0 0) 0x7fbeec108200 con 0x7fbef81052f0 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbede7fc640 1 -- 172.21.15.6:0/2850784545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003b70 con 0x5611786e5070 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbede7fc640 1 -- 172.21.15.6:0/2850784545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbef000edc0 con 0x5611786e5070 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.628+0000 7fbede7fc640 1 -- 172.21.15.6:0/2850784545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00045f0 con 0x5611786e5070 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- 172.21.15.6:0/2850784545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 msgr2=0x561178a90a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbef7fff640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 0x7fbee00b8b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x561178a8f6e0 tx=0x7fbee8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbef00107e0 tx=0x7fbef0010ca0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- 172.21.15.6:0/2850784545 shutdown_connections 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178a914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a90fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 --2- 172.21.15.6:0/2850784545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178a90a60 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- 172.21.15.6:0/2850784545 >> 172.21.15.6:0/2850784545 conn(0x5611786d9460 msgr2=0x561178a8e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- 172.21.15.6:0/2850784545 shutdown_connections 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- 172.21.15.6:0/2850784545 wait complete. 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.629+0000 7fbf04899740 1 -- start start 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 Processor -- start 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a9c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a9cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561178853700 con 0x5611786c4390 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56117898d110 con 0x5611786bc1b0 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561178a9f240 con 0x5611786e5070 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbf04899740 10 client.0 _ll_register_callbacks cb 0x5611789a6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48604/0 (socket says 172.21.15.6:48604) 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 -- 172.21.15.6:0/2229552931 learned_addr learned my addr 172.21.15.6:0/2229552931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a9c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a9cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 -- 172.21.15.6:0/2229552931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 msgr2=0x561178a9cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a9cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 -- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 msgr2=0x561178a9c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a9c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 -- 172.21.15.6:0/2229552931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611789bac40 con 0x5611786c4390 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.630+0000 7fbef77fe640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0caf40 tx=0x7fbeec03bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9205e4993bf00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec049070 con 0x5611786c4390 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9599+0+0 (secure 0 0 0) 0x7fbeec0c9f40 con 0x5611786c4390 2024-09-21T08:16:15.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef000edc0 con 0x5611786c4390 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbeec0cdaa0 con 0x5611786c4390 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbf04899740 10 client.17793 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561178aaaf10 con 0x5611786c4390 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.631+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbef000edc0 con 0x5611786c4390 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbeec0d71b0 con 0x5611786c4390 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 10 client.17793 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 20 client.17793 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611786a39f0 0x561178aae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 4 client.17793 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561178a04da0 con 0x5611786a39f0 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611786a39f0 0x561178aae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbed77fe640 10 client.17793 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:15.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.632+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611786a39f0 0x561178aae5d0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c666ac08e3b96ff4 server_cookie=273262e41d2bed69 in_seq=0 out_seq=0 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbed77fe640 1 -- 172.21.15.6:0/2229552931 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561178a04da0 con 0x5611786a39f0 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbed77fe640 10 client.17793 handle_command_reply: tid=0 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 client.17793 shutdown 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 msgr2=0x561178a9c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0caf40 tx=0x7fbeec03bf50 comp rx=0 tx=0).stop 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 shutdown_connections 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5611786a39f0 0x561178aae5d0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a9cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786c4390 0x561178a9c600 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 --2- 172.21.15.6:0/2229552931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178a9c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbed77fe640 0 client.17793 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 >> 172.21.15.6:0/2229552931 conn(0x5611786d9460 msgr2=0x561178a93c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 shutdown_connections 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 1 -- 172.21.15.6:0/2229552931 wait complete. 2024-09-21T08:16:15.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.633+0000 7fbf04899740 20 client.17793 trim_cache size 0 max 16384 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 Processor -- start 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 -- start start 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786c4390 0x561178a992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ace10 con 0x5611786bc1b0 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81af670 con 0x5611786c4390 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbf04899740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ad460 con 0x5611786e5070 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48606/0 (socket says 172.21.15.6:48606) 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 -- 172.21.15.6:0/3199532529 learned_addr learned my addr 172.21.15.6:0/3199532529 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 -- 172.21.15.6:0/3199532529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 msgr2=0x561178a997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef77fe640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786c4390 0x561178a992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 -- 172.21.15.6:0/3199532529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786c4390 msgr2=0x561178a992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.651+0000 7fbef7fff640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786c4390 0x561178a992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbef7fff640 1 -- 172.21.15.6:0/3199532529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561178a9d380 con 0x5611786bc1b0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbef7fff640 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009f70 tx=0x7fbee801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7bff192f632f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbeddffb640 1 -- 172.21.15.6:0/3199532529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee800fe40 con 0x5611786bc1b0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbeddffb640 1 -- 172.21.15.6:0/3199532529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee801fd10 con 0x5611786bc1b0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.652+0000 7fbeddffb640 1 -- 172.21.15.6:0/3199532529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee802bce0 con 0x5611786bc1b0 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- 172.21.15.6:0/3199532529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 msgr2=0x561178a9c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009f70 tx=0x7fbee801b000 comp rx=0 tx=0).stop 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- 172.21.15.6:0/3199532529 shutdown_connections 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786e5070 0x561178a997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786c4390 0x561178a992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 --2- 172.21.15.6:0/3199532529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786bc1b0 0x561178a9c580 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- 172.21.15.6:0/3199532529 >> 172.21.15.6:0/3199532529 conn(0x5611786d9460 msgr2=0x561178a9be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- 172.21.15.6:0/3199532529 shutdown_connections 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- 172.21.15.6:0/3199532529 wait complete. 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 -- start start 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.653+0000 7fbf04899740 1 Processor -- start 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178aa0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178aa1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81adb30 con 0x5611786e5070 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81aefa0 con 0x5611786bc1b0 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ae200 con 0x5611786c4390 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 10 client.0 _ll_register_callbacks cb 0x7fbeec005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:15.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48618/0 (socket says 172.21.15.6:48618) 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2393273163 learned_addr learned my addr 172.21.15.6:0/2393273163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178aa0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbef77fe640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178aa1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2393273163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 msgr2=0x561178aa1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178aa1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 msgr2=0x561178aa0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178aa0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 -- 172.21.15.6:0/2393273163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561178b18550 con 0x5611786e5070 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbefc8c2640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009990 tx=0x7fbef0004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3fbf4a4952d6da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000eb30 con 0x5611786e5070 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9599+0+0 (secure 0 0 0) 0x7fbef000ecd0 con 0x5611786e5070 2024-09-21T08:16:15.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.654+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee801fd10 con 0x5611786e5070 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbef001a480 con 0x5611786e5070 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 10 client.17799 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561178b19750 con 0x5611786e5070 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee801fd10 con 0x5611786e5070 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbef00115b0 con 0x5611786e5070 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 10 client.17799 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 10 client.17799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 20 client.17799 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561178678da0 0x561178b1bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 4 client.17799 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561178a00850 con 0x561178678da0 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.655+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561178678da0 0x561178b1bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbed77fe640 10 client.17799 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbef7fff640 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561178678da0 0x561178b1bd10 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70bedc76423914d server_cookie=4378b93e47b191ba in_seq=0 out_seq=0 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbed77fe640 1 -- 172.21.15.6:0/2393273163 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7474 (crc 0 0 0) 0x561178a00850 con 0x561178678da0 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbed77fe640 10 client.17799 handle_command_reply: tid=0 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 client.17799 shutdown 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 msgr2=0x561178b17f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009990 tx=0x7fbef0004980 comp rx=0 tx=0).stop 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 shutdown_connections 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x561178678da0 0x561178b1bd10 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5611786c4390 0x561178aa1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5611786e5070 0x561178b17f90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 --2- 172.21.15.6:0/2393273163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611786bc1b0 0x561178aa0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 >> 172.21.15.6:0/2393273163 conn(0x5611786d9460 msgr2=0x561178a9d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbed77fe640 0 client.17799 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:15.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 shutdown_connections 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.656+0000 7fbf04899740 1 -- 172.21.15.6:0/2393273163 wait complete. 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbf04899740 20 client.17799 trim_cache size 0 max 16384 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 msgr2=0x7fbee00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 0x7fbee00b8b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x561178a8f6e0 tx=0x7fbee8005f90 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 msgr2=0x7fbef819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbeec02a930 tx=0x7fbeec003b90 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 shutdown_connections 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbee00b6680 0x7fbee00b8b90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbef810de70 0x7fbef819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef81052f0 0x7fbef819a990 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 --2- 172.21.15.6:0/1437400361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbef81048c0 0x7fbef819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 >> 172.21.15.6:0/1437400361 conn(0x7fbef8079740 msgr2=0x7fbef80ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 shutdown_connections 2024-09-21T08:16:15.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:13.657+0000 7fbefe325640 1 -- 172.21.15.6:0/1437400361 wait complete. 2024-09-21T08:16:15.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:15 smithi119 ceph-mon[33564]: pgmap v818: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-21T08:16:15.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:15 smithi145 ceph-mon[34049]: pgmap v818: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-21T08:16:15.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:15 smithi006 ceph-mon[30970]: pgmap v818: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-21T08:16:16.152 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:16:16.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:16:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 -- 172.21.15.6:0/947622160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0105290 msgr2=0x7f65a010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 --2- 172.21.15.6:0/947622160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0105290 0x7f65a010d8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6594009900 tx=0x7f659402a410 comp rx=0 tx=0).stop 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 -- 172.21.15.6:0/947622160 shutdown_connections 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 --2- 172.21.15.6:0/947622160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0105290 0x7f65a010d8d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 --2- 172.21.15.6:0/947622160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 --2- 172.21.15.6:0/947622160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0104860 0x7f65a0104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.161+0000 7f65a6754640 1 -- 172.21.15.6:0/947622160 >> 172.21.15.6:0/947622160 conn(0x7f65a0079730 msgr2=0x7f65a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.162+0000 7f65a6754640 1 -- 172.21.15.6:0/947622160 shutdown_connections 2024-09-21T08:16:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.162+0000 7f65a6754640 1 -- 172.21.15.6:0/947622160 wait complete. 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.162+0000 7f65a6754640 1 Processor -- start 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.163+0000 7f65a6754640 1 -- start start 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0105290 0x7f65a019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f65a01138d0 con 0x7f65a0105290 2024-09-21T08:16:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f659ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f659ffff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:53296/0 (socket says 172.21.15.6:53296) 2024-09-21T08:16:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f659ffff640 1 -- 172.21.15.6:0/412045206 learned_addr learned my addr 172.21.15.6:0/412045206 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f659f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0105290 0x7f65a019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0113750 con 0x7f65a010de10 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0113a50 con 0x7f65a0104860 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.164+0000 7f65a4cf1640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f65a4cf1640 1 -- 172.21.15.6:0/412045206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 msgr2=0x7f65a019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f65a4cf1640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f65a4cf1640 1 -- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0105290 msgr2=0x7f65a019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f65a4cf1640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0105290 0x7f65a019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f65a4cf1640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a01a02f0 con 0x7f65a010de10 2024-09-21T08:16:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.165+0000 7f659ffff640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f65a4cf1640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a019fbc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f659000e970 tx=0x7f659000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659000ccc0 con 0x7f65a010de10 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6590005020 con 0x7f65a010de10 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659000ce60 con 0x7f65a010de10 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a01a05e0 con 0x7f65a010de10 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.166+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01a6d40 con 0x7f65a010de10 2024-09-21T08:16:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.168+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a006b4e0 con 0x7f65a010de10 2024-09-21T08:16:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.170+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6590004a00 con 0x7f65a010de10 2024-09-21T08:16:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.171+0000 7f659d7fa640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 0x7f65880b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.171+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9599+0+0 (secure 0 0 0) 0x7f65900e7a70 con 0x7f65a010de10 2024-09-21T08:16:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.171+0000 7f659ffff640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 0x7f65880b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.172+0000 7f659ffff640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 0x7f65880b8c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f659800f7d0 tx=0x7f6598009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.175+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65900adb30 con 0x7f65a010de10 2024-09-21T08:16:17.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:17 smithi119 ceph-mon[33564]: pgmap v819: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-09-21T08:16:17.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:17 smithi145 ceph-mon[34049]: pgmap v819: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-09-21T08:16:17.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:17 smithi006 ceph-mon[30970]: pgmap v819: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-09-21T08:16:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 800.0 s, 721.0 tps, lat 143.597 ms stddev 159.503 2024-09-21T08:16:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.611+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65a002e640 con 0x7f65a010de10 2024-09-21T08:16:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.613+0000 7f659d7fa640 1 -- 172.21.15.6:0/412045206 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f65900b1f10 con 0x7f65a010de10 2024-09-21T08:16:17.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:16:17.615 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:16:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:16:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 msgr2=0x7f65880b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 0x7f65880b8c90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f659800f7d0 tx=0x7f6598009500 comp rx=0 tx=0).stop 2024-09-21T08:16:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 msgr2=0x7f65a019fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a019fbc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f659000e970 tx=0x7f659000ee30 comp rx=0 tx=0).stop 2024-09-21T08:16:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 shutdown_connections 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f65880b6780 0x7f65880b8c90 secure :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f659800f7d0 tx=0x7f6598009500 comp rx=0 tx=0).stop 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65a010de10 0x7f65a019fbc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65a0105290 0x7f65a019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 --2- 172.21.15.6:0/412045206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65a0104860 0x7f65a019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.617+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 >> 172.21.15.6:0/412045206 conn(0x7f65a0079730 msgr2=0x7f65a00ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.619+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 shutdown_connections 2024-09-21T08:16:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:17.619+0000 7f65a6754640 1 -- 172.21.15.6:0/412045206 wait complete. 2024-09-21T08:16:18.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:18 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/412045206' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:18.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:18 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/412045206' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:18.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:18 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/412045206' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:18.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:16:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:19.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:19 smithi006 ceph-mon[30970]: pgmap v820: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.7 MiB/s wr, 595 op/s 2024-09-21T08:16:19.640 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:19 smithi006 ceph-mon[30970]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:16:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:19 smithi119 ceph-mon[33564]: pgmap v820: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.7 MiB/s wr, 595 op/s 2024-09-21T08:16:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:19 smithi119 ceph-mon[33564]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:16:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:19 smithi145 ceph-mon[34049]: pgmap v820: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.7 MiB/s wr, 595 op/s 2024-09-21T08:16:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:19 smithi145 ceph-mon[34049]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:16:20.091 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 -- 172.21.15.6:0/3297746757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 msgr2=0x7ff11010ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 --2- 172.21.15.6:0/3297746757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11010ff50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009900 tx=0x7ff10c02a440 comp rx=0 tx=0).stop 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 -- 172.21.15.6:0/3297746757 shutdown_connections 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 --2- 172.21.15.6:0/3297746757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff110110490 0x7ff11007b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 --2- 172.21.15.6:0/3297746757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11010ff50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 --2- 172.21.15.6:0/3297746757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11010baf0 0x7ff11010bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.637+0000 7ff118645640 1 -- 172.21.15.6:0/3297746757 >> 172.21.15.6:0/3297746757 conn(0x7ff110070ec0 msgr2=0x7ff1100712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.638+0000 7ff118645640 1 -- 172.21.15.6:0/3297746757 shutdown_connections 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.638+0000 7ff118645640 1 -- 172.21.15.6:0/3297746757 wait complete. 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.639+0000 7ff118645640 1 Processor -- start 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 -- start start 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff11010baf0 0x7ff1100851a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11007f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 0x7ff11007f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff11007d830 con 0x7ff110110490 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff11007d6b0 con 0x7ff11010fb40 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff118645640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff11007d9b0 con 0x7ff11010baf0 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff116be2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 0x7ff11007f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff116be2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 0x7ff11007f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41266/0 (socket says 172.21.15.6:41266) 2024-09-21T08:16:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.640+0000 7ff116be2640 1 -- 172.21.15.6:0/562933719 learned_addr learned my addr 172.21.15.6:0/562933719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.642+0000 7ff1163e1640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff11010baf0 0x7ff1100851a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11007f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 -- 172.21.15.6:0/562933719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff11010baf0 msgr2=0x7ff1100851a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff11010baf0 0x7ff1100851a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 -- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 msgr2=0x7ff11007f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 0x7ff11007f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 -- 172.21.15.6:0/562933719 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1100801e0 con 0x7ff11010fb40 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.644+0000 7ff115be0640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11007f460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009230 tx=0x7ff10c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.645+0000 7ff1077fe640 1 -- 172.21.15.6:0/562933719 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c03f070 con 0x7ff11010fb40 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.645+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1101cee70 con 0x7ff11010fb40 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.645+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1101cf2c0 con 0x7ff11010fb40 2024-09-21T08:16:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.646+0000 7ff1077fe640 1 -- 172.21.15.6:0/562933719 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff10c03baf0 con 0x7ff11010fb40 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.647+0000 7ff1077fe640 1 -- 172.21.15.6:0/562933719 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c035030 con 0x7ff11010fb40 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.653+0000 7ff11ebb9740 1 Processor -- start 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.653+0000 7ff11ebb9740 1 -- start start 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd571ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd571f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562cd5694ea0 con 0x562cd5356390 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562cd56842d0 con 0x562cd534e1b0 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562cd56880e0 con 0x562cd5377070 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff116be2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff116be2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:53320/0 (socket says 172.21.15.6:53320) 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.654+0000 7ff116be2640 1 -- 172.21.15.6:0/2941037445 learned_addr learned my addr 172.21.15.6:0/2941037445 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 -- 172.21.15.6:0/2941037445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 msgr2=0x562cd571ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:20.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd571ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 -- 172.21.15.6:0/2941037445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 msgr2=0x562cd571f120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd571f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 -- 172.21.15.6:0/2941037445 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd53e2650 con 0x562cd5377070 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.655+0000 7ff116be2640 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff100009830 tx=0x7ff100009cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe2c3daa1c8d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.656+0000 7ff1077fe640 1 -- 172.21.15.6:0/562933719 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff10c042070 con 0x7ff11010fb40 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.657+0000 7ff1077fe640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 0x7ff0fc0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.658+0000 7ff1077fe640 1 -- 172.21.15.6:0/562933719 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7ff10c1084d0 con 0x7ff11010fb40 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.658+0000 7ff1163e1640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 0x7ff0fc0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.658+0000 7ff104ff9640 1 -- 172.21.15.6:0/2941037445 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10000d950 con 0x562cd5377070 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.658+0000 7ff104ff9640 1 -- 172.21.15.6:0/2941037445 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff100019070 con 0x562cd5377070 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.658+0000 7ff104ff9640 1 -- 172.21.15.6:0/2941037445 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1000123e0 con 0x562cd5377070 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.661+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2941037445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 msgr2=0x562cd571e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.661+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff100009830 tx=0x7ff100009cf0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2941037445 shutdown_connections 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd571f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd571ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2941037445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd571e6a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2941037445 >> 172.21.15.6:0/2941037445 conn(0x562cd536b460 msgr2=0x562cd571c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2941037445 shutdown_connections 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.662+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2941037445 wait complete. 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.663+0000 7ff11ebb9740 1 -- start start 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.664+0000 7ff11ebb9740 1 Processor -- start 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.664+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.665+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.665+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56720/0 (socket says 172.21.15.6:56720) 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.665+0000 7ff1163e1640 1 -- 172.21.15.6:0/1419119671 learned_addr learned my addr 172.21.15.6:0/1419119671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.665+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd572a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd5736200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562cd54e5700 con 0x562cd5356390 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff116be2640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd5736200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562cd561f160 con 0x562cd534e1b0 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff115be0640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd572a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.666+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562cd572ce80 con 0x562cd5377070 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.667+0000 7ff1163e1640 1 -- 172.21.15.6:0/1419119671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 msgr2=0x562cd5736200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.667+0000 7ff1163e1640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd5736200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.667+0000 7ff1163e1640 1 -- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 msgr2=0x562cd572a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.667+0000 7ff1163e1640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd572a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.667+0000 7ff1163e1640 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd564cc90 con 0x562cd534e1b0 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.668+0000 7ff1163e1640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff108019000 tx=0x7ff108004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12980060a821d21e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.668+0000 7ff1163e1640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 0x7ff0fc0b8d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x562cd571d320 tx=0x7ff108009890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.668+0000 7ff11ebb9740 10 client.0 _ll_register_callbacks cb 0x562cd56389e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.669+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff100019070 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.669+0000 7ff0f9ffb640 10 client.27425 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.669+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/1419119671 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108021070 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.669+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/1419119671 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7ff1080119b0 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.669+0000 7ff115be0640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd572a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.670+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/1419119671 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff10802e050 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.671+0000 7ff11ebb9740 10 client.27425 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.671+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x562cd5738b70 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/1419119671 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff10800f040 con 0x562cd534e1b0 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 10 client.27425 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 10 client.27425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 20 client.27425 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd53359f0 0x562cd573bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 4 client.27425 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.672+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff100019070 con 0x562cd53359f0 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.673+0000 7ff115be0640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd53359f0 0x562cd573bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.674+0000 7ff115be0640 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd53359f0 0x562cd573bf90 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30377e8055c70767 server_cookie=2d8763e471417f8d in_seq=0 out_seq=0 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.675+0000 7ff0f9ffb640 10 client.27425 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.675+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/1419119671 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ff100019070 con 0x562cd53359f0 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.675+0000 7ff0f9ffb640 10 client.27425 handle_command_reply: tid=0 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.675+0000 7ff11ebb9740 1 client.27425 shutdown 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.676+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 msgr2=0x562cd5729db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.676+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff108019000 tx=0x7ff108004a40 comp rx=0 tx=0).stop 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 shutdown_connections 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd53359f0 0x562cd573bf90 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5377070 0x562cd5736200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5356390 0x562cd572a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/1419119671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd5729db0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 >> 172.21.15.6:0/1419119671 conn(0x562cd536b460 msgr2=0x562cd5721830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff0f9ffb640 0 client.27425 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 shutdown_connections 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 1 -- 172.21.15.6:0/1419119671 wait complete. 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.677+0000 7ff11ebb9740 20 client.27425 trim_cache size 0 max 16384 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.704+0000 7ff11ebb9740 1 Processor -- start 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.704+0000 7ff11ebb9740 1 -- start start 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.704+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.704+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd57217a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56734/0 (socket says 172.21.15.6:56734) 2024-09-21T08:16:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff1163e1640 1 -- 172.21.15.6:0/3710967509 learned_addr learned my addr 172.21.15.6:0/3710967509 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd5721ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff115be0640 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd57217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f400e020 con 0x562cd5377070 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f4010880 con 0x562cd534e1b0 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f400e670 con 0x562cd5356390 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff116be2640 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd5721ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff115be0640 1 -- 172.21.15.6:0/3710967509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 msgr2=0x562cd572a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff115be0640 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff115be0640 1 -- 172.21.15.6:0/3710967509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 msgr2=0x562cd5721ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.705+0000 7ff115be0640 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd5721ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.706+0000 7ff115be0640 1 -- 172.21.15.6:0/3710967509 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd5725640 con 0x562cd5356390 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.706+0000 7ff115be0640 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd57217a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff10c1057e0 tx=0x7ff10c02a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98acd4d792e234f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.706+0000 7ff0fbfff640 1 -- 172.21.15.6:0/3710967509 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c049040 con 0x562cd5356390 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.706+0000 7ff0fbfff640 1 -- 172.21.15.6:0/3710967509 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff10c0d7900 con 0x562cd5356390 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff0fbfff640 1 -- 172.21.15.6:0/3710967509 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c105a60 con 0x562cd5356390 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 msgr2=0x562cd57217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd57217a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff10c1057e0 tx=0x7ff10c02a440 comp rx=0 tx=0).stop 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 shutdown_connections 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd57217a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd5721ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/3710967509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.708+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 >> 172.21.15.6:0/3710967509 conn(0x562cd536b460 msgr2=0x562cd5729b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.709+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 shutdown_connections 2024-09-21T08:16:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.709+0000 7ff11ebb9740 1 -- 172.21.15.6:0/3710967509 wait complete. 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 -- start start 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 Processor -- start 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd572eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd57a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f400ed40 con 0x562cd5377070 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f40101b0 con 0x562cd534e1b0 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f400f410 con 0x562cd5356390 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.710+0000 7ff11ebb9740 10 client.0 _ll_register_callbacks cb 0x7ff108016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.711+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.711+0000 7ff1163e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56736/0 (socket says 172.21.15.6:56736) 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.711+0000 7ff1163e1640 1 -- 172.21.15.6:0/2204239285 learned_addr learned my addr 172.21.15.6:0/2204239285 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.711+0000 7ff116be2640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd57a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 -- 172.21.15.6:0/2204239285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 msgr2=0x562cd572eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd572eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 -- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 msgr2=0x562cd572e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 -- 172.21.15.6:0/2204239285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd57a5ed0 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff116be2640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd57a5990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff100009780 tx=0x7ff100014ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff5f822bb162327 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.712+0000 7ff0f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.713+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10000dd60 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.713+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7ff100028410 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.713+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff10c0d7900 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.714+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff100014e10 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.714+0000 7ff11ebb9740 10 client.17817 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.714+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562cd57a7020 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.714+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff10c0d7900 con 0x562cd5377070 2024-09-21T08:16:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.714+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff100013070 con 0x562cd5377070 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 10 client.17817 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 10 client.17817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 20 client.17817 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd530ada0 0x562cd57a9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 4 client.17817 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.715+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cd5696df0 con 0x562cd530ada0 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.717+0000 7ff1163e1640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd530ada0 0x562cd57a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.718+0000 7ff1163e1640 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd530ada0 0x562cd57a9380 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4382ee2f83bfc99 server_cookie=ea573f7a62b7cb6c in_seq=0 out_seq=0 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.718+0000 7ff0f9ffb640 10 client.17817 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.718+0000 7ff0f9ffb640 1 -- 172.21.15.6:0/2204239285 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cd5696df0 con 0x562cd530ada0 2024-09-21T08:16:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.718+0000 7ff0f9ffb640 10 client.17817 handle_command_reply: tid=0 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.718+0000 7ff11ebb9740 1 client.17817 shutdown 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.719+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 msgr2=0x562cd57a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.719+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd57a5990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff100009780 tx=0x7ff100014ca0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 shutdown_connections 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562cd530ada0 0x562cd57a9380 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562cd5356390 0x562cd572eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562cd5377070 0x562cd57a5990 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 --2- 172.21.15.6:0/2204239285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cd534e1b0 0x562cd572e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 >> 172.21.15.6:0/2204239285 conn(0x562cd536b460 msgr2=0x562cd5728230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff0f9ffb640 0 client.17817 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.720+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 shutdown_connections 2024-09-21T08:16:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.721+0000 7ff11ebb9740 1 -- 172.21.15.6:0/2204239285 wait complete. 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.721+0000 7ff11ebb9740 20 client.17817 trim_cache size 0 max 16384 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 msgr2=0x7ff0fc0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 0x7ff0fc0b8d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x562cd571d320 tx=0x7ff108009890 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 msgr2=0x7ff11007f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11007f460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009230 tx=0x7ff10c003b90 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 shutdown_connections 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ff0fc0b6880 0x7ff0fc0b8d90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff110110490 0x7ff11007f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff11010fb40 0x7ff11007f460 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 --2- 172.21.15.6:0/562933719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff11010baf0 0x7ff1100851a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.722+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 >> 172.21.15.6:0/562933719 conn(0x7ff110070ec0 msgr2=0x7ff11010dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.723+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 shutdown_connections 2024-09-21T08:16:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:19.723+0000 7ff118645640 1 -- 172.21.15.6:0/562933719 wait complete. 2024-09-21T08:16:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:21 smithi119 ceph-mon[33564]: pgmap v822: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-21T08:16:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:21 smithi145 ceph-mon[34049]: pgmap v822: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-21T08:16:21.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:21 smithi006 ceph-mon[30970]: pgmap v822: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-21T08:16:22.101 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:16:22.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:16:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 805.0 s, 672.6 tps, lat 149.544 ms stddev 102.049 2024-09-21T08:16:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:23.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.223+0000 7f9093317640 1 -- 172.21.15.6:0/378098870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c108d20 msgr2=0x7f908c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.223+0000 7f9093317640 1 --2- 172.21.15.6:0/378098870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c108d20 0x7f908c10f550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9084009ca0 tx=0x7f908402a8d0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 -- 172.21.15.6:0/378098870 shutdown_connections 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 --2- 172.21.15.6:0/378098870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c1083d0 0x7f908c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 --2- 172.21.15.6:0/378098870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c108d20 0x7f908c10f550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 --2- 172.21.15.6:0/378098870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f908c102ae0 0x7f908c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 -- 172.21.15.6:0/378098870 >> 172.21.15.6:0/378098870 conn(0x7f908c079760 msgr2=0x7f908c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 -- 172.21.15.6:0/378098870 shutdown_connections 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.224+0000 7f9093317640 1 -- 172.21.15.6:0/378098870 wait complete. 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.226+0000 7f9093317640 1 Processor -- start 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.226+0000 7f9093317640 1 -- start start 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f908c1083d0 0x7f908c198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f90910b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f90910b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56758/0 (socket says 172.21.15.6:56758) 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f90910b3640 1 -- 172.21.15.6:0/4196818816 learned_addr learned my addr 172.21.15.6:0/4196818816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 0x7f908c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f908c111740 con 0x7f908c1083d0 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1115c0 con 0x7f908c102ae0 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.227+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1118c0 con 0x7f908c108d20 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 0x7f908c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 -- 172.21.15.6:0/4196818816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 msgr2=0x7f908c1981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 -- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f908c1083d0 msgr2=0x7f908c198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f908c1083d0 0x7f908c198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90918b4640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c19e120 con 0x7f908c108d20 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.228+0000 7f90910b3640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.229+0000 7f90918b4640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 0x7f908c19d9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9084009bf0 tx=0x7f9084003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.229+0000 7f90827fc640 1 -- 172.21.15.6:0/4196818816 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084040820 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.229+0000 7f90827fc640 1 -- 172.21.15.6:0/4196818816 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9084040e50 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.230+0000 7f90827fc640 1 -- 172.21.15.6:0/4196818816 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840305d0 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.230+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c19e3b0 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.230+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a4b70 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.235+0000 7f90827fc640 1 -- 172.21.15.6:0/4196818816 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9084004160 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.237+0000 7f90827fc640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 0x7f90780b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.237+0000 7f90827fc640 1 -- 172.21.15.6:0/4196818816 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f908410d2b0 con 0x7f908c108d20 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.237+0000 7f90910b3640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 0x7f90780b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.238+0000 7f909988b740 1 Processor -- start 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.238+0000 7f909988b740 1 -- start start 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e107f350 0x55f4e1426430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1426970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f4e139ce60 con 0x55f4e107f350 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f4e138c290 con 0x55f4e105e670 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f909988b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f4e13900a0 con 0x55f4e1056490 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f90910b3640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 0x7f90780b8da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f90880099f0 tx=0x7f9088008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f90918b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f90918b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56772/0 (socket says 172.21.15.6:56772) 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.239+0000 7f90918b4640 1 -- 172.21.15.6:0/2087373626 learned_addr learned my addr 172.21.15.6:0/2087373626 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 -- 172.21.15.6:0/2087373626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 msgr2=0x55f4e1426970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1426970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 -- 172.21.15.6:0/2087373626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e107f350 msgr2=0x55f4e1426430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e107f350 0x55f4e1426430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 -- 172.21.15.6:0/2087373626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e10ea930 con 0x55f4e105e670 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.241+0000 7f90918b4640 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90840cf290 tx=0x7f908402a8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb7842035a93201 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.242+0000 7f90777fe640 1 -- 172.21.15.6:0/2087373626 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908410aa40 con 0x55f4e105e670 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.242+0000 7f90777fe640 1 -- 172.21.15.6:0/2087373626 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9084036030 con 0x55f4e105e670 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.242+0000 7f90777fe640 1 -- 172.21.15.6:0/2087373626 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840f6370 con 0x55f4e105e670 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.243+0000 7f909988b740 1 -- 172.21.15.6:0/2087373626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 msgr2=0x55f4e1426eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.243+0000 7f909988b740 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90840cf290 tx=0x7f908402a8d0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.243+0000 7f909988b740 1 -- 172.21.15.6:0/2087373626 shutdown_connections 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.244+0000 7f909988b740 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1426970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.244+0000 7f909988b740 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1426eb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.244+0000 7f909988b740 1 --2- 172.21.15.6:0/2087373626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e107f350 0x55f4e1426430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.244+0000 7f909988b740 1 -- 172.21.15.6:0/2087373626 >> 172.21.15.6:0/2087373626 conn(0x55f4e1073740 msgr2=0x55f4e1424320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.244+0000 7f909988b740 1 -- 172.21.15.6:0/2087373626 shutdown_connections 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.246+0000 7f909988b740 1 -- 172.21.15.6:0/2087373626 wait complete. 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.246+0000 7f909988b740 1 -- start start 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.248+0000 7f909988b740 1 Processor -- start 2024-09-21T08:16:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e1056490 0x55f4e143a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e107f350 0x55f4e14402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f4e11ed890 con 0x55f4e1056490 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f4e1326d40 con 0x55f4e105e670 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f4e143d100 con 0x55f4e107f350 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f90908b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f90908b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56786/0 (socket says 172.21.15.6:56786) 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f90908b2640 1 -- 172.21.15.6:0/3514722655 learned_addr learned my addr 172.21.15.6:0/3514722655 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f90918b4640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e107f350 0x55f4e14402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.253+0000 7f909988b740 10 client.0 _ll_register_callbacks cb 0x55f4e138ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 -- 172.21.15.6:0/3514722655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e107f350 msgr2=0x55f4e14402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e107f350 0x55f4e14402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 -- 172.21.15.6:0/3514722655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e1056490 msgr2=0x55f4e143a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e1056490 0x55f4e143a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 -- 172.21.15.6:0/3514722655 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e1440930 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f90908b2640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c300 tx=0x7f907c00c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=397dbfdbf78951d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.254+0000 7f9074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c00f860 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f907c00fa00 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9084036030 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f907c021050 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f909988b740 10 client.27443 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.255+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f4e1449370 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f907c00fc00 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f907c00e3b0 con 0x55f4e105e670 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 10 client.27443 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 10 client.27443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 20 client.27443 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e103dcd0 0x55f4e144c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 4 client.27443 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.256+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9084036030 con 0x55f4e103dcd0 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.257+0000 7f90910b3640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e103dcd0 0x55f4e144c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.257+0000 7f90910b3640 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e103dcd0 0x55f4e144c860 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a39f6603dd4f5f3 server_cookie=5830884dd3c8b19b in_seq=0 out_seq=0 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.257+0000 7f9074ff9640 10 client.27443 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.258+0000 7f9074ff9640 1 -- 172.21.15.6:0/3514722655 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9084036030 con 0x55f4e103dcd0 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.258+0000 7f9074ff9640 10 client.27443 handle_command_reply: tid=0 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 client.27443 shutdown 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 msgr2=0x55f4e143ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c300 tx=0x7f907c00c7c0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 shutdown_connections 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e103dcd0 0x55f4e144c860 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e107f350 0x55f4e14402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f9074ff9640 0 client.27443 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e143ae70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 --2- 172.21.15.6:0/3514722655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e1056490 0x55f4e143a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.259+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 >> 172.21.15.6:0/3514722655 conn(0x55f4e1073740 msgr2=0x55f4e1427460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.260+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 shutdown_connections 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.260+0000 7f909988b740 1 -- 172.21.15.6:0/3514722655 wait complete. 2024-09-21T08:16:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.260+0000 7f909988b740 20 client.27443 trim_cache size 0 max 16384 2024-09-21T08:16:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.295+0000 7f909988b740 1 Processor -- start 2024-09-21T08:16:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.296+0000 7f909988b740 1 -- start start 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.296+0000 7f909988b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f909988b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1427460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f909988b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e105e670 0x55f4e14279a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f909988b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1acd70 con 0x55f4e105e670 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f909988b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1af5d0 con 0x55f4e103dcd0 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f909988b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1ad3c0 con 0x55f4e1056490 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56788/0 (socket says 172.21.15.6:56788) 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 -- 172.21.15.6:0/3535288449 learned_addr learned my addr 172.21.15.6:0/3535288449 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90918b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e105e670 0x55f4e14279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90908b2640 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1427460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 -- 172.21.15.6:0/3535288449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 msgr2=0x55f4e1427460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1427460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 -- 172.21.15.6:0/3535288449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e105e670 msgr2=0x55f4e14279a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e105e670 0x55f4e14279a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.297+0000 7f90910b3640 1 -- 172.21.15.6:0/3535288449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e143b1e0 con 0x55f4e103dcd0 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.298+0000 7f90910b3640 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f908800d910 tx=0x7f90880047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bbebc811f9b2d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.298+0000 7f90908b2640 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1427460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.298+0000 7f9076ffd640 1 -- 172.21.15.6:0/3535288449 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908802d070 con 0x55f4e103dcd0 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.298+0000 7f9076ffd640 1 -- 172.21.15.6:0/3535288449 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9088016e60 con 0x55f4e103dcd0 2024-09-21T08:16:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.298+0000 7f9076ffd640 1 -- 172.21.15.6:0/3535288449 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088028b90 con 0x55f4e103dcd0 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.299+0000 7f909988b740 1 -- 172.21.15.6:0/3535288449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 msgr2=0x55f4e1447290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.299+0000 7f909988b740 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f908800d910 tx=0x7f90880047d0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 -- 172.21.15.6:0/3535288449 shutdown_connections 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1427460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e105e670 0x55f4e14279a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 --2- 172.21.15.6:0/3535288449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e103dcd0 0x55f4e1447290 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 -- 172.21.15.6:0/3535288449 >> 172.21.15.6:0/3535288449 conn(0x55f4e1073740 msgr2=0x55f4e1438f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 -- 172.21.15.6:0/3535288449 shutdown_connections 2024-09-21T08:16:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.300+0000 7f909988b740 1 -- 172.21.15.6:0/3535288449 wait complete. 2024-09-21T08:16:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.301+0000 7f909988b740 1 -- start start 2024-09-21T08:16:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.301+0000 7f909988b740 1 Processor -- start 2024-09-21T08:16:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 0x55f4e1447150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1443710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1443d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90908b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1443710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90910b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 0x55f4e1447150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90910b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 0x55f4e1447150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41374/0 (socket says 172.21.15.6:41374) 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90908b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1443710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:53390/0 (socket says 172.21.15.6:53390) 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90918b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1443d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f90910b3640 1 -- 172.21.15.6:0/579363258 learned_addr learned my addr 172.21.15.6:0/579363258 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1ada90 con 0x55f4e103dcd0 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1aef00 con 0x55f4e105e670 2024-09-21T08:16:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.302+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1ae160 con 0x55f4e1056490 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f909988b740 10 client.0 _ll_register_callbacks cb 0x7f907c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f90918b4640 1 -- 172.21.15.6:0/579363258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 msgr2=0x55f4e1443710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f90918b4640 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1443710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f90918b4640 1 -- 172.21.15.6:0/579363258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 msgr2=0x55f4e1447150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f90918b4640 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 0x55f4e1447150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.303+0000 7f90918b4640 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e14444f0 con 0x55f4e105e670 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.304+0000 7f90918b4640 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1443d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f90840cff30 tx=0x7f90840f63c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f3025980753d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.304+0000 7f9074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.304+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840dc450 con 0x55f4e105e670 2024-09-21T08:16:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.304+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f90840409c0 con 0x55f4e105e670 2024-09-21T08:16:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.304+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9088016e60 con 0x55f4e105e670 2024-09-21T08:16:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.305+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f90840dc6e0 con 0x55f4e105e670 2024-09-21T08:16:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.305+0000 7f909988b740 10 client.27449 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.305+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f4e14b8210 con 0x55f4e105e670 2024-09-21T08:16:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.305+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9088016e60 con 0x55f4e105e670 2024-09-21T08:16:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f90840d1f20 con 0x55f4e105e670 2024-09-21T08:16:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 10 client.27449 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 10 client.27449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 20 client.27449 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e107f350 0x55f4e14ba5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 4 client.27449 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.306+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f4e139edb0 con 0x55f4e107f350 2024-09-21T08:16:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.308+0000 7f90910b3640 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e107f350 0x55f4e14ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.310+0000 7f90910b3640 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e107f350 0x55f4e14ba5f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c49a42c7c8ab86 server_cookie=108c3e858c88b5b7 in_seq=0 out_seq=0 2024-09-21T08:16:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.310+0000 7f9074ff9640 10 client.27449 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.313+0000 7f9074ff9640 1 -- 172.21.15.6:0/579363258 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f4e139edb0 con 0x55f4e107f350 2024-09-21T08:16:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.313+0000 7f9074ff9640 10 client.27449 handle_command_reply: tid=0 2024-09-21T08:16:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.313+0000 7f909988b740 1 client.27449 shutdown 2024-09-21T08:16:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 msgr2=0x55f4e1443d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1443d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f90840cff30 tx=0x7f90840f63c0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 shutdown_connections 2024-09-21T08:16:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f4e107f350 0x55f4e14ba5f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4e1056490 0x55f4e1443710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4e105e670 0x55f4e1443d60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 --2- 172.21.15.6:0/579363258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4e103dcd0 0x55f4e1447150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 >> 172.21.15.6:0/579363258 conn(0x55f4e1073740 msgr2=0x55f4e1423c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f9074ff9640 0 client.27449 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 shutdown_connections 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.315+0000 7f909988b740 1 -- 172.21.15.6:0/579363258 wait complete. 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.316+0000 7f909988b740 20 client.27449 trim_cache size 0 max 16384 2024-09-21T08:16:23.317 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:23.318 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:16:23.318 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "673e7932-7c14-4dd6-bb7c-16fb1d902f70", 2024-09-21T08:16:23.318 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:16:23.318 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 msgr2=0x7f90780b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 0x7f90780b8da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f90880099f0 tx=0x7f9088008040 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 msgr2=0x7f908c19d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 0x7f908c19d9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9084009bf0 tx=0x7f9084003f60 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 shutdown_connections 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f90780b6890 0x7f90780b8da0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f908c108d20 0x7f908c19d9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f908c1083d0 0x7f908c198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 --2- 172.21.15.6:0/4196818816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f908c102ae0 0x7f908c1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 >> 172.21.15.6:0/4196818816 conn(0x7f908c079760 msgr2=0x7f908c105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.317+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 shutdown_connections 2024-09-21T08:16:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:23.318+0000 7f9093317640 1 -- 172.21.15.6:0/4196818816 wait complete. 2024-09-21T08:16:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:23 smithi119 ceph-mon[33564]: pgmap v823: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-09-21T08:16:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:23 smithi145 ceph-mon[34049]: pgmap v823: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-09-21T08:16:23.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:23 smithi006 ceph-mon[30970]: pgmap v823: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-09-21T08:16:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:24 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:16:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:24 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:24 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:16:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:24 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:24 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:16:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:24 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:24 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:16:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:24 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:24 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:16:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:24 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:24 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:16:24.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:24 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:25.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:16:25.627 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:25 smithi119 ceph-mon[33564]: pgmap v824: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-09-21T08:16:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:25 smithi145 ceph-mon[34049]: pgmap v824: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-09-21T08:16:25.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:25 smithi006 ceph-mon[30970]: pgmap v824: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-09-21T08:16:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.281+0000 7f6366ffd640 1 -- 172.21.15.6:0/3414332146 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c031800 con 0x7f6368075dd0 2024-09-21T08:16:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 -- 172.21.15.6:0/3414332146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368075dd0 msgr2=0x7f63680761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 --2- 172.21.15.6:0/3414332146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368075dd0 0x7f63680761e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f635c009900 tx=0x7f635c02a410 comp rx=0 tx=0).stop 2024-09-21T08:16:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 -- 172.21.15.6:0/3414332146 shutdown_connections 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 --2- 172.21.15.6:0/3414332146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368075dd0 0x7f63680761e0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f635c009900 tx=0x7f635c02a410 comp rx=0 tx=0).stop 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 --2- 172.21.15.6:0/3414332146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368114450 0x7f6368116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 --2- 172.21.15.6:0/3414332146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6368077380 0x7f63680757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.282+0000 7f636e76d640 1 -- 172.21.15.6:0/3414332146 >> 172.21.15.6:0/3414332146 conn(0x7f63680ff610 msgr2=0x7f6368101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.283+0000 7f636e76d640 1 -- 172.21.15.6:0/3414332146 shutdown_connections 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.283+0000 7f636e76d640 1 -- 172.21.15.6:0/3414332146 wait complete. 2024-09-21T08:16:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.284+0000 7f636e76d640 1 Processor -- start 2024-09-21T08:16:26.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.284+0000 7f636e76d640 1 -- start start 2024-09-21T08:16:26.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 0x7f636810cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636810d610 0x7f6368112950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6368119f90 con 0x7f636810d610 2024-09-21T08:16:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6368119e10 con 0x7f6368077380 2024-09-21T08:16:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.285+0000 7f636e76d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f636811a110 con 0x7f6368114450 2024-09-21T08:16:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.286+0000 7f63677fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 0x7f636810cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.286+0000 7f6367fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.286+0000 7f6367fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56806/0 (socket says 172.21.15.6:56806) 2024-09-21T08:16:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.286+0000 7f6367fff640 1 -- 172.21.15.6:0/2511490889 learned_addr learned my addr 172.21.15.6:0/2511490889 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.286+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636810d610 0x7f6368112950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 -- 172.21.15.6:0/2511490889 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 msgr2=0x7f636810cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 0x7f636810cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 -- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636810d610 msgr2=0x7f6368112950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636810d610 0x7f6368112950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 -- 172.21.15.6:0/2511490889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636810ddf0 con 0x7f6368077380 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f63677fe640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 0x7f636810cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:16:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f6367fff640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f635800d770 tx=0x7f635800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.287+0000 7f63657fa640 1 -- 172.21.15.6:0/2511490889 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f6368077380 2024-09-21T08:16:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.288+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6368112fb0 con 0x7f6368077380 2024-09-21T08:16:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.288+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63681134c0 con 0x7f6368077380 2024-09-21T08:16:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.289+0000 7f63657fa640 1 -- 172.21.15.6:0/2511490889 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63580054b0 con 0x7f6368077380 2024-09-21T08:16:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.289+0000 7f63657fa640 1 -- 172.21.15.6:0/2511490889 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358004b90 con 0x7f6368077380 2024-09-21T08:16:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.293+0000 7f6374ce1740 1 Processor -- start 2024-09-21T08:16:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.293+0000 7f6374ce1740 1 -- start start 2024-09-21T08:16:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564f7c053e50 con 0x564f7bd15390 2024-09-21T08:16:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564f7c043280 con 0x564f7bd36070 2024-09-21T08:16:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f6374ce1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564f7c047090 con 0x564f7bd0d1b0 2024-09-21T08:16:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.294+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:56812/0 (socket says 172.21.15.6:56812) 2024-09-21T08:16:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 -- 172.21.15.6:0/2180391149 learned_addr learned my addr 172.21.15.6:0/2180391149 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 -- 172.21.15.6:0/2180391149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 msgr2=0x564f7c0ddb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0ddb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 -- 172.21.15.6:0/2180391149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 msgr2=0x564f7c0de0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f636cd0a640 1 -- 172.21.15.6:0/2180391149 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7bda1650 con 0x564f7bd36070 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.295+0000 7f63657fa640 1 -- 172.21.15.6:0/2511490889 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6358009c30 con 0x7f6368077380 2024-09-21T08:16:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.296+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6360009fc0 tx=0x7f6360010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ae99e53b3cbe10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.297+0000 7f63657fa640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 0x7f63500b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.297+0000 7f634e7fc640 1 -- 172.21.15.6:0/2180391149 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360003b70 con 0x564f7bd36070 2024-09-21T08:16:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.297+0000 7f63657fa640 1 -- 172.21.15.6:0/2511490889 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f63580e7550 con 0x7f6368077380 2024-09-21T08:16:26.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.298+0000 7f634e7fc640 1 -- 172.21.15.6:0/2180391149 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6360003d10 con 0x564f7bd36070 2024-09-21T08:16:26.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.298+0000 7f634e7fc640 1 -- 172.21.15.6:0/2180391149 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360011980 con 0x564f7bd36070 2024-09-21T08:16:26.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.298+0000 7f6367fff640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 0x7f63500b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 -- 172.21.15.6:0/2180391149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 msgr2=0x564f7c0dd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6360009fc0 tx=0x7f6360010860 comp rx=0 tx=0).stop 2024-09-21T08:16:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6367fff640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 0x7f63500b8cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x564f7c0dc2d0 tx=0x7f635800de80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 -- 172.21.15.6:0/2180391149 shutdown_connections 2024-09-21T08:16:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0de0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2180391149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0dd650 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.299+0000 7f6374ce1740 1 -- 172.21.15.6:0/2180391149 >> 172.21.15.6:0/2180391149 conn(0x564f7bd2a460 msgr2=0x564f7c0db540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.300+0000 7f6374ce1740 1 -- 172.21.15.6:0/2180391149 shutdown_connections 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.300+0000 7f6374ce1740 1 -- 172.21.15.6:0/2180391149 wait complete. 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.301+0000 7f6374ce1740 1 -- start start 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.301+0000 7f6374ce1740 1 Processor -- start 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd36070 0x564f7c0f5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x564f7bea4700 con 0x564f7bd15390 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564f7bfde110 con 0x564f7bd0d1b0 2024-09-21T08:16:26.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564f7c0ebe80 con 0x564f7bd36070 2024-09-21T08:16:26.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f6374ce1740 10 client.0 _ll_register_callbacks cb 0x564f7bff7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:26.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f63677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f63677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41400/0 (socket says 172.21.15.6:41400) 2024-09-21T08:16:26.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.302+0000 7f63677fe640 1 -- 172.21.15.6:0/2828802624 learned_addr learned my addr 172.21.15.6:0/2828802624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.303+0000 7f63677fe640 1 -- 172.21.15.6:0/2828802624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd36070 msgr2=0x564f7c0f5200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.303+0000 7f63677fe640 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd36070 0x564f7c0f5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.303+0000 7f63677fe640 1 -- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd0d1b0 msgr2=0x564f7c0e8d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.303+0000 7f63677fe640 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e8d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.303+0000 7f63677fe640 1 -- 172.21.15.6:0/2828802624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7c00bc40 con 0x564f7bd15390 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.304+0000 7f63677fe640 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f635c009850 tx=0x7f635c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a69df324fd3c608 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.304+0000 7f63477fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.304+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c03f070 con 0x564f7bd15390 2024-09-21T08:16:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.305+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6360003d10 con 0x564f7bd15390 2024-09-21T08:16:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.305+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f635c0046c0 con 0x564f7bd15390 2024-09-21T08:16:26.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.305+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f635c035070 con 0x564f7bd15390 2024-09-21T08:16:26.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.305+0000 7f6374ce1740 10 client.17829 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:26.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.305+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f7c0f7be0 con 0x564f7bd15390 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.306+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6360003d10 con 0x564f7bd15390 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f635c003970 con 0x564f7bd15390 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 10 client.17829 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 10 client.17829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 20 client.17829 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcf49f0 0x564f7c0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 4 client.17829 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:26.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.307+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f7c055da0 con 0x564f7bcf49f0 2024-09-21T08:16:26.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.313+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcf49f0 0x564f7c0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.315+0000 7f636cd0a640 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcf49f0 0x564f7c0fb560 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be4f290f84e79d61 server_cookie=3f2df552c7d32719 in_seq=0 out_seq=0 2024-09-21T08:16:26.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.315+0000 7f63477fe640 10 client.17829 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.316+0000 7f63477fe640 1 -- 172.21.15.6:0/2828802624 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f7c055da0 con 0x564f7bcf49f0 2024-09-21T08:16:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.316+0000 7f63477fe640 10 client.17829 handle_command_reply: tid=0 2024-09-21T08:16:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.316+0000 7f6374ce1740 1 client.17829 shutdown 2024-09-21T08:16:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 msgr2=0x564f7c0e9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f635c009850 tx=0x7f635c005270 comp rx=0 tx=0).stop 2024-09-21T08:16:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 shutdown_connections 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcf49f0 0x564f7c0fb560 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd36070 0x564f7c0f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0e9260 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 --2- 172.21.15.6:0/2828802624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.322+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 >> 172.21.15.6:0/2828802624 conn(0x564f7bd2a460 msgr2=0x564f7c0e07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.323+0000 7f63477fe640 0 client.17829 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.323+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 shutdown_connections 2024-09-21T08:16:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.323+0000 7f6374ce1740 1 -- 172.21.15.6:0/2828802624 wait complete. 2024-09-21T08:16:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.323+0000 7f6374ce1740 20 client.17829 trim_cache size 0 max 16384 2024-09-21T08:16:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.360+0000 7f6374ce1740 1 Processor -- start 2024-09-21T08:16:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.360+0000 7f6374ce1740 1 -- start start 2024-09-21T08:16:26.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.360+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58030/0 (socket says 172.21.15.6:58030) 2024-09-21T08:16:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f636cd0a640 1 -- 172.21.15.6:0/1240434266 learned_addr learned my addr 172.21.15.6:0/1240434266 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:26.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd15390 0x564f7c0f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd36070 0x564f7c0e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f63677fe640 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd15390 0x564f7c0f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f635400e180 con 0x564f7bd36070 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.361+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63540109e0 con 0x564f7bd15390 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f635400e7d0 con 0x564f7bd0d1b0 2024-09-21T08:16:26.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f636cd0a640 1 -- 172.21.15.6:0/1240434266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd15390 msgr2=0x564f7c0f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd15390 0x564f7c0f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f636cd0a640 1 -- 172.21.15.6:0/1240434266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd36070 msgr2=0x564f7c0e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd36070 0x564f7c0e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.362+0000 7f636cd0a640 1 -- 172.21.15.6:0/1240434266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7c0e9820 con 0x564f7bd0d1b0 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.363+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x564f7c0fbd00 tx=0x7f6360011500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d531cdbe1cd481a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.363+0000 7f634dffb640 1 -- 172.21.15.6:0/1240434266 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360003970 con 0x564f7bd0d1b0 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.363+0000 7f634dffb640 1 -- 172.21.15.6:0/1240434266 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6360004030 con 0x564f7bd0d1b0 2024-09-21T08:16:26.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.363+0000 7f634dffb640 1 -- 172.21.15.6:0/1240434266 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360011870 con 0x564f7bd0d1b0 2024-09-21T08:16:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.364+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 msgr2=0x564f7c0e91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.364+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x564f7c0fbd00 tx=0x7f6360011500 comp rx=0 tx=0).stop 2024-09-21T08:16:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 shutdown_connections 2024-09-21T08:16:26.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd36070 0x564f7c0e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd15390 0x564f7c0f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1240434266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0e91e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 >> 172.21.15.6:0/1240434266 conn(0x564f7bd2a460 msgr2=0x564f7c0e8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 shutdown_connections 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.365+0000 7f6374ce1740 1 -- 172.21.15.6:0/1240434266 wait complete. 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.366+0000 7f6374ce1740 1 -- start start 2024-09-21T08:16:26.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.366+0000 7f6374ce1740 1 Processor -- start 2024-09-21T08:16:26.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.367+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.367+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.367+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.367+0000 7f636cd0a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58038/0 (socket says 172.21.15.6:58038) 2024-09-21T08:16:26.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f63677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f63677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0ed0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39042/0 (socket says 172.21.15.6:39042) 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.367+0000 7f6374ce1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f636cd0a640 1 -- 172.21.15.6:0/1383441268 learned_addr learned my addr 172.21.15.6:0/1383441268 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f635400eea0 con 0x564f7bd15390 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6354010310 con 0x564f7bd36070 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f635400f570 con 0x564f7bd0d1b0 2024-09-21T08:16:26.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.368+0000 7f6374ce1740 10 client.0 _ll_register_callbacks cb 0x7f63600093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 -- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 msgr2=0x564f7c0ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 -- 172.21.15.6:0/1383441268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 msgr2=0x564f7c0ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7c164f60 con 0x564f7bd0d1b0 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.369+0000 7f636cd0a640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f636000a010 tx=0x7f6360010ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc346e55fba15939 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.370+0000 7f63477fe640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:16:26.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.370+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360004620 con 0x564f7bd0d1b0 2024-09-21T08:16:26.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.370+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f6360021040 con 0x564f7bd0d1b0 2024-09-21T08:16:26.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.370+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6360004030 con 0x564f7bd0d1b0 2024-09-21T08:16:26.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.370+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f63600047c0 con 0x564f7bd0d1b0 2024-09-21T08:16:26.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.372+0000 7f6374ce1740 10 client.27544 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:26.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.372+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f7c166100 con 0x564f7bd0d1b0 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.372+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6360011aa0 con 0x564f7bd0d1b0 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f63600316c0 con 0x564f7bd0d1b0 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 10 client.27544 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 10 client.27544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 20 client.27544 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcc9da0 0x564f7c168570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 4 client.27544 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:16:26.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.373+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6360004030 con 0x564f7bcc9da0 2024-09-21T08:16:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.374+0000 7f63677fe640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcc9da0 0x564f7c168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:26.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.374+0000 7f63477fe640 10 client.27544 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f63677fe640 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcc9da0 0x564f7c168570 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e605ccfcf5967637 server_cookie=3d9285374686ab00 in_seq=0 out_seq=0 2024-09-21T08:16:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f63477fe640 1 -- 172.21.15.6:0/1383441268 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7758 (crc 0 0 0) 0x7f6360004030 con 0x564f7bcc9da0 2024-09-21T08:16:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f63477fe640 10 client.27544 handle_command_reply: tid=0 2024-09-21T08:16:26.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f6374ce1740 1 client.27544 shutdown 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 msgr2=0x564f7c0f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f636000a010 tx=0x7f6360010ed0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 shutdown_connections 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.375+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x564f7bcc9da0 0x564f7c168570 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564f7bd36070 0x564f7c0ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f7bd15390 0x564f7c0ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 --2- 172.21.15.6:0/1383441268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564f7bd0d1b0 0x564f7c0f1b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 >> 172.21.15.6:0/1383441268 conn(0x564f7bd2a460 msgr2=0x564f7c0ea1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f63477fe640 0 client.27544 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 shutdown_connections 2024-09-21T08:16:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 1 -- 172.21.15.6:0/1383441268 wait complete. 2024-09-21T08:16:26.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.376+0000 7f6374ce1740 20 client.27544 trim_cache size 0 max 16384 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:16:26.380 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.382 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:16:26.384 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:16:26.385 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.386 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.388 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.390 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.391 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.392 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:26.394 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 msgr2=0x7f63500b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 0x7f63500b8cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x564f7c0dc2d0 tx=0x7f635800de80 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 msgr2=0x7f6368113da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f635800d770 tx=0x7f635800dc30 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 shutdown_connections 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f63500b67b0 0x7f63500b8cc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6368114450 0x7f636810cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636810d610 0x7f6368112950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 --2- 172.21.15.6:0/2511490889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6368077380 0x7f6368113da0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.378+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 >> 172.21.15.6:0/2511490889 conn(0x7f63680ff610 msgr2=0x7f63681035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.379+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 shutdown_connections 2024-09-21T08:16:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:26.379+0000 7f636e76d640 1 -- 172.21.15.6:0/2511490889 wait complete. 2024-09-21T08:16:26.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:26 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:16:26.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:26 smithi119 ceph-mon[33564]: pgmap v825: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.2 MiB/s wr, 663 op/s 2024-09-21T08:16:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:26 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:16:26.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:26 smithi145 ceph-mon[34049]: pgmap v825: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.2 MiB/s wr, 663 op/s 2024-09-21T08:16:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:26 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:16:26.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:26 smithi006 ceph-mon[30970]: pgmap v825: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.2 MiB/s wr, 663 op/s 2024-09-21T08:16:27.169 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:16:27.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:16:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 810.0 s, 769.0 tps, lat 129.607 ms stddev 71.069 2024-09-21T08:16:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:28.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 -- 172.21.15.6:0/1328761881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a809aa30 msgr2=0x7fa4a80043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 --2- 172.21.15.6:0/1328761881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a809aa30 0x7fa4a80043f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009860 tx=0x7fa4a402a340 comp rx=0 tx=0).stop 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 -- 172.21.15.6:0/1328761881 shutdown_connections 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 --2- 172.21.15.6:0/1328761881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a809aa30 0x7fa4a80043f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 --2- 172.21.15.6:0/1328761881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 0x7fa4a809a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 --2- 172.21.15.6:0/1328761881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a80947a0 0x7fa4a8094bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 -- 172.21.15.6:0/1328761881 >> 172.21.15.6:0/1328761881 conn(0x7fa4a800c4a0 msgr2=0x7fa4a800c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 -- 172.21.15.6:0/1328761881 shutdown_connections 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.247+0000 7fa4af59e640 1 -- 172.21.15.6:0/1328761881 wait complete. 2024-09-21T08:16:28.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.248+0000 7fa4af59e640 1 Processor -- start 2024-09-21T08:16:28.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 -- start start 2024-09-21T08:16:28.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a80947a0 0x7fa4a812a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:28.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 0x7fa4a812ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:28.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:28.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80a3cf0 con 0x7fa4a809a0e0 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80a3b70 con 0x7fa4a809aa30 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4af59e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80a3e70 con 0x7fa4a80947a0 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:45132/0 (socket says 172.21.15.6:45132) 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4aed9d640 1 -- 172.21.15.6:0/3559304207 learned_addr learned my addr 172.21.15.6:0/3559304207 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4add9b640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 0x7fa4a812ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.249+0000 7fa4ae59c640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a80947a0 0x7fa4a812a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 -- 172.21.15.6:0/3559304207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a80947a0 msgr2=0x7fa4a812a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a80947a0 0x7fa4a812a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 -- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 msgr2=0x7fa4a812ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:28.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 0x7fa4a812ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 -- 172.21.15.6:0/3559304207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a81306d0 con 0x7fa4a809aa30 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4aed9d640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4005940 tx=0x7fa4a402ae20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4037040 con 0x7fa4a809aa30 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a8130960 con 0x7fa4a809aa30 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.250+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a8137120 con 0x7fa4a809aa30 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.251+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4a4052070 con 0x7fa4a809aa30 2024-09-21T08:16:28.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.251+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4030630 con 0x7fa4a809aa30 2024-09-21T08:16:28.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.252+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490005290 con 0x7fa4a809aa30 2024-09-21T08:16:28.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.255+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa4a4004040 con 0x7fa4a809aa30 2024-09-21T08:16:28.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.256+0000 7fa49f7fe640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:28.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.256+0000 7fa4ae59c640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:28.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.256+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7fa4a4118bd0 con 0x7fa4a809aa30 2024-09-21T08:16:28.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.257+0000 7fa4ae59c640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 0x7fa4980b8c10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0011fd0 tx=0x7fa4a0013040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:28.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.260+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4a40ded40 con 0x7fa4a809aa30 2024-09-21T08:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.702+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa490005580 con 0x7fa4a809aa30 2024-09-21T08:16:28.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:16:28.706 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:16:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.705+0000 7fa49f7fe640 1 -- 172.21.15.6:0/3559304207 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fa4a40e3120 con 0x7fa4a809aa30 2024-09-21T08:16:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:16:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.708+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 msgr2=0x7fa4980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.708+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 0x7fa4980b8c10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0011fd0 tx=0x7fa4a0013040 comp rx=0 tx=0).stop 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.708+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 msgr2=0x7fa4a812ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.708+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4005940 tx=0x7fa4a402ae20 comp rx=0 tx=0).stop 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 shutdown_connections 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4a809aa30 0x7fa4a812ffa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a809a0e0 0x7fa4a812ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 --2- 172.21.15.6:0/3559304207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4a80947a0 0x7fa4a812a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.709+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 >> 172.21.15.6:0/3559304207 conn(0x7fa4a800c4a0 msgr2=0x7fa4a8005270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.710+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 shutdown_connections 2024-09-21T08:16:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:28.710+0000 7fa4af59e640 1 -- 172.21.15.6:0/3559304207 wait complete. 2024-09-21T08:16:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:29 smithi119 ceph-mon[33564]: pgmap v826: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-09-21T08:16:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3559304207' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:29 smithi145 ceph-mon[34049]: pgmap v826: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-09-21T08:16:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3559304207' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:29.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:29 smithi006 ceph-mon[30970]: pgmap v826: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-09-21T08:16:29.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3559304207' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:16:31.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:31 smithi006 ceph-mon[30970]: pgmap v827: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:31 smithi119 ceph-mon[33564]: pgmap v827: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:31 smithi145 ceph-mon[34049]: pgmap v827: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 815.0 s, 708.1 tps, lat 141.263 ms stddev 75.317 2024-09-21T08:16:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:33 smithi006 ceph-mon[30970]: pgmap v828: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-21T08:16:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:33 smithi119 ceph-mon[33564]: pgmap v828: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-21T08:16:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:33 smithi145 ceph-mon[34049]: pgmap v828: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-09-21T08:16:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:35 smithi119 ceph-mon[33564]: pgmap v829: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.4 MiB/s wr, 708 op/s 2024-09-21T08:16:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:35 smithi145 ceph-mon[34049]: pgmap v829: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.4 MiB/s wr, 708 op/s 2024-09-21T08:16:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:35 smithi006 ceph-mon[30970]: pgmap v829: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.4 MiB/s wr, 708 op/s 2024-09-21T08:16:35.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:16:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 -- 172.21.15.6:0/2556215410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80a50f0 msgr2=0x7f30a80a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 --2- 172.21.15.6:0/2556215410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80a50f0 0x7f30a80a5500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f30b0069e80 tx=0x7f30b008f920 comp rx=0 tx=0).stop 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 -- 172.21.15.6:0/2556215410 shutdown_connections 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 --2- 172.21.15.6:0/2556215410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 0x7f30a80ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 --2- 172.21.15.6:0/2556215410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80aa860 0x7f30a80aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 --2- 172.21.15.6:0/2556215410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80a50f0 0x7f30a80a5500 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 -- 172.21.15.6:0/2556215410 >> 172.21.15.6:0/2556215410 conn(0x7f30a801cc70 msgr2=0x7f30a801d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 -- 172.21.15.6:0/2556215410 shutdown_connections 2024-09-21T08:16:36.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.900+0000 7f30b7244640 1 -- 172.21.15.6:0/2556215410 wait complete. 2024-09-21T08:16:36.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.901+0000 7f30b7244640 1 Processor -- start 2024-09-21T08:16:36.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 -- start start 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80a50f0 0x7f30a8143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 0x7f30a81497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80bd4d0 con 0x7f30a80a50f0 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80bd350 con 0x7f30a80aa860 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b7244640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80bd650 con 0x7f30a80ab1b0 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b5a41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b6242640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80a50f0 0x7f30a8143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b5a41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46218/0 (socket says 172.21.15.6:46218) 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b5a41640 1 -- 172.21.15.6:0/4068374392 learned_addr learned my addr 172.21.15.6:0/4068374392 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:36.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.902+0000 7f30b6a43640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 0x7f30a81497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 -- 172.21.15.6:0/4068374392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 msgr2=0x7f30a81497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 0x7f30a81497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 -- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80a50f0 msgr2=0x7f30a8143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80a50f0 0x7f30a8143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 -- 172.21.15.6:0/4068374392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8149ef0 con 0x7f30a80aa860 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30b5a41640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009e20 tx=0x7f30a000ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.903+0000 7f30a77fe640 1 -- 172.21.15.6:0/4068374392 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a000ccc0 con 0x7f30a80aa860 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.904+0000 7f30a77fe640 1 -- 172.21.15.6:0/4068374392 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a00218d0 con 0x7f30a80aa860 2024-09-21T08:16:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.904+0000 7f30a77fe640 1 -- 172.21.15.6:0/4068374392 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a000ccc0 con 0x7f30a80aa860 2024-09-21T08:16:36.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.904+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a814a1e0 con 0x7f30a80aa860 2024-09-21T08:16:36.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.904+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a80ace20 con 0x7f30a80aa860 2024-09-21T08:16:36.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.908+0000 7f30bea1a740 1 Processor -- start 2024-09-21T08:16:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 -- start start 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 0x5641d97c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5641d9738ea0 con 0x5641d93f21b0 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30a77fe640 1 -- 172.21.15.6:0/4068374392 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f30a00294e0 con 0x7f30a80aa860 2024-09-21T08:16:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5641d97282d0 con 0x5641d93fa390 2024-09-21T08:16:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30bea1a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5641d972c0e0 con 0x5641d941b070 2024-09-21T08:16:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30b6242640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30b6242640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51058/0 (socket says 172.21.15.6:51058) 2024-09-21T08:16:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.909+0000 7f30b6242640 1 -- 172.21.15.6:0/2820951197 learned_addr learned my addr 172.21.15.6:0/2820951197 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:36.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.910+0000 7f30b6a43640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.910+0000 7f30b6a43640 1 -- 172.21.15.6:0/2820951197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 msgr2=0x5641d97c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.911+0000 7f30a77fe640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 0x7f309c0b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.911+0000 7f30a77fe640 1 -- 172.21.15.6:0/4068374392 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f30a000cac0 con 0x7f30a80aa860 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b5a41640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 0x5641d97c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b6a43640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 0x5641d97c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b6a43640 1 -- 172.21.15.6:0/2820951197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 msgr2=0x5641d97c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b6a43640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b6a43640 1 -- 172.21.15.6:0/2820951197 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d9486650 con 0x5641d941b070 2024-09-21T08:16:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.912+0000 7f30b6a43640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97c2460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009900 tx=0x7f30ac009dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e24cb6a0abbb374 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.913+0000 7f30b6242640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:16:36.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.913+0000 7f30b5a41640 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 0x5641d97c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:16:36.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.915+0000 7f30b6a43640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 0x7f309c0b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.917+0000 7f30a4d9a640 1 -- 172.21.15.6:0/2820951197 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac017070 con 0x5641d941b070 2024-09-21T08:16:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.917+0000 7f30a4d9a640 1 -- 172.21.15.6:0/2820951197 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30ac013470 con 0x5641d941b070 2024-09-21T08:16:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.917+0000 7f30a4d9a640 1 -- 172.21.15.6:0/2820951197 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac012630 con 0x5641d941b070 2024-09-21T08:16:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.917+0000 7f30b6a43640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 0x7f309c0b8f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30ac013fd0 tx=0x7f30ac00ef10 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.918+0000 7f30bea1a740 1 -- 172.21.15.6:0/2820951197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 msgr2=0x5641d97c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.918+0000 7f30bea1a740 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97c2460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009900 tx=0x7f30ac009dc0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.919+0000 7f30bea1a740 1 -- 172.21.15.6:0/2820951197 shutdown_connections 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.919+0000 7f30bea1a740 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93fa390 0x5641d97c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.919+0000 7f30bea1a740 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.919+0000 7f30bea1a740 1 --2- 172.21.15.6:0/2820951197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97c2460 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.919+0000 7f30bea1a740 1 -- 172.21.15.6:0/2820951197 >> 172.21.15.6:0/2820951197 conn(0x5641d940f460 msgr2=0x5641d97c0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.920+0000 7f30bea1a740 1 -- 172.21.15.6:0/2820951197 shutdown_connections 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.920+0000 7f30bea1a740 1 -- 172.21.15.6:0/2820951197 wait complete. 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.920+0000 7f30bea1a740 1 -- start start 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.920+0000 7f30bea1a740 1 Processor -- start 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d941b070 0x5641d97d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5641d9589700 con 0x5641d93f21b0 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5641d96c3160 con 0x5641d941b070 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5641d97d0c40 con 0x5641d93fa390 2024-09-21T08:16:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.921+0000 7f30bea1a740 10 client.0 _ll_register_callbacks cb 0x5641d96dc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.922+0000 7f30b5a41640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.922+0000 7f30b5a41640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58622/0 (socket says 172.21.15.6:58622) 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.922+0000 7f30b5a41640 1 -- 172.21.15.6:0/3279583652 learned_addr learned my addr 172.21.15.6:0/3279583652 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 -- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d941b070 msgr2=0x5641d97d9f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d941b070 0x5641d97d9f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 -- 172.21.15.6:0/3279583652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 msgr2=0x5641d97cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 -- 172.21.15.6:0/3279583652 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d96f0c90 con 0x5641d93fa390 2024-09-21T08:16:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.923+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f30a00bb6a0 tx=0x7f30a00be970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c5ff627aeb5b973 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f3099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00c8a40 con 0x5641d93fa390 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ac013470 con 0x5641d93fa390 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f30a00be330 con 0x5641d93fa390 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30a00be530 con 0x5641d93fa390 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f30bea1a740 10 client.27559 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.924+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5641d97dc970 con 0x5641d93fa390 2024-09-21T08:16:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30ac013470 con 0x5641d93fa390 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f30a0021ba0 con 0x5641d93fa390 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 10 client.27559 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 10 client.27559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 20 client.27559 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93d99f0 0x5641d97dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 4 client.27559 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.925+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d973adf0 con 0x5641d93d99f0 2024-09-21T08:16:36.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.929+0000 7f30b6242640 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93d99f0 0x5641d97dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.932+0000 7f30b6242640 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93d99f0 0x5641d97dff00 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ad6f41f2110c7eb server_cookie=7c9ea16b327673a6 in_seq=0 out_seq=0 2024-09-21T08:16:36.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.932+0000 7f3099ffb640 10 client.27559 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:36.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.933+0000 7f3099ffb640 1 -- 172.21.15.6:0/3279583652 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641d973adf0 con 0x5641d93d99f0 2024-09-21T08:16:36.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.933+0000 7f3099ffb640 10 client.27559 handle_command_reply: tid=0 2024-09-21T08:16:36.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.933+0000 7f30bea1a740 1 client.27559 shutdown 2024-09-21T08:16:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 msgr2=0x5641d97ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f30a00bb6a0 tx=0x7f30a00be970 comp rx=0 tx=0).stop 2024-09-21T08:16:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 shutdown_connections 2024-09-21T08:16:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93d99f0 0x5641d97dff00 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97ce060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d941b070 0x5641d97d9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3279583652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93f21b0 0x5641d97cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 >> 172.21.15.6:0/3279583652 conn(0x5641d940f460 msgr2=0x5641d97c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.935+0000 7f3099ffb640 0 client.27559 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.936+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 shutdown_connections 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.936+0000 7f30bea1a740 1 -- 172.21.15.6:0/3279583652 wait complete. 2024-09-21T08:16:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.936+0000 7f30bea1a740 20 client.27559 trim_cache size 0 max 16384 2024-09-21T08:16:36.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.965+0000 7f30bea1a740 1 Processor -- start 2024-09-21T08:16:36.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.966+0000 7f30bea1a740 1 -- start start 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.966+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 0x5641d97bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30b6242640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30bea1a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f309400e050 con 0x5641d93fa390 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30b6242640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46252/0 (socket says 172.21.15.6:46252) 2024-09-21T08:16:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30b6242640 1 -- 172.21.15.6:0/3652749202 learned_addr learned my addr 172.21.15.6:0/3652749202 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:36.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30b6a43640 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30940108b0 con 0x5641d93f21b0 2024-09-21T08:16:36.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.967+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f309400e6a0 con 0x5641d941b070 2024-09-21T08:16:36.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.968+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 0x5641d97bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.968+0000 7f30b5a41640 1 -- 172.21.15.6:0/3652749202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 msgr2=0x5641d97bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.968+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.968+0000 7f30b5a41640 1 -- 172.21.15.6:0/3652749202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 msgr2=0x5641d97cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.969+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.969+0000 7f30b5a41640 1 -- 172.21.15.6:0/3652749202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d97cebc0 con 0x5641d93fa390 2024-09-21T08:16:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.969+0000 7f30b5a41640 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 0x5641d97bf980 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f30a00096b0 tx=0x7f30a0005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca069b1fc755487 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.971+0000 7f309bfff640 1 -- 172.21.15.6:0/3652749202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00be330 con 0x5641d93fa390 2024-09-21T08:16:36.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.971+0000 7f309bfff640 1 -- 172.21.15.6:0/3652749202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a00f8370 con 0x5641d93fa390 2024-09-21T08:16:36.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.971+0000 7f309bfff640 1 -- 172.21.15.6:0/3652749202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0021a80 con 0x5641d93fa390 2024-09-21T08:16:36.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 msgr2=0x5641d97bf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 0x5641d97bf980 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f30a00096b0 tx=0x7f30a0005c80 comp rx=0 tx=0).stop 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 shutdown_connections 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d941b070 0x5641d97bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d93fa390 0x5641d97bf980 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 --2- 172.21.15.6:0/3652749202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.972+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 >> 172.21.15.6:0/3652749202 conn(0x5641d940f460 msgr2=0x5641d97c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.973+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 shutdown_connections 2024-09-21T08:16:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.973+0000 7f30bea1a740 1 -- 172.21.15.6:0/3652749202 wait complete. 2024-09-21T08:16:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.973+0000 7f30bea1a740 1 -- start start 2024-09-21T08:16:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.973+0000 7f30bea1a740 1 Processor -- start 2024-09-21T08:16:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d941b070 0x5641d97d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f309400ed70 con 0x5641d941b070 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30940101e0 con 0x5641d93f21b0 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f309400f440 con 0x5641d93fa390 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30bea1a740 10 client.0 _ll_register_callbacks cb 0x7f30a00bea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.974+0000 7f30b6242640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b5a41640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46258/0 (socket says 172.21.15.6:46258) 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 -- 172.21.15.6:0/1401102562 learned_addr learned my addr 172.21.15.6:0/1401102562 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 -- 172.21.15.6:0/1401102562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 msgr2=0x5641d97d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 -- 172.21.15.6:0/1401102562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d941b070 msgr2=0x5641d97d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d941b070 0x5641d97d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.975+0000 7f30b6242640 1 -- 172.21.15.6:0/1401102562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d97d2910 con 0x5641d93f21b0 2024-09-21T08:16:36.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.976+0000 7f30b6242640 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30b002ebd0 tx=0x7f30b00514d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a86abcff4d93d8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:36.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.977+0000 7f3099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:36.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.977+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b009b070 con 0x5641d93f21b0 2024-09-21T08:16:36.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.977+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a00f8370 con 0x5641d93f21b0 2024-09-21T08:16:36.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.977+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7f30b0096820 con 0x5641d93f21b0 2024-09-21T08:16:36.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.979+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30b0092070 con 0x5641d93f21b0 2024-09-21T08:16:36.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.979+0000 7f30bea1a740 10 client.27482 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:36.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.979+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5641d984a8d0 con 0x5641d93f21b0 2024-09-21T08:16:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a00f8370 con 0x5641d93f21b0 2024-09-21T08:16:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f30b006a9e0 con 0x5641d93f21b0 2024-09-21T08:16:36.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 10 client.27482 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 10 client.27482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 20 client.27482 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93aeda0 0x5641d984d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 4 client.27482 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:16:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.982+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641d97368a0 con 0x5641d93aeda0 2024-09-21T08:16:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.985+0000 7f30b5a41640 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93aeda0 0x5641d984d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.988+0000 7f3099ffb640 10 client.27482 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.988+0000 7f30b5a41640 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93aeda0 0x5641d984d070 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebab3594bbec3e4c server_cookie=bab88a5ee829692e in_seq=0 out_seq=0 2024-09-21T08:16:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.989+0000 7f3099ffb640 1 -- 172.21.15.6:0/1401102562 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641d97368a0 con 0x5641d93aeda0 2024-09-21T08:16:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.989+0000 7f3099ffb640 10 client.27482 handle_command_reply: tid=0 2024-09-21T08:16:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.989+0000 7f30bea1a740 1 client.27482 shutdown 2024-09-21T08:16:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 msgr2=0x5641d97d6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30b002ebd0 tx=0x7f30b00514d0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 shutdown_connections 2024-09-21T08:16:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5641d93aeda0 0x5641d984d070 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641d93fa390 0x5641d97d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5641d941b070 0x5641d97d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 --2- 172.21.15.6:0/1401102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5641d93f21b0 0x5641d97d6730 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.991+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 >> 172.21.15.6:0/1401102562 conn(0x5641d940f460 msgr2=0x5641d97c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.992+0000 7f3099ffb640 0 client.27482 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.992+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 shutdown_connections 2024-09-21T08:16:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.993+0000 7f30bea1a740 1 -- 172.21.15.6:0/1401102562 wait complete. 2024-09-21T08:16:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.993+0000 7f30bea1a740 20 client.27482 trim_cache size 0 max 16384 2024-09-21T08:16:36.995 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.994+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 msgr2=0x7f309c0b8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.994+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 0x7f309c0b8f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30ac013fd0 tx=0x7f30ac00ef10 comp rx=0 tx=0).stop 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.994+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 msgr2=0x7f30a8144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.994+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009e20 tx=0x7f30a000ed90 comp rx=0 tx=0).stop 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 shutdown_connections 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f309c0b6a80 0x7f309c0b8f90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30a80ab1b0 0x7f30a81497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a80aa860 0x7f30a8144520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 --2- 172.21.15.6:0/4068374392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a80a50f0 0x7f30a8143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.995+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 >> 172.21.15.6:0/4068374392 conn(0x7f30a801cc70 msgr2=0x7f30a80a39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.996+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 shutdown_connections 2024-09-21T08:16:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:36.996+0000 7f30b7244640 1 -- 172.21.15.6:0/4068374392 wait complete. 2024-09-21T08:16:37.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:37 smithi119 ceph-mon[33564]: pgmap v830: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:37 smithi145 ceph-mon[34049]: pgmap v830: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:37 smithi006 ceph-mon[30970]: pgmap v830: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-21T08:16:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 820.0 s, 720.3 tps, lat 136.966 ms stddev 69.151 2024-09-21T08:16:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:39 smithi119 ceph-mon[33564]: pgmap v831: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-09-21T08:16:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:39 smithi145 ceph-mon[34049]: pgmap v831: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-09-21T08:16:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:39 smithi006 ceph-mon[30970]: pgmap v831: 129 pgs: 129 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-09-21T08:16:40.625 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:16:40.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:16:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:41 smithi119 ceph-mon[33564]: pgmap v832: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-21T08:16:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:41 smithi145 ceph-mon[34049]: pgmap v832: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-21T08:16:41.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:41 smithi006 ceph-mon[30970]: pgmap v832: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 633 op/s 2024-09-21T08:16:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 -- 172.21.15.6:0/3521490780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec410a3c0 msgr2=0x7faec410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 --2- 172.21.15.6:0/3521490780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec410a3c0 0x7faec410a7d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009900 tx=0x7faeb402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 -- 172.21.15.6:0/3521490780 shutdown_connections 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 --2- 172.21.15.6:0/3521490780 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec406af90 0x7faec410ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 --2- 172.21.15.6:0/3521490780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec410a3c0 0x7faec410a7d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 --2- 172.21.15.6:0/3521490780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410f150 0x7faec410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 -- 172.21.15.6:0/3521490780 >> 172.21.15.6:0/3521490780 conn(0x7faec40712f0 msgr2=0x7faec4073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 -- 172.21.15.6:0/3521490780 shutdown_connections 2024-09-21T08:16:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.315+0000 7faec8956640 1 -- 172.21.15.6:0/3521490780 wait complete. 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.316+0000 7faec8956640 1 Processor -- start 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.316+0000 7faec8956640 1 -- start start 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec406af90 0x7faec411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec410f150 0x7faec411c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec4119f80 con 0x7faec406af90 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec4119e00 con 0x7faec410a3c0 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec406af90 0x7faec411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46282/0 (socket says 172.21.15.6:46282) 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec1d9b640 1 -- 172.21.15.6:0/2923745323 learned_addr learned my addr 172.21.15.6:0/2923745323 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec8956640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec411a100 con 0x7faec410f150 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.317+0000 7faec2d9d640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec410f150 0x7faec411c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 -- 172.21.15.6:0/2923745323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec410f150 msgr2=0x7faec411c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec410f150 0x7faec411c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 -- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec406af90 msgr2=0x7faec411e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec406af90 0x7faec411e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 -- 172.21.15.6:0/2923745323 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec411c9b0 con 0x7faec410a3c0 2024-09-21T08:16:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.318+0000 7faec1d9b640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faeb4004770 tx=0x7faeb4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.321+0000 7faeb37fe640 1 -- 172.21.15.6:0/2923745323 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb403f030 con 0x7faec410a3c0 2024-09-21T08:16:42.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.321+0000 7faeb37fe640 1 -- 172.21.15.6:0/2923745323 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb4004440 con 0x7faec410a3c0 2024-09-21T08:16:42.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.321+0000 7faeb37fe640 1 -- 172.21.15.6:0/2923745323 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4035070 con 0x7faec410a3c0 2024-09-21T08:16:42.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.323+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec41b55f0 con 0x7faec410a3c0 2024-09-21T08:16:42.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.323+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41b59c0 con 0x7faec410a3c0 2024-09-21T08:16:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.327+0000 7faeceeca740 1 Processor -- start 2024-09-21T08:16:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.328+0000 7faeb37fe640 1 -- 172.21.15.6:0/2923745323 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7faeb4042030 con 0x7faec410a3c0 2024-09-21T08:16:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.330+0000 7faeb37fe640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 0x7faeac0b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.330+0000 7faeceeca740 1 -- start start 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.330+0000 7faeb37fe640 1 -- 172.21.15.6:0/2923745323 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7faeb4107d90 con 0x7faec410a3c0 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec2d9d640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 0x7faeac0b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da6725b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da6725beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55da671d1e60 con 0x55da66e93670 2024-09-21T08:16:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da671c1290 con 0x55da66eb4350 2024-09-21T08:16:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faeceeca740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55da671c50a0 con 0x55da66e8b490 2024-09-21T08:16:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46292/0 (socket says 172.21.15.6:46292) 2024-09-21T08:16:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 -- 172.21.15.6:0/403134060 learned_addr learned my addr 172.21.15.6:0/403134060 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec1d9b640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da6725b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec2d9d640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da6725beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 -- 172.21.15.6:0/403134060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 msgr2=0x55da6725b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da6725b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 -- 172.21.15.6:0/403134060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 msgr2=0x55da6725beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da6725beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.331+0000 7faec259c640 1 -- 172.21.15.6:0/403134060 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da66f1f930 con 0x55da66eb4350 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faec1d9b640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da6725b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faec2d9d640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da6725beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faec259c640 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faeb800bc10 tx=0x7faeb80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a85405e3a770ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faec2d9d640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 0x7faeac0b8d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faec410fd80 tx=0x7faebc011810 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faeb0ff9640 1 -- 172.21.15.6:0/403134060 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8005020 con 0x55da66eb4350 2024-09-21T08:16:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.332+0000 7faeb0ff9640 1 -- 172.21.15.6:0/403134060 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80047a0 con 0x55da66eb4350 2024-09-21T08:16:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.334+0000 7faeb0ff9640 1 -- 172.21.15.6:0/403134060 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80116a0 con 0x55da66eb4350 2024-09-21T08:16:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.334+0000 7faeceeca740 1 -- 172.21.15.6:0/403134060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 msgr2=0x55da6725b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.334+0000 7faeceeca740 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faeb800bc10 tx=0x7faeb80107a0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.339+0000 7faeceeca740 1 -- 172.21.15.6:0/403134060 shutdown_connections 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.339+0000 7faeceeca740 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da6725b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.339+0000 7faeceeca740 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da6725beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.339+0000 7faeceeca740 1 --2- 172.21.15.6:0/403134060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da6725b430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.339+0000 7faeceeca740 1 -- 172.21.15.6:0/403134060 >> 172.21.15.6:0/403134060 conn(0x55da66ea8740 msgr2=0x55da67259320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.341+0000 7faeceeca740 1 -- 172.21.15.6:0/403134060 shutdown_connections 2024-09-21T08:16:42.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.341+0000 7faeceeca740 1 -- 172.21.15.6:0/403134060 wait complete. 2024-09-21T08:16:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.341+0000 7faeceeca740 1 -- start start 2024-09-21T08:16:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.341+0000 7faeceeca740 1 Processor -- start 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.342+0000 7faeceeca740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.342+0000 7faeceeca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e93670 0x55da672674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.342+0000 7faeceeca740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66eb4350 0x55da67272ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.342+0000 7faeceeca740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55da67022890 con 0x55da66e8b490 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.343+0000 7faeceeca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da6715bd40 con 0x55da66e93670 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.343+0000 7faeceeca740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55da67269cb0 con 0x55da66eb4350 2024-09-21T08:16:42.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.343+0000 7faeceeca740 10 client.0 _ll_register_callbacks cb 0x55da671bfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.345+0000 7faec259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.345+0000 7faec259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51130/0 (socket says 172.21.15.6:51130) 2024-09-21T08:16:42.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.345+0000 7faec259c640 1 -- 172.21.15.6:0/3207575987 learned_addr learned my addr 172.21.15.6:0/3207575987 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.346+0000 7faec259c640 1 -- 172.21.15.6:0/3207575987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66eb4350 msgr2=0x55da67272ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.346+0000 7faec259c640 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66eb4350 0x55da67272ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.346+0000 7faec259c640 1 -- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e93670 msgr2=0x55da672674c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.346+0000 7faec259c640 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e93670 0x55da672674c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.346+0000 7faec259c640 1 -- 172.21.15.6:0/3207575987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da67273560 con 0x55da66e8b490 2024-09-21T08:16:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.347+0000 7faec259c640 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7faeb80057b0 tx=0x7faeb800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8ae43e48f4c321 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.347+0000 7faea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.349+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8004e90 con 0x55da66e8b490 2024-09-21T08:16:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.350+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb80047a0 con 0x55da66e8b490 2024-09-21T08:16:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.350+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7faeb8005030 con 0x55da66e8b490 2024-09-21T08:16:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.350+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faeb8032050 con 0x55da66e8b490 2024-09-21T08:16:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.351+0000 7faeceeca740 10 client.17859 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.351+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55da67275e00 con 0x55da66e8b490 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.352+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb80047a0 con 0x55da66e8b490 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.352+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faeb801b430 con 0x55da66e8b490 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.352+0000 7faeceeca740 10 client.17859 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faeceeca740 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faeceeca740 20 client.17859 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e72cd0 0x55da67279610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faeceeca740 4 client.17859 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da671d3db0 con 0x55da66e72cd0 2024-09-21T08:16:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.353+0000 7faec1d9b640 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e72cd0 0x55da67279610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.354+0000 7faea9ffb640 10 client.17859 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.354+0000 7faec1d9b640 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e72cd0 0x55da67279610 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6584855e28cb9af server_cookie=5d4329add3bf7c8f in_seq=0 out_seq=0 2024-09-21T08:16:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.355+0000 7faea9ffb640 1 -- 172.21.15.6:0/3207575987 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da671d3db0 con 0x55da66e72cd0 2024-09-21T08:16:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.356+0000 7faea9ffb640 10 client.17859 handle_command_reply: tid=0 2024-09-21T08:16:42.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.356+0000 7faeceeca740 1 client.17859 shutdown 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.356+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 msgr2=0x55da67266f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.356+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7faeb80057b0 tx=0x7faeb800b850 comp rx=0 tx=0).stop 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 shutdown_connections 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e72cd0 0x55da67279610 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66eb4350 0x55da67272ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e93670 0x55da672674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 --2- 172.21.15.6:0/3207575987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e8b490 0x55da67266f80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 >> 172.21.15.6:0/3207575987 conn(0x55da66ea8740 msgr2=0x55da6725e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.357+0000 7faea9ffb640 0 client.17859 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:42.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.358+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 shutdown_connections 2024-09-21T08:16:42.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.358+0000 7faeceeca740 1 -- 172.21.15.6:0/3207575987 wait complete. 2024-09-21T08:16:42.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.358+0000 7faeceeca740 20 client.17859 trim_cache size 0 max 16384 2024-09-21T08:16:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.393+0000 7faeceeca740 1 Processor -- start 2024-09-21T08:16:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.395+0000 7faeceeca740 1 -- start start 2024-09-21T08:16:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.395+0000 7faeceeca740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da67261550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.395+0000 7faeceeca740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da67266610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.395+0000 7faeceeca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faeceeca740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec41bdde0 con 0x55da66e93670 2024-09-21T08:16:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faeceeca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec41c0640 con 0x55da66eb4350 2024-09-21T08:16:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faeceeca740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec41be430 con 0x55da66e8b490 2024-09-21T08:16:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46304/0 (socket says 172.21.15.6:46304) 2024-09-21T08:16:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faec2d9d640 1 -- 172.21.15.6:0/1692446646 learned_addr learned my addr 172.21.15.6:0/1692446646 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.396+0000 7faec1d9b640 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da67266610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.398+0000 7faec259c640 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da67261550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.399+0000 7faec2d9d640 1 -- 172.21.15.6:0/1692446646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 msgr2=0x55da67261550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.399+0000 7faec2d9d640 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da67261550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.399+0000 7faec2d9d640 1 -- 172.21.15.6:0/1692446646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 msgr2=0x55da67266610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.399+0000 7faec2d9d640 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da67266610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.399+0000 7faec2d9d640 1 -- 172.21.15.6:0/1692446646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da67262610 con 0x55da66eb4350 2024-09-21T08:16:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.408+0000 7faec2d9d640 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faebc00f7c0 tx=0x7faebc009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e17d7eb66624d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.412+0000 7faeabfff640 1 -- 172.21.15.6:0/1692446646 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc022070 con 0x55da66eb4350 2024-09-21T08:16:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.412+0000 7faeabfff640 1 -- 172.21.15.6:0/1692446646 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc019050 con 0x55da66eb4350 2024-09-21T08:16:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.412+0000 7faeabfff640 1 -- 172.21.15.6:0/1692446646 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc017040 con 0x55da66eb4350 2024-09-21T08:16:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.415+0000 7faeceeca740 1 -- 172.21.15.6:0/1692446646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 msgr2=0x55da67263f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.415+0000 7faeceeca740 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faebc00f7c0 tx=0x7faebc009500 comp rx=0 tx=0).stop 2024-09-21T08:16:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 -- 172.21.15.6:0/1692446646 shutdown_connections 2024-09-21T08:16:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66eb4350 0x55da67263f70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66e93670 0x55da67266610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 --2- 172.21.15.6:0/1692446646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e8b490 0x55da67261550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 -- 172.21.15.6:0/1692446646 >> 172.21.15.6:0/1692446646 conn(0x55da66ea8740 msgr2=0x55da6725ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 -- 172.21.15.6:0/1692446646 shutdown_connections 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.417+0000 7faeceeca740 1 -- 172.21.15.6:0/1692446646 wait complete. 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.418+0000 7faeceeca740 1 -- start start 2024-09-21T08:16:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.418+0000 7faeceeca740 1 Processor -- start 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 0x55da6726f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e93670 0x55da6726aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 0x55da6726af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faec41beb00 con 0x55da66eb4350 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faec41bff70 con 0x55da66e8b490 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faec41bf1d0 con 0x55da66e93670 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faeceeca740 10 client.0 _ll_register_callbacks cb 0x7faeb4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faec259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 0x55da6726f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faec259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 0x55da6726f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46306/0 (socket says 172.21.15.6:46306) 2024-09-21T08:16:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faec259c640 1 -- 172.21.15.6:0/140451783 learned_addr learned my addr 172.21.15.6:0/140451783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.419+0000 7faec1d9b640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e93670 0x55da6726aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 0x55da6726af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 -- 172.21.15.6:0/140451783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e93670 msgr2=0x55da6726aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e93670 0x55da6726aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 -- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 msgr2=0x55da6726f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 0x55da6726f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.420+0000 7faec2d9d640 1 -- 172.21.15.6:0/140451783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da6726b520 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.421+0000 7faec2d9d640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 0x55da6726af60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7faebc00f790 tx=0x7faebc027cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5dd8e1d71f28d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.421+0000 7faea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.421+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc017070 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.421+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7faebc004a40 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.421+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faebc019050 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.422+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faebc036050 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.422+0000 7faeceeca740 10 client.17865 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.422+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55da672e3dc0 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.422+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc00f530 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.422+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faebc005030 con 0x55da66eb4350 2024-09-21T08:16:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 10 client.17865 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 10 client.17865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 20 client.17865 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e48080 0x55da672e6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 4 client.17865 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faec259c640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e48080 0x55da672e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.423+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7faebc019050 con 0x55da66e48080 2024-09-21T08:16:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.424+0000 7faea9ffb640 10 client.17865 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.424+0000 7faec259c640 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e48080 0x55da672e6450 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2224a4989f0e040 server_cookie=c138c964697bb997 in_seq=0 out_seq=0 2024-09-21T08:16:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faea9ffb640 1 -- 172.21.15.6:0/140451783 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7faebc019050 con 0x55da66e48080 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faea9ffb640 10 client.17865 handle_command_reply: tid=0 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 client.17865 shutdown 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 msgr2=0x55da6726af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 0x55da6726af60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7faebc00f790 tx=0x7faebc027cd0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 shutdown_connections 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55da66e48080 0x55da672e6450 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faea9ffb640 0 client.17865 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da66e93670 0x55da6726aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.427+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da66eb4350 0x55da6726af60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.428+0000 7faeceeca740 1 --2- 172.21.15.6:0/140451783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da66e8b490 0x55da6726f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.428+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 >> 172.21.15.6:0/140451783 conn(0x55da66ea8740 msgr2=0x55da6725cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.428+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 shutdown_connections 2024-09-21T08:16:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.428+0000 7faeceeca740 1 -- 172.21.15.6:0/140451783 wait complete. 2024-09-21T08:16:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.429+0000 7faeceeca740 20 client.17865 trim_cache size 0 max 16384 2024-09-21T08:16:42.432 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:16:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "d480b1ff-51cb-4407-8d5a-ecaeea7c8122", 2024-09-21T08:16:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:16:42.433 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 msgr2=0x7faeac0b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 0x7faeac0b8d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faec410fd80 tx=0x7faebc011810 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 msgr2=0x7faec411bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faeb4004770 tx=0x7faeb4004040 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 shutdown_connections 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faeac0b6850 0x7faeac0b8d60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faec410f150 0x7faec411c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faec410a3c0 0x7faec411bbd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 --2- 172.21.15.6:0/2923745323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faec406af90 0x7faec411e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 >> 172.21.15.6:0/2923745323 conn(0x7faec40712f0 msgr2=0x7faec410bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 shutdown_connections 2024-09-21T08:16:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:42.432+0000 7faec8956640 1 -- 172.21.15.6:0/2923745323 wait complete. 2024-09-21T08:16:42.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 825.0 s, 643.4 tps, lat 156.930 ms stddev 97.947 2024-09-21T08:16:43.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:43 smithi006 ceph-mon[30970]: pgmap v833: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-09-21T08:16:43.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:16:43.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:43 smithi119 ceph-mon[33564]: pgmap v833: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-09-21T08:16:43.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:43 smithi145 ceph-mon[34049]: pgmap v833: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-09-21T08:16:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:16:44.300 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:44 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:16:44.300 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:44 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:44.300 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:44 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:16:44.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:44 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:16:44.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:44 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:44.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:44 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:16:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:44 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:16:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:44 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:44.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:44 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:16:45.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:45 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:45.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:45 smithi006 ceph-mon[30970]: pgmap v834: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 704 op/s 2024-09-21T08:16:45.365 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "d480b1ff-51cb-4407-8d5a-ecaeea7c8122", 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:16:45.366 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:16:45.369 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.371 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.372 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.373 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.374 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.375 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.376 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:16:45.378 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:16:45.379 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:16:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:16:45.381 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:16:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.436+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/2813582399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc381083c0 msgr2=0x7fbc381087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.436+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/2813582399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc381083c0 0x7fbc381087d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009900 tx=0x7fbc2802a410 comp rx=0 tx=0).stop 2024-09-21T08:16:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.438+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/2813582399 shutdown_connections 2024-09-21T08:16:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.438+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/2813582399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc3810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.438+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/2813582399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc381083c0 0x7fbc381087d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.438+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/2813582399 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc38102a80 0x7fbc38102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.438+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/2813582399 >> 172.21.15.6:0/2813582399 conn(0x7fbc38079740 msgr2=0x7fbc38079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.441+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/2813582399 shutdown_connections 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.441+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/2813582399 wait complete. 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.442+0000 7fbc3f7f3640 1 Processor -- start 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.443+0000 7fbc3f7f3640 1 -- start start 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.443+0000 7fbc3f7f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.443+0000 7fbc3f7f3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc381083c0 0x7fbc3819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.443+0000 7fbc3f7f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc381a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3dd90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc381a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3dd90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc381a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46320/0 (socket says 172.21.15.6:46320) 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3dd90640 1 -- 172.21.15.6:0/3976825254 learned_addr learned my addr 172.21.15.6:0/3976825254 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38112880 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38112700 con 0x7fbc38108d10 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38112a00 con 0x7fbc381083c0 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.444+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51166/0 (socket says 172.21.15.6:51166) 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.445+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3976825254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc381083c0 msgr2=0x7fbc3819cb70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.445+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc381083c0 0x7fbc3819cb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.445+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3976825254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 msgr2=0x7fbc381a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.445+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc381a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.445+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc381a2540 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.451+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9f0 tx=0x7fbc3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.453+0000 7fbc2e7fc640 1 -- 172.21.15.6:0/3976825254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400ccc0 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.453+0000 7fbc2e7fc640 1 -- 172.21.15.6:0/3976825254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc340108c0 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.453+0000 7fbc2e7fc640 1 -- 172.21.15.6:0/3976825254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc340187e0 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.454+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc381a2830 con 0x7fbc38102a80 2024-09-21T08:16:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.454+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3806cde0 con 0x7fbc38102a80 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.459+0000 7fbc45d67740 1 Processor -- start 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.461+0000 7fbc45d67740 1 -- start start 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.461+0000 7fbc2e7fc640 1 -- 172.21.15.6:0/3976825254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbc34018980 con 0x7fbc38102a80 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.461+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.462+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d1631b0 0x558b8d533b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.462+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d16b390 0x558b8d5340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.462+0000 7fbc45d67740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558b8d4a9e50 con 0x558b8d18c070 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.462+0000 7fbc45d67740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558b8d499280 con 0x558b8d16b390 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.462+0000 7fbc45d67740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b8d49d090 con 0x558b8d1631b0 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.463+0000 7fbc3dd90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.463+0000 7fbc3dd90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51170/0 (socket says 172.21.15.6:51170) 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.463+0000 7fbc3dd90640 1 -- 172.21.15.6:0/1070298407 learned_addr learned my addr 172.21.15.6:0/1070298407 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.463+0000 7fbc2e7fc640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 0x7fbc240b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d1631b0 0x558b8d533b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3dd90640 1 -- 172.21.15.6:0/1070298407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d1631b0 msgr2=0x558b8d533b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d1631b0 0x558b8d533b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3dd90640 1 -- 172.21.15.6:0/1070298407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d16b390 msgr2=0x558b8d5340d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d16b390 0x558b8d5340d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc3dd90640 1 -- 172.21.15.6:0/1070298407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8d1f7650 con 0x558b8d18c070 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.464+0000 7fbc2e7fc640 1 -- 172.21.15.6:0/3976825254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7fbc340e7f20 con 0x7fbc38102a80 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.465+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 0x7fbc240b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.465+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009fb0 tx=0x7fbc30021810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf56168e5c9b157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.466+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 0x7fbc240b8d60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbc30030000 tx=0x7fbc3002ccd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.467+0000 7fbc237fe640 1 -- 172.21.15.6:0/1070298407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30033070 con 0x558b8d18c070 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.467+0000 7fbc237fe640 1 -- 172.21.15.6:0/1070298407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc30022b90 con 0x558b8d18c070 2024-09-21T08:16:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.467+0000 7fbc237fe640 1 -- 172.21.15.6:0/1070298407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3002c620 con 0x558b8d18c070 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.468+0000 7fbc45d67740 1 -- 172.21.15.6:0/1070298407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 msgr2=0x558b8d533650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.468+0000 7fbc45d67740 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009fb0 tx=0x7fbc30021810 comp rx=0 tx=0).stop 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 -- 172.21.15.6:0/1070298407 shutdown_connections 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d1631b0 0x558b8d533b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d16b390 0x558b8d5340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 --2- 172.21.15.6:0/1070298407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d533650 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 -- 172.21.15.6:0/1070298407 >> 172.21.15.6:0/1070298407 conn(0x558b8d180460 msgr2=0x558b8d531540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 -- 172.21.15.6:0/1070298407 shutdown_connections 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 -- 172.21.15.6:0/1070298407 wait complete. 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.469+0000 7fbc45d67740 1 -- start start 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.470+0000 7fbc45d67740 1 Processor -- start 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.470+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.470+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d16b390 0x558b8d53f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.470+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 0x558b8d553930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46346/0 (socket says 172.21.15.6:46346) 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc45d67740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558b8d2fa700 con 0x558b8d16b390 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc45d67740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558b8d434110 con 0x558b8d1631b0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc45d67740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b8d541e30 con 0x558b8d18c070 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc45d67740 10 client.0 _ll_register_callbacks cb 0x558b8d44d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3d58f640 1 -- 172.21.15.6:0/188100880 learned_addr learned my addr 172.21.15.6:0/188100880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 0x558b8d553930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d16b390 0x558b8d53f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3d58f640 1 -- 172.21.15.6:0/188100880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 msgr2=0x558b8d553930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.471+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 0x558b8d553930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc3d58f640 1 -- 172.21.15.6:0/188100880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d16b390 msgr2=0x558b8d53f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d16b390 0x558b8d53f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc3d58f640 1 -- 172.21.15.6:0/188100880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8d461c40 con 0x558b8d1631b0 2024-09-21T08:16:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 0x558b8d553930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbc340ad630 tx=0x7fbc3400ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a5743dd850b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.472+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ad280 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.473+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc30022b90 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.473+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7fbc340acb90 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.473+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc340ad280 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 10 client.27506 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558b8d556470 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc30022b90 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc340ac600 con 0x558b8d1631b0 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 10 client.27506 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 10 client.27506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 20 client.27506 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d14a9f0 0x558b8d5597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 4 client.27506 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.474+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b8d4abda0 con 0x558b8d14a9f0 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.475+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d14a9f0 0x558b8d5597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.476+0000 7fbc20ff9640 10 client.27506 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.476+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d14a9f0 0x558b8d5597d0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68a3ac9e00dd95b server_cookie=1c84212bdb2b799f in_seq=0 out_seq=0 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.476+0000 7fbc20ff9640 1 -- 172.21.15.6:0/188100880 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b8d4abda0 con 0x558b8d14a9f0 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.476+0000 7fbc20ff9640 10 client.27506 handle_command_reply: tid=0 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 client.27506 shutdown 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 msgr2=0x558b8d53edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbc340ad630 tx=0x7fbc3400ce60 comp rx=0 tx=0).stop 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 shutdown_connections 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d14a9f0 0x558b8d5597d0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d18c070 0x558b8d553930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d16b390 0x558b8d53f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 --2- 172.21.15.6:0/188100880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d53edd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.477+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 >> 172.21.15.6:0/188100880 conn(0x558b8d180460 msgr2=0x558b8d536830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.478+0000 7fbc20ff9640 0 client.27506 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.478+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 shutdown_connections 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.478+0000 7fbc45d67740 1 -- 172.21.15.6:0/188100880 wait complete. 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.479+0000 7fbc45d67740 20 client.27506 trim_cache size 0 max 16384 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.514+0000 7fbc45d67740 1 Processor -- start 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.514+0000 7fbc45d67740 1 -- start start 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.514+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 0x558b8d536e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d53bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 0x558b8d536e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 0x558b8d536e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51188/0 (socket says 172.21.15.6:51188) 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc3d58f640 1 -- 172.21.15.6:0/557363651 learned_addr learned my addr 172.21.15.6:0/557363651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc45d67740 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 0x558b8d53c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38070da0 con 0x558b8d1631b0 2024-09-21T08:16:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38073620 con 0x558b8d18c070 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38071410 con 0x558b8d16b390 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.515+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 0x558b8d53c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d53bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 -- 172.21.15.6:0/557363651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 msgr2=0x558b8d53bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d53bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 -- 172.21.15.6:0/557363651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 msgr2=0x558b8d536e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 0x558b8d536e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 -- 172.21.15.6:0/557363651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8d5373a0 con 0x558b8d18c070 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.516+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 0x558b8d53c500 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009f80 tx=0x7fbc30034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a60ad393897f2d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.517+0000 7fbc22ffd640 1 -- 172.21.15.6:0/557363651 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30033070 con 0x558b8d18c070 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.517+0000 7fbc22ffd640 1 -- 172.21.15.6:0/557363651 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc30009930 con 0x558b8d18c070 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.517+0000 7fbc22ffd640 1 -- 172.21.15.6:0/557363651 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30022790 con 0x558b8d18c070 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 msgr2=0x558b8d53c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 0x558b8d53c500 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009f80 tx=0x7fbc30034000 comp rx=0 tx=0).stop 2024-09-21T08:16:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 shutdown_connections 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d53bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d18c070 0x558b8d53c500 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 --2- 172.21.15.6:0/557363651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d1631b0 0x558b8d536e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 >> 172.21.15.6:0/557363651 conn(0x558b8d180460 msgr2=0x558b8d536750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 shutdown_connections 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.518+0000 7fbc45d67740 1 -- 172.21.15.6:0/557363651 wait complete. 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.519+0000 7fbc45d67740 1 -- start start 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.519+0000 7fbc45d67740 1 Processor -- start 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d54c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc3d58f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:46358/0 (socket says 172.21.15.6:46358) 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc3cd8e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d54c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc3cd8e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d54c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:58764/0 (socket says 172.21.15.6:58764) 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc45d67740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d5bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.520+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3301974792 learned_addr learned my addr 172.21.15.6:0/3301974792 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38071ae0 con 0x558b8d18c070 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38072f50 con 0x558b8d1631b0 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380721b0 con 0x558b8d16b390 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3dd90640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d5bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3301974792 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 msgr2=0x558b8d54c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d54c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3301974792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 msgr2=0x558b8d5bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d5bd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc3d58f640 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8d5bd790 con 0x558b8d1631b0 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.521+0000 7fbc45d67740 10 client.0 _ll_register_callbacks cb 0x7fbc340a9f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.522+0000 7fbc3d58f640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc340a9f00 tx=0x7fbc34009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5637416f32aae9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:16:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.522+0000 7fbc20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.522+0000 7fbc20ff9640 1 -- 172.21.15.6:0/3301974792 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34098040 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.522+0000 7fbc20ff9640 1 -- 172.21.15.6:0/3301974792 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9511+0+0 (secure 0 0 0) 0x7fbc340b21b0 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.522+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc30009930 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.523+0000 7fbc20ff9640 1 -- 172.21.15.6:0/3301974792 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc340ad280 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.523+0000 7fbc45d67740 10 client.27512 fetch_fsmap learned FSMap version 21 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.524+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=21}) -- 0x558b8d5c4a70 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc20ff9640 1 -- 172.21.15.6:0/3301974792 <== mon.2 v2:172.21.15.119:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc340ac600 con 0x558b8d1631b0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc45d67740 10 client.27512 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc45d67740 10 client.27512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc45d67740 20 client.27512 populate_metadata read hostname 'smithi006' 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d11fda0 0x558b8d5c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.526+0000 7fbc45d67740 4 client.27512 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.527+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d11fda0 0x558b8d5c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:16:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.527+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fbc30009930 con 0x558b8d11fda0 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.531+0000 7fbc3cd8e640 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d11fda0 0x558b8d5c7080 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8966cd17d2aca7c6 server_cookie=6ea5890030f653bd in_seq=0 out_seq=0 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.531+0000 7fbc20ff9640 10 client.27512 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.532+0000 7fbc20ff9640 1 -- 172.21.15.6:0/3301974792 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8238 (crc 0 0 0) 0x7fbc30009930 con 0x558b8d11fda0 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.532+0000 7fbc20ff9640 10 client.27512 handle_command_reply: tid=0 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.532+0000 7fbc45d67740 1 client.27512 shutdown 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 msgr2=0x558b8d54c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc340a9f00 tx=0x7fbc34009700 comp rx=0 tx=0).stop 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 shutdown_connections 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558b8d11fda0 0x558b8d5c7080 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b8d16b390 0x558b8d54c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b8d18c070 0x558b8d5bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 --2- 172.21.15.6:0/3301974792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558b8d1631b0 0x558b8d54c2f0 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc340a9f00 tx=0x7fbc34009700 comp rx=0 tx=0).stop 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 >> 172.21.15.6:0/3301974792 conn(0x558b8d180460 msgr2=0x558b8d53d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.533+0000 7fbc20ff9640 0 client.27512 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.537+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 shutdown_connections 2024-09-21T08:16:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.538+0000 7fbc45d67740 1 -- 172.21.15.6:0/3301974792 wait complete. 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.538+0000 7fbc45d67740 20 client.27512 trim_cache size 0 max 16384 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 msgr2=0x7fbc240b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 0x7fbc240b8d60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbc30030000 tx=0x7fbc3002ccd0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 msgr2=0x7fbc3819c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9f0 tx=0x7fbc3400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 shutdown_connections 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fbc240b6850 0x7fbc240b8d60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc381083c0 0x7fbc3819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38108d10 0x7fbc381a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 --2- 172.21.15.6:0/3976825254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc38102a80 0x7fbc3819c5d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 >> 172.21.15.6:0/3976825254 conn(0x7fbc38079740 msgr2=0x7fbc381044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.539+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 shutdown_connections 2024-09-21T08:16:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:16:44.540+0000 7fbc3f7f3640 1 -- 172.21.15.6:0/3976825254 wait complete. 2024-09-21T08:16:45.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:45 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:45.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:45 smithi119 ceph-mon[33564]: pgmap v834: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 704 op/s 2024-09-21T08:16:45.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:45 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:16:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:45 smithi145 ceph-mon[34049]: pgmap v834: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 704 op/s 2024-09-21T08:16:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:47 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:16:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:47 smithi119 ceph-mon[33564]: pgmap v835: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-09-21T08:16:47.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:47 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:16:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:47 smithi145 ceph-mon[34049]: pgmap v835: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-09-21T08:16:47.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:47 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:16:47.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:47 smithi006 ceph-mon[30970]: pgmap v835: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.1 MiB/s wr, 667 op/s 2024-09-21T08:16:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 830.0 s, 746.0 tps, lat 134.377 ms stddev 78.243 2024-09-21T08:16:48.393 INFO:tasks.cephfs.filesystem:scrub status for tag:d480b1ff-51cb-4407-8d5a-ecaeea7c8122 - {'path': '/', 'tag': 'd480b1ff-51cb-4407-8d5a-ecaeea7c8122', 'options': 'recursive,force'} 2024-09-21T08:16:49.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:49 smithi119 ceph-mon[33564]: pgmap v836: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 9.2 MiB/s wr, 738 op/s 2024-09-21T08:16:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:49 smithi145 ceph-mon[34049]: pgmap v836: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 9.2 MiB/s wr, 738 op/s 2024-09-21T08:16:49.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:49 smithi006 ceph-mon[30970]: pgmap v836: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 9.2 MiB/s wr, 738 op/s 2024-09-21T08:16:51.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:51 smithi119 ceph-mon[33564]: pgmap v837: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-21T08:16:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:51 smithi145 ceph-mon[34049]: pgmap v837: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-21T08:16:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:51 smithi006 ceph-mon[30970]: pgmap v837: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 9.7 MiB/s wr, 685 op/s 2024-09-21T08:16:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 835.0 s, 843.2 tps, lat 118.776 ms stddev 92.982 2024-09-21T08:16:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:53 smithi119 ceph-mon[33564]: pgmap v838: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-21T08:16:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:53 smithi145 ceph-mon[34049]: pgmap v838: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-21T08:16:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:53 smithi006 ceph-mon[30970]: pgmap v838: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-21T08:16:55.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:55 smithi119 ceph-mon[33564]: pgmap v839: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-21T08:16:55.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:55 smithi145 ceph-mon[34049]: pgmap v839: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-21T08:16:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:55 smithi006 ceph-mon[30970]: pgmap v839: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-21T08:16:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:57 smithi119 ceph-mon[33564]: pgmap v840: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-21T08:16:57.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:57 smithi145 ceph-mon[34049]: pgmap v840: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-21T08:16:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:57 smithi006 ceph-mon[30970]: pgmap v840: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-09-21T08:16:57.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 840.0 s, 817.2 tps, lat 120.999 ms stddev 75.659 2024-09-21T08:16:59.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:16:59 smithi119 ceph-mon[33564]: pgmap v841: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-09-21T08:16:59.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:16:59 smithi145 ceph-mon[34049]: pgmap v841: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-09-21T08:16:59.947 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:16:59 smithi006 ceph-mon[30970]: pgmap v841: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-09-21T08:17:01.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:01 smithi119 ceph-mon[33564]: pgmap v842: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 12 MiB/s wr, 723 op/s 2024-09-21T08:17:01.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:01 smithi145 ceph-mon[34049]: pgmap v842: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 12 MiB/s wr, 723 op/s 2024-09-21T08:17:01.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:01 smithi006 ceph-mon[30970]: pgmap v842: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 12 MiB/s wr, 723 op/s 2024-09-21T08:17:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 845.0 s, 847.6 tps, lat 118.944 ms stddev 98.258 2024-09-21T08:17:03.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:03 smithi119 ceph-mon[33564]: pgmap v843: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 12 MiB/s wr, 744 op/s 2024-09-21T08:17:03.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:03 smithi145 ceph-mon[34049]: pgmap v843: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 12 MiB/s wr, 744 op/s 2024-09-21T08:17:03.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:03 smithi006 ceph-mon[30970]: pgmap v843: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 12 MiB/s wr, 744 op/s 2024-09-21T08:17:05.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:05 smithi119 ceph-mon[33564]: pgmap v844: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 14 MiB/s wr, 815 op/s 2024-09-21T08:17:05.946 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:05 smithi145 ceph-mon[34049]: pgmap v844: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 14 MiB/s wr, 815 op/s 2024-09-21T08:17:05.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:05 smithi006 ceph-mon[30970]: pgmap v844: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 14 MiB/s wr, 815 op/s 2024-09-21T08:17:06.211 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.2 2024-09-21T08:17:06.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:17:06.870 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:06.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:06 smithi119 ceph-mon[33564]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:17:06.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:06 smithi119 ceph-mon[33564]: pgmap v846: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-21T08:17:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:06 smithi145 ceph-mon[34049]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:17:06.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:06 smithi145 ceph-mon[34049]: pgmap v846: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-21T08:17:06.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:06 smithi006 ceph-mon[30970]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:17:06.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:06 smithi006 ceph-mon[30970]: pgmap v846: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 12 MiB/s wr, 786 op/s 2024-09-21T08:17:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 850.0 s, 687.6 tps, lat 145.552 ms stddev 150.590 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.061+0000 7f929ffff640 1 -- 172.21.15.6:0/3063516313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0034a50 con 0x7f92a810b860 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 -- 172.21.15.6:0/3063516313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810b860 msgr2=0x7f92a810bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 --2- 172.21.15.6:0/3063516313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810b860 0x7f92a810bc70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f92a0013490 tx=0x7f92a0032b10 comp rx=0 tx=0).stop 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 -- 172.21.15.6:0/3063516313 shutdown_connections 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 --2- 172.21.15.6:0/3063516313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a8110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 --2- 172.21.15.6:0/3063516313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810b860 0x7f92a810bc70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 --2- 172.21.15.6:0/3063516313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810a3c0 0x7f92a810a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.062+0000 7f92af58b640 1 -- 172.21.15.6:0/3063516313 >> 172.21.15.6:0/3063516313 conn(0x7f92a8070ec0 msgr2=0x7f92a80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.063+0000 7f92af58b640 1 -- 172.21.15.6:0/3063516313 shutdown_connections 2024-09-21T08:17:08.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.063+0000 7f92af58b640 1 -- 172.21.15.6:0/3063516313 wait complete. 2024-09-21T08:17:08.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 Processor -- start 2024-09-21T08:17:08.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 -- start start 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 0x7f92a81a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a81a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92a811a0f0 con 0x7f92a810a3c0 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8119f70 con 0x7f92a810b860 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92af58b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f92a811a270 con 0x7f92a810c1b0 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.064+0000 7f92ad327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92ad327640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41232/0 (socket says 172.21.15.6:41232) 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92adb28640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a81a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92ad327640 1 -- 172.21.15.6:0/955346777 learned_addr learned my addr 172.21.15.6:0/955346777 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 0x7f92a81a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 -- 172.21.15.6:0/955346777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 msgr2=0x7f92a81a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a81a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 -- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 msgr2=0x7f92a81a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92acb26640 1 -- 172.21.15.6:0/955346777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a81a69e0 con 0x7f92a810b860 2024-09-21T08:17:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92adb28640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a81a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:08.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.065+0000 7f92ad327640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f92acb26640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 0x7f92a81a1010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92a0013460 tx=0x7f92a0034880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a003a040 con 0x7f92a810b860 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a81a6c70 con 0x7f92a810b860 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92a0034460 con 0x7f92a810b860 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a81ad430 con 0x7f92a810b860 2024-09-21T08:17:08.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.066+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0004410 con 0x7f92a810b860 2024-09-21T08:17:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.070+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f92a003d070 con 0x7f92a810b860 2024-09-21T08:17:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.072+0000 7f929e7fc640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 0x7f92940b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.072+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9599+0+0 (secure 0 0 0) 0x7f92a010fd70 con 0x7f92a810b860 2024-09-21T08:17:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.072+0000 7f92ad327640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 0x7f92940b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.074+0000 7f92ad327640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 0x7f92940b8c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f92a4011550 tx=0x7f92a4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.074+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c0052c0 con 0x7f92a810b860 2024-09-21T08:17:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.080+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92a00d5e90 con 0x7f92a810b860 2024-09-21T08:17:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.512+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f928c005880 con 0x7f92a810b860 2024-09-21T08:17:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.513+0000 7f929e7fc640 1 -- 172.21.15.6:0/955346777 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f92a00da270 con 0x7f92a810b860 2024-09-21T08:17:08.517 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:17:08.517 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:17:08.517 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:17:08.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.517+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 msgr2=0x7f92940b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:08.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.517+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 0x7f92940b8c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f92a4011550 tx=0x7f92a4005f90 comp rx=0 tx=0).stop 2024-09-21T08:17:08.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.517+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 msgr2=0x7f92a81a1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:08.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.517+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 0x7f92a81a1010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92a0013460 tx=0x7f92a0034880 comp rx=0 tx=0).stop 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.519+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 shutdown_connections 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.519+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f92940b6730 0x7f92940b8c40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.519+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92a810c1b0 0x7f92a81a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.519+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a810b860 0x7f92a81a1010 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.519+0000 7f92af58b640 1 --2- 172.21.15.6:0/955346777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92a810a3c0 0x7f92a81a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.520+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 >> 172.21.15.6:0/955346777 conn(0x7f92a8070ec0 msgr2=0x7f92a810d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.520+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 shutdown_connections 2024-09-21T08:17:08.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:08.520+0000 7f92af58b640 1 -- 172.21.15.6:0/955346777 wait complete. 2024-09-21T08:17:09.330 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:09 smithi006 ceph-mon[30970]: pgmap v847: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-21T08:17:09.330 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:09 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/955346777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:09.331 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:09 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:17:09.332 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db / --timeout 90 --expiration 143.2 --await-for 45.0' 2024-09-21T08:17:09.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db / --timeout 90 --expiration 143.2 --await-for 45.0 2024-09-21T08:17:09.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:09 smithi119 ceph-mon[33564]: pgmap v847: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-21T08:17:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:09 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/955346777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:09.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:09 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:17:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:09 smithi145 ceph-mon[34049]: pgmap v847: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-21T08:17:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:09 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/955346777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:09.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:09 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:17:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:10.331 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:17:10.331 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:17:10.331 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:17:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:17:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:17:10.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:17:10.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:17:10.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:17:10.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.546+0000 7fa300dfb640 1 -- 172.21.15.6:0/2515692687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc109fe0 msgr2=0x7fa2fc10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.546+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2515692687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc10a3f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009860 tx=0x7fa2f002a340 comp rx=0 tx=0).stop 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 -- 172.21.15.6:0/2515692687 shutdown_connections 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2515692687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc110270 0x7fa2fc116aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2515692687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2515692687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc10a3f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 -- 172.21.15.6:0/2515692687 >> 172.21.15.6:0/2515692687 conn(0x7fa2fc079610 msgr2=0x7fa2fc1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 -- 172.21.15.6:0/2515692687 shutdown_connections 2024-09-21T08:17:10.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.548+0000 7fa300dfb640 1 -- 172.21.15.6:0/2515692687 wait complete. 2024-09-21T08:17:10.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.549+0000 7fa300dfb640 1 Processor -- start 2024-09-21T08:17:10.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.549+0000 7fa300dfb640 1 -- start start 2024-09-21T08:17:10.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc083d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc07d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 0x7fa2fc07d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc119de0 con 0x7fa2fc10f920 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc119c60 con 0x7fa2fc109fe0 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa300dfb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc119f60 con 0x7fa2fc110270 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2fbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 0x7fa2fc07d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc083d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2fbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 0x7fa2fc07d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:35536/0 (socket says 172.21.15.6:35536) 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc083d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:51994/0 (socket says 172.21.15.6:51994) 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2fbfff640 1 -- 172.21.15.6:0/2704715498 learned_addr learned my addr 172.21.15.6:0/2704715498 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:10.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.550+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc07d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.551+0000 7fa2faffd640 1 -- 172.21.15.6:0/2704715498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 msgr2=0x7fa2fc07d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.551+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 0x7fa2fc07d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.551+0000 7fa2faffd640 1 -- 172.21.15.6:0/2704715498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 msgr2=0x7fa2fc083d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.551+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc083d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.551+0000 7fa2faffd640 1 -- 172.21.15.6:0/2704715498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc07de10 con 0x7fa2fc10f920 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.552+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc07d020 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c940 tx=0x7fa2ec00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.552+0000 7fa2f8ff9640 1 -- 172.21.15.6:0/2704715498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec007bb0 con 0x7fa2fc10f920 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.552+0000 7fa2f8ff9640 1 -- 172.21.15.6:0/2704715498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2ec007d50 con 0x7fa2fc10f920 2024-09-21T08:17:10.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.552+0000 7fa2f8ff9640 1 -- 172.21.15.6:0/2704715498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec018660 con 0x7fa2fc10f920 2024-09-21T08:17:10.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.553+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc082ae0 con 0x7fa2fc10f920 2024-09-21T08:17:10.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.553+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc082fd0 con 0x7fa2fc10f920 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa2f8ff9640 1 -- 172.21.15.6:0/2704715498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa2ec00f450 con 0x7fa2fc10f920 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 Processor -- start 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 -- start start 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436348d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c436349260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c4362beb90 con 0x55c435f78980 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c4362adfc0 con 0x55c435f80b60 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.560+0000 7fa3085d1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4362b1dd0 con 0x55c435fa1840 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:35544/0 (socket says 172.21.15.6:35544) 2024-09-21T08:17:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3338880356 learned_addr learned my addr 172.21.15.6:0/3338880356 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2f8ff9640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 0x7fa2e40b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2faffd640 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c436349260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436348d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2f8ff9640 1 -- 172.21.15.6:0/2704715498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9599+0+0 (secure 0 0 0) 0x7fa2ec0e7a80 con 0x7fa2fc10f920 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3338880356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 msgr2=0x55c436349260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c436349260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3338880356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 msgr2=0x55c436348d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.561+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436348d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3338880356 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c436235060 con 0x55c435fa1840 2024-09-21T08:17:10.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 0x7fa2e40b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009fd0 tx=0x7fa2f400ea00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d02c590cde7b4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2e1ffb640 1 -- 172.21.15.6:0/3338880356 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f401b480 con 0x55c435fa1840 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2e1ffb640 1 -- 172.21.15.6:0/3338880356 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f401bb30 con 0x55c435fa1840 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.562+0000 7fa2e1ffb640 1 -- 172.21.15.6:0/3338880356 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f401ac30 con 0x55c435fa1840 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 -- 172.21.15.6:0/3338880356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 msgr2=0x55c4363487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009fd0 tx=0x7fa2f400ea00 comp rx=0 tx=0).stop 2024-09-21T08:17:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 0x7fa2e40b8da0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4023000 tx=0x7fa2f401ae90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 -- 172.21.15.6:0/3338880356 shutdown_connections 2024-09-21T08:17:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c436349260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436348d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3338880356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363487e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.564+0000 7fa3085d1740 1 -- 172.21.15.6:0/3338880356 >> 172.21.15.6:0/3338880356 conn(0x55c435f95990 msgr2=0x55c4363466d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.565+0000 7fa3085d1740 1 -- 172.21.15.6:0/3338880356 shutdown_connections 2024-09-21T08:17:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.565+0000 7fa3085d1740 1 -- 172.21.15.6:0/3338880356 wait complete. 2024-09-21T08:17:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.565+0000 7fa3085d1740 1 -- start start 2024-09-21T08:17:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 Processor -- start 2024-09-21T08:17:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f78980 0x55c436354420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 0x55c4363549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c43610f7a0 con 0x55c435f80b60 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c4362530a0 con 0x55c435f78980 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c436356fc0 con 0x55c435fa1840 2024-09-21T08:17:10.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.566+0000 7fa3085d1740 10 client.0 _ll_register_callbacks cb 0x55c4362303c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.567+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 0x55c4363549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.567+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 0x55c4363549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41272/0 (socket says 172.21.15.6:41272) 2024-09-21T08:17:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.567+0000 7fa2faffd640 1 -- 172.21.15.6:0/3409286488 learned_addr learned my addr 172.21.15.6:0/3409286488 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.567+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.567+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f78980 0x55c436354420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f78980 msgr2=0x55c436354420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f78980 0x55c436354420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3409286488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 msgr2=0x55c4363549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 0x55c4363549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 -- 172.21.15.6:0/3409286488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c436241880 con 0x55c435fa1840 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363602b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009540 tx=0x7fa2f4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10391f2aeb7655b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.568+0000 7fa2daffd640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f402b070 con 0x55c435fa1840 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9599+0+0 (secure 0 0 0) 0x7fa2f400ddb0 con 0x55c435fa1840 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f401bb30 con 0x55c435fa1840 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2f401b480 con 0x55c435fa1840 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa3085d1740 10 client.27610 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.569+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c43601bb90 con 0x55c435fa1840 2024-09-21T08:17:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f401bb30 con 0x55c435fa1840 2024-09-21T08:17:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2f401bce0 con 0x55c435fa1840 2024-09-21T08:17:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 10 client.27610 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 10 client.27610 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:17:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 20 client.27610 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f601c0 0x55c436366680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 4 client.27610 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4362c0ae0 con 0x55c435f601c0 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.570+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f601c0 0x55c436366680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.571+0000 7fa2daffd640 10 client.27610 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.571+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f601c0 0x55c436366680 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17761e9239ca2791 server_cookie=f6c33ded3d243e68 in_seq=0 out_seq=0 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa2daffd640 1 -- 172.21.15.6:0/3409286488 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4362c0ae0 con 0x55c435f601c0 2024-09-21T08:17:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa2daffd640 10 client.27610 handle_command_reply: tid=0 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 client.27610 shutdown 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 msgr2=0x55c4363602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363602b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009540 tx=0x7fa2f4017000 comp rx=0 tx=0).stop 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 shutdown_connections 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f601c0 0x55c436366680 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363602b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f80b60 0x55c4363549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3409286488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f78980 0x55c436354420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.572+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 >> 172.21.15.6:0/3409286488 conn(0x55c435f95990 msgr2=0x55c436344d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.573+0000 7fa2daffd640 0 client.27610 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.573+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 shutdown_connections 2024-09-21T08:17:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.573+0000 7fa3085d1740 1 -- 172.21.15.6:0/3409286488 wait complete. 2024-09-21T08:17:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.573+0000 7fa3085d1740 20 client.27610 trim_cache size 0 max 16384 2024-09-21T08:17:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.608+0000 7fa3085d1740 1 Processor -- start 2024-09-21T08:17:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.608+0000 7fa3085d1740 1 -- start start 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436345440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435fa1840 0x55c43634de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:35550/0 (socket says 172.21.15.6:35550) 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.609+0000 7fa2faffd640 1 -- 172.21.15.6:0/4147168945 learned_addr learned my addr 172.21.15.6:0/4147168945 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435fa1840 0x55c43634de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436345440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1b8af0 con 0x55c435f78980 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1b7d50 con 0x55c435fa1840 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc074e60 con 0x55c435f80b60 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2faffd640 1 -- 172.21.15.6:0/4147168945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435fa1840 msgr2=0x55c43634de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2faffd640 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435fa1840 0x55c43634de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2faffd640 1 -- 172.21.15.6:0/4147168945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 msgr2=0x55c436345440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.610+0000 7fa2faffd640 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436345440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.611+0000 7fa2faffd640 1 -- 172.21.15.6:0/4147168945 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4363554e0 con 0x55c435f80b60 2024-09-21T08:17:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.611+0000 7fa2faffd640 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0ad3d0 tx=0x7fa2ec0076c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f057ff3484483c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.611+0000 7fa2e17fa640 1 -- 172.21.15.6:0/4147168945 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b1f20 con 0x55c435f80b60 2024-09-21T08:17:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.611+0000 7fa2e17fa640 1 -- 172.21.15.6:0/4147168945 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2ec0b6e60 con 0x55c435f80b60 2024-09-21T08:17:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.611+0000 7fa2e17fa640 1 -- 172.21.15.6:0/4147168945 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0a8d90 con 0x55c435f80b60 2024-09-21T08:17:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.612+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 msgr2=0x55c43634d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.612+0000 7fa3085d1740 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0ad3d0 tx=0x7fa2ec0076c0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.614+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 shutdown_connections 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.614+0000 7fa3085d1740 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435f80b60 0x55c43634d8f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.614+0000 7fa3085d1740 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435fa1840 0x55c43634de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.614+0000 7fa3085d1740 1 --2- 172.21.15.6:0/4147168945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c436345440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.614+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 >> 172.21.15.6:0/4147168945 conn(0x55c435f95990 msgr2=0x55c436344d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.615+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 shutdown_connections 2024-09-21T08:17:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.615+0000 7fa3085d1740 1 -- 172.21.15.6:0/4147168945 wait complete. 2024-09-21T08:17:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.615+0000 7fa3085d1740 1 -- start start 2024-09-21T08:17:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.616+0000 7fa3085d1740 1 Processor -- start 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.616+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c43635c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1b62d0 con 0x55c435f78980 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1b7680 con 0x55c435f80b60 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1b68e0 con 0x55c435fa1840 2024-09-21T08:17:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.617+0000 7fa3085d1740 10 client.0 _ll_register_callbacks cb 0x7fa2f400e450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.618+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.618+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41280/0 (socket says 172.21.15.6:41280) 2024-09-21T08:17:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.618+0000 7fa2fb7fe640 1 -- 172.21.15.6:0/3949476823 learned_addr learned my addr 172.21.15.6:0/3949476823 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fbfff640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2faffd640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c43635c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 -- 172.21.15.6:0/3949476823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 msgr2=0x55c4363571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 -- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 msgr2=0x55c43635c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c43635c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 -- 172.21.15.6:0/3949476823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c43635ced0 con 0x55c435f78980 2024-09-21T08:17:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2faffd640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c43635c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.619+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009830 tx=0x7fa2f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae62929cd9923db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa2daffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0037040 con 0x55c435f78980 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9599+0+0 (secure 0 0 0) 0x7fa2f0004450 con 0x55c435f78980 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2ec0b6e60 con 0x55c435f78980 2024-09-21T08:17:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2f0066050 con 0x55c435f78980 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa3085d1740 10 client.17904 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.620+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c4363d1600 con 0x55c435f78980 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2ec0b6e60 con 0x55c435f78980 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa2f0003ba0 con 0x55c435f78980 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 10 client.17904 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 10 client.17904 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 20 client.17904 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f35570 0x55c4363d3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 4 client.17904 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.2, "await_for": 45.0}] 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.621+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.2, "await_for": 45.0}) -- 0x55c4362bc590 con 0x55c435f35570 2024-09-21T08:17:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.622+0000 7fa2faffd640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f35570 0x55c4363d3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.625+0000 7fa2faffd640 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f35570 0x55c4363d3e10 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8514f85a335fd1d server_cookie=bc484dc86cb6e3c7 in_seq=0 out_seq=0 2024-09-21T08:17:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.625+0000 7fa2daffd640 10 client.17904 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa2daffd640 1 -- 172.21.15.6:0/3949476823 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c4362bc590 con 0x55c435f35570 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa2daffd640 10 client.17904 handle_command_reply: tid=0 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 client.17904 shutdown 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 msgr2=0x55c43635c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009830 tx=0x7fa2f0000bc0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 shutdown_connections 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55c435f35570 0x55c4363d3e10 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c435fa1840 0x55c4363571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa2daffd640 0 client.17904 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c435f80b60 0x55c43635c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 --2- 172.21.15.6:0/3949476823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c435f78980 0x55c43635c220 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.937+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 >> 172.21.15.6:0/3949476823 conn(0x55c435f95990 msgr2=0x55c43634d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 shutdown_connections 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa3085d1740 1 -- 172.21.15.6:0/3949476823 wait complete. 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa3085d1740 20 client.17904 trim_cache size 0 max 16384 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 62, 2024-09-21T08:17:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "ab881309": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 62, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 143.2, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "QUIESCED", 2024-09-21T08:17:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 msgr2=0x7fa2e40b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 0x7fa2e40b8da0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4023000 tx=0x7fa2f401ae90 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 msgr2=0x7fa2fc07d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc07d020 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c940 tx=0x7fa2ec00ce00 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 shutdown_connections 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e40b6890 0x7fa2e40b8da0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2fc110270 0x7fa2fc07d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc10f920 0x7fa2fc07d020 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 --2- 172.21.15.6:0/2704715498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2fc109fe0 0x7fa2fc083d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.938+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 >> 172.21.15.6:0/2704715498 conn(0x7fa2fc079610 msgr2=0x7fa2fc07a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.939+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 shutdown_connections 2024-09-21T08:17:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:10.939+0000 7fa300dfb640 1 -- 172.21.15.6:0/2704715498 wait complete. 2024-09-21T08:17:11.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:11 smithi006 ceph-mon[30970]: pgmap v848: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-21T08:17:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:11 smithi119 ceph-mon[33564]: pgmap v848: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-21T08:17:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:11 smithi145 ceph-mon[34049]: pgmap v848: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-21T08:17:12.581 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 855.0 s, 438.1 tps, lat 138.858 ms stddev 75.423 2024-09-21T08:17:12.717 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ab881309', quiesce took 6.5 seconds. Will release after: 16.7 2024-09-21T08:17:13.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:13 smithi119 ceph-mon[33564]: pgmap v849: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-21T08:17:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:13 smithi145 ceph-mon[34049]: pgmap v849: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-21T08:17:13.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:13 smithi006 ceph-mon[30970]: pgmap v849: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-21T08:17:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:14 smithi119 ceph-mon[33564]: osdmap e107: 12 total, 12 up, 12 in 2024-09-21T08:17:14.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:14 smithi145 ceph-mon[34049]: osdmap e107: 12 total, 12 up, 12 in 2024-09-21T08:17:14.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:14 smithi006 ceph-mon[30970]: osdmap e107: 12 total, 12 up, 12 in 2024-09-21T08:17:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:15 smithi119 ceph-mon[33564]: pgmap v851: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-09-21T08:17:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:15 smithi145 ceph-mon[34049]: pgmap v851: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-09-21T08:17:15.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:15 smithi006 ceph-mon[30970]: pgmap v851: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-09-21T08:17:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:17:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:17 smithi119 ceph-mon[33564]: pgmap v852: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 7.0 MiB/s wr, 484 op/s 2024-09-21T08:17:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:17 smithi145 ceph-mon[34049]: pgmap v852: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 7.0 MiB/s wr, 484 op/s 2024-09-21T08:17:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:17 smithi006 ceph-mon[30970]: pgmap v852: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 7.0 MiB/s wr, 484 op/s 2024-09-21T08:17:18.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:17:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 -- 172.21.15.6:0/3510954681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 msgr2=0x7f1b1c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 --2- 172.21.15.6:0/3510954681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c102ef0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009900 tx=0x7f1b0c02a410 comp rx=0 tx=0).stop 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 -- 172.21.15.6:0/3510954681 shutdown_connections 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 --2- 172.21.15.6:0/3510954681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 0x7f1b1c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 --2- 172.21.15.6:0/3510954681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 0x7f1b1c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 --2- 172.21.15.6:0/3510954681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c102ef0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 -- 172.21.15.6:0/3510954681 >> 172.21.15.6:0/3510954681 conn(0x7f1b1c079760 msgr2=0x7f1b1c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 -- 172.21.15.6:0/3510954681 shutdown_connections 2024-09-21T08:17:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.167+0000 7f1b22323640 1 -- 172.21.15.6:0/3510954681 wait complete. 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 Processor -- start 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 -- start start 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 0x7f1b1c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 0x7f1b1c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c112840 con 0x7f1b1c102ae0 2024-09-21T08:17:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1126c0 con 0x7f1b1c1083d0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b22323640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1129c0 con 0x7f1b1c108d20 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.168+0000 7f1b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47672/0 (socket says 172.21.15.6:47672) 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 -- 172.21.15.6:0/4041352140 learned_addr learned my addr 172.21.15.6:0/4041352140 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b13fff640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 0x7f1b1c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b208c0640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 0x7f1b1c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 -- 172.21.15.6:0/4041352140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 msgr2=0x7f1b1c19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 0x7f1b1c19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 -- 172.21.15.6:0/4041352140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 msgr2=0x7f1b1c19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 0x7f1b1c19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 -- 172.21.15.6:0/4041352140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c1a0210 con 0x7f1b1c102ae0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009230 tx=0x7f1b0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b19ffb640 1 -- 172.21.15.6:0/4041352140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c03f030 con 0x7f1b1c102ae0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b19ffb640 1 -- 172.21.15.6:0/4041352140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b0c003a80 con 0x7f1b1c102ae0 2024-09-21T08:17:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c1a04a0 con 0x7f1b1c102ae0 2024-09-21T08:17:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b19ffb640 1 -- 172.21.15.6:0/4041352140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c035070 con 0x7f1b1c102ae0 2024-09-21T08:17:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.169+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c1a09d0 con 0x7f1b1c102ae0 2024-09-21T08:17:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.172+0000 7f1b19ffb640 1 -- 172.21.15.6:0/4041352140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1b0c042030 con 0x7f1b1c102ae0 2024-09-21T08:17:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.172+0000 7f1b28897740 1 Processor -- start 2024-09-21T08:17:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.172+0000 7f1b28897740 1 -- start start 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 0x563992ed2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ed27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ed2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563992e48e50 con 0x563992b0a390 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563992e38280 con 0x563992b2b070 2024-09-21T08:17:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b28897740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563992e3c090 con 0x563992b021b0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b1bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ed27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b208c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 0x563992ed2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ed2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b208c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 0x563992ed2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:58796/0 (socket says 172.21.15.6:58796) 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b208c0640 1 -- 172.21.15.6:0/1194714935 learned_addr learned my addr 172.21.15.6:0/1194714935 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b19ffb640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 0x7f1b080b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b13fff640 1 -- 172.21.15.6:0/1194714935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 msgr2=0x563992ed27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b13fff640 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ed27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b13fff640 1 -- 172.21.15.6:0/1194714935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 msgr2=0x563992ed2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b13fff640 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 0x563992ed2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.173+0000 7f1b208c0640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 0x7f1b080b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b13fff640 1 -- 172.21.15.6:0/1194714935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563992b96650 con 0x563992b0a390 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b19ffb640 1 -- 172.21.15.6:0/4041352140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f1b0c108310 con 0x7f1b1c102ae0 2024-09-21T08:17:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b13fff640 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ed2cf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06b680 tx=0x7f1b0400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51420ef1cabf81e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b127fc640 1 -- 172.21.15.6:0/1194714935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04004020 con 0x563992b0a390 2024-09-21T08:17:19.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b208c0640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 0x7f1b080b8c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1b14005c40 tx=0x7f1b14004ab0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b127fc640 1 -- 172.21.15.6:0/1194714935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b040041c0 con 0x563992b0a390 2024-09-21T08:17:19.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.174+0000 7f1b127fc640 1 -- 172.21.15.6:0/1194714935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04010690 con 0x563992b0a390 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- 172.21.15.6:0/1194714935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 msgr2=0x563992ed2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ed2cf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06b680 tx=0x7f1b0400e350 comp rx=0 tx=0).stop 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- 172.21.15.6:0/1194714935 shutdown_connections 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ed27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ed2cf0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 --2- 172.21.15.6:0/1194714935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b2b070 0x563992ed2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- 172.21.15.6:0/1194714935 >> 172.21.15.6:0/1194714935 conn(0x563992b1f460 msgr2=0x563992ed0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- 172.21.15.6:0/1194714935 shutdown_connections 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- 172.21.15.6:0/1194714935 wait complete. 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.175+0000 7f1b28897740 1 -- start start 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 Processor -- start 2024-09-21T08:17:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ee1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992ee21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563992c99700 con 0x563992b2b070 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563992dd3110 con 0x563992b0a390 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563992ee4db0 con 0x563992b021b0 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b28897740 10 client.0 _ll_register_callbacks cb 0x563992dec990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47688/0 (socket says 172.21.15.6:47688) 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 -- 172.21.15.6:0/1891251353 learned_addr learned my addr 172.21.15.6:0/1891251353 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ee1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b13fff640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992ee21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 -- 172.21.15.6:0/1891251353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 msgr2=0x563992ee1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ee1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 -- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 msgr2=0x563992ee21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992ee21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.176+0000 7f1b208c0640 1 -- 172.21.15.6:0/1891251353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563992e00c40 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1b208c0640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1b14005bf0 tx=0x7f1b14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fe8a2e944c704c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14025070 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f1b14012bc0 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b040041c0 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b1401a040 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1b28897740 10 client.17916 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563992ef0aa0 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.177+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b040041c0 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b14020040 con 0x563992b2b070 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 10 client.17916 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 10 client.17916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 20 client.17916 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992ae99f0 0x563992ef3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 4 client.17916 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563992e4ada0 con 0x563992ae99f0 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.178+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992ae99f0 0x563992ef3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.179+0000 7f1afb7fe640 10 client.17916 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.179+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992ae99f0 0x563992ef3fa0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af97ce83709d480 server_cookie=903405244dad899 in_seq=0 out_seq=0 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.179+0000 7f1afb7fe640 1 -- 172.21.15.6:0/1891251353 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563992e4ada0 con 0x563992ae99f0 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.179+0000 7f1afb7fe640 10 client.17916 handle_command_reply: tid=0 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.179+0000 7f1b28897740 1 client.17916 shutdown 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 msgr2=0x563992ee2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1b14005bf0 tx=0x7f1b14004a40 comp rx=0 tx=0).stop 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 shutdown_connections 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992ae99f0 0x563992ef3fa0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1afb7fe640 0 client.17916 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b2b070 0x563992ee2730 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992ee21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 --2- 172.21.15.6:0/1891251353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b021b0 0x563992ee1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 >> 172.21.15.6:0/1891251353 conn(0x563992b1f460 msgr2=0x563992ed3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 shutdown_connections 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 1 -- 172.21.15.6:0/1891251353 wait complete. 2024-09-21T08:17:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.180+0000 7f1b28897740 20 client.17916 trim_cache size 0 max 16384 2024-09-21T08:17:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.197+0000 7f1b28897740 1 Processor -- start 2024-09-21T08:17:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.197+0000 7f1b28897740 1 -- start start 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992edeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992edf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1acc20 con 0x563992b021b0 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1af480 con 0x563992b0a390 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b28897740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1ad270 con 0x563992b2b070 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47692/0 (socket says 172.21.15.6:47692) 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 -- 172.21.15.6:0/3486867015 learned_addr learned my addr 172.21.15.6:0/3486867015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b208c0640 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992edf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b13fff640 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992edeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 -- 172.21.15.6:0/3486867015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 msgr2=0x563992edf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992edf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 -- 172.21.15.6:0/3486867015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 msgr2=0x563992edeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992edeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 -- 172.21.15.6:0/3486867015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563992ee01b0 con 0x563992b021b0 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c105680 tx=0x7f1b0c0f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bab293b7594b1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b11ffb640 1 -- 172.21.15.6:0/3486867015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c049040 con 0x563992b021b0 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.198+0000 7f1b11ffb640 1 -- 172.21.15.6:0/3486867015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b0c0cd830 con 0x563992b021b0 2024-09-21T08:17:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b11ffb640 1 -- 172.21.15.6:0/3486867015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c003c30 con 0x563992b021b0 2024-09-21T08:17:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 -- 172.21.15.6:0/3486867015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 msgr2=0x563992ee38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c105680 tx=0x7f1b0c0f1040 comp rx=0 tx=0).stop 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 -- 172.21.15.6:0/3486867015 shutdown_connections 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992edf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b0a390 0x563992edeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 --2- 172.21.15.6:0/3486867015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b021b0 0x563992ee38e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 -- 172.21.15.6:0/3486867015 >> 172.21.15.6:0/3486867015 conn(0x563992b1f460 msgr2=0x563992ee31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 -- 172.21.15.6:0/3486867015 shutdown_connections 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.199+0000 7f1b28897740 1 -- 172.21.15.6:0/3486867015 wait complete. 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 -- start start 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 Processor -- start 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 0x563992ee6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992ee6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1ad940 con 0x563992b0a390 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1aedb0 con 0x563992b021b0 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c1ae010 con 0x563992b2b070 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b28897740 10 client.0 _ll_register_callbacks cb 0x7f1b14014530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47696/0 (socket says 172.21.15.6:47696) 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 -- 172.21.15.6:0/4265394140 learned_addr learned my addr 172.21.15.6:0/4265394140 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 0x563992ee6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b208c0640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992ee6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 -- 172.21.15.6:0/4265394140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 msgr2=0x563992ee6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992ee6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 -- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 msgr2=0x563992ee6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 0x563992ee6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.200+0000 7f1b13fff640 1 -- 172.21.15.6:0/4265394140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563992f5d960 con 0x563992b0a390 2024-09-21T08:17:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 0x563992ee6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1b13fff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06b680 tx=0x7f1b04005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da43df15d41c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0402c060 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f1b040035f0 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0c0cd830 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b04033050 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1b28897740 10 client.17922 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563992f5ebf0 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b0c0cd830 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.201+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b04026070 con 0x563992b0a390 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 10 client.17922 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 10 client.17922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 20 client.17922 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992abeda0 0x563992f61060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 4 client.17922 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563992e46850 con 0x563992abeda0 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992abeda0 0x563992f61060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1b1bfff640 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992abeda0 0x563992f61060 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7eebaee34ac8c3e server_cookie=c4c1d2f78efefc5b in_seq=0 out_seq=0 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.202+0000 7f1afb7fe640 10 client.17922 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1afb7fe640 1 -- 172.21.15.6:0/4265394140 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8042 (crc 0 0 0) 0x563992e46850 con 0x563992abeda0 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1afb7fe640 10 client.17922 handle_command_reply: tid=0 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 client.17922 shutdown 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 msgr2=0x563992ee6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c06b680 tx=0x7f1b04005270 comp rx=0 tx=0).stop 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 shutdown_connections 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x563992abeda0 0x563992f61060 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563992b2b070 0x563992ee6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563992b0a390 0x563992ee6560 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 --2- 172.21.15.6:0/4265394140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563992b021b0 0x563992ee6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 >> 172.21.15.6:0/4265394140 conn(0x563992b1f460 msgr2=0x563992eed760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1afb7fe640 0 client.17922 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 shutdown_connections 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 1 -- 172.21.15.6:0/4265394140 wait complete. 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.203+0000 7f1b28897740 20 client.17922 trim_cache size 0 max 16384 2024-09-21T08:17:19.210 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:17:19.211 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.213 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.214 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:17:19.215 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.217 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:17:19.218 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.219 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.220 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.220 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:17:19.220 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.222 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.223 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:17:19.224 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:17:19.225 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 msgr2=0x7f1b080b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 0x7f1b080b8c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1b14005c40 tx=0x7f1b14004ab0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 msgr2=0x7f1b1c19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009230 tx=0x7f1b0c004270 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 shutdown_connections 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f1b080b6730 0x7f1b080b8c40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1c108d20 0x7f1b1c19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b1c1083d0 0x7f1b1c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 --2- 172.21.15.6:0/4041352140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c102ae0 0x7f1b1c19a360 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 >> 172.21.15.6:0/4041352140 conn(0x7f1b1c079760 msgr2=0x7f1b1c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 shutdown_connections 2024-09-21T08:17:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:19.204+0000 7f1b22323640 1 -- 172.21.15.6:0/4041352140 wait complete. 2024-09-21T08:17:19.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:19 smithi119 ceph-mon[33564]: pgmap v853: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T08:17:19.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:19 smithi145 ceph-mon[34049]: pgmap v853: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T08:17:19.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:19 smithi006 ceph-mon[30970]: pgmap v853: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T08:17:20.151 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:17:20.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:17:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 -- 172.21.15.6:0/2402830151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6994108d10 msgr2=0x7f699410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2402830151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6994108d10 0x7f699410f540 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ca0 tx=0x7f698c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 -- 172.21.15.6:0/2402830151 shutdown_connections 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2402830151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f69941083c0 0x7f69941087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2402830151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6994108d10 0x7f699410f540 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2402830151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994102a80 0x7f6994102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 -- 172.21.15.6:0/2402830151 >> 172.21.15.6:0/2402830151 conn(0x7f6994079740 msgr2=0x7f6994079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 -- 172.21.15.6:0/2402830151 shutdown_connections 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.945+0000 7f699a8aa640 1 -- 172.21.15.6:0/2402830151 wait complete. 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 Processor -- start 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 -- start start 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6994102a80 0x7f699419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994108d10 0x7f699419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6994112880 con 0x7f69941083c0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6994112700 con 0x7f6994108d10 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f699a8aa640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6994112a00 con 0x7f6994102a80 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f69937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f69937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47724/0 (socket says 172.21.15.6:47724) 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f69937fe640 1 -- 172.21.15.6:0/2870348531 learned_addr learned my addr 172.21.15.6:0/2870348531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f6998e47640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994108d10 0x7f699419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.946+0000 7f6993fff640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6994102a80 0x7f699419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 -- 172.21.15.6:0/2870348531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6994102a80 msgr2=0x7f699419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6994102a80 0x7f699419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 -- 172.21.15.6:0/2870348531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994108d10 msgr2=0x7f699419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994108d10 0x7f699419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 -- 172.21.15.6:0/2870348531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69941a6370 con 0x7f69941083c0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69937fe640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f698800c970 tx=0x7f698800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988014070 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69941a6660 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6988004440 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941a6bf0 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.947+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988003ce0 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.948+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6994103d00 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.950+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6988017070 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.950+0000 7f69917fa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 0x7f697c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.950+0000 7f6993fff640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 0x7f697c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.951+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f69880e7d90 con 0x7f69941083c0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.951+0000 7f6993fff640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 0x7f697c0b8bc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6984005fd0 tx=0x7f6984005e40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:20.953+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f698801e020 con 0x7f69941083c0 2024-09-21T08:17:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.181+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6994102e90 con 0x7f69941083c0 2024-09-21T08:17:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.182+0000 7f69917fa640 1 -- 172.21.15.6:0/2870348531 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f69880adf00 con 0x7f69941083c0 2024-09-21T08:17:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:17:21.184 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:17:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.184+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 msgr2=0x7f697c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.184+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 0x7f697c0b8bc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6984005fd0 tx=0x7f6984005e40 comp rx=0 tx=0).stop 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 msgr2=0x7f699419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f698800c970 tx=0x7f698800ce30 comp rx=0 tx=0).stop 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 shutdown_connections 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f697c0b66b0 0x7f697c0b8bc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6994108d10 0x7f699419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69941083c0 0x7f699419b6b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 --2- 172.21.15.6:0/2870348531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6994102a80 0x7f699419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 >> 172.21.15.6:0/2870348531 conn(0x7f6994079740 msgr2=0x7f6994104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 shutdown_connections 2024-09-21T08:17:21.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:21.185+0000 7f699a8aa640 1 -- 172.21.15.6:0/2870348531 wait complete. 2024-09-21T08:17:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:21 smithi006 ceph-mon[30970]: pgmap v854: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 3.0 MiB/s wr, 223 op/s 2024-09-21T08:17:21.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2870348531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:21 smithi119 ceph-mon[33564]: pgmap v854: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 3.0 MiB/s wr, 223 op/s 2024-09-21T08:17:21.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2870348531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:21 smithi145 ceph-mon[34049]: pgmap v854: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 3.0 MiB/s wr, 223 op/s 2024-09-21T08:17:21.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2870348531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:21.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:17:22.259 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:17:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 -- 172.21.15.6:0/2442655516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c105330 msgr2=0x7f8c6c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2442655516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c105330 0x7f8c6c10d880 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009900 tx=0x7f8c6002a410 comp rx=0 tx=0).stop 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 -- 172.21.15.6:0/2442655516 shutdown_connections 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2442655516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c10de40 0x7f8c6c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2442655516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c105330 0x7f8c6c10d880 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2442655516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c1049e0 0x7f8c6c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 -- 172.21.15.6:0/2442655516 >> 172.21.15.6:0/2442655516 conn(0x7f8c6c079750 msgr2=0x7f8c6c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 -- 172.21.15.6:0/2442655516 shutdown_connections 2024-09-21T08:17:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.790+0000 7f8c718d6640 1 -- 172.21.15.6:0/2442655516 wait complete. 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 Processor -- start 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 -- start start 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c1049e0 0x7f8c6c102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c105330 0x7f8c6c102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c113950 con 0x7f8c6c10de40 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1137d0 con 0x7f8c6c1049e0 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c718d6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c113ad0 con 0x7f8c6c105330 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47740/0 (socket says 172.21.15.6:47740) 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 -- 172.21.15.6:0/2338545241 learned_addr learned my addr 172.21.15.6:0/2338545241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c105330 0x7f8c6c102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c1049e0 0x7f8c6c102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 -- 172.21.15.6:0/2338545241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c105330 msgr2=0x7f8c6c102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c105330 0x7f8c6c102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 -- 172.21.15.6:0/2338545241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c1049e0 msgr2=0x7f8c6c102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c1049e0 0x7f8c6c102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.791+0000 7f8c6b7fe640 1 -- 172.21.15.6:0/2338545241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c1a86e0 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400eaa0 tx=0x7f8c6400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c708d4640 1 -- 172.21.15.6:0/2338545241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400cdb0 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c1a89d0 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c708d4640 1 -- 172.21.15.6:0/2338545241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c64005020 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c708d4640 1 -- 172.21.15.6:0/2338545241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640116d0 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.792+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1a8ee0 con 0x7f8c6c10de40 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.794+0000 7f8c77e4a740 1 Processor -- start 2024-09-21T08:17:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c708d4640 1 -- 172.21.15.6:0/2338545241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8c640051d0 con 0x7f8c6c10de40 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 -- start start 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 0x5624256fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562425672ea0 con 0x562425334390 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5624256622d0 con 0x562425355070 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5624256660e0 con 0x56242532c1b0 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47744/0 (socket says 172.21.15.6:47744) 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2257513292 learned_addr learned my addr 172.21.15.6:0/2257513292 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 0x5624256fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.795+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 -- 172.21.15.6:0/2257513292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 msgr2=0x5624256fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 -- 172.21.15.6:0/2257513292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 msgr2=0x5624256fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 -- 172.21.15.6:0/2257513292 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624253c0650 con 0x56242532c1b0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c708d4640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 0x7f8c540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 0x7f8c540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 0x5624256fc800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c005fd0 tx=0x7f8c5c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bfeb0226bc1f66f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c708d4640 1 -- 172.21.15.6:0/2338545241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f8c640e7bf0 con 0x7f8c6c10de40 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c51ffb640 1 -- 172.21.15.6:0/2257513292 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c01c480 con 0x56242532c1b0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c51ffb640 1 -- 172.21.15.6:0/2257513292 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c5c01cab0 con 0x56242532c1b0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.796+0000 7f8c51ffb640 1 -- 172.21.15.6:0/2257513292 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c011970 con 0x56242532c1b0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2257513292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 msgr2=0x5624256fc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 0x7f8c540b8b90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000c00 tx=0x7f8c60005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 0x5624256fc800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c005fd0 tx=0x7f8c5c0107a0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2257513292 shutdown_connections 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56242532c1b0 0x5624256fc800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x5624256fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2257513292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2257513292 >> 172.21.15.6:0/2257513292 conn(0x562425349460 msgr2=0x5624256fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2257513292 shutdown_connections 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2257513292 wait complete. 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.797+0000 7f8c77e4a740 1 -- start start 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 Processor -- start 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x562425707960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x562425713dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5624254c3700 con 0x562425334390 2024-09-21T08:17:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5624255fd160 con 0x56242532c1b0 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56242570aaa0 con 0x562425355070 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c77e4a740 10 client.0 _ll_register_callbacks cb 0x5624256169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47758/0 (socket says 172.21.15.6:47758) 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2350236515 learned_addr learned my addr 172.21.15.6:0/2350236515 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x562425707960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x562425713dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2350236515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 msgr2=0x562425713dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x562425713dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 msgr2=0x562425707960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x562425707960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.798+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2350236515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242562ac90 con 0x562425334390 2024-09-21T08:17:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005940 tx=0x7f8c6002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24313e65a988c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6004e070 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f8c600037f0 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5c01cab0 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8c60035040 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 10 client.17940 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5624257167c0 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c5c01cab0 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8c60053960 con 0x562425334390 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 10 client.17940 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.799+0000 7f8c77e4a740 20 client.17940 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624253139f0 0x562425719c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c77e4a740 4 client.17940 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562425674df0 con 0x5624253139f0 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624253139f0 0x562425719c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c4affd640 10 client.17940 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.800+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624253139f0 0x562425719c20 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3f8553499654478 server_cookie=9938b30fce075b56 in_seq=0 out_seq=0 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c4affd640 1 -- 172.21.15.6:0/2350236515 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562425674df0 con 0x5624253139f0 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c4affd640 10 client.17940 handle_command_reply: tid=0 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 client.17940 shutdown 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 msgr2=0x562425707ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8c60005940 tx=0x7f8c6002a410 comp rx=0 tx=0).stop 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 shutdown_connections 2024-09-21T08:17:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624253139f0 0x562425719c20 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x562425713dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x562425707ea0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c4affd640 0 client.17940 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2350236515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x562425707960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 >> 172.21.15.6:0/2350236515 conn(0x562425349460 msgr2=0x5624256ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 shutdown_connections 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2350236515 wait complete. 2024-09-21T08:17:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.801+0000 7f8c77e4a740 20 client.17940 trim_cache size 0 max 16384 2024-09-21T08:17:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 Processor -- start 2024-09-21T08:17:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 -- start start 2024-09-21T08:17:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 0x562425713cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b1080 con 0x56242532c1b0 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b38e0 con 0x562425355070 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b16d0 con 0x562425334390 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47764/0 (socket says 172.21.15.6:47764) 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 -- 172.21.15.6:0/1899000639 learned_addr learned my addr 172.21.15.6:0/1899000639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 0x562425713cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 -- 172.21.15.6:0/1899000639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 msgr2=0x562425713cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 0x562425713cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 -- 172.21.15.6:0/1899000639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 msgr2=0x5624256f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6affd640 1 -- 172.21.15.6:0/1899000639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562425705e60 con 0x56242532c1b0 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.815+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 0x562425713cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c6affd640 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c01b000 tx=0x7f8c5c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74fa7039f7fca52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c517fa640 1 -- 172.21.15.6:0/1899000639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c005040 con 0x56242532c1b0 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c517fa640 1 -- 172.21.15.6:0/1899000639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c5c01c480 con 0x56242532c1b0 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c517fa640 1 -- 172.21.15.6:0/1899000639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0048c0 con 0x56242532c1b0 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c77e4a740 1 -- 172.21.15.6:0/1899000639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 msgr2=0x5624256ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.816+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c01b000 tx=0x7f8c5c01e040 comp rx=0 tx=0).stop 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- 172.21.15.6:0/1899000639 shutdown_connections 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425334390 0x562425713cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562425355070 0x5624256f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/1899000639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56242532c1b0 0x5624256ffad0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- 172.21.15.6:0/1899000639 >> 172.21.15.6:0/1899000639 conn(0x562425349460 msgr2=0x5624256ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- 172.21.15.6:0/1899000639 shutdown_connections 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- 172.21.15.6:0/1899000639 wait complete. 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- start start 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 Processor -- start 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x56242570be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x56242570c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b1da0 con 0x562425334390 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b3210 con 0x56242532c1b0 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c1b2470 con 0x562425355070 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.817+0000 7f8c77e4a740 10 client.0 _ll_register_callbacks cb 0x7f8c60031420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47778/0 (socket says 172.21.15.6:47778) 2024-09-21T08:17:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2890704435 learned_addr learned my addr 172.21.15.6:0/2890704435 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x56242570be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6b7fe640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x56242570c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2890704435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 msgr2=0x56242570c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x56242570c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 msgr2=0x56242570be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x56242570be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 -- 172.21.15.6:0/2890704435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562425783710 con 0x562425334390 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c6a7fc640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8c6002a930 tx=0x7f8c6003d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3500d98fc1944d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6004e040 con 0x562425334390 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f8c60053460 con 0x562425334390 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.818+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5c01c480 con 0x562425334390 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8c60031830 con 0x562425334390 2024-09-21T08:17:22.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 10 client.17946 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562425784990 con 0x562425334390 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c5c01c480 con 0x562425334390 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8c60003a80 con 0x562425334390 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 10 client.17946 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 10 client.17946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 20 client.17946 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624252e8da0 0x562425787140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 4 client.17946 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624256708a0 con 0x5624252e8da0 2024-09-21T08:17:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.819+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624252e8da0 0x562425787140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c6affd640 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624252e8da0 0x562425787140 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3162b81fcc6a76 server_cookie=4017c9ccb32542f4 in_seq=0 out_seq=0 2024-09-21T08:17:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c4affd640 10 client.17946 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c4affd640 1 -- 172.21.15.6:0/2890704435 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624256708a0 con 0x5624252e8da0 2024-09-21T08:17:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c4affd640 10 client.17946 handle_command_reply: tid=0 2024-09-21T08:17:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 client.17946 shutdown 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 msgr2=0x56242570c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8c6002a930 tx=0x7f8c6003d9f0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 shutdown_connections 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5624252e8da0 0x562425787140 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562425355070 0x56242570c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c4affd640 0 client.17946 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562425334390 0x56242570c370 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 --2- 172.21.15.6:0/2890704435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56242532c1b0 0x56242570be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 >> 172.21.15.6:0/2890704435 conn(0x562425349460 msgr2=0x5624256f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 shutdown_connections 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 1 -- 172.21.15.6:0/2890704435 wait complete. 2024-09-21T08:17:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.820+0000 7f8c77e4a740 20 client.17946 trim_cache size 0 max 16384 2024-09-21T08:17:22.829 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:17:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 msgr2=0x7f8c540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 0x7f8c540b8b90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000c00 tx=0x7f8c60005fd0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 msgr2=0x7f8c6c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400eaa0 tx=0x7f8c6400ef60 comp rx=0 tx=0).stop 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 shutdown_connections 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f8c540b6680 0x7f8c540b8b90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c6c105330 0x7f8c6c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c10de40 0x7f8c6c1031a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 --2- 172.21.15.6:0/2338545241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c6c1049e0 0x7f8c6c102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 >> 172.21.15.6:0/2338545241 conn(0x7f8c6c079750 msgr2=0x7f8c6c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 shutdown_connections 2024-09-21T08:17:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:22.821+0000 7f8c718d6640 1 -- 172.21.15.6:0/2338545241 wait complete. 2024-09-21T08:17:23.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:23 smithi119 ceph-mon[33564]: pgmap v855: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.8 MiB/s wr, 126 op/s 2024-09-21T08:17:23.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:23 smithi145 ceph-mon[34049]: pgmap v855: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.8 MiB/s wr, 126 op/s 2024-09-21T08:17:23.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:23 smithi006 ceph-mon[30970]: pgmap v855: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.8 MiB/s wr, 126 op/s 2024-09-21T08:17:24.512 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:17:24.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:17:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:24 smithi119 ceph-mon[33564]: pgmap v856: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 496 KiB/s wr, 42 op/s 2024-09-21T08:17:24.918 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:24 smithi006 ceph-mon[30970]: pgmap v856: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 496 KiB/s wr, 42 op/s 2024-09-21T08:17:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:24 smithi145 ceph-mon[34049]: pgmap v856: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 496 KiB/s wr, 42 op/s 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 -- 172.21.15.6:0/4239081753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381083d0 msgr2=0x7faa381087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 --2- 172.21.15.6:0/4239081753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381083d0 0x7faa381087e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faa28009900 tx=0x7faa2802a410 comp rx=0 tx=0).stop 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 -- 172.21.15.6:0/4239081753 shutdown_connections 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 --2- 172.21.15.6:0/4239081753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa38108d20 0x7faa3810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 --2- 172.21.15.6:0/4239081753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa381083d0 0x7faa381087e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 --2- 172.21.15.6:0/4239081753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 0x7faa38102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 -- 172.21.15.6:0/4239081753 >> 172.21.15.6:0/4239081753 conn(0x7faa38079760 msgr2=0x7faa38079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 -- 172.21.15.6:0/4239081753 shutdown_connections 2024-09-21T08:17:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.270+0000 7faa405e2640 1 -- 172.21.15.6:0/4239081753 wait complete. 2024-09-21T08:17:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 Processor -- start 2024-09-21T08:17:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 -- start start 2024-09-21T08:17:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 0x7faa38199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa381083d0 0x7faa381998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa38112840 con 0x7faa38108d20 2024-09-21T08:17:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa381126c0 con 0x7faa38102ae0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.271+0000 7faa405e2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faa381129c0 con 0x7faa381083d0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47794/0 (socket says 172.21.15.6:47794) 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 -- 172.21.15.6:0/3167522753 learned_addr learned my addr 172.21.15.6:0/3167522753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 0x7faa38199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa381083d0 0x7faa381998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 -- 172.21.15.6:0/3167522753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa381083d0 msgr2=0x7faa381998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa381083d0 0x7faa381998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 -- 172.21.15.6:0/3167522753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 msgr2=0x7faa38199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 0x7faa38199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 -- 172.21.15.6:0/3167522753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3819f2a0 con 0x7faa38108d20 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faa3000eaa0 tx=0x7faa3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.272+0000 7faa2f7fe640 1 -- 172.21.15.6:0/3167522753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3000cdb0 con 0x7faa38108d20 2024-09-21T08:17:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.273+0000 7faa2f7fe640 1 -- 172.21.15.6:0/3167522753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa30005020 con 0x7faa38108d20 2024-09-21T08:17:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.273+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3819f590 con 0x7faa38108d20 2024-09-21T08:17:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.273+0000 7faa2f7fe640 1 -- 172.21.15.6:0/3167522753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300116d0 con 0x7faa38108d20 2024-09-21T08:17:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.273+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3806bb40 con 0x7faa38108d20 2024-09-21T08:17:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.275+0000 7faa46b56740 1 Processor -- start 2024-09-21T08:17:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.275+0000 7faa2f7fe640 1 -- 172.21.15.6:0/3167522753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7faa300051d0 con 0x7faa38108d20 2024-09-21T08:17:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.275+0000 7faa46b56740 1 -- start start 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x55824233b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f73670 0x55824233beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5582422b1e60 con 0x558241f6b490 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5582422a1290 con 0x558241f94350 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa46b56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5582422a50a0 con 0x558241f73670 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47806/0 (socket says 172.21.15.6:47806) 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 -- 172.21.15.6:0/2444694808 learned_addr learned my addr 172.21.15.6:0/2444694808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3db7d640 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f73670 0x55824233beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3db7d640 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x55824233b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 -- 172.21.15.6:0/2444694808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f73670 msgr2=0x55824233beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f73670 0x55824233beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 -- 172.21.15.6:0/2444694808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 msgr2=0x55824233b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x55824233b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3e37e640 1 -- 172.21.15.6:0/2444694808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558241fff930 con 0x558241f6b490 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa2f7fe640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 0x7faa240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.276+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 0x7faa240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.277+0000 7faa2f7fe640 1 -- 172.21.15.6:0/3167522753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7faa300e7b60 con 0x7faa38108d20 2024-09-21T08:17:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.277+0000 7faa3e37e640 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7faa3400ac20 tx=0x7faa3400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ab99754722ed67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.277+0000 7faa2cff9640 1 -- 172.21.15.6:0/2444694808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401d070 con 0x558241f6b490 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.277+0000 7faa2cff9640 1 -- 172.21.15.6:0/2444694808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa34018ad0 con 0x558241f6b490 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.277+0000 7faa2cff9640 1 -- 172.21.15.6:0/2444694808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340109c0 con 0x558241f6b490 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- 172.21.15.6:0/2444694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 msgr2=0x55824233b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 0x7faa240b8b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa28004770 tx=0x7faa280058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7faa3400ac20 tx=0x7faa3400f790 comp rx=0 tx=0).stop 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- 172.21.15.6:0/2444694808 shutdown_connections 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f73670 0x55824233beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x55824233b970 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 --2- 172.21.15.6:0/2444694808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x55824233b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- 172.21.15.6:0/2444694808 >> 172.21.15.6:0/2444694808 conn(0x558241f88740 msgr2=0x558242339320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- 172.21.15.6:0/2444694808 shutdown_connections 2024-09-21T08:17:25.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- 172.21.15.6:0/2444694808 wait complete. 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 -- start start 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.278+0000 7faa46b56740 1 Processor -- start 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x558242357270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558242102890 con 0x558241f73670 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55824223bd40 con 0x558241f94350 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55824234df40 con 0x558241f6b490 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa46b56740 10 client.0 _ll_register_callbacks cb 0x55824229fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47812/0 (socket says 172.21.15.6:47812) 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 -- 172.21.15.6:0/3818500028 learned_addr learned my addr 172.21.15.6:0/3818500028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x558242357270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 -- 172.21.15.6:0/3818500028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 msgr2=0x55824234b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 -- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 msgr2=0x558242357270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x558242357270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 -- 172.21.15.6:0/3818500028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558242357880 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7faa28033000 tx=0x7faa2802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b518074fa62a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.279+0000 7faa21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28035040 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7faa280035f0 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa34018ad0 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faa2805c050 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 10 client.17958 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55824235a1b0 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa34018ad0 con 0x558241f73670 2024-09-21T08:17:25.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faa28047070 con 0x558241f73670 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 10 client.17958 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 20 client.17958 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f52cd0 0x55824235d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 4 client.17958 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.280+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582422b3db0 con 0x558241f52cd0 2024-09-21T08:17:25.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.281+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f52cd0 0x55824235d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.281+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f52cd0 0x55824235d6d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a03fbf26f140a631 server_cookie=b2cc1defa254fa52 in_seq=0 out_seq=0 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.281+0000 7faa21ffb640 10 client.17958 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa21ffb640 1 -- 172.21.15.6:0/3818500028 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582422b3db0 con 0x558241f52cd0 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa21ffb640 10 client.17958 handle_command_reply: tid=0 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 client.17958 shutdown 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 msgr2=0x55824234b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7faa28033000 tx=0x7faa2802a410 comp rx=0 tx=0).stop 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 shutdown_connections 2024-09-21T08:17:25.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f52cd0 0x55824235d6d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f94350 0x558242357270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa21ffb640 0 client.17958 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f73670 0x55824234b9d0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 --2- 172.21.15.6:0/3818500028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 >> 172.21.15.6:0/3818500028 conn(0x558241f88740 msgr2=0x558242337850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 shutdown_connections 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 1 -- 172.21.15.6:0/3818500028 wait complete. 2024-09-21T08:17:25.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.282+0000 7faa46b56740 20 client.17958 trim_cache size 0 max 16384 2024-09-21T08:17:25.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 Processor -- start 2024-09-21T08:17:25.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 -- start start 2024-09-21T08:17:25.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x558242337d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 0x558242348440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa381ace10 con 0x558241f6b490 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa381af670 con 0x558241f73670 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa46b56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faa381ad460 con 0x558241f94350 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa3e37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa3e37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47814/0 (socket says 172.21.15.6:47814) 2024-09-21T08:17:25.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.300+0000 7faa3e37e640 1 -- 172.21.15.6:0/3108424087 learned_addr learned my addr 172.21.15.6:0/3108424087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 0x558242348440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x558242337d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 -- 172.21.15.6:0/3108424087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 msgr2=0x558242348440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 0x558242348440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 -- 172.21.15.6:0/3108424087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 msgr2=0x558242337d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x558242337d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 -- 172.21.15.6:0/3108424087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558242341500 con 0x558241f6b490 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 0x558242348440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3db7d640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x558242337d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa3e37e640 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7faa34000c00 tx=0x7faa3400a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fead10e1adae5eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa23fff640 1 -- 172.21.15.6:0/3108424087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3402f070 con 0x558241f6b490 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa23fff640 1 -- 172.21.15.6:0/3108424087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa3401e040 con 0x558241f6b490 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.301+0000 7faa23fff640 1 -- 172.21.15.6:0/3108424087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401d040 con 0x558241f6b490 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- 172.21.15.6:0/3108424087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 msgr2=0x558242337850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7faa34000c00 tx=0x7faa3400a470 comp rx=0 tx=0).stop 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- 172.21.15.6:0/3108424087 shutdown_connections 2024-09-21T08:17:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f94350 0x558242348440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x558242337d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 --2- 172.21.15.6:0/3108424087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f6b490 0x558242337850 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- 172.21.15.6:0/3108424087 >> 172.21.15.6:0/3108424087 conn(0x558241f88740 msgr2=0x558242349ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- 172.21.15.6:0/3108424087 shutdown_connections 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- 172.21.15.6:0/3108424087 wait complete. 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 -- start start 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.302+0000 7faa46b56740 1 Processor -- start 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x55824234eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa381adb30 con 0x558241f94350 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa381aefa0 con 0x558241f73670 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faa381ae200 con 0x558241f6b490 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa46b56740 10 client.0 _ll_register_callbacks cb 0x7faa28009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47830/0 (socket says 172.21.15.6:47830) 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 -- 172.21.15.6:0/1474788349 learned_addr learned my addr 172.21.15.6:0/1474788349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3db7d640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x55824234eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3e37e640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 -- 172.21.15.6:0/1474788349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 msgr2=0x55824234e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 -- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 msgr2=0x55824234eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x55824234eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 -- 172.21.15.6:0/1474788349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824234f310 con 0x558241f94350 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3db7d640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x55824234eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa3eb7f640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7faa300092f0 tx=0x7faa300acec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccaedb80a503b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.303+0000 7faa21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3001f050 con 0x558241f94350 2024-09-21T08:17:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7faa300a8fd0 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3401e040 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faa300b6ff0 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 10 client.17964 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5582423c94d0 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa3401e040 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faa3000f040 con 0x558241f94350 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 10 client.17964 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 10 client.17964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 20 client.17964 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f28080 0x5582423cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 4 client.17964 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:17:25.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.304+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55824234bd60 con 0x558241f28080 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.305+0000 7faa3e37e640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f28080 0x5582423cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.305+0000 7faa3e37e640 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f28080 0x5582423cbce0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46cad6f642a35452 server_cookie=f34f251bd4e1d9ce in_seq=0 out_seq=0 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.305+0000 7faa21ffb640 10 client.17964 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa21ffb640 1 -- 172.21.15.6:0/1474788349 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55824234bd60 con 0x558241f28080 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa21ffb640 10 client.17964 handle_command_reply: tid=0 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 client.17964 shutdown 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 msgr2=0x5582423c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7faa300092f0 tx=0x7faa300acec0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 shutdown_connections 2024-09-21T08:17:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x558241f28080 0x5582423cbce0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558241f94350 0x5582423c80b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558241f73670 0x55824234eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 --2- 172.21.15.6:0/1474788349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558241f6b490 0x55824234e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa21ffb640 0 client.17964 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 >> 172.21.15.6:0/1474788349 conn(0x558241f88740 msgr2=0x55824233c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 shutdown_connections 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 1 -- 172.21.15.6:0/1474788349 wait complete. 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.307+0000 7faa46b56740 20 client.17964 trim_cache size 0 max 16384 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:17:25.313 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "d05c27c0-e763-4500-88c9-e4785471a320", 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 msgr2=0x7faa240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 0x7faa240b8b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa28004770 tx=0x7faa280058d0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 msgr2=0x7faa3819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faa3000eaa0 tx=0x7faa3000ef60 comp rx=0 tx=0).stop 2024-09-21T08:17:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 shutdown_connections 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7faa240b6680 0x7faa240b8b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa381083d0 0x7faa381998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa38108d20 0x7faa3819eb70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 --2- 172.21.15.6:0/3167522753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa38102ae0 0x7faa38199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 >> 172.21.15.6:0/3167522753 conn(0x7faa38079760 msgr2=0x7faa38104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 shutdown_connections 2024-09-21T08:17:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:25.308+0000 7faa405e2640 1 -- 172.21.15.6:0/3167522753 wait complete. 2024-09-21T08:17:26.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:17:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 -- 172.21.15.6:0/3001808226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0102a60 msgr2=0x7f04c0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 --2- 172.21.15.6:0/3001808226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0102a60 0x7f04c0102e70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b002a410 comp rx=0 tx=0).stop 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 -- 172.21.15.6:0/3001808226 shutdown_connections 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 --2- 172.21.15.6:0/3001808226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 0x7f04c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 --2- 172.21.15.6:0/3001808226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c01083a0 0x7f04c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 --2- 172.21.15.6:0/3001808226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0102a60 0x7f04c0102e70 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 -- 172.21.15.6:0/3001808226 >> 172.21.15.6:0/3001808226 conn(0x7f04c0079730 msgr2=0x7f04c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 -- 172.21.15.6:0/3001808226 shutdown_connections 2024-09-21T08:17:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.830+0000 7f04c5132640 1 -- 172.21.15.6:0/3001808226 wait complete. 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.831+0000 7f04c5132640 1 Processor -- start 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.831+0000 7f04c5132640 1 -- start start 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c0102a60 0x7f04c010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 0x7f04c0110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01139c0 con 0x7f04c01083a0 2024-09-21T08:17:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0113840 con 0x7f04c0102a60 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04c5132640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0113b40 con 0x7f04c0108cf0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57018/0 (socket says 172.21.15.6:57018) 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 -- 172.21.15.6:0/2654264436 learned_addr learned my addr 172.21.15.6:0/2654264436 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04bf59e640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 0x7f04c0110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04bed9d640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c0102a60 0x7f04c010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 -- 172.21.15.6:0/2654264436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 msgr2=0x7f04c0110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 0x7f04c0110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 -- 172.21.15.6:0/2654264436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c0102a60 msgr2=0x7f04c010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c0102a60 0x7f04c010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 -- 172.21.15.6:0/2654264436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c01a86d0 con 0x7f04c01083a0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.832+0000 7f04b659c640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f04a800b450 tx=0x7f04a800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.833+0000 7f04bcd99640 1 -- 172.21.15.6:0/2654264436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8015020 con 0x7f04c01083a0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.833+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c01a89c0 con 0x7f04c01083a0 2024-09-21T08:17:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.833+0000 7f04bcd99640 1 -- 172.21.15.6:0/2654264436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04a8011d20 con 0x7f04c01083a0 2024-09-21T08:17:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.833+0000 7f04bcd99640 1 -- 172.21.15.6:0/2654264436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8010e10 con 0x7f04c01083a0 2024-09-21T08:17:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.833+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c01a8f80 con 0x7f04c01083a0 2024-09-21T08:17:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.835+0000 7f04cb6a6740 1 Processor -- start 2024-09-21T08:17:26.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.835+0000 7f04cb6a6740 1 -- start start 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a81f070 0x55d41abc6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d41ab3ce50 con 0x55d41a7f61b0 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d41ab2c280 con 0x55d41a7fe390 2024-09-21T08:17:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d41ab30090 con 0x55d41a81f070 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bcd99640 1 -- 172.21.15.6:0/2654264436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f04a8018020 con 0x7f04c01083a0 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57032/0 (socket says 172.21.15.6:57032) 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 -- 172.21.15.6:0/3930158841 learned_addr learned my addr 172.21.15.6:0/3930158841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bf59e640 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a81f070 0x55d41abc6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04b659c640 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 -- 172.21.15.6:0/3930158841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a81f070 msgr2=0x55d41abc6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a81f070 0x55d41abc6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 -- 172.21.15.6:0/3930158841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 msgr2=0x55d41abc70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.836+0000 7f04bed9d640 1 -- 172.21.15.6:0/3930158841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41a88a650 con 0x55d41a7f61b0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04bed9d640 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2f79bfc50a485e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04b559a640 1 -- 172.21.15.6:0/3930158841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035030 con 0x55d41a7f61b0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04b559a640 1 -- 172.21.15.6:0/3930158841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0040070 con 0x55d41a7f61b0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04b559a640 1 -- 172.21.15.6:0/3930158841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b00459a0 con 0x55d41a7f61b0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04bcd99640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 0x7f04ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04bf59e640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 0x7f04ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.837+0000 7f04bcd99640 1 -- 172.21.15.6:0/2654264436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f04a80e7490 con 0x7f04c01083a0 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- 172.21.15.6:0/3930158841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 msgr2=0x55d41abc6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04bf59e640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 0x7f04ac0b8b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f04b800af10 tx=0x7f04b800a4d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b0005fd0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- 172.21.15.6:0/3930158841 shutdown_connections 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7f61b0 0x55d41abc6b90 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/3930158841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a81f070 0x55d41abc6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- 172.21.15.6:0/3930158841 >> 172.21.15.6:0/3930158841 conn(0x55d41a813460 msgr2=0x55d41abc4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- 172.21.15.6:0/3930158841 shutdown_connections 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- 172.21.15.6:0/3930158841 wait complete. 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.838+0000 7f04cb6a6740 1 -- start start 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 Processor -- start 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 0x55d41abd2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 0x55d41abde0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d41a98d700 con 0x55d41a7fe390 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d41aac7110 con 0x55d41a81f070 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d41abd4dd0 con 0x55d41a7f61b0 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04cb6a6740 10 client.0 _ll_register_callbacks cb 0x55d41aae0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 0x55d41abd2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44578/0 (socket says 172.21.15.6:44578) 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 -- 172.21.15.6:0/615513457 learned_addr learned my addr 172.21.15.6:0/615513457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bf59e640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 0x55d41abde0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 -- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 msgr2=0x55d41abde0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 0x55d41abde0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 -- 172.21.15.6:0/615513457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 msgr2=0x55d41abd2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 0x55d41abd2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.839+0000 7f04bed9d640 1 -- 172.21.15.6:0/615513457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41aaf4c40 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04b659c640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 0x55d41abd2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04bf59e640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 0x55d41abde0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04bed9d640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f04b002aa00 tx=0x7f04b00459f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f12509bfa8cdb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035070 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f04b00035f0 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0040070 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04b0056050 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04cb6a6740 10 client.27676 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.840+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d41abe0b10 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0040070 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f04b003c640 con 0x55d41a7f61b0 2024-09-21T08:17:26.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 10 client.27676 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 10 client.27676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 20 client.27676 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a7dd9f0 0x55d41abe3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 4 client.27676 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d41ab3eda0 con 0x55d41a7dd9f0 2024-09-21T08:17:26.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.841+0000 7f04b659c640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a7dd9f0 0x55d41abe3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.842+0000 7f04b659c640 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a7dd9f0 0x55d41abe3e70 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66736ebb2f096463 server_cookie=e4c5da555fee585e in_seq=0 out_seq=0 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.842+0000 7f04a67fc640 10 client.27676 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.842+0000 7f04a67fc640 1 -- 172.21.15.6:0/615513457 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d41ab3eda0 con 0x55d41a7dd9f0 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.842+0000 7f04a67fc640 10 client.27676 handle_command_reply: tid=0 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.842+0000 7f04cb6a6740 1 client.27676 shutdown 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 msgr2=0x55d41abd1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f04b002aa00 tx=0x7f04b00459f0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 shutdown_connections 2024-09-21T08:17:26.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a7dd9f0 0x55d41abe3e70 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a81f070 0x55d41abde0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7fe390 0x55d41abd2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04a67fc640 0 client.27676 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/615513457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abd1d40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 >> 172.21.15.6:0/615513457 conn(0x55d41a813460 msgr2=0x55d41abc97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 shutdown_connections 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 1 -- 172.21.15.6:0/615513457 wait complete. 2024-09-21T08:17:26.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.843+0000 7f04cb6a6740 20 client.27676 trim_cache size 0 max 16384 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.860+0000 7f04cb6a6740 1 Processor -- start 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.860+0000 7f04cb6a6740 1 -- start start 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abc9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b1170 con 0x55d41a7dd9f0 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b39d0 con 0x55d41a7fe390 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b17c0 con 0x55d41a7f61b0 2024-09-21T08:17:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57050/0 (socket says 172.21.15.6:57050) 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04b659c640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abc9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 -- 172.21.15.6:0/459211722 learned_addr learned my addr 172.21.15.6:0/459211722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bf59e640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 -- 172.21.15.6:0/459211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 msgr2=0x55d41abc9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abc9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 -- 172.21.15.6:0/459211722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 msgr2=0x55d41abc9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 -- 172.21.15.6:0/459211722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41abcd5d0 con 0x55d41a7dd9f0 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04b659c640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abc9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:17:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bf59e640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.861+0000 7f04bed9d640 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f04b0045710 tx=0x7f04b0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fee92a1b0099b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04b4d99640 1 -- 172.21.15.6:0/459211722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035040 con 0x55d41a7dd9f0 2024-09-21T08:17:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04b4d99640 1 -- 172.21.15.6:0/459211722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0040070 con 0x55d41a7dd9f0 2024-09-21T08:17:26.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04b4d99640 1 -- 172.21.15.6:0/459211722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0003850 con 0x55d41a7dd9f0 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 -- 172.21.15.6:0/459211722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 msgr2=0x55d41abd2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f04b0045710 tx=0x7f04b0005fd0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 -- 172.21.15.6:0/459211722 shutdown_connections 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7f61b0 0x55d41abc9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7fe390 0x55d41abc9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/459211722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abd2200 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 -- 172.21.15.6:0/459211722 >> 172.21.15.6:0/459211722 conn(0x55d41a813460 msgr2=0x55d41abd1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.862+0000 7f04cb6a6740 1 -- 172.21.15.6:0/459211722 shutdown_connections 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 -- 172.21.15.6:0/459211722 wait complete. 2024-09-21T08:17:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 -- start start 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 Processor -- start 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 0x55d41abe4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7fe390 0x55d41abe4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b1e90 con 0x55d41a7dd9f0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b3300 con 0x55d41a7f61b0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b2560 con 0x55d41a7fe390 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04cb6a6740 10 client.0 _ll_register_callbacks cb 0x7f04b800a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.863+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57066/0 (socket says 172.21.15.6:57066) 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 -- 172.21.15.6:0/1339845326 learned_addr learned my addr 172.21.15.6:0/1339845326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bf59e640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7fe390 0x55d41abe4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04b659c640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 0x55d41abe4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 -- 172.21.15.6:0/1339845326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7fe390 msgr2=0x55d41abe4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7fe390 0x55d41abe4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 -- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 msgr2=0x55d41abe4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 0x55d41abe4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 -- 172.21.15.6:0/1339845326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41abe5690 con 0x55d41a7dd9f0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04b659c640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 0x55d41abe4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04bed9d640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b0045470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f712a4a5f5aaa87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035040 con 0x55d41a7dd9f0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f04b003cd90 con 0x55d41a7dd9f0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.864+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0040070 con 0x55d41a7dd9f0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04b006c050 con 0x55d41a7dd9f0 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 10 client.17982 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d41ac4e470 con 0x55d41a7dd9f0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0040070 con 0x55d41a7dd9f0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f04b0003c60 con 0x55d41a7dd9f0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 10 client.17982 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 20 client.17982 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a81f070 0x55d41ac50af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 4 client.17982 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d41ab3a850 con 0x55d41a81f070 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.865+0000 7f04b659c640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a81f070 0x55d41ac50af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04b659c640 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a81f070 0x55d41ac50af0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5b9fc9b34152ae server_cookie=aac40b29ae6432d9 in_seq=0 out_seq=0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04a67fc640 10 client.17982 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04a67fc640 1 -- 172.21.15.6:0/1339845326 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8522 (crc 0 0 0) 0x55d41ab3a850 con 0x55d41a81f070 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04a67fc640 10 client.17982 handle_command_reply: tid=0 2024-09-21T08:17:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 client.17982 shutdown 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 msgr2=0x55d41abe75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b0045470 comp rx=0 tx=0).stop 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 shutdown_connections 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d41a81f070 0x55d41ac50af0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d41a7fe390 0x55d41abe4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d41a7f61b0 0x55d41abe4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 --2- 172.21.15.6:0/1339845326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d41a7dd9f0 0x55d41abe75c0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.866+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 >> 172.21.15.6:0/1339845326 conn(0x55d41a813460 msgr2=0x55d41abc7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04a67fc640 0 client.17982 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 shutdown_connections 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04cb6a6740 1 -- 172.21.15.6:0/1339845326 wait complete. 2024-09-21T08:17:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04cb6a6740 20 client.17982 trim_cache size 0 max 16384 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "d05c27c0-e763-4500-88c9-e4785471a320": { 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "d05c27c0-e763-4500-88c9-e4785471a320", 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:26.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "d05c27c0-e763-4500-88c9-e4785471a320": { 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:17:25.306236+0000", 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:17:26.877 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:17:26.880 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.881 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:17:26.884 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.885 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:17:26.888 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:17:26.889 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.890 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 msgr2=0x7f04ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 0x7f04ac0b8b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f04b800af10 tx=0x7f04b800a4d0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 msgr2=0x7f04c01104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f04a800b450 tx=0x7f04a800b910 comp rx=0 tx=0).stop 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 shutdown_connections 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f04ac0b6680 0x7f04ac0b8b90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04c0108cf0 0x7f04c0110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c01083a0 0x7f04c01104f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 --2- 172.21.15.6:0/2654264436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04c0102a60 0x7f04c010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.867+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 >> 172.21.15.6:0/2654264436 conn(0x7f04c0079730 msgr2=0x7f04c01014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.868+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 shutdown_connections 2024-09-21T08:17:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:26.868+0000 7f04c5132640 1 -- 172.21.15.6:0/2654264436 wait complete. 2024-09-21T08:17:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:27 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:17:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:27 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:27 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:17:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:27 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:27 smithi119 ceph-mon[33564]: pgmap v857: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 404 KiB/s wr, 33 op/s 2024-09-21T08:17:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:27 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:17:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:27 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:27 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:17:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:27 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:27 smithi145 ceph-mon[34049]: pgmap v857: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 404 KiB/s wr, 33 op/s 2024-09-21T08:17:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:27 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:17:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:27 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:27 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:17:27.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:27 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:17:27.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:27 smithi006 ceph-mon[30970]: pgmap v857: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 404 KiB/s wr, 33 op/s 2024-09-21T08:17:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T08:17:27.683 INFO:tasks.cephfs.filesystem:scrub status for tag:d05c27c0-e763-4500-88c9-e4785471a320 - {'path': '/', 'tag': 'd05c27c0-e763-4500-88c9-e4785471a320', 'options': 'recursive,force'} 2024-09-21T08:17:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:29 smithi119 ceph-mon[33564]: pgmap v858: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 462 KiB/s wr, 55 op/s 2024-09-21T08:17:29.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:17:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:29 smithi145 ceph-mon[34049]: pgmap v858: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 462 KiB/s wr, 55 op/s 2024-09-21T08:17:29.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:29 smithi006 ceph-mon[30970]: pgmap v858: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 462 KiB/s wr, 55 op/s 2024-09-21T08:17:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3417364112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 msgr2=0x7ffa50110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3417364112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50110670 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009ca0 tx=0x7ffa4802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3417364112 shutdown_connections 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3417364112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa501094f0 0x7ffa50109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3417364112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50110670 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3417364112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa50103bb0 0x7ffa50103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3417364112 >> 172.21.15.6:0/3417364112 conn(0x7ffa500ff600 msgr2=0x7ffa50101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3417364112 shutdown_connections 2024-09-21T08:17:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.197+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3417364112 wait complete. 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 Processor -- start 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 -- start start 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa50103bb0 0x7ffa50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 0x7ffa50075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50113a00 con 0x7ffa50109e40 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50113880 con 0x7ffa501094f0 2024-09-21T08:17:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa55cd3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50113b80 con 0x7ffa50103bb0 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57080/0 (socket says 172.21.15.6:57080) 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa4ffff640 1 -- 172.21.15.6:0/3422756241 learned_addr learned my addr 172.21.15.6:0/3422756241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa4effd640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 0x7ffa50075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.198+0000 7ffa4f7fe640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa50103bb0 0x7ffa50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 -- 172.21.15.6:0/3422756241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa50103bb0 msgr2=0x7ffa50075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa50103bb0 0x7ffa50075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 -- 172.21.15.6:0/3422756241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 msgr2=0x7ffa50075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 0x7ffa50075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 -- 172.21.15.6:0/3422756241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa501a8670 con 0x7ffa50109e40 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4effd640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 0x7ffa50075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4ffff640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005e30 tx=0x7ffa480093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:30.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48032d10 con 0x7ffa50109e40 2024-09-21T08:17:30.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa48032eb0 con 0x7ffa50109e40 2024-09-21T08:17:30.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa501a8900 con 0x7ffa50109e40 2024-09-21T08:17:30.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48030b20 con 0x7ffa50109e40 2024-09-21T08:17:30.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.199+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa501a8e90 con 0x7ffa50109e40 2024-09-21T08:17:30.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.200+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa50103fc0 con 0x7ffa50109e40 2024-09-21T08:17:30.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.202+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ffa48030ce0 con 0x7ffa50109e40 2024-09-21T08:17:30.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.202+0000 7ffa4cff9640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 0x7ffa380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:30.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.203+0000 7ffa4f7fe640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 0x7ffa380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:30.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.203+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7ffa48108d30 con 0x7ffa50109e40 2024-09-21T08:17:30.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.203+0000 7ffa4f7fe640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 0x7ffa380b8c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005d00 tx=0x7ffa40005c70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.207+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa480ceea0 con 0x7ffa50109e40 2024-09-21T08:17:30.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.431+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa5002e640 con 0x7ffa50109e40 2024-09-21T08:17:30.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.432+0000 7ffa4cff9640 1 -- 172.21.15.6:0/3422756241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7ffa480d3280 con 0x7ffa50109e40 2024-09-21T08:17:30.434 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:17:30.434 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:17:30.435 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 msgr2=0x7ffa380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 0x7ffa380b8c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005d00 tx=0x7ffa40005c70 comp rx=0 tx=0).stop 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 msgr2=0x7ffa50076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005e30 tx=0x7ffa480093d0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 shutdown_connections 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7ffa380b6700 0x7ffa380b8c10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50109e40 0x7ffa50076190 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa501094f0 0x7ffa50075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 --2- 172.21.15.6:0/3422756241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa50103bb0 0x7ffa50075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:30.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 >> 172.21.15.6:0/3422756241 conn(0x7ffa500ff600 msgr2=0x7ffa50101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:30.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 shutdown_connections 2024-09-21T08:17:30.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:30.435+0000 7ffa55cd3640 1 -- 172.21.15.6:0/3422756241 wait complete. 2024-09-21T08:17:31.137 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:31 smithi006 ceph-mon[30970]: pgmap v859: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 617 KiB/s wr, 75 op/s 2024-09-21T08:17:31.137 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3422756241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:31.167 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --set-id ab881309 --release --await' 2024-09-21T08:17:31.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --set-id ab881309 --release --await 2024-09-21T08:17:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:31 smithi119 ceph-mon[33564]: pgmap v859: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 617 KiB/s wr, 75 op/s 2024-09-21T08:17:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3422756241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:31 smithi145 ceph-mon[34049]: pgmap v859: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 617 KiB/s wr, 75 op/s 2024-09-21T08:17:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3422756241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:17:31.474 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 -- 172.21.15.6:0/486532097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae01094f0 msgr2=0x7f9ae0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 --2- 172.21.15.6:0/486532097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae01094f0 0x7f9ae0109900 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009900 tx=0x7f9ad002a410 comp rx=0 tx=0).stop 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 -- 172.21.15.6:0/486532097 shutdown_connections 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 --2- 172.21.15.6:0/486532097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae0109e40 0x7f9ae0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 --2- 172.21.15.6:0/486532097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae01094f0 0x7f9ae0109900 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 --2- 172.21.15.6:0/486532097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0103bb0 0x7f9ae0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 -- 172.21.15.6:0/486532097 >> 172.21.15.6:0/486532097 conn(0x7f9ae00ff600 msgr2=0x7f9ae0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 -- 172.21.15.6:0/486532097 shutdown_connections 2024-09-21T08:17:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.993+0000 7f9ae849c640 1 -- 172.21.15.6:0/486532097 wait complete. 2024-09-21T08:17:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 Processor -- start 2024-09-21T08:17:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 -- start start 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae01094f0 0x7f9ae019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 0x7f9ae01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01139b0 con 0x7f9ae0103bb0 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0113830 con 0x7f9ae0109e40 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae849c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0113b30 con 0x7f9ae01094f0 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57098/0 (socket says 172.21.15.6:57098) 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae6238640 1 -- 172.21.15.6:0/2863531259 learned_addr learned my addr 172.21.15.6:0/2863531259 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.994+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae01094f0 0x7f9ae019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 0x7f9ae01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 -- 172.21.15.6:0/2863531259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae01094f0 msgr2=0x7f9ae019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae01094f0 0x7f9ae019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 -- 172.21.15.6:0/2863531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 msgr2=0x7f9ae01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 0x7f9ae01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 -- 172.21.15.6:0/2863531259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae01a2630 con 0x7f9ae0103bb0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 0x7f9ae01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae6238640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c890 tx=0x7f9adc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ad77fe640 1 -- 172.21.15.6:0/2863531259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004220 con 0x7f9ae0103bb0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae01a2920 con 0x7f9ae0103bb0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ad77fe640 1 -- 172.21.15.6:0/2863531259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9adc007e40 con 0x7f9ae0103bb0 2024-09-21T08:17:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ad77fe640 1 -- 172.21.15.6:0/2863531259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004a00 con 0x7f9ae0103bb0 2024-09-21T08:17:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.995+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae01a9080 con 0x7f9ae0103bb0 2024-09-21T08:17:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 Processor -- start 2024-09-21T08:17:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 -- start start 2024-09-21T08:17:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9ad77fe640 1 -- 172.21.15.6:0/2863531259 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9adc0079b0 con 0x7f9ae0103bb0 2024-09-21T08:17:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 0x5617274d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5617273bcdc0 con 0x561727102660 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5617274491f0 con 0x56172710a840 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9aeea10740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561727438620 con 0x56172712b520 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57100/0 (socket says 172.21.15.6:57100) 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.998+0000 7f9ae6238640 1 -- 172.21.15.6:0/3144731390 learned_addr learned my addr 172.21.15.6:0/3144731390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 0x5617274d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 -- 172.21.15.6:0/3144731390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 msgr2=0x5617274d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 0x5617274d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 -- 172.21.15.6:0/3144731390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 msgr2=0x5617274d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 -- 172.21.15.6:0/3144731390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561727400fd0 con 0x561727102660 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 0x5617274d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0e4b20 tx=0x7f9adc0ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cbe9ac31863e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ad77fe640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 0x7f9acc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ad4d9a640 1 -- 172.21.15.6:0/3144731390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0f6070 con 0x561727102660 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ad4d9a640 1 -- 172.21.15.6:0/3144731390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9adc0b7d50 con 0x561727102660 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 0x7f9acc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:31.999+0000 7f9ad4d9a640 1 -- 172.21.15.6:0/3144731390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0ad080 con 0x561727102660 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9ad77fe640 1 -- 172.21.15.6:0/2863531259 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f9adc0e7840 con 0x7f9ae0103bb0 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 -- 172.21.15.6:0/3144731390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 msgr2=0x5617274d1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 0x7f9acc0b8b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005fd0 tx=0x7f9ad8009990 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0e4b20 tx=0x7f9adc0ef690 comp rx=0 tx=0).stop 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 -- 172.21.15.6:0/3144731390 shutdown_connections 2024-09-21T08:17:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274d1a50 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3144731390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56172712b520 0x5617274d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.000+0000 7f9aeea10740 1 -- 172.21.15.6:0/3144731390 >> 172.21.15.6:0/3144731390 conn(0x56172711f910 msgr2=0x5617274cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 -- 172.21.15.6:0/3144731390 shutdown_connections 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 -- 172.21.15.6:0/3144731390 wait complete. 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 -- start start 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 Processor -- start 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 0x5617274dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.001+0000 7f9aeea10740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5617273d3300 con 0x56172710a840 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9aeea10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56172743c430 con 0x56172712b520 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9aeea10740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561727299bb0 con 0x561727102660 2024-09-21T08:17:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9aeea10740 10 client.0 _ll_register_callbacks cb 0x5617273ed120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57102/0 (socket says 172.21.15.6:57102) 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 -- 172.21.15.6:0/133406751 learned_addr learned my addr 172.21.15.6:0/133406751 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae6238640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 0x5617274dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 -- 172.21.15.6:0/133406751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 msgr2=0x5617274dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274dcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 -- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 msgr2=0x5617274dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 0x5617274dd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 -- 172.21.15.6:0/133406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617273c2780 con 0x56172710a840 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 0x5617274dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae6238640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0000c00 tx=0x7f9ad0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdc788b276bb42a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0035040 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f9ad0004040 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.002+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9adc0b7d50 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9ad0004240 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 10 client.18000 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561727196b00 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9adc0b7d50 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9ad003d450 con 0x56172710a840 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 10 client.18000 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 10 client.18000 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 20 client.18000 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5617270e9ea0 0x5617274eef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 4 client.18000 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:17:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.003+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56172744b140 con 0x5617270e9ea0 2024-09-21T08:17:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.004+0000 7f9ae6238640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5617270e9ea0 0x5617274eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.004+0000 7f9ac9ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.004+0000 7f9ae6238640 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5617270e9ea0 0x5617274eef10 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dffff6723b1d4adb server_cookie=488cee24169a936c in_seq=0 out_seq=0 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/133406751 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56172744b140 con 0x5617270e9ea0 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9ac9ffb640 10 client.18000 handle_command_reply: tid=0 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 client.18000 shutdown 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 msgr2=0x5617274dd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0000c00 tx=0x7f9ad0031400 comp rx=0 tx=0).stop 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 shutdown_connections 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5617270e9ea0 0x5617274eef10 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172712b520 0x5617274dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9ac9ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56172710a840 0x5617274dd030 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 --2- 172.21.15.6:0/133406751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 >> 172.21.15.6:0/133406751 conn(0x56172711f910 msgr2=0x5617274d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 shutdown_connections 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.005+0000 7f9aeea10740 1 -- 172.21.15.6:0/133406751 wait complete. 2024-09-21T08:17:32.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.006+0000 7f9aeea10740 20 client.18000 trim_cache size 0 max 16384 2024-09-21T08:17:32.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 Processor -- start 2024-09-21T08:17:32.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 -- start start 2024-09-21T08:17:32.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b11c0 con 0x5617270e9ea0 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b3a20 con 0x56172710a840 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9aeea10740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b1810 con 0x561727102660 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.023+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57118/0 (socket says 172.21.15.6:57118) 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 -- 172.21.15.6:0/3983004000 learned_addr learned my addr 172.21.15.6:0/3983004000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 -- 172.21.15.6:0/3983004000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 msgr2=0x5617274de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274de720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 -- 172.21.15.6:0/3983004000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 msgr2=0x5617274d9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 -- 172.21.15.6:0/3983004000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56172720d960 con 0x5617270e9ea0 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:17:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9ae6238640 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6243fe8db2ebaa71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9acbfff640 1 -- 172.21.15.6:0/3983004000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0da790 con 0x5617270e9ea0 2024-09-21T08:17:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9acbfff640 1 -- 172.21.15.6:0/3983004000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9adc0efe90 con 0x5617270e9ea0 2024-09-21T08:17:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.024+0000 7f9acbfff640 1 -- 172.21.15.6:0/3983004000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0d8fc0 con 0x5617270e9ea0 2024-09-21T08:17:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 -- 172.21.15.6:0/3983004000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 msgr2=0x5617274d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc00a3f0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 -- 172.21.15.6:0/3983004000 shutdown_connections 2024-09-21T08:17:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561727102660 0x5617274de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617274d9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 --2- 172.21.15.6:0/3983004000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617270e9ea0 0x5617274d2f00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 -- 172.21.15.6:0/3983004000 >> 172.21.15.6:0/3983004000 conn(0x56172711f910 msgr2=0x5617274de010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 -- 172.21.15.6:0/3983004000 shutdown_connections 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.025+0000 7f9aeea10740 1 -- 172.21.15.6:0/3983004000 wait complete. 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 -- start start 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 Processor -- start 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617270e9ea0 0x5617274e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617275588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b1ee0 con 0x561727102660 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b3350 con 0x56172710a840 2024-09-21T08:17:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b25b0 con 0x5617270e9ea0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9aeea10740 10 client.0 _ll_register_callbacks cb 0x7f9ad0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57132/0 (socket says 172.21.15.6:57132) 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 -- 172.21.15.6:0/901146952 learned_addr learned my addr 172.21.15.6:0/901146952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae6a39640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617275588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae6238640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617270e9ea0 0x5617274e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 -- 172.21.15.6:0/901146952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617270e9ea0 msgr2=0x5617274e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617270e9ea0 0x5617274e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 -- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 msgr2=0x5617275588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.026+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617275588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ae5a37640 1 -- 172.21.15.6:0/901146952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561727558e20 con 0x561727102660 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ae5a37640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ad003d870 tx=0x7f9ad0031d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b5e57098fe3533 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:17:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0058020 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f9ad00316b0 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9adc0efe90 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9ad0063050 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9aeea10740 10 client.18006 fetch_fsmap learned FSMap version 21 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561727559f20 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.027+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9adc0efe90 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9ad005f4a0 con 0x561727102660 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 10 client.18006 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 10 client.18006 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 20 client.18006 populate_metadata read hostname 'smithi006' 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56172712b520 0x56172755c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 4 client.18006 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ab881309", "release": true, "await": true}] 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ab881309", "release": true, "await": true}) -- 0x561727446bf0 con 0x56172712b520 2024-09-21T08:17:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9ae6238640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56172712b520 0x56172755c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:17:32.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9ac9ffb640 10 client.18006 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:32.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.028+0000 7f9ae6238640 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56172712b520 0x56172755c670 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ddb88e2b8827d5e server_cookie=a9bb25c1d46da9b9 in_seq=0 out_seq=0 2024-09-21T08:17:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9ac9ffb640 1 -- 172.21.15.6:0/901146952 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561727446bf0 con 0x56172712b520 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9ac9ffb640 10 client.18006 handle_command_reply: tid=0 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 client.18006 shutdown 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 msgr2=0x5617274e39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9ad003d870 tx=0x7f9ad0031d50 comp rx=0 tx=0).stop 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 shutdown_connections 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x56172712b520 0x56172755c670 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56172710a840 0x5617275588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9ac9ffb640 0 client.18006 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561727102660 0x5617274e39f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 --2- 172.21.15.6:0/901146952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617270e9ea0 0x5617274e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 >> 172.21.15.6:0/901146952 conn(0x56172711f910 msgr2=0x5617274de910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 shutdown_connections 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 1 -- 172.21.15.6:0/901146952 wait complete. 2024-09-21T08:17:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.460+0000 7f9aeea10740 20 client.18006 trim_cache size 0 max 16384 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 64, 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": { 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "ab881309": { 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 64, 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "age_ref": 0.0, 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:17:32.464 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "timeout": 90.0, 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "expiration": 143.2, 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "members": { 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "file:/": { 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "excluded": false, 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "state": { 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RELEASED", 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:32.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:17:32.466 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:17:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 msgr2=0x7f9acc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 0x7f9acc0b8b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005fd0 tx=0x7f9ad8009990 comp rx=0 tx=0).stop 2024-09-21T08:17:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 msgr2=0x7f9ae019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:17:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c890 tx=0x7f9adc00cd50 comp rx=0 tx=0).stop 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 shutdown_connections 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f9acc0b6680 0x7f9acc0b8b90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ae01094f0 0x7f9ae019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ae0109e40 0x7f9ae01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 --2- 172.21.15.6:0/2863531259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ae0103bb0 0x7f9ae019c6c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 >> 172.21.15.6:0/2863531259 conn(0x7f9ae00ff600 msgr2=0x7f9ae010e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 shutdown_connections 2024-09-21T08:17:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:17:32.461+0000 7f9ae849c640 1 -- 172.21.15.6:0/2863531259 wait complete. 2024-09-21T08:17:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 875.0 s, 26.4 tps, lat 13841.571 ms stddev 10610.812 2024-09-21T08:17:33.166 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ab881309', total seconds elapsed: 27.0 2024-09-21T08:17:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:33 smithi119 ceph-mon[33564]: pgmap v860: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 657 KiB/s wr, 80 op/s 2024-09-21T08:17:33.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:33 smithi145 ceph-mon[34049]: pgmap v860: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 657 KiB/s wr, 80 op/s 2024-09-21T08:17:33.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:33 smithi006 ceph-mon[30970]: pgmap v860: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 657 KiB/s wr, 80 op/s 2024-09-21T08:17:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:35 smithi119 ceph-mon[33564]: pgmap v861: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 631 KiB/s wr, 77 op/s 2024-09-21T08:17:35.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:35 smithi145 ceph-mon[34049]: pgmap v861: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 631 KiB/s wr, 77 op/s 2024-09-21T08:17:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:35 smithi006 ceph-mon[30970]: pgmap v861: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 631 KiB/s wr, 77 op/s 2024-09-21T08:17:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:37 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:17:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:37 smithi119 ceph-mon[33564]: pgmap v862: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-09-21T08:17:37.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:37 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:17:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:37 smithi145 ceph-mon[34049]: pgmap v862: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-09-21T08:17:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:37 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:17:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:37 smithi006 ceph-mon[30970]: pgmap v862: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-09-21T08:17:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 880.0 s, 911.4 tps, lat 190.939 ms stddev 1340.739 2024-09-21T08:17:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:39 smithi119 ceph-mon[33564]: pgmap v863: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 227 op/s 2024-09-21T08:17:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:39 smithi145 ceph-mon[34049]: pgmap v863: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 227 op/s 2024-09-21T08:17:39.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:39 smithi006 ceph-mon[30970]: pgmap v863: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 227 op/s 2024-09-21T08:17:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:41 smithi119 ceph-mon[33564]: pgmap v864: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 299 op/s 2024-09-21T08:17:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:41 smithi145 ceph-mon[34049]: pgmap v864: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 299 op/s 2024-09-21T08:17:41.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:41 smithi006 ceph-mon[30970]: pgmap v864: 129 pgs: 129 active+clean; 3.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 299 op/s 2024-09-21T08:17:42.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 885.0 s, 854.8 tps, lat 117.362 ms stddev 54.083 2024-09-21T08:17:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:43 smithi119 ceph-mon[33564]: pgmap v865: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-09-21T08:17:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:43 smithi145 ceph-mon[34049]: pgmap v865: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-09-21T08:17:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:43 smithi006 ceph-mon[30970]: pgmap v865: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-09-21T08:17:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:45 smithi119 ceph-mon[33564]: pgmap v866: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-21T08:17:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:45 smithi145 ceph-mon[34049]: pgmap v866: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-21T08:17:45.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:45 smithi006 ceph-mon[30970]: pgmap v866: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 9.0 MiB/s wr, 579 op/s 2024-09-21T08:17:47.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:47 smithi119 ceph-mon[33564]: pgmap v867: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 9.8 MiB/s wr, 661 op/s 2024-09-21T08:17:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:47 smithi145 ceph-mon[34049]: pgmap v867: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 9.8 MiB/s wr, 661 op/s 2024-09-21T08:17:47.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:47 smithi006 ceph-mon[30970]: pgmap v867: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 9.8 MiB/s wr, 661 op/s 2024-09-21T08:17:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 890.0 s, 750.8 tps, lat 131.521 ms stddev 91.548 2024-09-21T08:17:49.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:49 smithi119 ceph-mon[33564]: pgmap v868: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 11 MiB/s wr, 779 op/s 2024-09-21T08:17:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:49 smithi145 ceph-mon[34049]: pgmap v868: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 11 MiB/s wr, 779 op/s 2024-09-21T08:17:49.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:49 smithi006 ceph-mon[30970]: pgmap v868: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 11 MiB/s wr, 779 op/s 2024-09-21T08:17:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:51 smithi119 ceph-mon[33564]: pgmap v869: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-09-21T08:17:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:51 smithi145 ceph-mon[34049]: pgmap v869: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-09-21T08:17:51.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:51 smithi006 ceph-mon[30970]: pgmap v869: 129 pgs: 129 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-09-21T08:17:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 895.0 s, 765.2 tps, lat 130.104 ms stddev 83.032 2024-09-21T08:17:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:53 smithi119 ceph-mon[33564]: pgmap v870: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 10 MiB/s wr, 773 op/s 2024-09-21T08:17:53.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:53 smithi145 ceph-mon[34049]: pgmap v870: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 10 MiB/s wr, 773 op/s 2024-09-21T08:17:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:53 smithi006 ceph-mon[30970]: pgmap v870: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 10 MiB/s wr, 773 op/s 2024-09-21T08:17:55.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:55 smithi119 ceph-mon[33564]: pgmap v871: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-21T08:17:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:55 smithi145 ceph-mon[34049]: pgmap v871: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-21T08:17:55.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:55 smithi006 ceph-mon[30970]: pgmap v871: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 11 MiB/s wr, 821 op/s 2024-09-21T08:17:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:57 smithi119 ceph-mon[33564]: pgmap v872: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 8.7 MiB/s wr, 700 op/s 2024-09-21T08:17:57.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:57 smithi145 ceph-mon[34049]: pgmap v872: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 8.7 MiB/s wr, 700 op/s 2024-09-21T08:17:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:57 smithi006 ceph-mon[30970]: pgmap v872: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 8.7 MiB/s wr, 700 op/s 2024-09-21T08:17:57.579 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 900.0 s, 769.0 tps, lat 132.258 ms stddev 115.527 2024-09-21T08:17:57.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:17:57.740 INFO:teuthology.orchestra.run.smithi006.stdout:transaction type: 2024-09-21T08:17:57.740 INFO:teuthology.orchestra.run.smithi006.stdout:scaling factor: 32 2024-09-21T08:17:57.740 INFO:teuthology.orchestra.run.smithi006.stdout:query mode: simple 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:number of clients: 100 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:number of threads: 4 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:duration: 900 s 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:number of transactions actually processed: 522500 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:latency average = 172.195 ms 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:latency stddev = 1000.026 ms 2024-09-21T08:17:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:tps = 580.452130 (including connections establishing) 2024-09-21T08:17:57.742 INFO:teuthology.orchestra.run.smithi006.stdout:tps = 580.459780 (excluding connections establishing) 2024-09-21T08:17:57.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-21T08:17:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:17:59.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:17:59 smithi119 ceph-mon[33564]: pgmap v873: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 11 MiB/s wr, 772 op/s 2024-09-21T08:17:59.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:17:59 smithi145 ceph-mon[34049]: pgmap v873: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 11 MiB/s wr, 772 op/s 2024-09-21T08:17:59.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:17:59 smithi006 ceph-mon[30970]: pgmap v873: 129 pgs: 129 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 11 MiB/s wr, 772 op/s 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 -- 172.21.15.6:0/3721290549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 msgr2=0x7f6db8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 --2- 172.21.15.6:0/3721290549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db8110300 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009ca0 tx=0x7f6db002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 -- 172.21.15.6:0/3721290549 shutdown_connections 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 --2- 172.21.15.6:0/3721290549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db8110300 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 --2- 172.21.15.6:0/3721290549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db8105300 0x7f6db810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 --2- 172.21.15.6:0/3721290549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db81049b0 0x7f6db8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 -- 172.21.15.6:0/3721290549 >> 172.21.15.6:0/3721290549 conn(0x7f6db8079730 msgr2=0x7f6db8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 -- 172.21.15.6:0/3721290549 shutdown_connections 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.019+0000 7f6dbe898640 1 -- 172.21.15.6:0/3721290549 wait complete. 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 Processor -- start 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 -- start start 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 0x7f6db819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db8105300 0x7f6db819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db81a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8113970 con 0x7f6db810de10 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81137f0 con 0x7f6db81049b0 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.020+0000 7f6dbe898640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8113af0 con 0x7f6db8105300 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db81a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 0x7f6db819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 0x7f6db819c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:55760/0 (socket says 172.21.15.6:55760) 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6db7fff640 1 -- 172.21.15.6:0/2081426687 learned_addr learned my addr 172.21.15.6:0/2081426687 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6db77fe640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db8105300 0x7f6db819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 -- 172.21.15.6:0/2081426687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db8105300 msgr2=0x7f6db819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db8105300 0x7f6db819cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 -- 172.21.15.6:0/2081426687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 msgr2=0x7f6db819c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 0x7f6db819c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 -- 172.21.15.6:0/2081426687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db81a24b0 con 0x7f6db810de10 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.021+0000 7f6dbce35640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db81a1d80 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6db0031040 tx=0x7f6db0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.022+0000 7f6db57fa640 1 -- 172.21.15.6:0/2081426687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0032c10 con 0x7f6db810de10 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.022+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81a2740 con 0x7f6db810de10 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.022+0000 7f6db57fa640 1 -- 172.21.15.6:0/2081426687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6db0032db0 con 0x7f6db810de10 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.022+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db81a8f00 con 0x7f6db810de10 2024-09-21T08:18:00.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.022+0000 7f6db57fa640 1 -- 172.21.15.6:0/2081426687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0030a20 con 0x7f6db810de10 2024-09-21T08:18:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 Processor -- start 2024-09-21T08:18:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6db57fa640 1 -- 172.21.15.6:0/2081426687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6db0030bc0 con 0x7f6db810de10 2024-09-21T08:18:00.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 -- start start 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 0x562d3d9e5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3d9e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562d3d95be50 con 0x562d3d61d390 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562d3d94b280 con 0x562d3d6151b0 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.026+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562d3d94f090 con 0x562d3d63e070 2024-09-21T08:18:00.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3d9e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3d9e5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49432/0 (socket says 172.21.15.6:49432) 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 -- 172.21.15.6:0/247961495 learned_addr learned my addr 172.21.15.6:0/247961495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 0x562d3d9e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db57fa640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 0x7f6da00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db7fff640 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 -- 172.21.15.6:0/247961495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 msgr2=0x562d3d9e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9e57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 -- 172.21.15.6:0/247961495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 msgr2=0x562d3d9e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6dbce35640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 0x7f6da00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3d9e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 -- 172.21.15.6:0/247961495 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3d6a9650 con 0x562d3d63e070 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.027+0000 7f6db77fe640 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 0x562d3d9e5270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6dac011790 tx=0x7f6dac005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a033bac6c79442b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.028+0000 7f6db57fa640 1 -- 172.21.15.6:0/2081426687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f6db0108b90 con 0x7f6db810de10 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.028+0000 7f6d9e7fc640 1 -- 172.21.15.6:0/247961495 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac011dd0 con 0x562d3d63e070 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.028+0000 7f6d9e7fc640 1 -- 172.21.15.6:0/247961495 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dac0054b0 con 0x562d3d63e070 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.028+0000 7f6dbce35640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 0x7f6da00b8c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ce390 tx=0x7f6db00cad60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.028+0000 7f6d9e7fc640 1 -- 172.21.15.6:0/247961495 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0047a0 con 0x562d3d63e070 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/247961495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 msgr2=0x562d3d9e5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 0x562d3d9e5270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6dac011790 tx=0x7f6dac005f90 comp rx=0 tx=0).stop 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/247961495 shutdown_connections 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3d9e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/247961495 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d63e070 0x562d3d9e5270 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/247961495 >> 172.21.15.6:0/247961495 conn(0x562d3d632460 msgr2=0x562d3d9e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/247961495 shutdown_connections 2024-09-21T08:18:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/247961495 wait complete. 2024-09-21T08:18:00.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.030+0000 7f6dc4e0c740 1 -- start start 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 Processor -- start 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9f0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562d3d7ac700 con 0x562d3d63e070 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562d3d8e6110 con 0x562d3d6151b0 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562d3d9f3a50 con 0x562d3d61d390 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6dc4e0c740 10 client.0 _ll_register_callbacks cb 0x562d3d8ff990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49440/0 (socket says 172.21.15.6:49440) 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6db77fe640 1 -- 172.21.15.6:0/3362598195 learned_addr learned my addr 172.21.15.6:0/3362598195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:00.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6db7fff640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.031+0000 7f6db77fe640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 -- 172.21.15.6:0/3362598195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 msgr2=0x562d3d9f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 -- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 msgr2=0x562d3d9f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 -- 172.21.15.6:0/3362598195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3d913c40 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6db77fe640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fb70 tx=0x7f6dac013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a02ed90e46b316e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6d977fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac011030 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dac0054b0 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f6dac027070 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6dac036050 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6dc4e0c740 10 client.18018 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.032+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562d3d9ff820 con 0x562d3d63e070 2024-09-21T08:18:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dac0054b0 con 0x562d3d63e070 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6dac02d040 con 0x562d3d63e070 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 10 client.18018 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 10 client.18018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 20 client.18018 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5fc9f0 0x562d3da02b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 4 client.18018 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.033+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d3d95dda0 con 0x562d3d5fc9f0 2024-09-21T08:18:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.034+0000 7f6db7fff640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5fc9f0 0x562d3da02b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.034+0000 7f6db7fff640 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5fc9f0 0x562d3da02b80 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10792f864659e2ee server_cookie=ed72217a8a23229b in_seq=0 out_seq=0 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.034+0000 7f6d977fe640 10 client.18018 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6d977fe640 1 -- 172.21.15.6:0/3362598195 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d3d95dda0 con 0x562d3d5fc9f0 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6d977fe640 10 client.18018 handle_command_reply: tid=0 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 client.18018 shutdown 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 msgr2=0x562d3d9fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fb70 tx=0x7f6dac013040 comp rx=0 tx=0).stop 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 shutdown_connections 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5fc9f0 0x562d3da02b80 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d63e070 0x562d3d9fcda0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/3362598195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d6151b0 0x562d3d9f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 >> 172.21.15.6:0/3362598195 conn(0x562d3d632460 msgr2=0x562d3d9e8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6d977fe640 0 client.18018 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 shutdown_connections 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/3362598195 wait complete. 2024-09-21T08:18:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.035+0000 7f6dc4e0c740 20 client.18018 trim_cache size 0 max 16384 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.056+0000 7f6dc4e0c740 1 Processor -- start 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.056+0000 7f6dc4e0c740 1 -- start start 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b10c0 con 0x562d3d6151b0 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b3920 con 0x562d3d63e070 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b1710 con 0x562d3d61d390 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49446/0 (socket says 172.21.15.6:49446) 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 -- 172.21.15.6:0/2076482808 learned_addr learned my addr 172.21.15.6:0/2076482808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db7fff640 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 -- 172.21.15.6:0/2076482808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 msgr2=0x562d3d9e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 -- 172.21.15.6:0/2076482808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 msgr2=0x562d3d9fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.057+0000 7f6db77fe640 1 -- 172.21.15.6:0/2076482808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3d9f1c30 con 0x562d3d6151b0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.058+0000 7f6db77fe640 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097c0 tx=0x7f6dac005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863f636fbe3721fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.058+0000 7f6d9dffb640 1 -- 172.21.15.6:0/2076482808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac009db0 con 0x562d3d6151b0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.058+0000 7f6d9dffb640 1 -- 172.21.15.6:0/2076482808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dac01f660 con 0x562d3d6151b0 2024-09-21T08:18:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.058+0000 7f6d9dffb640 1 -- 172.21.15.6:0/2076482808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0112a0 con 0x562d3d6151b0 2024-09-21T08:18:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/2076482808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 msgr2=0x562d3d9f0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097c0 tx=0x7f6dac005f90 comp rx=0 tx=0).stop 2024-09-21T08:18:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/2076482808 shutdown_connections 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d61d390 0x562d3d9e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/2076482808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d6151b0 0x562d3d9f0ef0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/2076482808 >> 172.21.15.6:0/2076482808 conn(0x562d3d632460 msgr2=0x562d3d9e2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/2076482808 shutdown_connections 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/2076482808 wait complete. 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.059+0000 7f6dc4e0c740 1 -- start start 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 Processor -- start 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 0x562d3da65590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b1de0 con 0x562d3d61d390 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b3250 con 0x562d3d63e070 2024-09-21T08:18:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b24b0 con 0x562d3d6151b0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6dc4e0c740 10 client.0 _ll_register_callbacks cb 0x7f6dac009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49458/0 (socket says 172.21.15.6:49458) 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6db7fff640 1 -- 172.21.15.6:0/1417503875 learned_addr learned my addr 172.21.15.6:0/1417503875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6db77fe640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 0x562d3da65590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.060+0000 7f6db77fe640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 -- 172.21.15.6:0/1417503875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 msgr2=0x562d3da65590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 0x562d3da65590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 -- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 msgr2=0x562d3d9f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 -- 172.21.15.6:0/1417503875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3d9f9190 con 0x562d3d61d390 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db77fe640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 0x562d3da65590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6db7fff640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x562d3da03150 tx=0x7f6da8014970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55a7c8739e41ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6d977fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004050 con 0x562d3d61d390 2024-09-21T08:18:00.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f6da80041f0 con 0x562d3d61d390 2024-09-21T08:18:00.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dac01f660 con 0x562d3d61d390 2024-09-21T08:18:00.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.061+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6da80043f0 con 0x562d3d61d390 2024-09-21T08:18:00.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 10 client.18024 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:00.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562d3da6ce50 con 0x562d3d61d390 2024-09-21T08:18:00.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dac01f660 con 0x562d3d61d390 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6da8010760 con 0x562d3d61d390 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 10 client.18024 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 10 client.18024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 20 client.18024 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5d1da0 0x562d3da6f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 4 client.18024 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d3d959850 con 0x562d3d5d1da0 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.062+0000 7f6db77fe640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5d1da0 0x562d3da6f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6d977fe640 10 client.18024 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6db77fe640 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5d1da0 0x562d3da6f640 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a933c8cde8bc304c server_cookie=1a2ab8706cbb3e83 in_seq=0 out_seq=0 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6d977fe640 1 -- 172.21.15.6:0/1417503875 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8326 (crc 0 0 0) 0x562d3d959850 con 0x562d3d5d1da0 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6d977fe640 10 client.18024 handle_command_reply: tid=0 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6dc4e0c740 1 client.18024 shutdown 2024-09-21T08:18:00.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 msgr2=0x562d3da65b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.063+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x562d3da03150 tx=0x7f6da8014970 comp rx=0 tx=0).stop 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 shutdown_connections 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x562d3d5d1da0 0x562d3da6f640 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562d3d63e070 0x562d3d9f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562d3d61d390 0x562d3da65b30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 --2- 172.21.15.6:0/1417503875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562d3d6151b0 0x562d3da65590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 >> 172.21.15.6:0/1417503875 conn(0x562d3d632460 msgr2=0x562d3d9f1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6d977fe640 0 client.18024 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 shutdown_connections 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 1 -- 172.21.15.6:0/1417503875 wait complete. 2024-09-21T08:18:00.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dc4e0c740 20 client.18024 trim_cache size 0 max 16384 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "d05c27c0-e763-4500-88c9-e4785471a320": { 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:17:25.306236+0000", 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:18:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:18:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:18:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:18:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:18:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:18:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 msgr2=0x7f6da00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 0x7f6da00b8c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ce390 tx=0x7f6db00cad60 comp rx=0 tx=0).stop 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.064+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 msgr2=0x7f6db81a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db81a1d80 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6db0031040 tx=0x7f6db0003f10 comp rx=0 tx=0).stop 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 shutdown_connections 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6da00b6700 0x7f6da00b8c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6db8105300 0x7f6db819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6db810de10 0x7f6db81a1d80 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 --2- 172.21.15.6:0/2081426687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db81049b0 0x7f6db819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 >> 172.21.15.6:0/2081426687 conn(0x7f6db8079730 msgr2=0x7f6db810ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 shutdown_connections 2024-09-21T08:18:00.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:00.065+0000 7f6dbe898640 1 -- 172.21.15.6:0/2081426687 wait complete. 2024-09-21T08:18:01.067 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:18:01.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:18:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:01 smithi119 ceph-mon[33564]: pgmap v874: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-09-21T08:18:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:01 smithi145 ceph-mon[34049]: pgmap v874: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-09-21T08:18:01.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:01 smithi006 ceph-mon[30970]: pgmap v874: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-09-21T08:18:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.587+0000 7f552b4c5640 1 -- 172.21.15.6:0/2495458486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f552410aee0 msgr2=0x7f5524115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.587+0000 7f552b4c5640 1 --2- 172.21.15.6:0/2495458486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f552410aee0 0x7f5524115fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5514009860 tx=0x7f551402e790 comp rx=0 tx=0).stop 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.590+0000 7f552b4c5640 1 -- 172.21.15.6:0/2495458486 shutdown_connections 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.590+0000 7f552b4c5640 1 --2- 172.21.15.6:0/2495458486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f5524118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.590+0000 7f552b4c5640 1 --2- 172.21.15.6:0/2495458486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f552410aee0 0x7f5524115fd0 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5514009860 tx=0x7f551402e790 comp rx=0 tx=0).stop 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.590+0000 7f552b4c5640 1 --2- 172.21.15.6:0/2495458486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f552410a590 0x7f552410a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:02.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.590+0000 7f552b4c5640 1 -- 172.21.15.6:0/2495458486 >> 172.21.15.6:0/2495458486 conn(0x7f5524070ec0 msgr2=0x7f55240712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:02.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.591+0000 7f552b4c5640 1 -- 172.21.15.6:0/2495458486 shutdown_connections 2024-09-21T08:18:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.595+0000 7f552b4c5640 1 -- 172.21.15.6:0/2495458486 wait complete. 2024-09-21T08:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.596+0000 7f552b4c5640 1 Processor -- start 2024-09-21T08:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.596+0000 7f552b4c5640 1 -- start start 2024-09-21T08:18:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f552410a590 0x7f5524115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55241104e0 0x7f55241108f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f552411a020 con 0x7f552410a590 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5524119ea0 con 0x7f55241104e0 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f552b4c5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f552411a1a0 con 0x7f5524116640 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f5528a60640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f5528a60640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:44694/0 (socket says 172.21.15.6:44694) 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.597+0000 7f5528a60640 1 -- 172.21.15.6:0/2301122904 learned_addr learned my addr 172.21.15.6:0/2301122904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.599+0000 7f5528a60640 1 -- 172.21.15.6:0/2301122904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55241104e0 msgr2=0x7f55241108f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.599+0000 7f5528a60640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55241104e0 0x7f55241108f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.599+0000 7f5528a60640 1 -- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f552410a590 msgr2=0x7f5524115da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.599+0000 7f5528a60640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f552410a590 0x7f5524115da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.599+0000 7f5528a60640 1 -- 172.21.15.6:0/2301122904 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552407b780 con 0x7f5524116640 2024-09-21T08:18:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.603+0000 7f5528a60640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f5514035630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:02.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.608+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514004030 con 0x7f5524116640 2024-09-21T08:18:02.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.608+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55140046c0 con 0x7f5524116640 2024-09-21T08:18:02.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.608+0000 7f552b4c5640 1 -- 172.21.15.6:0/2301122904 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552407ba10 con 0x7f5524116640 2024-09-21T08:18:02.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.608+0000 7f552b4c5640 1 -- 172.21.15.6:0/2301122904 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552407bea0 con 0x7f5524116640 2024-09-21T08:18:02.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.609+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552410a9a0 con 0x7f5524116640 2024-09-21T08:18:02.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.612+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514003850 con 0x7f5524116640 2024-09-21T08:18:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.621+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5514003b10 con 0x7f5524116640 2024-09-21T08:18:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.622+0000 7f551a7fc640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 0x7f55100b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.622+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f551410a560 con 0x7f5524116640 2024-09-21T08:18:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.622+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5514004870 con 0x7f5524116640 2024-09-21T08:18:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.629+0000 7f5529261640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 0x7f55100b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:02.632+0000 7f5529261640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 0x7f55100b8d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f55200058c0 tx=0x7f5520005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:02.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:18:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:18:02.580+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:18:02.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:18:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:18:02.580+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:18:02.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:18:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:18:02.580+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:18:02.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:18:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:18:02.580+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:18:02.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:18:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:18:02.580+0000 7f6a8e375640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T08:18:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.074+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55241112a0 con 0x7f5524116640 2024-09-21T08:18:03.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.076+0000 7f551a7fc640 1 -- 172.21.15.6:0/2301122904 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f55140d06f0 con 0x7f5524116640 2024-09-21T08:18:03.077 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:03.077 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:18:03.077 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:18:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.080+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 msgr2=0x7f55100b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.080+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 0x7f55100b8d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f55200058c0 tx=0x7f5520005850 comp rx=0 tx=0).stop 2024-09-21T08:18:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.081+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 msgr2=0x7f552410ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.081+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5514000c00 tx=0x7f5514035630 comp rx=0 tx=0).stop 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 shutdown_connections 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f55100b6880 0x7f55100b8d90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5524116640 0x7f552410ffa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55241104e0 0x7f55241108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 --2- 172.21.15.6:0/2301122904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f552410a590 0x7f5524115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.090+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 >> 172.21.15.6:0/2301122904 conn(0x7f5524070ec0 msgr2=0x7f5524072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.094+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 shutdown_connections 2024-09-21T08:18:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:03.094+0000 7f550ffff640 1 -- 172.21.15.6:0/2301122904 wait complete. 2024-09-21T08:18:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:03 smithi119 ceph-mon[33564]: pgmap v875: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-21T08:18:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:03 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2301122904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:03 smithi145 ceph-mon[34049]: pgmap v875: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-21T08:18:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:03 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2301122904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:03 smithi006 ceph-mon[30970]: pgmap v875: 129 pgs: 129 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 9.6 MiB/s wr, 734 op/s 2024-09-21T08:18:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:03 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2301122904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:05 smithi119 ceph-mon[33564]: pgmap v876: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-09-21T08:18:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:05 smithi119 ceph-mon[33564]: mgrmap e25: x(active, since 26m), standbys: z, y 2024-09-21T08:18:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:05 smithi145 ceph-mon[34049]: pgmap v876: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-09-21T08:18:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:05 smithi145 ceph-mon[34049]: mgrmap e25: x(active, since 26m), standbys: z, y 2024-09-21T08:18:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:05 smithi006 ceph-mon[30970]: pgmap v876: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-09-21T08:18:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:05 smithi006 ceph-mon[30970]: mgrmap e25: x(active, since 26m), standbys: z, y 2024-09-21T08:18:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:07 smithi119 ceph-mon[33564]: pgmap v877: 129 pgs: 129 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 8.9 MiB/s wr, 799 op/s 2024-09-21T08:18:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:07 smithi145 ceph-mon[34049]: pgmap v877: 129 pgs: 129 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 8.9 MiB/s wr, 799 op/s 2024-09-21T08:18:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:07 smithi006 ceph-mon[30970]: pgmap v877: 129 pgs: 129 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 8.9 MiB/s wr, 799 op/s 2024-09-21T08:18:07.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:18:07.954 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:08.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T08:18:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 -- 172.21.15.6:0/3958791791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42501049b0 msgr2=0x7f4250104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 --2- 172.21.15.6:0/3958791791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42501049b0 0x7f4250104dc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f424c009900 tx=0x7f424c02a410 comp rx=0 tx=0).stop 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 -- 172.21.15.6:0/3958791791 shutdown_connections 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 --2- 172.21.15.6:0/3958791791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4250105300 0x7f425010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 --2- 172.21.15.6:0/3958791791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 0x7f4250110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 --2- 172.21.15.6:0/3958791791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42501049b0 0x7f4250104dc0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 -- 172.21.15.6:0/3958791791 >> 172.21.15.6:0/3958791791 conn(0x7f4250079730 msgr2=0x7f4250079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 -- 172.21.15.6:0/3958791791 shutdown_connections 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 -- 172.21.15.6:0/3958791791 wait complete. 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.459+0000 7f4257a55640 1 Processor -- start 2024-09-21T08:18:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 -- start start 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 0x7f425019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 0x7f425019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 0x7f42501a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4250113970 con 0x7f4250105300 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f42501137f0 con 0x7f425010de10 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4257a55640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4250113af0 con 0x7f42501049b0 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4254ff0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 0x7f425019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 0x7f425019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4254ff0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 0x7f425019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45924/0 (socket says 172.21.15.6:45924) 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4254ff0640 1 -- 172.21.15.6:0/4114831593 learned_addr learned my addr 172.21.15.6:0/4114831593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f4255ff2640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 0x7f42501a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 -- 172.21.15.6:0/4114831593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 msgr2=0x7f42501a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 0x7f42501a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 -- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 msgr2=0x7f425019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 0x7f425019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.460+0000 7f42557f1640 1 -- 172.21.15.6:0/4114831593 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42501a2570 con 0x7f42501049b0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f42557f1640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 0x7f425019c6c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f424c009230 tx=0x7f424c003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f42467fc640 1 -- 172.21.15.6:0/4114831593 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c03f070 con 0x7f42501049b0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42501a2800 con 0x7f42501049b0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f42467fc640 1 -- 172.21.15.6:0/4114831593 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f424c003e10 con 0x7f42501049b0 2024-09-21T08:18:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f42467fc640 1 -- 172.21.15.6:0/4114831593 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c035030 con 0x7f42501049b0 2024-09-21T08:18:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.461+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501a2d00 con 0x7f42501049b0 2024-09-21T08:18:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 Processor -- start 2024-09-21T08:18:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 -- start start 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:total 2 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1422832906 Sep 21 08:01 . 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1422832906 Sep 21 08:01 .. 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 data 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:total 46 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 . 2024-09-21T08:18:08.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1422832906 Sep 21 08:01 .. 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 base 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 21 08:01 current_logfiles 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 21 08:01 global 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1178 Sep 21 08:01 log 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_commit_ts 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_dynshmem 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 08:01 pg_hba.conf 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 08:01 pg_ident.conf 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:18 pg_logical 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 pg_multixact 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_notify 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_replslot 2024-09-21T08:18:08.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_serial 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_snapshots 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 08:18 pg_stat 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:18 pg_stat_tmp 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 21 08:17 pg_subtrans 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_tblspc 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 pg_twophase 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 838860800 Sep 21 08:18 pg_wal 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 08:01 pg_xact 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 08:01 postgresql.auto.conf 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 08:01 postgresql.conf 2024-09-21T08:18:08.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 21 08:01 postmaster.opts 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 . 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 1 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 13493 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 550236719 Sep 21 08:08 13494 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:02 pgsql_tmp 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T08:18:08.469 INFO:teuthology.orchestra.run.smithi006.stdout:total 7778 2024-09-21T08:18:08.470 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 . 2024-09-21T08:18:08.470 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 .. 2024-09-21T08:18:08.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc1fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5628fc171ea0 con 0x5628fbe54070 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5628fc1612d0 con 0x5628fbe33390 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.464+0000 7f425dfc9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5628fc1650e0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 1247 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:18:08.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1247_vm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:01 1249 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1249_fsm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1249_vm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:01 1259 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1259_vm 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:18:08.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:18:08.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:18:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:18:08.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:18:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45936/0 (socket says 172.21.15.6:45936) 2024-09-21T08:18:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f42467fc640 1 -- 172.21.15.6:0/4114831593 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f424c042070 con 0x7f42501049b0 2024-09-21T08:18:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 -- 172.21.15.6:0/3924254381 learned_addr learned my addr 172.21.15.6:0/3924254381 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2579 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:18:08.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:18:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606_vm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:01 2608 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2608_vm 2024-09-21T08:18:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2610 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2610_vm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:18:08.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 08:01 2619 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2619_fsm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2619_vm 2024-09-21T08:18:08.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:01 2658 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 2659 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:18:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2662 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2663 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2664 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2665 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2666 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2667 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:01 2673 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:01 2674 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:18:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2678 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2679 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc1fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:18:08.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2696 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:18:08.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2703 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2704 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:18:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:18:08.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:18:08.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:18:08.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3455 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:18:08.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 -- 172.21.15.6:0/3924254381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 msgr2=0x5628fc1fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 -- 172.21.15.6:0/3924254381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 msgr2=0x5628fc1fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc1fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:18:08.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:18:08.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:18:08.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:18:08.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:18:08.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:18:08.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:18:08.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:18:08.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:18:08.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 -- 172.21.15.6:0/3924254381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fbebf650 con 0x5628fbe54070 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4248007ec0 tx=0x7f424800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a0b18b394ec446 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.465+0000 7f423b7fe640 1 -- 172.21.15.6:0/3924254381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248010840 con 0x5628fbe54070 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f423b7fe640 1 -- 172.21.15.6:0/3924254381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42480183f0 con 0x5628fbe54070 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f423b7fe640 1 -- 172.21.15.6:0/3924254381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248017600 con 0x5628fbe54070 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f42467fc640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 0x7f423c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f42557f1640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 0x7f423c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f42467fc640 1 -- 172.21.15.6:0/4114831593 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f424c108130 con 0x7f42501049b0 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f425dfc9740 1 -- 172.21.15.6:0/3924254381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 msgr2=0x5628fc1fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4248007ec0 tx=0x7f424800f790 comp rx=0 tx=0).stop 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.466+0000 7f42557f1640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 0x7f423c0b8bc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x5628fc1f9f40 tx=0x7f424c009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 -- 172.21.15.6:0/3924254381 shutdown_connections 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc1fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3924254381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc1fb2c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 -- 172.21.15.6:0/3924254381 >> 172.21.15.6:0/3924254381 conn(0x5628fbe48460 msgr2=0x5628fc1f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 -- 172.21.15.6:0/3924254381 shutdown_connections 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 -- 172.21.15.6:0/3924254381 wait complete. 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 -- start start 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.467+0000 7f425dfc9740 1 Processor -- start 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe33390 0x5628fc206e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc212df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5628fbfc2700 con 0x5628fbe54070 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5628fc0fc160 con 0x5628fbe2b1b0 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5628fc209aa0 con 0x5628fbe33390 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f425dfc9740 10 client.0 _ll_register_callbacks cb 0x5628fc1159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53500/0 (socket says 172.21.15.6:53500) 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4255ff2640 1 -- 172.21.15.6:0/3428878223 learned_addr learned my addr 172.21.15.6:0/3428878223 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc212df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe33390 0x5628fc206e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.468+0000 7f4255ff2640 1 -- 172.21.15.6:0/3428878223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe33390 msgr2=0x5628fc206e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe33390 0x5628fc206e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4255ff2640 1 -- 172.21.15.6:0/3428878223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 msgr2=0x5628fc212df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc212df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4255ff2640 1 -- 172.21.15.6:0/3428878223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fc129c90 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4248018d90 tx=0x7f4248012040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad44e116552e953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4238ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424802c060 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42480183f0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f42480179a0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4248033050 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f425dfc9740 10 client.27629 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.469+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5628fc21dfc0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42480183f0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4248024040 con 0x5628fbe2b1b0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 10 client.27629 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 10 client.27629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 20 client.27629 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbe129f0 0x5628fc2213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 4 client.27629 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628fc173df0 con 0x5628fbe129f0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.470+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbe129f0 0x5628fc2213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.471+0000 7f4238ff9640 10 client.27629 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.471+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbe129f0 0x5628fc2213e0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd00d272ae224d9 server_cookie=c6d1115474509c5a in_seq=0 out_seq=0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.471+0000 7f4238ff9640 1 -- 172.21.15.6:0/3428878223 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628fc173df0 con 0x5628fbe129f0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.471+0000 7f4238ff9640 10 client.27629 handle_command_reply: tid=0 2024-09-21T08:18:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.471+0000 7f425dfc9740 1 client.27629 shutdown 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 msgr2=0x5628fc206950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4248018d90 tx=0x7f4248012040 comp rx=0 tx=0).stop 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 shutdown_connections 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbe129f0 0x5628fc2213e0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe33390 0x5628fc206e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe54070 0x5628fc212df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3428878223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe2b1b0 0x5628fc206950 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 >> 172.21.15.6:0/3428878223 conn(0x5628fbe48460 msgr2=0x5628fc1fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f4238ff9640 0 client.27629 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 shutdown_connections 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 1 -- 172.21.15.6:0/3428878223 wait complete. 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.472+0000 7f425dfc9740 20 client.27629 trim_cache size 0 max 16384 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 Processor -- start 2024-09-21T08:18:08.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 -- start start 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc208580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe54070 0x5628fc1f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f42501acd70 con 0x5628fbe2b1b0 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f42501af550 con 0x5628fbe33390 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f425dfc9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42501ad3c0 con 0x5628fbe54070 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45968/0 (socket says 172.21.15.6:45968) 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 -- 172.21.15.6:0/4131363528 learned_addr learned my addr 172.21.15.6:0/4131363528 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4254ff0640 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc208580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 -- 172.21.15.6:0/4131363528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe54070 msgr2=0x5628fc1f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe54070 0x5628fc1f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 -- 172.21.15.6:0/4131363528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 msgr2=0x5628fc208580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc208580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.489+0000 7f4255ff2640 1 -- 172.21.15.6:0/4131363528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fc2015f0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.490+0000 7f4255ff2640 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f424801aff0 tx=0x7f4248011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77ed233f03c2871 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.490+0000 7f423affd640 1 -- 172.21.15.6:0/4131363528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424802c040 con 0x5628fbe2b1b0 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.490+0000 7f423affd640 1 -- 172.21.15.6:0/4131363528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42480183f0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.490+0000 7f423affd640 1 -- 172.21.15.6:0/4131363528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480108a0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- 172.21.15.6:0/4131363528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 msgr2=0x5628fc1fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f424801aff0 tx=0x7f4248011f30 comp rx=0 tx=0).stop 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- 172.21.15.6:0/4131363528 shutdown_connections 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe54070 0x5628fc1f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe33390 0x5628fc208580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 --2- 172.21.15.6:0/4131363528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe2b1b0 0x5628fc1fccb0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- 172.21.15.6:0/4131363528 >> 172.21.15.6:0/4131363528 conn(0x5628fbe48460 msgr2=0x5628fc207e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- 172.21.15.6:0/4131363528 shutdown_connections 2024-09-21T08:18:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- 172.21.15.6:0/4131363528 wait complete. 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.491+0000 7f425dfc9740 1 -- start start 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 Processor -- start 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc221e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe54070 0x5628fc283b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f42501ada10 con 0x5628fbe33390 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f42501aee80 con 0x5628fbe54070 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42501ae0e0 con 0x5628fbe2b1b0 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f425dfc9740 10 client.0 _ll_register_callbacks cb 0x7f4248007d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45984/0 (socket says 172.21.15.6:45984) 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 -- 172.21.15.6:0/3033177233 learned_addr learned my addr 172.21.15.6:0/3033177233 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe54070 0x5628fc283b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc221e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 -- 172.21.15.6:0/3033177233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 msgr2=0x5628fc221e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc221e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 -- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe54070 msgr2=0x5628fc283b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.492+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe54070 0x5628fc283b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4254ff0640 1 -- 172.21.15.6:0/3033177233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fc284200 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4254ff0640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x5628fc0fc270 tx=0x7f42400035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c36df279c3500b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4238ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424001d410 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f424001d5b0 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42480183f0 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f424002e050 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f425dfc9740 10 client.18051 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.493+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5628fc28b5e0 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42480183f0 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4240011890 con 0x5628fbe33390 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 10 client.18051 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:08.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 20 client.18051 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbde7da0 0x5628fc28de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 4 client.18051 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628fc16f8a0 con 0x5628fbde7da0 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.494+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbde7da0 0x5628fc28de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f4238ff9640 10 client.18051 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f4255ff2640 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbde7da0 0x5628fc28de50 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6972064fd45c444 server_cookie=6b9f9439c4fbfbc2 in_seq=0 out_seq=0 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f4238ff9640 1 -- 172.21.15.6:0/3033177233 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628fc16f8a0 con 0x5628fbde7da0 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f4238ff9640 10 client.18051 handle_command_reply: tid=0 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 client.18051 shutdown 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 msgr2=0x5628fc2223e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x5628fc0fc270 tx=0x7f42400035f0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 shutdown_connections 2024-09-21T08:18:08.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5628fbde7da0 0x5628fc28de50 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628fbe54070 0x5628fc283b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5628fbe33390 0x5628fc2223e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 --2- 172.21.15.6:0/3033177233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5628fbe2b1b0 0x5628fc221e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 >> 172.21.15.6:0/3033177233 conn(0x5628fbe48460 msgr2=0x5628fc208680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f4238ff9640 0 client.18051 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 shutdown_connections 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 1 -- 172.21.15.6:0/3033177233 wait complete. 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.495+0000 7f425dfc9740 20 client.18051 trim_cache size 0 max 16384 2024-09-21T08:18:08.514 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 msgr2=0x7f423c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 0x7f423c0b8bc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x5628fc1f9f40 tx=0x7f424c009260 comp rx=0 tx=0).stop 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 msgr2=0x7f425019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 0x7f425019c6c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f424c009230 tx=0x7f424c003c20 comp rx=0 tx=0).stop 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 shutdown_connections 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f423c0b66b0 0x7f423c0b8bc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f425010de10 0x7f42501a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4250105300 0x7f425019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 --2- 172.21.15.6:0/4114831593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42501049b0 0x7f425019c6c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:08.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 >> 172.21.15.6:0/4114831593 conn(0x7f4250079730 msgr2=0x7f4250100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:08.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 shutdown_connections 2024-09-21T08:18:08.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:08.496+0000 7f4257a55640 1 -- 172.21.15.6:0/4114831593 wait complete. 2024-09-21T08:18:08.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:18:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:18:08.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:08.747 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:total 7778 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 08:01 . 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 .. 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 1247 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1247_vm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:01 1249 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1249_fsm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1249_vm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:18:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:01 1259 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1259_vm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:18:08.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:18:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2579 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:18:08.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2606_vm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:01 2608 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2608_vm 2024-09-21T08:18:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2610 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2610_vm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:18:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 08:01 2619 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2619_fsm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2619_vm 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:18:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:01 2658 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:01 2659 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2662 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2663 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2664 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2665 2024-09-21T08:18:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2666 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2667 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:01 2673 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:01 2674 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2678 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2679 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:18:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2696 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:18:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2703 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2704 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:18:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:18:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:18:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:18:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3455 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:18:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:18:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:18:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:18:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:18:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:18:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:18:09.054 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:18:09.055 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:total 537343 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 550236719 Sep 21 08:08 . 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 .. 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 112 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 113 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:03 1247 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1247_fsm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 1247_vm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 08:03 1249 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:03 1249_fsm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 1249_vm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 08:01 1255 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1255_fsm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1255_vm 2024-09-21T08:18:09.057 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 08:17 1259 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1259_fsm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 1259_vm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 08:01 13344 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13344_fsm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13344_vm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13346 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13348 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13349_fsm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13349_vm 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13351 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13353 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354 2024-09-21T08:18:09.058 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13354_fsm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13354_vm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13356 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13358 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 13359_fsm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13359_vm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 13361 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 13363 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1417 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 1418 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 438173696 Sep 21 08:18 16396 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 08:17 16396_fsm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:18 16396_vm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1040384 Sep 21 08:18 16397 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:17 16397_fsm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:18 16397_vm 2024-09-21T08:18:09.059 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3162112 Sep 21 08:17 16399 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:18 16399_fsm 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:18 16399_vm 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:17 16400 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:17 16402 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 21 08:18 16404 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 27508736 Sep 21 08:18 16406 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:18 16406_fsm 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:18 16406_vm 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 174 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 175 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2187 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2224 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2328 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2336 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2337 2024-09-21T08:18:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2579 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2600 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2600_fsm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2600_vm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2601_fsm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2601_vm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2602 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2602_fsm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2602_vm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2603 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2603_fsm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2603_vm 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2604 2024-09-21T08:18:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2605 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2605_fsm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2605_vm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 2606 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2606_fsm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 2606_vm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2607 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2607_fsm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2607_vm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 08:03 2608 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2608_fsm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 2608_vm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 08:01 2609 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2609_fsm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2609_vm 2024-09-21T08:18:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:03 2610 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2610_fsm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 2610_vm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2611 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2612_fsm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2612_vm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2613 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2615_fsm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2615_vm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2616 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2616_fsm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2616_vm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 08:01 2617 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2617_fsm 2024-09-21T08:18:09.063 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2617_vm 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 08:01 2618 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2618_fsm 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2618_vm 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 21 08:17 2619 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:04 2619_fsm 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:03 2619_vm 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2620 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2650 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2651 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2652 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2653 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2654 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2655 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2656 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2657 2024-09-21T08:18:09.064 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 08:03 2658 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 08:03 2659 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2660 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2661 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:03 2662 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:03 2663 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2664 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2665 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2666 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2667 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2668 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2669 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2670 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 08:03 2673 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 08:03 2674 2024-09-21T08:18:09.065 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 08:01 2675 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2678 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:03 2679 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2680 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2681 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2682 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2683 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2684 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2685 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2686 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2687 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 2688 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 08:01 2689 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 08:01 2690 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 08:01 2691 2024-09-21T08:18:09.066 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2692 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2693 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:06 2696 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2699 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2701 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2702 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:03 2703 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:03 2704 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2753 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2753_fsm 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2753_vm 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2754 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2755 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2756 2024-09-21T08:18:09.067 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 2757 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2830 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2831 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2832 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2833 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2834 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2835 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2836 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2837 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 08:01 2838 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2838_fsm 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2838_vm 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2839 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840 2024-09-21T08:18:09.068 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2840_fsm 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2840_vm 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2841 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2995 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2996 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3079_fsm 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3079_vm 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3080 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3081 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:01 3085 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3118 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3119 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 08:01 3164 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3256 2024-09-21T08:18:09.069 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3257 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3258 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3350 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3351 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3379 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3380 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3381 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3394 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3394_fsm 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3394_vm 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3395 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3429 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3430 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3431 2024-09-21T08:18:09.070 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3433 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3439 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3440 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 08:03 3455 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 08:01 3456 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3456_fsm 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3456_vm 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3466 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3467 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3468 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3501 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3502 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3503 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3534 2024-09-21T08:18:09.071 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3541_fsm 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3541_vm 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3542 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3574 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3575 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3576 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3596 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3597 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3598 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3599 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3600_fsm 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3600_vm 2024-09-21T08:18:09.072 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3601_fsm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3601_vm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3602_fsm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3602_vm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3603_fsm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3603_vm 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3604 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3605 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3606 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3607 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3608 2024-09-21T08:18:09.073 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 08:01 3609 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3712 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 3764_fsm 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3764_vm 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3766 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 3767 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3997 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4143 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4144 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4145 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4146 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4147 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4148 2024-09-21T08:18:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4149 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4150 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4151 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4152 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4153 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4154 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4155 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4156 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4157 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4158 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4159 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4160 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4161 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4162 2024-09-21T08:18:09.075 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4163 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4164 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4165 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4166 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4167 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4168 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4169 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4170 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4171 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4172 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4173 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4174 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 5002 2024-09-21T08:18:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 548 2024-09-21T08:18:09.077 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 549 2024-09-21T08:18:09.077 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6102 2024-09-21T08:18:09.077 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6104 2024-09-21T08:18:09.077 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6106 2024-09-21T08:18:09.077 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6110 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6111 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6112 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6113 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6117 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 826 2024-09-21T08:18:09.110 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 827 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 828 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 21 08:01 pg_internal.init 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 08:01 PG_VERSION 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:02 . 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 566162997 Sep 21 08:02 .. 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:total 561 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 21 08:01 . 2024-09-21T08:18:09.111 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1213 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1213_fsm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1213_vm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1214 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1214_fsm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1214_vm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 1232 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 1233 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1260 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1260_fsm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1260_vm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1261 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1261_fsm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1261_vm 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1262 2024-09-21T08:18:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 1262_fsm 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 1262_vm 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2396 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 08:01 2396_fsm 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2396_vm 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2397 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2671 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2672 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2676 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2677 2024-09-21T08:18:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2694 2024-09-21T08:18:09.127 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2695 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2697 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 2698 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2846 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2847 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2964 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2965 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 2966 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 2967 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 3592 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 3593 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4060 2024-09-21T08:18:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4061 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4175 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4176 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4177 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4178 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4181 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4182 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4183 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4184 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 4185 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 4186 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6000 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6001 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6002 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 6100 2024-09-21T08:18:09.129 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6114 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 6115 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:18 pg_control 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 08:01 pg_filenode.map 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 21 08:01 pg_internal.init 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1178 Sep 21 08:01 . 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1249 Sep 21 08:18 postgresql-Sat.log 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T08:18:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2024-09-21T08:18:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:18 . 2024-09-21T08:18:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 mappings 2024-09-21T08:18:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:18 replorigin_checkpoint 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 snapshots 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:18 .. 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 08:18 .. 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:total 2 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 . 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 members 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 offsets 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 .. 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 0000 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:total 9 2024-09-21T08:18:09.179 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:01 . 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 08:01 .. 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 08:06 0000 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T08:18:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:total 16 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 08:18 . 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 21 08:18 db_0.stat 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 21 08:18 db_13494.stat 2024-09-21T08:18:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 21 08:18 global.stat 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:18 . 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:total 257 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 21 08:17 . 2024-09-21T08:18:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.229 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 21 08:17 0007 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:total 819202 2024-09-21T08:18:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 838860800 Sep 21 08:18 . 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:18 00000001000000000000006A 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:10 00000001000000000000006B 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:07 00000001000000000000006C 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:10 00000001000000000000006D 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:08 00000001000000000000006E 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 00000001000000000000006F 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:14 000000010000000000000070 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000071 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:13 000000010000000000000072 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:11 000000010000000000000073 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 000000010000000000000074 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000075 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:11 000000010000000000000076 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:13 000000010000000000000077 2024-09-21T08:18:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000078 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000079 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:14 00000001000000000000007A 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 00000001000000000000007B 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:13 00000001000000000000007C 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 00000001000000000000007D 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:11 00000001000000000000007E 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:11 00000001000000000000007F 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:14 000000010000000000000080 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000081 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:15 000000010000000000000082 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000083 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000084 2024-09-21T08:18:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000085 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:13 000000010000000000000086 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:13 000000010000000000000087 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:14 000000010000000000000088 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 000000010000000000000089 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 00000001000000000000008A 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:11 00000001000000000000008B 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:12 00000001000000000000008C 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 00000001000000000000008D 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 00000001000000000000008E 2024-09-21T08:18:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 00000001000000000000008F 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000090 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 000000010000000000000091 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000092 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 000000010000000000000093 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000094 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 000000010000000000000095 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000096 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 000000010000000000000097 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000098 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:17 000000010000000000000099 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 00000001000000000000009A 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 08:16 00000001000000000000009B 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 archive_status 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.238 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 08:01 . 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 838860800 Sep 21 08:18 .. 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:total 129 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 08:01 . 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1406055583 Sep 21 08:18 .. 2024-09-21T08:18:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 08:17 0000 2024-09-21T08:18:09.240 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T08:18:09.250 INFO:tasks.quiescer:joining Quiescers 2024-09-21T08:18:09.250 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T08:18:09.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:18:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:09.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:09 smithi119 ceph-mon[33564]: pgmap v878: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 10 MiB/s wr, 936 op/s 2024-09-21T08:18:09.933 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:09 smithi006 ceph-mon[30970]: pgmap v878: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 10 MiB/s wr, 936 op/s 2024-09-21T08:18:09.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:09 smithi145 ceph-mon[34049]: pgmap v878: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 10 MiB/s wr, 936 op/s 2024-09-21T08:18:10.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 -- 172.21.15.6:0/3864558977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 msgr2=0x7f133c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:10.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 --2- 172.21.15.6:0/3864558977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c075bc0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1338009900 tx=0x7f133802a410 comp rx=0 tx=0).stop 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 -- 172.21.15.6:0/3864558977 shutdown_connections 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 --2- 172.21.15.6:0/3864558977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c076100 0x7f133c10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 --2- 172.21.15.6:0/3864558977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c110110 0x7f133c112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 --2- 172.21.15.6:0/3864558977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c075bc0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 -- 172.21.15.6:0/3864558977 >> 172.21.15.6:0/3864558977 conn(0x7f133c0ff600 msgr2=0x7f133c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 -- 172.21.15.6:0/3864558977 shutdown_connections 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.052+0000 7f134354c640 1 -- 172.21.15.6:0/3864558977 wait complete. 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.053+0000 7f134354c640 1 Processor -- start 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.053+0000 7f134354c640 1 -- start start 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.053+0000 7f134354c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.053+0000 7f134354c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c076100 0x7f133c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:10.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c110110 0x7f133c1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f133c115b70 con 0x7f133c0757b0 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f133c1159f0 con 0x7f133c076100 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f133c115cf0 con 0x7f133c110110 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45992/0 (socket says 172.21.15.6:45992) 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 -- 172.21.15.6:0/4108029771 learned_addr learned my addr 172.21.15.6:0/4108029771 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f1340ae7640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c076100 0x7f133c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f1341ae9640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c110110 0x7f133c1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 -- 172.21.15.6:0/4108029771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c110110 msgr2=0x7f133c1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c110110 0x7f133c1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 -- 172.21.15.6:0/4108029771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c076100 msgr2=0x7f133c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:10.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c076100 0x7f133c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 -- 172.21.15.6:0/4108029771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c1a2530 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13412e8640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1338009230 tx=0x7f13380319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133803f030 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c1a27c0 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13380043d0 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338035070 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.054+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1a8f80 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.055+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c076cc0 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.057+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f1338042030 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.058+0000 7f13327fc640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 0x7f13280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.058+0000 7f1340ae7640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 0x7f13280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.058+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9511+0+0 (secure 0 0 0) 0x7f1338108260 con 0x7f133c0757b0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.059+0000 7f1340ae7640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 0x7f13280b8b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f133c1125b0 tx=0x7f132c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:10.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.062+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13380d27b0 con 0x7f133c0757b0 2024-09-21T08:18:10.191 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:18:10.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:18:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.312+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f133c075bc0 con 0x7f133c0757b0 2024-09-21T08:18:10.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.313+0000 7f13327fc640 1 -- 172.21.15.6:0/4108029771 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f13380d76f0 con 0x7f133c0757b0 2024-09-21T08:18:10.314 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:18:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:18:10.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 msgr2=0x7f13280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 0x7f13280b8b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f133c1125b0 tx=0x7f132c005f90 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 msgr2=0x7f133c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f1338009230 tx=0x7f13380319a0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 shutdown_connections 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f13280b6680 0x7f13280b8b90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f133c110110 0x7f133c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f133c076100 0x7f133c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 --2- 172.21.15.6:0/4108029771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f133c0757b0 0x7f133c19c5c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 >> 172.21.15.6:0/4108029771 conn(0x7f133c0ff600 msgr2=0x7f133c108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 shutdown_connections 2024-09-21T08:18:10.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:10.315+0000 7f134354c640 1 -- 172.21.15.6:0/4108029771 wait complete. 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:18:10.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:18:10.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:18:10.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:10 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4108029771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:18:10.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:18:10.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:18:10.944 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:10 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4108029771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:10.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:18:10.961 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:10 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4108029771' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:11.009 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24713 quiesce db --cancel --all' 2024-09-21T08:18:11.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- timeout 105 ceph tell mds.24713 quiesce db --cancel --all 2024-09-21T08:18:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 -- 172.21.15.6:0/705205855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840ab1f0 msgr2=0x7f00840aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 --2- 172.21.15.6:0/705205855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840ab1f0 0x7f00840aba10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0080009900 tx=0x7f008002a440 comp rx=0 tx=0).stop 2024-09-21T08:18:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 -- 172.21.15.6:0/705205855 shutdown_connections 2024-09-21T08:18:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 --2- 172.21.15.6:0/705205855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00840aa8a0 0x7f00840aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 --2- 172.21.15.6:0/705205855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840ab1f0 0x7f00840aba10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 --2- 172.21.15.6:0/705205855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840a5130 0x7f00840a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.748+0000 7f009271d640 1 -- 172.21.15.6:0/705205855 >> 172.21.15.6:0/705205855 conn(0x7f008401ccb0 msgr2=0x7f008401d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.756+0000 7f009271d640 1 -- 172.21.15.6:0/705205855 shutdown_connections 2024-09-21T08:18:11.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.757+0000 7f009271d640 1 -- 172.21.15.6:0/705205855 wait complete. 2024-09-21T08:18:11.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.758+0000 7f009271d640 1 Processor -- start 2024-09-21T08:18:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 -- start start 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840a5130 0x7f00840baf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00840aa8a0 0x7f00840b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00840bd5d0 con 0x7f00840ab1f0 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00840bd450 con 0x7f00840a5130 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.762+0000 7f009271d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f00840bd750 con 0x7f00840aa8a0 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46014/0 (socket says 172.21.15.6:46014) 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 -- 172.21.15.6:0/204041679 learned_addr learned my addr 172.21.15.6:0/204041679 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 -- 172.21.15.6:0/204041679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00840aa8a0 msgr2=0x7f00840b41d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00840aa8a0 0x7f00840b41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 -- 172.21.15.6:0/204041679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840a5130 msgr2=0x7f00840baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840a5130 0x7f00840baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.763+0000 7f0090cba640 1 -- 172.21.15.6:0/204041679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00840b4f70 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.764+0000 7f0090cba640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f008002a9b0 tx=0x7f0080003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.765+0000 7f00897fa640 1 -- 172.21.15.6:0/204041679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080040030 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.765+0000 7f00897fa640 1 -- 172.21.15.6:0/204041679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f008003c8d0 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.765+0000 7f00897fa640 1 -- 172.21.15.6:0/204041679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080031930 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.766+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00840b9bd0 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.766+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00840ba060 con 0x7f00840ab1f0 2024-09-21T08:18:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.773+0000 7f0098c91740 1 Processor -- start 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 -- start start 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffad0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffad1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d3ffa46e60 con 0x55d3ff729350 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d3ffa36290 con 0x55d3ff708670 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f0098c91740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d3ffa3a0a0 con 0x55d3ff700490 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f00897fa640 1 -- 172.21.15.6:0/204041679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0080043030 con 0x7f00840ab1f0 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46016/0 (socket says 172.21.15.6:46016) 2024-09-21T08:18:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f008b7fe640 1 -- 172.21.15.6:0/3382938155 learned_addr learned my addr 172.21.15.6:0/3382938155 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.775+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffad1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008bfff640 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffad0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 -- 172.21.15.6:0/3382938155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 msgr2=0x55d3ffad0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffad0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 -- 172.21.15.6:0/3382938155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 msgr2=0x55d3ffad1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffad1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 -- 172.21.15.6:0/3382938155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ff794930 con 0x55d3ff729350 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.776+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0078013750 tx=0x7f0078005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc1d4bbdde621d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.777+0000 7f00897fa640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 0x7f007c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.777+0000 7f00897fa640 1 -- 172.21.15.6:0/204041679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f00801082c0 con 0x7f00840ab1f0 2024-09-21T08:18:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.780+0000 7f00767fc640 1 -- 172.21.15.6:0/3382938155 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078004020 con 0x55d3ff729350 2024-09-21T08:18:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.780+0000 7f00767fc640 1 -- 172.21.15.6:0/3382938155 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00780041c0 con 0x55d3ff729350 2024-09-21T08:18:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.780+0000 7f00767fc640 1 -- 172.21.15.6:0/3382938155 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078003850 con 0x55d3ff729350 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.781+0000 7f0098c91740 1 -- 172.21.15.6:0/3382938155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 msgr2=0x55d3ffad0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.781+0000 7f0098c91740 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0078013750 tx=0x7f0078005f90 comp rx=0 tx=0).stop 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f0098c91740 1 -- 172.21.15.6:0/3382938155 shutdown_connections 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f0098c91740 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffad0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f0098c91740 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffad1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f0098c91740 1 --2- 172.21.15.6:0/3382938155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffad0610 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f0098c91740 1 -- 172.21.15.6:0/3382938155 >> 172.21.15.6:0/3382938155 conn(0x55d3ff71d740 msgr2=0x55d3fface500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.782+0000 7f008bfff640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 0x7f007c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.784+0000 7f0098c91740 1 -- 172.21.15.6:0/3382938155 shutdown_connections 2024-09-21T08:18:11.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.784+0000 7f0098c91740 1 -- 172.21.15.6:0/3382938155 wait complete. 2024-09-21T08:18:11.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.784+0000 7f0098c91740 1 -- start start 2024-09-21T08:18:11.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.784+0000 7f0098c91740 1 Processor -- start 2024-09-21T08:18:11.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.784+0000 7f008bfff640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 0x7f007c0b8d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f008c066c70 tx=0x7f008c06f040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffadc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffadc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffae8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d3ff897890 con 0x55d3ff729350 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d3ff9d0d40 con 0x55d3ff708670 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d3ffadedf0 con 0x55d3ff700490 2024-09-21T08:18:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.791+0000 7f0098c91740 10 client.0 _ll_register_callbacks cb 0x55d3ffa34c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:11.793 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: pgmap v879: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 8.3 MiB/s wr, 857 op/s 2024-09-21T08:18:11.794 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:18:11.794 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:18:11.794 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:18:11.794 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:18:11.794 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:11 smithi006 ceph-mon[30970]: osdmap e108: 12 total, 12 up, 12 in 2024-09-21T08:18:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.793+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffadc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.793+0000 7f008bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffadc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.793+0000 7f008bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffadc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:46402/0 (socket says 172.21.15.6:46402) 2024-09-21T08:18:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.793+0000 7f008bfff640 1 -- 172.21.15.6:0/2760394811 learned_addr learned my addr 172.21.15.6:0/2760394811 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.793+0000 7f0090cba640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffae8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.796+0000 7f0090cba640 1 -- 172.21.15.6:0/2760394811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 msgr2=0x55d3ffadc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.796+0000 7f0090cba640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffadc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.796+0000 7f0090cba640 1 -- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 msgr2=0x55d3ffadc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.796+0000 7f0090cba640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffadc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.796+0000 7f0090cba640 1 -- 172.21.15.6:0/2760394811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ffae8750 con 0x55d3ff729350 2024-09-21T08:18:11.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.797+0000 7f0090cba640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffae8140 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0080105580 tx=0x7f0080105b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ec1fea96989c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.797+0000 7f006b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.800+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008004a040 con 0x55d3ff729350 2024-09-21T08:18:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.800+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00780041c0 con 0x55d3ff729350 2024-09-21T08:18:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.800+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f00800d7410 con 0x55d3ff729350 2024-09-21T08:18:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.802+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f00800cd790 con 0x55d3ff729350 2024-09-21T08:18:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.802+0000 7f0098c91740 10 client.18066 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.802+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d3ffaeb080 con 0x55d3ff729350 2024-09-21T08:18:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.802+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00780041c0 con 0x55d3ff729350 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.803+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f00800ccee0 con 0x55d3ff729350 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 10 client.18066 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 20 client.18066 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6e7cd0 0x55d3ffaee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 4 client.18066 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.804+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3ffa48db0 con 0x55d3ff6e7cd0 2024-09-21T08:18:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.806+0000 7f008bfff640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6e7cd0 0x55d3ffaee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.809+0000 7f008bfff640 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6e7cd0 0x55d3ffaee7c0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64912eb55d166de server_cookie=fa13157d0d86ffc8 in_seq=0 out_seq=0 2024-09-21T08:18:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.809+0000 7f006b7fe640 10 client.18066 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.813+0000 7f006b7fe640 1 -- 172.21.15.6:0/2760394811 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3ffa48db0 con 0x55d3ff6e7cd0 2024-09-21T08:18:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.813+0000 7f006b7fe640 10 client.18066 handle_command_reply: tid=0 2024-09-21T08:18:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 client.18066 shutdown 2024-09-21T08:18:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 msgr2=0x55d3ffae8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffae8140 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0080105580 tx=0x7f0080105b00 comp rx=0 tx=0).stop 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 shutdown_connections 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6e7cd0 0x55d3ffaee7c0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff729350 0x55d3ffae8140 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffadc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 --2- 172.21.15.6:0/2760394811 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff700490 0x55d3ffadc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.814+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 >> 172.21.15.6:0/2760394811 conn(0x55d3ff71d740 msgr2=0x55d3ffad37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.818+0000 7f006b7fe640 0 client.18066 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:11.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.819+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 shutdown_connections 2024-09-21T08:18:11.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.824+0000 7f0098c91740 1 -- 172.21.15.6:0/2760394811 wait complete. 2024-09-21T08:18:11.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.826+0000 7f0098c91740 20 client.18066 trim_cache size 0 max 16384 2024-09-21T08:18:11.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.869+0000 7f0098c91740 1 Processor -- start 2024-09-21T08:18:11.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.869+0000 7f0098c91740 1 -- start start 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.869+0000 7f0098c91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 0x55d3ffae8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0098c91740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff708670 0x55d3ffad5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0098c91740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffad5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f008bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 0x55d3ffae8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f008bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 0x55d3ffae8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53600/0 (socket says 172.21.15.6:53600) 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f008bfff640 1 -- 172.21.15.6:0/610608818 learned_addr learned my addr 172.21.15.6:0/610608818 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f007000e170 con 0x55d3ff708670 2024-09-21T08:18:11.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0090cba640 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffad5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0070010940 con 0x55d3ff700490 2024-09-21T08:18:11.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f007000e730 con 0x55d3ff729350 2024-09-21T08:18:11.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.870+0000 7f008b7fe640 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff708670 0x55d3ffad5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.876+0000 7f0090cba640 1 -- 172.21.15.6:0/610608818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 msgr2=0x55d3ffae8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.876+0000 7f0090cba640 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 0x55d3ffae8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.876+0000 7f0090cba640 1 -- 172.21.15.6:0/610608818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff708670 msgr2=0x55d3ffad5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.876+0000 7f0090cba640 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff708670 0x55d3ffad5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.876+0000 7f0090cba640 1 -- 172.21.15.6:0/610608818 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ffadc5c0 con 0x55d3ff729350 2024-09-21T08:18:11.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.877+0000 7f0090cba640 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffad5c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f008003cfd0 tx=0x7f00800cd340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba130d2589421ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.878+0000 7f0075ffb640 1 -- 172.21.15.6:0/610608818 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008004a070 con 0x55d3ff729350 2024-09-21T08:18:11.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.879+0000 7f0075ffb640 1 -- 172.21.15.6:0/610608818 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00800d76a0 con 0x55d3ff729350 2024-09-21T08:18:11.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.879+0000 7f0075ffb640 1 -- 172.21.15.6:0/610608818 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00800f12f0 con 0x55d3ff729350 2024-09-21T08:18:11.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.880+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 msgr2=0x55d3ffad5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.880+0000 7f0098c91740 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffad5c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f008003cfd0 tx=0x7f00800cd340 comp rx=0 tx=0).stop 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 shutdown_connections 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffad5c60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff708670 0x55d3ffad5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 --2- 172.21.15.6:0/610608818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff700490 0x55d3ffae8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 >> 172.21.15.6:0/610608818 conn(0x55d3ff71d740 msgr2=0x55d3ffada8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 shutdown_connections 2024-09-21T08:18:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.882+0000 7f0098c91740 1 -- 172.21.15.6:0/610608818 wait complete. 2024-09-21T08:18:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.883+0000 7f0098c91740 1 -- start start 2024-09-21T08:18:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.883+0000 7f0098c91740 1 Processor -- start 2024-09-21T08:18:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.884+0000 7f0098c91740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.884+0000 7f0098c91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffae11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.884+0000 7f0098c91740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffb522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.884+0000 7f0098c91740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f007000ee00 con 0x55d3ff700490 2024-09-21T08:18:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.884+0000 7f0098c91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0070010270 con 0x55d3ff708670 2024-09-21T08:18:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.885+0000 7f0098c91740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f007000f4d0 con 0x55d3ff729350 2024-09-21T08:18:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.885+0000 7f0098c91740 10 client.0 _ll_register_callbacks cb 0x7f0080005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.885+0000 7f008bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.885+0000 7f008bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46052/0 (socket says 172.21.15.6:46052) 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.885+0000 7f008bfff640 1 -- 172.21.15.6:0/3817576642 learned_addr learned my addr 172.21.15.6:0/3817576642 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffae11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f0090cba640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffb522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 -- 172.21.15.6:0/3817576642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 msgr2=0x55d3ffb522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffb522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 -- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 msgr2=0x55d3ffae11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffae11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 -- 172.21.15.6:0/3817576642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ffb52950 con 0x55d3ff700490 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.886+0000 7f008bfff640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f008c068d40 tx=0x7f008c051ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fad80e5f134296 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.888+0000 7f006b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.888+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c07aa00 con 0x55d3ff700490 2024-09-21T08:18:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.888+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f008c07aba0 con 0x55d3ff700490 2024-09-21T08:18:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.888+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00800d76a0 con 0x55d3ff700490 2024-09-21T08:18:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.889+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f008c07ada0 con 0x55d3ff700490 2024-09-21T08:18:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.894+0000 7f0098c91740 10 client.18072 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.894+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d3ffb59e10 con 0x55d3ff700490 2024-09-21T08:18:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00800d76a0 con 0x55d3ff700490 2024-09-21T08:18:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f008c08e520 con 0x55d3ff700490 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 10 client.18072 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 10 client.18072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 20 client.18072 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6bd080 0x55d3ffb5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 4 client.18072 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:18:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.895+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3ffa44860 con 0x55d3ff6bd080 2024-09-21T08:18:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.896+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6bd080 0x55d3ffb5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.897+0000 7f006b7fe640 10 client.18072 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.897+0000 7f008b7fe640 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6bd080 0x55d3ffb5c580 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7f5862c50b9e2c server_cookie=19df92bb62b6b8e4 in_seq=0 out_seq=0 2024-09-21T08:18:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.902+0000 7f006b7fe640 1 -- 172.21.15.6:0/3817576642 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3ffa44860 con 0x55d3ff6bd080 2024-09-21T08:18:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.902+0000 7f006b7fe640 10 client.18072 handle_command_reply: tid=0 2024-09-21T08:18:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.902+0000 7f0098c91740 1 client.18072 shutdown 2024-09-21T08:18:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.902+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 msgr2=0x55d3ffae0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.902+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f008c068d40 tx=0x7f008c051ed0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 shutdown_connections 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55d3ff6bd080 0x55d3ffb5c580 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3ff729350 0x55d3ffb522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3ff708670 0x55d3ffae11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f006b7fe640 0 client.18072 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 --2- 172.21.15.6:0/3817576642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d3ff700490 0x55d3ffae0bc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 >> 172.21.15.6:0/3817576642 conn(0x55d3ff71d740 msgr2=0x55d3ffad5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 shutdown_connections 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.904+0000 7f0098c91740 1 -- 172.21.15.6:0/3817576642 wait complete. 2024-09-21T08:18:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.905+0000 7f0098c91740 20 client.18072 trim_cache size 0 max 16384 2024-09-21T08:18:11.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: pgmap v879: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 8.3 MiB/s wr, 857 op/s 2024-09-21T08:18:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:18:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:18:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:18:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:18:11.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:11 smithi119 ceph-mon[33564]: osdmap e108: 12 total, 12 up, 12 in 2024-09-21T08:18:11.909 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2024-09-21T08:18:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "4f814aa6-a69e-45b6-bb83-da170b44b5a5", 2024-09-21T08:18:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2024-09-21T08:18:11.909 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 msgr2=0x7f007c0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 0x7f007c0b8d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f008c066c70 tx=0x7f008c06f040 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 msgr2=0x7f00840b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f008002a9b0 tx=0x7f0080003f60 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 shutdown_connections 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f007c0b6880 0x7f007c0b8d90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00840aa8a0 0x7f00840b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840ab1f0 0x7f00840b4750 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 --2- 172.21.15.6:0/204041679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00840a5130 0x7f00840baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 >> 172.21.15.6:0/204041679 conn(0x7f008401ccb0 msgr2=0x7f00840a3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 shutdown_connections 2024-09-21T08:18:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:11.908+0000 7f009271d640 1 -- 172.21.15.6:0/204041679 wait complete. 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: pgmap v879: 129 pgs: 129 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 8.3 MiB/s wr, 857 op/s 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi119 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi006 to 177.0M 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi006 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T08:18:11.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:11 smithi145 ceph-mon[34049]: osdmap e108: 12 total, 12 up, 12 in 2024-09-21T08:18:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.713+0000 7fb650391640 1 -- 172.21.15.6:0/2011281113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb648102a60 msgr2=0x7fb648102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.713+0000 7fb650391640 1 --2- 172.21.15.6:0/2011281113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb648102a60 0x7fb648102e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb644009900 tx=0x7fb64402a410 comp rx=0 tx=0).stop 2024-09-21T08:18:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.714+0000 7fb650391640 1 -- 172.21.15.6:0/2011281113 shutdown_connections 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.714+0000 7fb650391640 1 --2- 172.21.15.6:0/2011281113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648108cf0 0x7fb64810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.714+0000 7fb650391640 1 --2- 172.21.15.6:0/2011281113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6481083a0 0x7fb6481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.714+0000 7fb650391640 1 --2- 172.21.15.6:0/2011281113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb648102a60 0x7fb648102e70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.714+0000 7fb650391640 1 -- 172.21.15.6:0/2011281113 >> 172.21.15.6:0/2011281113 conn(0x7fb648079730 msgr2=0x7fb648079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.715+0000 7fb650391640 1 -- 172.21.15.6:0/2011281113 shutdown_connections 2024-09-21T08:18:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.715+0000 7fb650391640 1 -- 172.21.15.6:0/2011281113 wait complete. 2024-09-21T08:18:12.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 Processor -- start 2024-09-21T08:18:12.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 -- start start 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648102a60 0x7fb64819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 0x7fb64819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb64806bab0 con 0x7fb648108cf0 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb64806b930 con 0x7fb6481083a0 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.716+0000 7fb650391640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb64806bc30 con 0x7fb648102a60 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64e92e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 0x7fb64819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64e12d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648102a60 0x7fb64819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53628/0 (socket says 172.21.15.6:53628) 2024-09-21T08:18:12.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 -- 172.21.15.6:0/76621198 learned_addr learned my addr 172.21.15.6:0/76621198 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:12.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 -- 172.21.15.6:0/76621198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648102a60 msgr2=0x7fb64819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648102a60 0x7fb64819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 -- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 msgr2=0x7fb64819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 0x7fb64819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 -- 172.21.15.6:0/76621198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6481a02b0 con 0x7fb6481083a0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64e92e640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 0x7fb64819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.717+0000 7fb64d92c640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e9c0 tx=0x7fb63800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.718+0000 7fb63f7fe640 1 -- 172.21.15.6:0/76621198 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63800cd80 con 0x7fb6481083a0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.718+0000 7fb63f7fe640 1 -- 172.21.15.6:0/76621198 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6380054b0 con 0x7fb6481083a0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.718+0000 7fb63f7fe640 1 -- 172.21.15.6:0/76621198 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638010430 con 0x7fb6481083a0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.718+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481a05a0 con 0x7fb6481083a0 2024-09-21T08:18:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.718+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6481a6d00 con 0x7fb6481083a0 2024-09-21T08:18:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.720+0000 7fb656905740 1 Processor -- start 2024-09-21T08:18:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.720+0000 7fb656905740 1 -- start start 2024-09-21T08:18:12.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.720+0000 7fb63f7fe640 1 -- 172.21.15.6:0/76621198 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb6380105d0 con 0x7fb6481083a0 2024-09-21T08:18:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf29850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb615f0 0x55607bf29d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55607be9fdd0 con 0x55607bb822d0 2024-09-21T08:18:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55607be8f200 con 0x55607bb59410 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb656905740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55607be93010 con 0x55607bb615f0 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e92e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e92e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46086/0 (socket says 172.21.15.6:46086) 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e92e640 1 -- 172.21.15.6:0/435892457 learned_addr learned my addr 172.21.15.6:0/435892457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf29850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64d92c640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb615f0 0x55607bf29d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 -- 172.21.15.6:0/435892457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb615f0 msgr2=0x55607bf29d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb615f0 0x55607bf29d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 -- 172.21.15.6:0/435892457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 msgr2=0x55607bf29310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e12d640 1 -- 172.21.15.6:0/435892457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607bbed8b0 con 0x55607bb59410 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.721+0000 7fb64e92e640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb63f7fe640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 0x7fb6340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb64e12d640 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf29850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb644006010 tx=0x7fb644004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd26b8a01dd204b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb64e92e640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 0x7fb6340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb63f7fe640 1 -- 172.21.15.6:0/76621198 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7fb6380e80c0 con 0x7fb6481083a0 2024-09-21T08:18:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb63cd9a640 1 -- 172.21.15.6:0/435892457 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644041030 con 0x55607bb59410 2024-09-21T08:18:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb63cd9a640 1 -- 172.21.15.6:0/435892457 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb644031cc0 con 0x55607bb59410 2024-09-21T08:18:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.722+0000 7fb63cd9a640 1 -- 172.21.15.6:0/435892457 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644036040 con 0x55607bb59410 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- 172.21.15.6:0/435892457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 msgr2=0x55607bf29850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb64e92e640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 0x7fb6340b8c10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6400098b0 tx=0x7fb640009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf29850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb644006010 tx=0x7fb644004520 comp rx=0 tx=0).stop 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- 172.21.15.6:0/435892457 shutdown_connections 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb615f0 0x55607bf29d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf29850 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 --2- 172.21.15.6:0/435892457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb822d0 0x55607bf29310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- 172.21.15.6:0/435892457 >> 172.21.15.6:0/435892457 conn(0x55607bb766c0 msgr2=0x55607bf27200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- 172.21.15.6:0/435892457 shutdown_connections 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- 172.21.15.6:0/435892457 wait complete. 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.723+0000 7fb656905740 1 -- start start 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 Processor -- start 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 0x55607bf35460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf40d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55607bcf0810 con 0x55607bb59410 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55607be2a080 con 0x55607bb615f0 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55607bf37a90 con 0x55607bb822d0 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb64e12d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 0x55607bf35460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb64e12d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46102/0 (socket says 172.21.15.6:46102) 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb64e12d640 1 -- 172.21.15.6:0/1413611925 learned_addr learned my addr 172.21.15.6:0/1413611925 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb656905740 10 client.0 _ll_register_callbacks cb 0x55607be3a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.724+0000 7fb64e92e640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf40d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 -- 172.21.15.6:0/1413611925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 msgr2=0x55607bf40d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf40d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 -- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 msgr2=0x55607bf35460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 0x55607bf35460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 -- 172.21.15.6:0/1413611925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607be34460 con 0x55607bb59410 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 0x55607bf35460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e92e640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf40d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb64e12d640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb644005ab0 tx=0x7fb644032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a1f2f920270569 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644036050 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7fb644031640 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb644031cc0 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb64405b050 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb656905740 10 client.18084 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.725+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55607bf43aa0 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb644031cc0 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb64403d690 con 0x55607bb59410 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 10 client.18084 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 10 client.18084 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 20 client.18084 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb40c50 0x55607bf47010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 4 client.18084 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55607bea1d20 con 0x55607bb40c50 2024-09-21T08:18:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb40c50 0x55607bf47010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.726+0000 7fb631ffb640 10 client.18084 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.727+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb40c50 0x55607bf47010 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3a95c2d793ccae server_cookie=dd0a7ff6448793fa in_seq=0 out_seq=0 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb631ffb640 1 -- 172.21.15.6:0/1413611925 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55607bea1d20 con 0x55607bb40c50 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb631ffb640 10 client.18084 handle_command_reply: tid=0 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 client.18084 shutdown 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 msgr2=0x55607bf34f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb644005ab0 tx=0x7fb644032f50 comp rx=0 tx=0).stop 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 shutdown_connections 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb40c50 0x55607bf47010 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf40d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb615f0 0x55607bf35460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 --2- 172.21.15.6:0/1413611925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb59410 0x55607bf34f20 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 >> 172.21.15.6:0/1413611925 conn(0x55607bb766c0 msgr2=0x55607bf2c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb631ffb640 0 client.18084 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 shutdown_connections 2024-09-21T08:18:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.728+0000 7fb656905740 1 -- 172.21.15.6:0/1413611925 wait complete. 2024-09-21T08:18:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.729+0000 7fb656905740 20 client.18084 trim_cache size 0 max 16384 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.746+0000 7fb656905740 1 Processor -- start 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.746+0000 7fb656905740 1 -- start start 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.746+0000 7fb656905740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb59410 0x55607bf36950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb656905740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb656905740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb822d0 0x55607bf40c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb656905740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481acd40 con 0x55607bb615f0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb656905740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481af5a0 con 0x55607bb822d0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb656905740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481ad390 con 0x55607bb59410 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46114/0 (socket says 172.21.15.6:46114) 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 -- 172.21.15.6:0/1057233956 learned_addr learned my addr 172.21.15.6:0/1057233956 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64e92e640 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb822d0 0x55607bf40c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64e12d640 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb59410 0x55607bf36950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 -- 172.21.15.6:0/1057233956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb59410 msgr2=0x55607bf36950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb59410 0x55607bf36950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 -- 172.21.15.6:0/1057233956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb822d0 msgr2=0x55607bf40c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb822d0 0x55607bf40c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 -- 172.21.15.6:0/1057233956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607bf35c70 con 0x55607bb615f0 2024-09-21T08:18:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb64d92c640 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb638000c00 tx=0x7fb6380ebc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae4a57ea6c8e57c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.747+0000 7fb633fff640 1 -- 172.21.15.6:0/1057233956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380aa130 con 0x55607bb615f0 2024-09-21T08:18:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.748+0000 7fb633fff640 1 -- 172.21.15.6:0/1057233956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6380ad5f0 con 0x55607bb615f0 2024-09-21T08:18:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.748+0000 7fb633fff640 1 -- 172.21.15.6:0/1057233956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380a9250 con 0x55607bb615f0 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- 172.21.15.6:0/1057233956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 msgr2=0x55607bf36e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb638000c00 tx=0x7fb6380ebc10 comp rx=0 tx=0).stop 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- 172.21.15.6:0/1057233956 shutdown_connections 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb822d0 0x55607bf40c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf36e90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- 172.21.15.6:0/1057233956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb59410 0x55607bf36950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- 172.21.15.6:0/1057233956 >> 172.21.15.6:0/1057233956 conn(0x55607bb766c0 msgr2=0x55607bf36240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- 172.21.15.6:0/1057233956 shutdown_connections 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- 172.21.15.6:0/1057233956 wait complete. 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 -- start start 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 Processor -- start 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.749+0000 7fb656905740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf39130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb656905740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481ada60 con 0x55607bb615f0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb656905740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481aeed0 con 0x55607bb59410 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb656905740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481ae130 con 0x55607bb822d0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb656905740 10 client.0 _ll_register_callbacks cb 0x7fb644009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64e12d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46120/0 (socket says 172.21.15.6:46120) 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64e12d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.6:53646/0 (socket says 172.21.15.6:53646) 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 -- 172.21.15.6:0/3633743373 learned_addr learned my addr 172.21.15.6:0/3633743373 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64e92e640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf39130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 -- 172.21.15.6:0/3633743373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 msgr2=0x55607bf39130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf39130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 -- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 msgr2=0x55607bf3d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 -- 172.21.15.6:0/3633743373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607bf2c170 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64e12d640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb64d92c640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb638009250 tx=0x7fb6380056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277dc1a0c4731b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380ad250 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.750+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7fb6380a9d50 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6380ad5f0 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6380ad430 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 10 client.18090 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55607bf21490 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6380ad5f0 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb6380ea110 con 0x55607bb615f0 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 10 client.18090 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 10 client.18090 resolve_mds: validated gid 24713 aka daemon mds.b 2024-09-21T08:18:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 20 client.18090 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb16000 0x55607bfb3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 4 client.18090 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T08:18:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.751+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55607be9d7d0 con 0x55607bb16000 2024-09-21T08:18:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.752+0000 7fb64e12d640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb16000 0x55607bfb3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.752+0000 7fb631ffb640 10 client.18090 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.752+0000 7fb64e12d640 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb16000 0x55607bfb3dd0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556b2d010903e381 server_cookie=1fb105ac3f134b86 in_seq=0 out_seq=0 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb631ffb640 1 -- 172.21.15.6:0/3633743373 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55607be9d7d0 con 0x55607bb16000 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb631ffb640 10 client.18090 handle_command_reply: tid=0 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 client.18090 shutdown 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 msgr2=0x55607bf38ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb638009250 tx=0x7fb6380056f0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 shutdown_connections 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55607bb16000 0x55607bfb3dd0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55607bb822d0 0x55607bf39130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55607bb615f0 0x55607bf38ae0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 --2- 172.21.15.6:0/3633743373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55607bb59410 0x55607bf3d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb631ffb640 0 client.18090 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 >> 172.21.15.6:0/3633743373 conn(0x55607bb766c0 msgr2=0x55607bf33f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 shutdown_connections 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 1 -- 172.21.15.6:0/3633743373 wait complete. 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.753+0000 7fb656905740 20 client.18090 trim_cache size 0 max 16384 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 21, 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "leader": 24713, 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "set_version": 64, 2024-09-21T08:18:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "sets": {} 2024-09-21T08:18:12.759 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 msgr2=0x7fb6340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 0x7fb6340b8c10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6400098b0 tx=0x7fb640009600 comp rx=0 tx=0).stop 2024-09-21T08:18:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 msgr2=0x7fb64819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e9c0 tx=0x7fb63800ee80 comp rx=0 tx=0).stop 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 shutdown_connections 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6340b6700 0x7fb6340b8c10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb648108cf0 0x7fb64819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6481083a0 0x7fb64819a8e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 --2- 172.21.15.6:0/76621198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb648102a60 0x7fb64819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 >> 172.21.15.6:0/76621198 conn(0x7fb648079730 msgr2=0x7fb6481014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 shutdown_connections 2024-09-21T08:18:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:12.754+0000 7fb650391640 1 -- 172.21.15.6:0/76621198 wait complete. 2024-09-21T08:18:12.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:12 smithi119 ceph-mon[33564]: scrub queued for path: / 2024-09-21T08:18:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:12 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:12.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:12 smithi119 ceph-mon[33564]: scrub summary: active paths [/] 2024-09-21T08:18:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:12 smithi145 ceph-mon[34049]: scrub queued for path: / 2024-09-21T08:18:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:12 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:12.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:12 smithi145 ceph-mon[34049]: scrub summary: active paths [/] 2024-09-21T08:18:12.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:12 smithi006 ceph-mon[30970]: scrub queued for path: / 2024-09-21T08:18:12.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:12 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:12.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:12 smithi006 ceph-mon[30970]: scrub summary: active paths [/] 2024-09-21T08:18:13.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:13 smithi119 ceph-mon[33564]: pgmap v881: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 8.2 MiB/s wr, 832 op/s 2024-09-21T08:18:13.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:13 smithi006 ceph-mon[30970]: pgmap v881: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 8.2 MiB/s wr, 832 op/s 2024-09-21T08:18:13.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:13 smithi145 ceph-mon[34049]: pgmap v881: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 8.2 MiB/s wr, 832 op/s 2024-09-21T08:18:14.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:18:15.144 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T08:18:15.144 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T08:18:15.159 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T08:18:15.159 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T08:18:15.159 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:18:15.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T08:18:15.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T08:18:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:15.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T08:18:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 -- 172.21.15.6:0/2667531372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2060108c30 msgr2=0x7f206010f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 --2- 172.21.15.6:0/2667531372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2060108c30 0x7f206010f460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2058009ca0 tx=0x7f205802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 -- 172.21.15.6:0/2667531372 shutdown_connections 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 --2- 172.21.15.6:0/2667531372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 0x7f20601086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 --2- 172.21.15.6:0/2667531372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2060108c30 0x7f206010f460 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 --2- 172.21.15.6:0/2667531372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20601029b0 0x7f2060102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 -- 172.21.15.6:0/2667531372 >> 172.21.15.6:0/2667531372 conn(0x7f206007a740 msgr2=0x7f206007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 -- 172.21.15.6:0/2667531372 shutdown_connections 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.608+0000 7f2067ded640 1 -- 172.21.15.6:0/2667531372 wait complete. 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 Processor -- start 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 -- start start 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 0x7f206019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2060108c30 0x7f206019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20601127f0 con 0x7f20601029b0 2024-09-21T08:18:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2060112670 con 0x7f2060108c30 2024-09-21T08:18:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2067ded640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2060112970 con 0x7f20601082e0 2024-09-21T08:18:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2065b89640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2065b89640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46132/0 (socket says 172.21.15.6:46132) 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2065b89640 1 -- 172.21.15.6:0/1156641291 learned_addr learned my addr 172.21.15.6:0/1156641291 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f206638a640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2060108c30 0x7f206019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.609+0000 7f2065388640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 0x7f206019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 -- 172.21.15.6:0/1156641291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 msgr2=0x7f206019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 0x7f206019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 -- 172.21.15.6:0/1156641291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2060108c30 msgr2=0x7f206019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2060108c30 0x7f206019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 -- 172.21.15.6:0/1156641291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20601a0290 con 0x7f20601029b0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.610+0000 7f2065b89640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e9f0 tx=0x7f205c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.615+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00cd80 con 0x7f20601029b0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.615+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f205c0108c0 con 0x7f20601029b0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.615+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c0187c0 con 0x7f20601029b0 2024-09-21T08:18:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.615+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20601a0580 con 0x7f20601029b0 2024-09-21T08:18:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.615+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20601a6d10 con 0x7f20601029b0 2024-09-21T08:18:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.616+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2060102dc0 con 0x7f20601029b0 2024-09-21T08:18:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.617+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f205c010430 con 0x7f20601029b0 2024-09-21T08:18:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.618+0000 7f2052ffd640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 0x7f204c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.618+0000 7f2065388640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 0x7f204c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.618+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f205c0e7e40 con 0x7f20601029b0 2024-09-21T08:18:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.619+0000 7f2065388640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 0x7f204c0b8c10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f206007b170 tx=0x7f205400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.623+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f205c0b2340 con 0x7f20601029b0 2024-09-21T08:18:15.710 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:15 smithi006 ceph-mon[30970]: pgmap v882: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.5 MiB/s wr, 568 op/s 2024-09-21T08:18:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 -- 172.21.15.6:0/2725048514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83981083a0 msgr2=0x7f83981087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 --2- 172.21.15.6:0/2725048514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83981083a0 0x7f83981087b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8388009900 tx=0x7f838802a410 comp rx=0 tx=0).stop 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 -- 172.21.15.6:0/2725048514 shutdown_connections 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 --2- 172.21.15.6:0/2725048514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8398108cf0 0x7f839810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 --2- 172.21.15.6:0/2725048514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83981083a0 0x7f83981087b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 --2- 172.21.15.6:0/2725048514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 0x7f8398102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 -- 172.21.15.6:0/2725048514 >> 172.21.15.6:0/2725048514 conn(0x7f8398079730 msgr2=0x7f8398079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 -- 172.21.15.6:0/2725048514 shutdown_connections 2024-09-21T08:18:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.836+0000 7f839f642640 1 -- 172.21.15.6:0/2725048514 wait complete. 2024-09-21T08:18:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 Processor -- start 2024-09-21T08:18:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 -- start start 2024-09-21T08:18:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2060063800 con 0x7f204c0b6700 2024-09-21T08:18:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 0x7f839819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83981083a0 0x7f839819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8398112810 con 0x7f8398108cf0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8398112690 con 0x7f83981083a0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839f642640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8398112990 con 0x7f8398102a60 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839dbdf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839dbdf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46152/0 (socket says 172.21.15.6:46152) 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839dbdf640 1 -- 172.21.15.6:0/2948975954 learned_addr learned my addr 172.21.15.6:0/2948975954 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83981083a0 0x7f839819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.837+0000 7f839d3de640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 0x7f839819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 -- 172.21.15.6:0/2948975954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 msgr2=0x7f839819b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 0x7f839819b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 -- 172.21.15.6:0/2948975954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83981083a0 msgr2=0x7f839819b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83981083a0 0x7f839819b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 -- 172.21.15.6:0/2948975954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83981a6460 con 0x7f8398108cf0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839dbdf640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f839000cce0 tx=0x7f839000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f838e7fc640 1 -- 172.21.15.6:0/2948975954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839000f450 con 0x7f8398108cf0 2024-09-21T08:18:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f838e7fc640 1 -- 172.21.15.6:0/2948975954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f839000fa80 con 0x7f8398108cf0 2024-09-21T08:18:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981a6750 con 0x7f8398108cf0 2024-09-21T08:18:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f838e7fc640 1 -- 172.21.15.6:0/2948975954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390018ad0 con 0x7f8398108cf0 2024-09-21T08:18:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.838+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83981a6c10 con 0x7f8398108cf0 2024-09-21T08:18:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.841+0000 7f83a5bb6740 1 Processor -- start 2024-09-21T08:18:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f838e7fc640 1 -- 172.21.15.6:0/2948975954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f839000f5f0 con 0x7f8398108cf0 2024-09-21T08:18:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 -- start start 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb5321270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb5321cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ceb5297e50 con 0x55ceb4f511b0 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ceb5287280 con 0x55ceb4f7a070 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ceb528b090 con 0x55ceb4f59390 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f839d3de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f839d3de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46164/0 (socket says 172.21.15.6:46164) 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f839d3de640 1 -- 172.21.15.6:0/640833680 learned_addr learned my addr 172.21.15.6:0/640833680 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f839cbdd640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb5321270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.842+0000 7f839cbdd640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb5321cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 -- 172.21.15.6:0/640833680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 msgr2=0x55ceb5321cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb5321cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 -- 172.21.15.6:0/640833680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 msgr2=0x55ceb5321270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb5321270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f838e7fc640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 0x7f83840b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 -- 172.21.15.6:0/640833680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb4fe5650 con 0x55ceb4f511b0 2024-09-21T08:18:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839cbdd640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb5321cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 0x7f83840b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f838e7fc640 1 -- 172.21.15.6:0/2948975954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f83900e8170 con 0x7f8398108cf0 2024-09-21T08:18:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f839d3de640 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f839400bcb0 tx=0x7f83940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3245f6e855c7a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f83837fe640 1 -- 172.21.15.6:0/640833680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839401c480 con 0x55ceb4f511b0 2024-09-21T08:18:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f83837fe640 1 -- 172.21.15.6:0/640833680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f839401cab0 con 0x55ceb4f511b0 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.843+0000 7f83837fe640 1 -- 172.21.15.6:0/640833680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394011bb0 con 0x55ceb4f511b0 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 -- 172.21.15.6:0/640833680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 msgr2=0x55ceb53217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 0x7f83840b8c40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8388004770 tx=0x7f8388005fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f839400bcb0 tx=0x7f83940107a0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 -- 172.21.15.6:0/640833680 shutdown_connections 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb5321cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53217b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/640833680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb5321270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 -- 172.21.15.6:0/640833680 >> 172.21.15.6:0/640833680 conn(0x55ceb4f6e460 msgr2=0x55ceb531f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.844+0000 7f83a5bb6740 1 -- 172.21.15.6:0/640833680 shutdown_connections 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 -- 172.21.15.6:0/640833680 wait complete. 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 -- start start 2024-09-21T08:18:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 Processor -- start 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb532ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.845+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb532d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ceb50e8700 con 0x55ceb4f59390 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ceb5222110 con 0x55ceb4f7a070 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ceb532fa50 con 0x55ceb4f511b0 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f83a5bb6740 10 client.0 _ll_register_callbacks cb 0x55ceb523b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839dbdf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb532d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.6:46504/0 (socket says 172.21.15.6:46504) 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 -- 172.21.15.6:0/3208820540 learned_addr learned my addr 172.21.15.6:0/3208820540 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 -- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 msgr2=0x55ceb532d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb532d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 -- 172.21.15.6:0/3208820540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 msgr2=0x55ceb532ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb532ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 -- 172.21.15.6:0/3208820540 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb524fc40 con 0x55ceb4f511b0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f839d3de640 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8394005940 tx=0x7f839400bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d93ce283738633d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.846+0000 7f8380ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839402b060 con 0x55ceb4f511b0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839401cab0 con 0x55ceb4f511b0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f839401c480 con 0x55ceb4f511b0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8394032050 con 0x55ceb4f511b0 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f83a5bb6740 10 client.27784 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ceb533b6f0 con 0x55ceb4f511b0 2024-09-21T08:18:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8394011da0 con 0x55ceb4f511b0 2024-09-21T08:18:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f2052ffd640 1 -- 172.21.15.6:0/1156641291 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f2060063800 con 0x7f204c0b6700 2024-09-21T08:18:15.851 INFO:teuthology.orchestra.run.smithi006.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T08:01:07", "first": "2024-09-21T08:02:00", "last": "2024-09-21T08:18:02", "last_pruned": "2024-09-21T08:18:04", "created_count": 17, "pruned_count": 11, "active": true} 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8394005080 con 0x55ceb4f511b0 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f83a5bb6740 10 client.27784 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.847+0000 7f83a5bb6740 10 client.27784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f83a5bb6740 20 client.27784 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f389f0 0x55ceb533eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f83a5bb6740 4 client.27784 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f839401cab0 con 0x55ceb4f389f0 2024-09-21T08:18:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f839cbdd640 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f389f0 0x55ceb533eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f839cbdd640 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f389f0 0x55ceb533eb40 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300e20339e905dfa server_cookie=137b49c7b8650173 in_seq=0 out_seq=0 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.848+0000 7f8380ff9640 10 client.27784 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f8380ff9640 1 -- 172.21.15.6:0/3208820540 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f839401cab0 con 0x55ceb4f389f0 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f8380ff9640 10 client.27784 handle_command_reply: tid=0 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 client.27784 shutdown 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 msgr2=0x55ceb532c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8394005940 tx=0x7f839400bfd0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 shutdown_connections 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f389f0 0x55ceb533eb40 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb532d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb532ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/3208820540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f511b0 0x55ceb532c8d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 >> 172.21.15.6:0/3208820540 conn(0x55ceb4f6e460 msgr2=0x55ceb5324420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.849+0000 7f8380ff9640 0 client.27784 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 shutdown_connections 2024-09-21T08:18:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f83a5bb6740 1 -- 172.21.15.6:0/3208820540 wait complete. 2024-09-21T08:18:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f83a5bb6740 20 client.27784 trim_cache size 0 max 16384 2024-09-21T08:18:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 msgr2=0x7f204c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 0x7f204c0b8c10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f206007b170 tx=0x7f205400b390 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 msgr2=0x7f206019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e9f0 tx=0x7f205c00eeb0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 shutdown_connections 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f204c0b6700 0x7f204c0b8c10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20601082e0 0x7f206019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2060108c30 0x7f206019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 --2- 172.21.15.6:0/1156641291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20601029b0 0x7f206019a360 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 >> 172.21.15.6:0/1156641291 conn(0x7f206007a740 msgr2=0x7f20601019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 shutdown_connections 2024-09-21T08:18:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.850+0000 7f2067ded640 1 -- 172.21.15.6:0/1156641291 wait complete. 2024-09-21T08:18:15.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T08:18:15.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.869+0000 7f83a5bb6740 1 Processor -- start 2024-09-21T08:18:15.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.869+0000 7f83a5bb6740 1 -- start start 2024-09-21T08:18:15.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 0x55ceb532cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 0x55ceb53355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83981aef70 con 0x55ceb4f59390 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b17d0 con 0x55ceb4f511b0 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83981af5c0 con 0x55ceb4f7a070 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46182/0 (socket says 172.21.15.6:46182) 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 -- 172.21.15.6:0/2263486846 learned_addr learned my addr 172.21.15.6:0/2263486846 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839dbdf640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 0x55ceb53355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839d3de640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 0x55ceb532cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 -- 172.21.15.6:0/2263486846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 msgr2=0x55ceb53355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 0x55ceb53355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 -- 172.21.15.6:0/2263486846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 msgr2=0x55ceb532cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 0x55ceb532cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839cbdd640 1 -- 172.21.15.6:0/2263486846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb532b830 con 0x55ceb4f59390 2024-09-21T08:18:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839dbdf640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 0x55ceb53355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.870+0000 7f839d3de640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 0x55ceb532cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.871+0000 7f839cbdd640 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f8388000c00 tx=0x7f83880058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbbc73e833d99e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.871+0000 7f8382ffd640 1 -- 172.21.15.6:0/2263486846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035040 con 0x55ceb4f59390 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.871+0000 7f8382ffd640 1 -- 172.21.15.6:0/2263486846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8388057070 con 0x55ceb4f59390 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.871+0000 7f8382ffd640 1 -- 172.21.15.6:0/2263486846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838803d6c0 con 0x55ceb4f59390 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 -- 172.21.15.6:0/2263486846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 msgr2=0x55ceb5335080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f8388000c00 tx=0x7f83880058d0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 -- 172.21.15.6:0/2263486846 shutdown_connections 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f7a070 0x55ceb53355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f59390 0x55ceb5335080 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/2263486846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f511b0 0x55ceb532cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 -- 172.21.15.6:0/2263486846 >> 172.21.15.6:0/2263486846 conn(0x55ceb4f6e460 msgr2=0x55ceb532c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 -- 172.21.15.6:0/2263486846 shutdown_connections 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.872+0000 7f83a5bb6740 1 -- 172.21.15.6:0/2263486846 wait complete. 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 -- start start 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 Processor -- start 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb53a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb53ac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83981afc90 con 0x55ceb4f511b0 2024-09-21T08:18:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b1100 con 0x55ceb4f7a070 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b0360 con 0x55ceb4f59390 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f839d3de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f83a5bb6740 10 client.0 _ll_register_callbacks cb 0x7f8388032a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f839cbdd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb53a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f839d3de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46196/0 (socket says 172.21.15.6:46196) 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f839d3de640 1 -- 172.21.15.6:0/1869804461 learned_addr learned my addr 172.21.15.6:0/1869804461 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.873+0000 7f839dbdf640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb53ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 -- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 msgr2=0x55ceb53ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb53ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 -- 172.21.15.6:0/1869804461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 msgr2=0x55ceb53a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 -- 172.21.15.6:0/1869804461 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb53a22d0 con 0x55ceb4f59390 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839d3de640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f839cbdd640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb53a1a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd4a74d7d17c259 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f8380ff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:18:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035040 con 0x55ceb4f59390 2024-09-21T08:18:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7f83880043d0 con 0x55ceb4f59390 2024-09-21T08:18:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8388057070 con 0x55ceb4f59390 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f838806b050 con 0x55ceb4f59390 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f83a5bb6740 10 client.27790 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.874+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ceb53adb10 con 0x55ceb4f59390 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8388057070 con 0x55ceb4f59390 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8388047070 con 0x55ceb4f59390 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 10 client.27790 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 10 client.27790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 20 client.27790 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f0dda0 0x55ceb53b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 4 client.27790 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.875+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ceb5299da0 con 0x55ceb4f0dda0 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f839d3de640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f0dda0 0x55ceb53b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f839d3de640 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f0dda0 0x55ceb53b0190 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3d2b5480de99d2 server_cookie=b21b5b9e7bcd5b33 in_seq=0 out_seq=0 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f8380ff9640 10 client.27790 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f8380ff9640 1 -- 172.21.15.6:0/1869804461 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8806 (crc 0 0 0) 0x55ceb5299da0 con 0x55ceb4f0dda0 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f8380ff9640 10 client.27790 handle_command_reply: tid=0 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f83a5bb6740 1 client.27790 shutdown 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 msgr2=0x55ceb53a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.876+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb53a1a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388003f60 comp rx=0 tx=0).stop 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 shutdown_connections 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55ceb4f0dda0 0x55ceb53b0190 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ceb4f59390 0x55ceb53a1a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ceb4f7a070 0x55ceb53ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 --2- 172.21.15.6:0/1869804461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ceb4f511b0 0x55ceb53a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 >> 172.21.15.6:0/1869804461 conn(0x55ceb4f6e460 msgr2=0x55ceb5329cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f8380ff9640 0 client.27790 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 shutdown_connections 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 1 -- 172.21.15.6:0/1869804461 wait complete. 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f83a5bb6740 20 client.27790 trim_cache size 0 max 16384 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2024-09-21T08:18:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "4f814aa6-a69e-45b6-bb83-da170b44b5a5": { 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "4f814aa6-a69e-45b6-bb83-da170b44b5a5", 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:18:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:18:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "4f814aa6-a69e-45b6-bb83-da170b44b5a5": { 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:18:11.897155+0000", 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:18:15.895 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:18:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "d05c27c0-e763-4500-88c9-e4785471a320": { 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:17:25.306236+0000", 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:15.900 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 msgr2=0x7f83840b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 0x7f83840b8c40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8388004770 tx=0x7f8388005fd0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 msgr2=0x7f839819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f839000cce0 tx=0x7f839000a620 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 shutdown_connections 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f83840b6730 0x7f83840b8c40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8398108cf0 0x7f839819bce0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83981083a0 0x7f839819b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 --2- 172.21.15.6:0/2948975954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8398102a60 0x7f839819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.877+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 >> 172.21.15.6:0/2948975954 conn(0x7f8398079730 msgr2=0x7f8398104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:15.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.878+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 shutdown_connections 2024-09-21T08:18:15.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:15.878+0000 7f839f642640 1 -- 172.21.15.6:0/2948975954 wait complete. 2024-09-21T08:18:15.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:15 smithi119 ceph-mon[33564]: pgmap v882: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.5 MiB/s wr, 568 op/s 2024-09-21T08:18:15.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:15 smithi145 ceph-mon[34049]: pgmap v882: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.5 MiB/s wr, 568 op/s 2024-09-21T08:18:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 -- 172.21.15.6:0/1292179448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 msgr2=0x7fc3381086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 --2- 172.21.15.6:0/1292179448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc3381086f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009900 tx=0x7fc32c02a410 comp rx=0 tx=0).stop 2024-09-21T08:18:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 -- 172.21.15.6:0/1292179448 shutdown_connections 2024-09-21T08:18:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 --2- 172.21.15.6:0/1292179448 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc338108c30 0x7fc33810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 --2- 172.21.15.6:0/1292179448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc3381086f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 --2- 172.21.15.6:0/1292179448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3381029b0 0x7fc338102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 -- 172.21.15.6:0/1292179448 >> 172.21.15.6:0/1292179448 conn(0x7fc33807a740 msgr2=0x7fc33807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 -- 172.21.15.6:0/1292179448 shutdown_connections 2024-09-21T08:18:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.046+0000 7fc33c8de640 1 -- 172.21.15.6:0/1292179448 wait complete. 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 Processor -- start 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 -- start start 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3381029b0 0x7fc33819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 0x7fc33819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381127a0 con 0x7fc3381082e0 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc338112620 con 0x7fc338108c30 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33c8de640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc338112920 con 0x7fc3381029b0 2024-09-21T08:18:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46208/0 (socket says 172.21.15.6:46208) 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 -- 172.21.15.6:0/680690039 learned_addr learned my addr 172.21.15.6:0/680690039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc33659c640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3381029b0 0x7fc33819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc336d9d640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 0x7fc33819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 -- 172.21.15.6:0/680690039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3381029b0 msgr2=0x7fc33819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3381029b0 0x7fc33819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 -- 172.21.15.6:0/680690039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 msgr2=0x7fc33819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 0x7fc33819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc335d9b640 1 -- 172.21.15.6:0/680690039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3381a6480 con 0x7fc3381082e0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.047+0000 7fc336d9d640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 0x7fc33819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc335d9b640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005940 tx=0x7fc32c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c03f030 con 0x7fc3381082e0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc32c003a80 con 0x7fc3381082e0 2024-09-21T08:18:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3381a6710 con 0x7fc3381082e0 2024-09-21T08:18:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c035070 con 0x7fc3381082e0 2024-09-21T08:18:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.048+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381a6c50 con 0x7fc3381082e0 2024-09-21T08:18:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.049+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc338102dc0 con 0x7fc3381082e0 2024-09-21T08:18:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.051+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fc32c042030 con 0x7fc3381082e0 2024-09-21T08:18:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.051+0000 7fc3277fe640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 0x7fc3200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.051+0000 7fc33659c640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 0x7fc3200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.051+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9599+0+0 (secure 0 0 0) 0x7fc32c1083f0 con 0x7fc3381082e0 2024-09-21T08:18:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.052+0000 7fc33659c640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 0x7fc3200b8c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc33806b740 tx=0x7fc32800b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.055+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc32c0ce510 con 0x7fc3381082e0 2024-09-21T08:18:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.272+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 --> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc338063800 con 0x7fc3200b6700 2024-09-21T08:18:16.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.280+0000 7fc3277fe640 1 -- 172.21.15.6:0/680690039 <== mgr.14226 v2:172.21.15.6:6800/1939189819 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc338063800 con 0x7fc3200b6700 2024-09-21T08:18:16.281 INFO:teuthology.orchestra.run.smithi006.stdout:/ 1m 6m3h 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 msgr2=0x7fc3200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 0x7fc3200b8c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc33806b740 tx=0x7fc32800b410 comp rx=0 tx=0).stop 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 msgr2=0x7fc33819b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005940 tx=0x7fc32c0040e0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 shutdown_connections 2024-09-21T08:18:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fc3200b6700 0x7fc3200b8c10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338108c30 0x7fc33819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3381082e0 0x7fc33819b730 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 --2- 172.21.15.6:0/680690039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3381029b0 0x7fc33819b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 >> 172.21.15.6:0/680690039 conn(0x7fc33807a740 msgr2=0x7fc338106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 shutdown_connections 2024-09-21T08:18:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:16.283+0000 7fc33c8de640 1 -- 172.21.15.6:0/680690039 wait complete. 2024-09-21T08:18:16.299 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T08:18:16.309 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T08:18:16.719 INFO:tasks.cephfs.filesystem:scrub status for tag:4f814aa6-a69e-45b6-bb83-da170b44b5a5 - {'path': '/', 'tag': '4f814aa6-a69e-45b6-bb83-da170b44b5a5', 'options': 'recursive,force'} 2024-09-21T08:18:16.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:16 smithi119 ceph-mon[33564]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:16 smithi145 ceph-mon[34049]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:16.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:16 smithi006 ceph-mon[30970]: scrub summary: idle+waiting paths [/] 2024-09-21T08:18:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:17 smithi119 ceph-mon[33564]: from='client.18096 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:17 smithi119 ceph-mon[33564]: pgmap v883: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2024-09-21T08:18:17.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:17 smithi119 ceph-mon[33564]: from='client.18117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:17 smithi145 ceph-mon[34049]: from='client.18096 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:17 smithi145 ceph-mon[34049]: pgmap v883: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2024-09-21T08:18:17.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:17 smithi145 ceph-mon[34049]: from='client.18117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:17 smithi006 ceph-mon[30970]: from='client.18096 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:17 smithi006 ceph-mon[30970]: pgmap v883: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2024-09-21T08:18:17.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:17 smithi006 ceph-mon[30970]: from='client.18117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:18:18.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:18 smithi119 ceph-mon[33564]: pgmap v884: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2024-09-21T08:18:18.942 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:18 smithi145 ceph-mon[34049]: pgmap v884: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2024-09-21T08:18:18.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:18 smithi006 ceph-mon[30970]: pgmap v884: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2024-09-21T08:18:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:21 smithi119 ceph-mon[33564]: pgmap v885: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 862 KiB/s wr, 76 op/s 2024-09-21T08:18:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:21 smithi145 ceph-mon[34049]: pgmap v885: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 862 KiB/s wr, 76 op/s 2024-09-21T08:18:21.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:21 smithi006 ceph-mon[30970]: pgmap v885: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 862 KiB/s wr, 76 op/s 2024-09-21T08:18:22.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:22 smithi119 ceph-mon[33564]: scrub summary: idle 2024-09-21T08:18:22.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:22 smithi145 ceph-mon[34049]: scrub summary: idle 2024-09-21T08:18:22.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:22 smithi006 ceph-mon[30970]: scrub summary: idle 2024-09-21T08:18:23.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:23 smithi006 ceph-mon[30970]: pgmap v886: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-21T08:18:23.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:23 smithi119 ceph-mon[33564]: pgmap v886: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-21T08:18:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:23 smithi145 ceph-mon[34049]: pgmap v886: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-21T08:18:24.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:24 smithi119 ceph-mon[33564]: osdmap e109: 12 total, 12 up, 12 in 2024-09-21T08:18:24.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:24 smithi145 ceph-mon[34049]: osdmap e109: 12 total, 12 up, 12 in 2024-09-21T08:18:24.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:24 smithi006 ceph-mon[30970]: osdmap e109: 12 total, 12 up, 12 in 2024-09-21T08:18:25.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:25 smithi119 ceph-mon[33564]: pgmap v888: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-09-21T08:18:25.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:25 smithi145 ceph-mon[34049]: pgmap v888: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-09-21T08:18:25.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:25 smithi006 ceph-mon[30970]: pgmap v888: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-09-21T08:18:27.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:27 smithi119 ceph-mon[33564]: pgmap v889: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-21T08:18:27.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:27 smithi145 ceph-mon[34049]: pgmap v889: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-21T08:18:27.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:27 smithi006 ceph-mon[30970]: pgmap v889: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-21T08:18:29.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:29 smithi119 ceph-mon[33564]: pgmap v890: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-21T08:18:29.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:29 smithi145 ceph-mon[34049]: pgmap v890: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-21T08:18:29.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:29 smithi006 ceph-mon[30970]: pgmap v890: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-21T08:18:30.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:30 smithi119 ceph-mon[33564]: pgmap v891: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 4 op/s 2024-09-21T08:18:30.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:30 smithi145 ceph-mon[34049]: pgmap v891: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 4 op/s 2024-09-21T08:18:30.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:30 smithi006 ceph-mon[30970]: pgmap v891: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 KiB/s wr, 4 op/s 2024-09-21T08:18:33.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:33 smithi006 ceph-mon[30970]: pgmap v892: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T08:18:33.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:33 smithi119 ceph-mon[33564]: pgmap v892: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T08:18:33.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:33 smithi145 ceph-mon[34049]: pgmap v892: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T08:18:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:35 smithi119 ceph-mon[33564]: pgmap v893: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-21T08:18:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:35 smithi145 ceph-mon[34049]: pgmap v893: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-21T08:18:35.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:35 smithi006 ceph-mon[30970]: pgmap v893: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-09-21T08:18:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:37 smithi119 ceph-mon[33564]: pgmap v894: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-09-21T08:18:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:37 smithi145 ceph-mon[34049]: pgmap v894: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-09-21T08:18:37.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:37 smithi006 ceph-mon[30970]: pgmap v894: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-09-21T08:18:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:39 smithi119 ceph-mon[33564]: pgmap v895: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:39 smithi145 ceph-mon[34049]: pgmap v895: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:39.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:39 smithi006 ceph-mon[30970]: pgmap v895: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:41 smithi119 ceph-mon[33564]: pgmap v896: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:41 smithi145 ceph-mon[34049]: pgmap v896: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:41.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:41 smithi006 ceph-mon[30970]: pgmap v896: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-09-21T08:18:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:43 smithi119 ceph-mon[33564]: pgmap v897: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2024-09-21T08:18:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:43 smithi145 ceph-mon[34049]: pgmap v897: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2024-09-21T08:18:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:43 smithi006 ceph-mon[30970]: pgmap v897: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2024-09-21T08:18:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:45 smithi119 ceph-mon[33564]: pgmap v898: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2 op/s 2024-09-21T08:18:45.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:45 smithi145 ceph-mon[34049]: pgmap v898: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2 op/s 2024-09-21T08:18:45.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:45 smithi006 ceph-mon[30970]: pgmap v898: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2 op/s 2024-09-21T08:18:46.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:18:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:47 smithi119 ceph-mon[33564]: pgmap v899: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2 op/s 2024-09-21T08:18:47.437 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:47 smithi006 ceph-mon[30970]: pgmap v899: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2 op/s 2024-09-21T08:18:47.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:47 smithi145 ceph-mon[34049]: pgmap v899: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2 op/s 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.553+0000 7f34db3d6640 1 -- 172.21.15.6:0/330178508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d4108cf0 msgr2=0x7f34d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.553+0000 7f34db3d6640 1 --2- 172.21.15.6:0/330178508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d4108cf0 0x7f34d410f520 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009ca0 tx=0x7f34cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 -- 172.21.15.6:0/330178508 shutdown_connections 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 --2- 172.21.15.6:0/330178508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d4108cf0 0x7f34d410f520 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 --2- 172.21.15.6:0/330178508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d41083a0 0x7f34d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 --2- 172.21.15.6:0/330178508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 -- 172.21.15.6:0/330178508 >> 172.21.15.6:0/330178508 conn(0x7f34d4079730 msgr2=0x7f34d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 -- 172.21.15.6:0/330178508 shutdown_connections 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 -- 172.21.15.6:0/330178508 wait complete. 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 Processor -- start 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.554+0000 7f34db3d6640 1 -- start start 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d4108cf0 0x7f34d419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34d4112860 con 0x7f34d41083a0 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41126e0 con 0x7f34d4108cf0 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34db3d6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41129e0 con 0x7f34d4102a60 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45506/0 (socket says 172.21.15.6:45506) 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 -- 172.21.15.6:0/779884758 learned_addr learned my addr 172.21.15.6:0/779884758 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d9973640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d4108cf0 0x7f34d419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d9172640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 -- 172.21.15.6:0/779884758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 msgr2=0x7f34d4199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 -- 172.21.15.6:0/779884758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d4108cf0 msgr2=0x7f34d419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d4108cf0 0x7f34d419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 -- 172.21.15.6:0/779884758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d419f180 con 0x7f34d41083a0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d9172640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.555+0000 7f34d8971640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e9c0 tx=0x7f34c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.556+0000 7f34ca7fc640 1 -- 172.21.15.6:0/779884758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400cd80 con 0x7f34d41083a0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.556+0000 7f34ca7fc640 1 -- 172.21.15.6:0/779884758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34c40054b0 con 0x7f34d41083a0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.556+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d419f470 con 0x7f34d41083a0 2024-09-21T08:18:47.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.556+0000 7f34ca7fc640 1 -- 172.21.15.6:0/779884758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4010430 con 0x7f34d41083a0 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.556+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d41a5bd0 con 0x7f34d41083a0 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 Processor -- start 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34ca7fc640 1 -- 172.21.15.6:0/779884758 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f34c40105d0 con 0x7f34d41083a0 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 -- start start 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f5e070 0x5570b7307480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f3d390 0x5570b7307f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5570b727be50 con 0x5570b6f351b0 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570b726b280 con 0x5570b6f3d390 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34e194a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570b726f090 con 0x5570b6f5e070 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34d9172640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34d9172640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45512/0 (socket says 172.21.15.6:45512) 2024-09-21T08:18:47.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34d9172640 1 -- 172.21.15.6:0/3417777749 learned_addr learned my addr 172.21.15.6:0/3417777749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34d9973640 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f5e070 0x5570b7307480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.559+0000 7f34d8971640 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f3d390 0x5570b7307f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 -- 172.21.15.6:0/3417777749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f5e070 msgr2=0x5570b7307480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f5e070 0x5570b7307480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 -- 172.21.15.6:0/3417777749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f3d390 msgr2=0x5570b7307f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f3d390 0x5570b7307f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 -- 172.21.15.6:0/3417777749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b6fc9650 con 0x5570b6f351b0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34ca7fc640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 0x7f34c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9973640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 0x7f34c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34ca7fc640 1 -- 172.21.15.6:0/779884758 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f34c40e8030 con 0x7f34d41083a0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34d9172640 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f34d000bd40 tx=0x7f34d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d184e6739572c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34bf7fe640 1 -- 172.21.15.6:0/3417777749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0015070 con 0x5570b6f351b0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34bf7fe640 1 -- 172.21.15.6:0/3417777749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34d000be30 con 0x5570b6f351b0 2024-09-21T08:18:47.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.560+0000 7f34bf7fe640 1 -- 172.21.15.6:0/3417777749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d00118e0 con 0x5570b6f351b0 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 -- 172.21.15.6:0/3417777749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 msgr2=0x5570b73079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34d9973640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 0x7f34c00b8b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f34cc006010 tx=0x7f34cc009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f34d000bd40 tx=0x7f34d000f730 comp rx=0 tx=0).stop 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 -- 172.21.15.6:0/3417777749 shutdown_connections 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f3d390 0x5570b7307f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f351b0 0x5570b73079c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 --2- 172.21.15.6:0/3417777749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f5e070 0x5570b7307480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 -- 172.21.15.6:0/3417777749 >> 172.21.15.6:0/3417777749 conn(0x5570b6f52460 msgr2=0x5570b7305370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 -- 172.21.15.6:0/3417777749 shutdown_connections 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.561+0000 7f34e194a740 1 -- 172.21.15.6:0/3417777749 wait complete. 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 -- start start 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 Processor -- start 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7311650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7320e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5570b70cc700 con 0x5570b6f5e070 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570b7206110 con 0x5570b6f351b0 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570b7302bf0 con 0x5570b6f3d390 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7320e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7320e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34d9973640 1 -- 172.21.15.6:0/768751536 learned_addr learned my addr 172.21.15.6:0/768751536 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34d8971640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7311650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34d9172640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.562+0000 7f34e194a740 10 client.0 _ll_register_callbacks cb 0x5570b721f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 -- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 msgr2=0x5570b73110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 -- 172.21.15.6:0/768751536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 msgr2=0x5570b7320e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7320e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 -- 172.21.15.6:0/768751536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b7233c40 con 0x5570b6f3d390 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d9172640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34d8971640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7311650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f34c40e5370 tx=0x7f34c4005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6f72a91fe5fb72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40a9940 con 0x5570b6f3d390 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mon.1 v2:172.21.15.145:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f34c40ea2d0 con 0x5570b6f3d390 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d000be30 con 0x5570b6f3d390 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f34c40ad210 con 0x5570b6f3d390 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34e194a740 10 client.27808 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.563+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5570b7323c70 con 0x5570b6f3d390 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mon.1 v2:172.21.15.145:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34d000be30 con 0x5570b6f3d390 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mon.1 v2:172.21.15.145:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f34c40b2190 con 0x5570b6f3d390 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 10 client.27808 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 10 client.27808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 20 client.27808 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6f1c9f0 0x5570b73271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 4 client.27808 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b727dda0 con 0x5570b6f1c9f0 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.564+0000 7f34d9172640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6f1c9f0 0x5570b73271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.565+0000 7f34d9172640 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6f1c9f0 0x5570b73271b0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac9662cb58096f8c server_cookie=d363e87e3add5964 in_seq=0 out_seq=0 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.565+0000 7f34bcff9640 10 client.27808 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.565+0000 7f34bcff9640 1 -- 172.21.15.6:0/768751536 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570b727dda0 con 0x5570b6f1c9f0 2024-09-21T08:18:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.565+0000 7f34bcff9640 10 client.27808 handle_command_reply: tid=0 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 client.27808 shutdown 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 msgr2=0x5570b7311650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7311650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f34c40e5370 tx=0x7f34c4005720 comp rx=0 tx=0).stop 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 shutdown_connections 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6f1c9f0 0x5570b73271b0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7311650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7320e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 --2- 172.21.15.6:0/768751536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 >> 172.21.15.6:0/768751536 conn(0x5570b6f52460 msgr2=0x5570b730a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34bcff9640 0 client.27808 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 shutdown_connections 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 1 -- 172.21.15.6:0/768751536 wait complete. 2024-09-21T08:18:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.566+0000 7f34e194a740 20 client.27808 trim_cache size 0 max 16384 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.584+0000 7f34e194a740 1 Processor -- start 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 -- start start 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b7305320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b730b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41acbb0 con 0x5570b6f5e070 2024-09-21T08:18:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41af410 con 0x5570b6f351b0 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34e194a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41ad200 con 0x5570b6f3d390 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45526/0 (socket says 172.21.15.6:45526) 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 -- 172.21.15.6:0/1151042747 learned_addr learned my addr 172.21.15.6:0/1151042747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9172640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b7305320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d8971640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b730b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 -- 172.21.15.6:0/1151042747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 msgr2=0x5570b730b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b730b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 -- 172.21.15.6:0/1151042747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 msgr2=0x5570b7305320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b7305320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9973640 1 -- 172.21.15.6:0/1151042747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b730bad0 con 0x5570b6f5e070 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d9172640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b7305320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.585+0000 7f34d8971640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b730b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.586+0000 7f34d9973640 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f34cc003b00 tx=0x7f34cc044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f985ea67a7cee77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.586+0000 7f34beffd640 1 -- 172.21.15.6:0/1151042747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc032cc0 con 0x5570b6f5e070 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.586+0000 7f34beffd640 1 -- 172.21.15.6:0/1151042747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc036050 con 0x5570b6f5e070 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.586+0000 7f34beffd640 1 -- 172.21.15.6:0/1151042747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc030920 con 0x5570b6f5e070 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- 172.21.15.6:0/1151042747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 msgr2=0x5570b7308bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f34cc003b00 tx=0x7f34cc044000 comp rx=0 tx=0).stop 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- 172.21.15.6:0/1151042747 shutdown_connections 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b730b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7308bc0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 --2- 172.21.15.6:0/1151042747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b7305320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- 172.21.15.6:0/1151042747 >> 172.21.15.6:0/1151042747 conn(0x5570b6f52460 msgr2=0x5570b73084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- 172.21.15.6:0/1151042747 shutdown_connections 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- 172.21.15.6:0/1151042747 wait complete. 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 -- start start 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.587+0000 7f34e194a740 1 Processor -- start 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7320c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41ad8d0 con 0x5570b6f5e070 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41aed40 con 0x5570b6f351b0 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f34d41adfa0 con 0x5570b6f3d390 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34e194a740 10 client.0 _ll_register_callbacks cb 0x7f34c40eb870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45538/0 (socket says 172.21.15.6:45538) 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 -- 172.21.15.6:0/2948734035 learned_addr learned my addr 172.21.15.6:0/2948734035 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9172640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d8971640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7320c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 -- 172.21.15.6:0/2948734035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 msgr2=0x5570b7320c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7320c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 -- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 msgr2=0x5570b73206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.588+0000 7f34d9973640 1 -- 172.21.15.6:0/2948734035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b731a5a0 con 0x5570b6f5e070 2024-09-21T08:18:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34d9973640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f34cc02ade0 tx=0x7f34cc032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df13be1295fc1fce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc05d070 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f34cc004450 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34cc036050 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f34cc004650 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 10 client.18135 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5570b731fd00 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc036050 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f34cc054430 con 0x5570b6f5e070 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 10 client.18135 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 20 client.18135 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6ef1da0 0x5570b7393c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 4 client.18135 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.589+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5570b7279850 con 0x5570b6ef1da0 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.590+0000 7f34d9172640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6ef1da0 0x5570b7393c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.590+0000 7f34d9172640 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6ef1da0 0x5570b7393c40 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb7ae89a96915b4e server_cookie=75a3362305e35007 in_seq=0 out_seq=0 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.590+0000 7f34bcff9640 10 client.18135 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.590+0000 7f34bcff9640 1 -- 172.21.15.6:0/2948734035 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8610 (crc 0 0 0) 0x5570b7279850 con 0x5570b6ef1da0 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.590+0000 7f34bcff9640 10 client.18135 handle_command_reply: tid=0 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 client.18135 shutdown 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 msgr2=0x5570b7319e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f34cc02ade0 tx=0x7f34cc032cc0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 shutdown_connections 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x5570b6ef1da0 0x5570b7393c40 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570b6f3d390 0x5570b7320c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5570b6f5e070 0x5570b7319e30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 --2- 172.21.15.6:0/2948734035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570b6f351b0 0x5570b73206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 >> 172.21.15.6:0/2948734035 conn(0x5570b6f52460 msgr2=0x5570b73143e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34bcff9640 0 client.18135 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 shutdown_connections 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 1 -- 172.21.15.6:0/2948734035 wait complete. 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34e194a740 20 client.18135 trim_cache size 0 max 16384 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {}, 2024-09-21T08:18:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_stats": { 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "848988bd-4662-4f2c-b70b-978cbeef237a": { 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:43.545014+0000", 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "fe4e48e3-38b3-4933-b895-bdb23123142a": { 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:02:33.440461+0000", 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "b7b6e0b5-1750-4a0c-bbcf-649873246a98": { 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:58.342097+0000", 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "a7d87064-fb7e-4e69-baad-1d3cfe5955e9": { 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:10:54.574338+0000", 2024-09-21T08:18:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "673e7932-7c14-4dd6-bb7c-16fb1d902f70": { 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:23.310671+0000", 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "848e85ef-6ec6-4bad-bce6-4f1367fd842c": { 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:03.326884+0000", 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "d480b1ff-51cb-4407-8d5a-ecaeea7c8122": { 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:42.424229+0000", 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "ff72ecee-4198-4c31-afd5-530f37a041ca": { 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:06:22.266883+0000", 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "4f814aa6-a69e-45b6-bb83-da170b44b5a5": { 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:18:11.897155+0000", 2024-09-21T08:18:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "d5eacd38-1730-4388-90b5-68f260b0d3cd": { 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:07:49.954752+0000", 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "7de19529-7eca-4fce-8912-1b95b95dca42": { 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:03:20.262318+0000", 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "487ed3a7-1faa-4b71-b846-b5d47fdc1652": { 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:05:37.551971+0000", 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "9274b668-698a-41d0-8c88-fff10bd2f605": { 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:51.610090+0000", 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "02c52d1c-f2d1-4deb-a790-30e7b25fb30e": { 2024-09-21T08:18:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:08.269541+0000", 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf1dea7-299f-43f1-bbe7-47d2ef9d2ec8": { 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:13.390300+0000", 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "1ae80109-8f73-4ee4-bf79-1193249d2bb0": { 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:01:52.155469+0000", 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "ce57228e-95cc-4ed1-83e0-d39f9663882b": { 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:09:56.793700+0000", 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "9bc13a88-359e-48de-80d4-c29f066ed33a": { 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:05.732077+0000", 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "e7f7f916-7851-431e-9b4f-9dd6ba508462": { 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:11:45.332153+0000", 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "0f2cdaf6-acbe-4c51-9b50-24abcc1f9f1d": { 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:33.840019+0000", 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "5fa4ff92-89ea-4420-8179-4009a709c8cc": { 2024-09-21T08:18:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:16:06.649058+0000", 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "5d8aef01-33f1-44fe-abcd-397baa796fb3": { 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:08:42.690473+0000", 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "1d4fa5e1-3be1-487e-a1b2-2bc0d9241029": { 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:12:45.801739+0000", 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "ba76e127-460c-4a6c-bcc3-53fe4bc5b1a7": { 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:04:04.347243+0000", 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "492d5c41-ebf2-4f18-9be9-73b4a7649e8b": { 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:24.436443+0000", 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "c25dfd7e-21a8-4e74-9299-5b6488ecbfa7": { 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:13:39.394491+0000", 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "9597b6f0-7ad2-4a01-a191-4ddd1f0fd773": { 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:34.019219+0000", 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "58447fde-13ac-41a1-b590-2b49810bc95b": { 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:14:53.815757+0000", 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "898d22e2-15cf-48c0-b2c4-9819dd84c550": { 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:15:23.688060+0000", 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "d05c27c0-e763-4500-88c9-e4785471a320": { 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "start_time": "2024-09-21T08:17:25.306236+0000", 2024-09-21T08:18:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_started": 0, 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_passed": 0, 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_failed": 0, 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uninline_skipped": 0 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 msgr2=0x7f34c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 0x7f34c00b8b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f34cc006010 tx=0x7f34cc009360 comp rx=0 tx=0).stop 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 msgr2=0x7f34d41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.591+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e9c0 tx=0x7f34c400ee80 comp rx=0 tx=0).stop 2024-09-21T08:18:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 shutdown_connections 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f34c00b6680 0x7f34c00b8b90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34d4108cf0 0x7f34d419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d41083a0 0x7f34d41997b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 --2- 172.21.15.6:0/779884758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34d4102a60 0x7f34d4199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 >> 172.21.15.6:0/779884758 conn(0x7f34d4079730 msgr2=0x7f34d41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 shutdown_connections 2024-09-21T08:18:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:47.592+0000 7f34db3d6640 1 -- 172.21.15.6:0/779884758 wait complete. 2024-09-21T08:18:48.417 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:18:48.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:18:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 -- 172.21.15.6:0/2697492989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85241094c0 msgr2=0x7f85241098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 --2- 172.21.15.6:0/2697492989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85241094c0 0x7f85241098d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f850c009900 tx=0x7f850c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 -- 172.21.15.6:0/2697492989 shutdown_connections 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 --2- 172.21.15.6:0/2697492989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524109e10 0x7f8524110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 --2- 172.21.15.6:0/2697492989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85241094c0 0x7f85241098d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 --2- 172.21.15.6:0/2697492989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8524103b80 0x7f8524103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 -- 172.21.15.6:0/2697492989 >> 172.21.15.6:0/2697492989 conn(0x7f85240ff610 msgr2=0x7f8524101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 -- 172.21.15.6:0/2697492989 shutdown_connections 2024-09-21T08:18:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.215+0000 7f8528f90640 1 -- 172.21.15.6:0/2697492989 wait complete. 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.216+0000 7f8528f90640 1 Processor -- start 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.216+0000 7f8528f90640 1 -- start start 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524103b80 0x7f852419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85241094c0 0x7f852419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8524113980 con 0x7f8524109e10 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8524113800 con 0x7f8524103b80 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8528f90640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8524113b00 con 0x7f85241094c0 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45554/0 (socket says 172.21.15.6:45554) 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 -- 172.21.15.6:0/1496187109 learned_addr learned my addr 172.21.15.6:0/1496187109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f851bfff640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85241094c0 0x7f852419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f852259c640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524103b80 0x7f852419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 -- 172.21.15.6:0/1496187109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85241094c0 msgr2=0x7f852419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85241094c0 0x7f852419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 -- 172.21.15.6:0/1496187109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524103b80 msgr2=0x7f852419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524103b80 0x7f852419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 -- 172.21.15.6:0/1496187109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85241a0220 con 0x7f8524109e10 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.217+0000 7f8522d9d640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f851c00cce0 tx=0x7f851c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.218+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c00f450 con 0x7f8524109e10 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.218+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f851c00fa80 con 0x7f8524109e10 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.218+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85241a0510 con 0x7f8524109e10 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.218+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c0189c0 con 0x7f8524109e10 2024-09-21T08:18:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.218+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85241a09d0 con 0x7f8524109e10 2024-09-21T08:18:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.219+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8524103f90 con 0x7f8524109e10 2024-09-21T08:18:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.220+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f851c00fc30 con 0x7f8524109e10 2024-09-21T08:18:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.221+0000 7f851b7fe640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 0x7f85100b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.221+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f851c0e7fd0 con 0x7f8524109e10 2024-09-21T08:18:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.221+0000 7f852259c640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 0x7f85100b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.222+0000 7f852259c640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 0x7f85100b8bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f851400abe0 tx=0x7f851400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.224+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f851c014030 con 0x7f8524109e10 2024-09-21T08:18:49.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:49 smithi119 ceph-mon[33564]: pgmap v900: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:18:49.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:49 smithi145 ceph-mon[34049]: pgmap v900: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:18:49.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.451+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f852419b4a0 con 0x7f8524109e10 2024-09-21T08:18:49.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:49 smithi006 ceph-mon[30970]: pgmap v900: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T08:18:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.452+0000 7f851b7fe640 1 -- 172.21.15.6:0/1496187109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f852419b4a0 con 0x7f8524109e10 2024-09-21T08:18:49.453 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:49.453 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:18:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:18:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 msgr2=0x7f85100b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 0x7f85100b8bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f851400abe0 tx=0x7f851400a2d0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 msgr2=0x7f852419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f851c00cce0 tx=0x7f851c00a620 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 shutdown_connections 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f85100b66b0 0x7f85100b8bc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85241094c0 0x7f852419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8524109e10 0x7f852419fbb0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 --2- 172.21.15.6:0/1496187109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8524103b80 0x7f852419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 >> 172.21.15.6:0/1496187109 conn(0x7f85240ff610 msgr2=0x7f8524101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 shutdown_connections 2024-09-21T08:18:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:49.454+0000 7f8528f90640 1 -- 172.21.15.6:0/1496187109 wait complete. 2024-09-21T08:18:50.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:18:50.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:50 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1496187109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:50.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:50 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1496187109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:50.447 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:50.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:50 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1496187109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 -- 172.21.15.6:0/3710070692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c108d20 msgr2=0x7f291c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 --2- 172.21.15.6:0/3710070692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c108d20 0x7f291c10f550 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2914009ca0 tx=0x7f291402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 -- 172.21.15.6:0/3710070692 shutdown_connections 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 --2- 172.21.15.6:0/3710070692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c108d20 0x7f291c10f550 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 --2- 172.21.15.6:0/3710070692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c1083d0 0x7f291c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 --2- 172.21.15.6:0/3710070692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c102ae0 0x7f291c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 -- 172.21.15.6:0/3710070692 >> 172.21.15.6:0/3710070692 conn(0x7f291c079760 msgr2=0x7f291c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.940+0000 7f2922b69640 1 -- 172.21.15.6:0/3710070692 shutdown_connections 2024-09-21T08:18:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.941+0000 7f2922b69640 1 -- 172.21.15.6:0/3710070692 wait complete. 2024-09-21T08:18:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.941+0000 7f2922b69640 1 Processor -- start 2024-09-21T08:18:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.941+0000 7f2922b69640 1 -- start start 2024-09-21T08:18:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c1083d0 0x7f291c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c108d20 0x7f291c19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112890 con 0x7f291c102ae0 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112710 con 0x7f291c108d20 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2922b69640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112a10 con 0x7f291c1083d0 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45574/0 (socket says 172.21.15.6:45574) 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 -- 172.21.15.6:0/2852274721 learned_addr learned my addr 172.21.15.6:0/2852274721 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2913fff640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c1083d0 0x7f291c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2921106640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c108d20 0x7f291c19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 -- 172.21.15.6:0/2852274721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c1083d0 msgr2=0x7f291c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c1083d0 0x7f291c19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 -- 172.21.15.6:0/2852274721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c108d20 msgr2=0x7f291c19fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c108d20 0x7f291c19fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.942+0000 7f2920905640 1 -- 172.21.15.6:0/2852274721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c1a0300 con 0x7f291c102ae0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2920905640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f291800e9f0 tx=0x7f291800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2911ffb640 1 -- 172.21.15.6:0/2852274721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291800cd80 con 0x7f291c102ae0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c1a05f0 con 0x7f291c102ae0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2911ffb640 1 -- 172.21.15.6:0/2852274721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29180054b0 con 0x7f291c102ae0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2911ffb640 1 -- 172.21.15.6:0/2852274721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918010430 con 0x7f291c102ae0 2024-09-21T08:18:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.943+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c1a6d50 con 0x7f291c102ae0 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.945+0000 7f29290dd740 1 Processor -- start 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.945+0000 7f29290dd740 1 -- start start 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2911ffb640 1 -- 172.21.15.6:0/2852274721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f29180046c0 con 0x7f291c102ae0 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73ddc3070 0x55f73e16a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e16ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f73e0e0ea0 con 0x55f73dd9a1b0 2024-09-21T08:18:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f73e0d02d0 con 0x55f73dda2390 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f29290dd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f73e0d40e0 con 0x55f73ddc3070 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45586/0 (socket says 172.21.15.6:45586) 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 -- 172.21.15.6:0/3384493422 learned_addr learned my addr 172.21.15.6:0/3384493422 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2913fff640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e16ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2921106640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73ddc3070 0x55f73e16a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 -- 172.21.15.6:0/3384493422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73ddc3070 msgr2=0x55f73e16a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73ddc3070 0x55f73e16a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 -- 172.21.15.6:0/3384493422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 msgr2=0x55f73e16ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e16ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2920905640 1 -- 172.21.15.6:0/3384493422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73de2e650 con 0x55f73dd9a1b0 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.946+0000 7f2913fff640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e16ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2911ffb640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 0x7f29040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2920905640 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29180e51a0 tx=0x7f29180ebf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddad3afe3946bcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2921106640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 0x7f29040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2911ffb640 1 -- 172.21.15.6:0/2852274721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f29180e7ec0 con 0x7f291c102ae0 2024-09-21T08:18:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2902ffd640 1 -- 172.21.15.6:0/3384493422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180a9f80 con 0x55f73dd9a1b0 2024-09-21T08:18:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2902ffd640 1 -- 172.21.15.6:0/3384493422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29180ad440 con 0x55f73dd9a1b0 2024-09-21T08:18:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.947+0000 7f2902ffd640 1 -- 172.21.15.6:0/3384493422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180ad0a0 con 0x55f73dd9a1b0 2024-09-21T08:18:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 -- 172.21.15.6:0/3384493422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 msgr2=0x55f73e16a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29180e51a0 tx=0x7f29180ebf70 comp rx=0 tx=0).stop 2024-09-21T08:18:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f2921106640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 0x7f29040b8b90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2914006010 tx=0x7f2914009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 -- 172.21.15.6:0/3384493422 shutdown_connections 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e16ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16a800 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 --2- 172.21.15.6:0/3384493422 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73ddc3070 0x55f73e16a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 -- 172.21.15.6:0/3384493422 >> 172.21.15.6:0/3384493422 conn(0x55f73ddb7460 msgr2=0x55f73e1681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 -- 172.21.15.6:0/3384493422 shutdown_connections 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.948+0000 7f29290dd740 1 -- 172.21.15.6:0/3384493422 wait complete. 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 -- start start 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 Processor -- start 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e179dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f73df31700 con 0x55f73dda2390 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f73e06b160 con 0x55f73ddc3070 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f73e17cda0 con 0x55f73dd9a1b0 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f29290dd740 10 client.0 _ll_register_callbacks cb 0x55f73e0849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f2913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f2913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45600/0 (socket says 172.21.15.6:45600) 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f2913fff640 1 -- 172.21.15.6:0/3237536482 learned_addr learned my addr 172.21.15.6:0/3237536482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f2920905640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e179dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.949+0000 7f2921106640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 -- 172.21.15.6:0/3237536482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 msgr2=0x55f73e179dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e179dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 -- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 msgr2=0x55f73e186100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 -- 172.21.15.6:0/3237536482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73e098c90 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2921106640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f2913fff640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b9f0 tx=0x7f290c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18fbef002455869 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f28fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c003e20 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f290c011440 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29180ad440 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f290c011640 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f29290dd740 10 client.18153 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f73e188b80 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.950+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29180ad440 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f290c01b890 con 0x55f73dda2390 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 10 client.18153 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 20 client.18153 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd819f0 0x55f73e18c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 4 client.18153 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f73e0e2df0 con 0x55f73dd819f0 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.951+0000 7f2920905640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd819f0 0x55f73e18c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.952+0000 7f2920905640 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd819f0 0x55f73e18c140 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6835d9a62df28f1f server_cookie=bd6bce92ebe1befb in_seq=0 out_seq=0 2024-09-21T08:18:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.952+0000 7f28fbfff640 10 client.18153 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.952+0000 7f28fbfff640 1 -- 172.21.15.6:0/3237536482 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f73e0e2df0 con 0x55f73dd819f0 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.952+0000 7f28fbfff640 10 client.18153 handle_command_reply: tid=0 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.952+0000 7f29290dd740 1 client.18153 shutdown 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 msgr2=0x55f73e17a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b9f0 tx=0x7f290c00beb0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 shutdown_connections 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd819f0 0x55f73e18c140 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dda2390 0x55f73e17a300 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 --2- 172.21.15.6:0/3237536482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e179dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 >> 172.21.15.6:0/3237536482 conn(0x55f73ddb7460 msgr2=0x55f73e166750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f28fbfff640 0 client.18153 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 shutdown_connections 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 1 -- 172.21.15.6:0/3237536482 wait complete. 2024-09-21T08:18:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.953+0000 7f29290dd740 20 client.18153 trim_cache size 0 max 16384 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.966+0000 7f29290dd740 1 Processor -- start 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.966+0000 7f29290dd740 1 -- start start 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dda2390 0x55f73e17b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1acd30 con 0x55f73dd9a1b0 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1af590 con 0x55f73ddc3070 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f29290dd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1ad380 con 0x55f73dda2390 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45614/0 (socket says 172.21.15.6:45614) 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 -- 172.21.15.6:0/666894908 learned_addr learned my addr 172.21.15.6:0/666894908 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2913fff640 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dda2390 0x55f73e17b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 -- 172.21.15.6:0/666894908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dda2390 msgr2=0x55f73e17b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dda2390 0x55f73e17b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 -- 172.21.15.6:0/666894908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 msgr2=0x55f73e186000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 -- 172.21.15.6:0/666894908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73e16cbd0 con 0x55f73dd9a1b0 2024-09-21T08:18:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.967+0000 7f2920905640 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2918009380 tx=0x7f2918009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242fe4e477f9bff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29027fc640 1 -- 172.21.15.6:0/666894908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918098020 con 0x55f73dd9a1b0 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29027fc640 1 -- 172.21.15.6:0/666894908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29180ad440 con 0x55f73dd9a1b0 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29027fc640 1 -- 172.21.15.6:0/666894908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180ad280 con 0x55f73dd9a1b0 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 -- 172.21.15.6:0/666894908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 msgr2=0x55f73e16fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2918009380 tx=0x7f2918009720 comp rx=0 tx=0).stop 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 -- 172.21.15.6:0/666894908 shutdown_connections 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dda2390 0x55f73e17b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73ddc3070 0x55f73e186000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 --2- 172.21.15.6:0/666894908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73dd9a1b0 0x55f73e16fe20 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 -- 172.21.15.6:0/666894908 >> 172.21.15.6:0/666894908 conn(0x55f73ddb7460 msgr2=0x55f73e17b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.968+0000 7f29290dd740 1 -- 172.21.15.6:0/666894908 shutdown_connections 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 -- 172.21.15.6:0/666894908 wait complete. 2024-09-21T08:18:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 -- start start 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 Processor -- start 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e17e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e17e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1ada50 con 0x55f73ddc3070 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1aeec0 con 0x55f73dda2390 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1ae120 con 0x55f73dd9a1b0 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.969+0000 7f29290dd740 10 client.0 _ll_register_callbacks cb 0x7f290c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45630/0 (socket says 172.21.15.6:45630) 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2920905640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e17e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 -- 172.21.15.6:0/587366459 learned_addr learned my addr 172.21.15.6:0/587366459 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2913fff640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e17e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 -- 172.21.15.6:0/587366459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 msgr2=0x55f73e17e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e17e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 -- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 msgr2=0x55f73e17e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e17e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 -- 172.21.15.6:0/587366459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73e1635d0 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2913fff640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e17e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f2921106640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f2914009ca0 tx=0x7f2914003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d7ce5760f9c75e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f28fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914057060 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f2914042030 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.970+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29180ad440 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f291405e050 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 10 client.18159 fetch_fsmap learned FSMap version 21 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f73e1f6db0 con 0x55f73ddc3070 2024-09-21T08:18:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29180ad440 con 0x55f73ddc3070 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2914030750 con 0x55f73ddc3070 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 10 client.18159 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 20 client.18159 populate_metadata read hostname 'smithi006' 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd56da0 0x55f73e1f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 4 client.18159 mds_command: new command op to 24713 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.971+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 --> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f73e0de8a0 con 0x55f73dd56da0 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f2920905640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd56da0 0x55f73e1f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f2920905640 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd56da0 0x55f73e1f95d0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a829bab7f6b2583 server_cookie=7b6a58ac981fefd9 in_seq=0 out_seq=0 2024-09-21T08:18:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f28fbfff640 10 client.18159 ms_handle_connect on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f28fbfff640 1 -- 172.21.15.6:0/587366459 <== mds.0 v2:172.21.15.119:6838/1644051507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f73e0de8a0 con 0x55f73dd56da0 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f28fbfff640 10 client.18159 handle_command_reply: tid=0 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 client.18159 shutdown 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 msgr2=0x55f73e17ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f2914009ca0 tx=0x7f2914003c10 comp rx=0 tx=0).stop 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 shutdown_connections 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:6838/1644051507,v1:172.21.15.119:6839/1644051507] conn(0x55f73dd56da0 0x55f73e1f95d0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f73ddc3070 0x55f73e17ec60 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f73dda2390 0x55f73e17e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 --2- 172.21.15.6:0/587366459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f73dd9a1b0 0x55f73e17e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 >> 172.21.15.6:0/587366459 conn(0x55f73ddb7460 msgr2=0x55f73e16fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.972+0000 7f28fbfff640 0 client.18159 ms_handle_reset on v2:172.21.15.119:6838/1644051507 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 shutdown_connections 2024-09-21T08:18:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f29290dd740 1 -- 172.21.15.6:0/587366459 wait complete. 2024-09-21T08:18:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f29290dd740 20 client.18159 trim_cache size 0 max 16384 2024-09-21T08:18:50.978 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2024-09-21T08:18:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 msgr2=0x7f29040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 0x7f29040b8b90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2914006010 tx=0x7f2914009360 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 msgr2=0x7f291c19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f291800e9f0 tx=0x7f291800edf0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 shutdown_connections 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f29040b6680 0x7f29040b8b90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f291c1083d0 0x7f291c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291c108d20 0x7f291c19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 --2- 172.21.15.6:0/2852274721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f291c102ae0 0x7f291c19a390 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 >> 172.21.15.6:0/2852274721 conn(0x7f291c079760 msgr2=0x7f291c101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 shutdown_connections 2024-09-21T08:18:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:50.973+0000 7f2922b69640 1 -- 172.21.15.6:0/2852274721 wait complete. 2024-09-21T08:18:51.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:51 smithi119 ceph-mon[33564]: pgmap v901: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:51.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:51 smithi145 ceph-mon[34049]: pgmap v901: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:51.447 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:51 smithi006 ceph-mon[30970]: pgmap v901: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:51.803 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T08:18:51.804 INFO:tasks.fwd_scrub:done joining 2024-09-21T08:18:51.804 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T08:18:51.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- 172.21.15.6:0/2177053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 msgr2=0x7f071010f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 --2- 172.21.15.6:0/2177053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071010f470 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0708009ca0 tx=0x7f070802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- 172.21.15.6:0/2177053566 shutdown_connections 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 --2- 172.21.15.6:0/2177053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071010f470 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 --2- 172.21.15.6:0/2177053566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f0710108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 --2- 172.21.15.6:0/2177053566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 0x7f0710102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- 172.21.15.6:0/2177053566 >> 172.21.15.6:0/2177053566 conn(0x7f071007a670 msgr2=0x7f071007aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:51.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- 172.21.15.6:0/2177053566 shutdown_connections 2024-09-21T08:18:51.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- 172.21.15.6:0/2177053566 wait complete. 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 Processor -- start 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.951+0000 7f071868c640 1 -- start start 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 0x7f071019b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f071019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112800 con 0x7f0710108c40 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112680 con 0x7f07101082f0 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f071868c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112980 con 0x7f07101029c0 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45654/0 (socket says 172.21.15.6:45654) 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 -- 172.21.15.6:0/2286260610 learned_addr learned my addr 172.21.15.6:0/2286260610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0715c27640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f071019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716428640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 0x7f071019b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 -- 172.21.15.6:0/2286260610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 msgr2=0x7f071019b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 0x7f071019b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 -- 172.21.15.6:0/2286260610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 msgr2=0x7f071019b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f071019b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 -- 172.21.15.6:0/2286260610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101a63e0 con 0x7f0710108c40 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0715c27640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f071019b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.952+0000 7f0716c29640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0708005e30 tx=0x7f07080093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.953+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708032d10 con 0x7f0710108c40 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.953+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101a6670 con 0x7f0710108c40 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.953+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0708032eb0 con 0x7f0710108c40 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.953+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708030b20 con 0x7f0710108c40 2024-09-21T08:18:51.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.953+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101a6c10 con 0x7f0710108c40 2024-09-21T08:18:51.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.954+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710102dd0 con 0x7f0710108c40 2024-09-21T08:18:51.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.955+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0708030cc0 con 0x7f0710108c40 2024-09-21T08:18:51.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.956+0000 7f07077fe640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:51.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.956+0000 7f0716428640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.957+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f0708108f40 con 0x7f0710108c40 2024-09-21T08:18:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.957+0000 7f0716428640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f070c005fd0 tx=0x7f070c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:51.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:51.960+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07080cf0b0 con 0x7f0710108c40 2024-09-21T08:18:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.151+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f071010a4a0 con 0x7f0710108c40 2024-09-21T08:18:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.153+0000 7f07077fe640 1 -- 172.21.15.6:0/2286260610 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+25392 (secure 0 0 0) 0x7f07080d3490 con 0x7f0710108c40 2024-09-21T08:18:52.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:52.154 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":109,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:18:23.595546+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]},{"pool":4,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:18:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 msgr2=0x7f06fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f070c005fd0 tx=0x7f070c005850 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 msgr2=0x7f071019bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0708005e30 tx=0x7f07080093d0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 shutdown_connections 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f06fc0b6680 0x7f06fc0b8b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0710108c40 0x7f071019bb50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07101082f0 0x7f071019b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 --2- 172.21.15.6:0/2286260610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07101029c0 0x7f071019b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 >> 172.21.15.6:0/2286260610 conn(0x7f071007a670 msgr2=0x7f0710104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 shutdown_connections 2024-09-21T08:18:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.155+0000 7f071868c640 1 -- 172.21.15.6:0/2286260610 wait complete. 2024-09-21T08:18:52.170 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:54:01.897308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:58:41.348167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:58:43.952628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:58:50.378691+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T08:18:52.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T08:18:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 -- 172.21.15.6:0/801725443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 msgr2=0x7f024c10f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 --2- 172.21.15.6:0/801725443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c10f440 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0244009ca0 tx=0x7f024402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 -- 172.21.15.6:0/801725443 shutdown_connections 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 --2- 172.21.15.6:0/801725443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c10f440 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 --2- 172.21.15.6:0/801725443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c1086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 --2- 172.21.15.6:0/801725443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 0x7f024c102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 -- 172.21.15.6:0/801725443 >> 172.21.15.6:0/801725443 conn(0x7f024c0fe3b0 msgr2=0x7f024c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 -- 172.21.15.6:0/801725443 shutdown_connections 2024-09-21T08:18:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.299+0000 7f0251bad640 1 -- 172.21.15.6:0/801725443 wait complete. 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 Processor -- start 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 -- start start 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 0x7f024c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1127d0 con 0x7f024c108c10 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f024c112650 con 0x7f024c1082c0 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f0251bad640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f024c112950 con 0x7f024c102990 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f024bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f024bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45672/0 (socket says 172.21.15.6:45672) 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f024bfff640 1 -- 172.21.15.6:0/2343970331 learned_addr learned my addr 172.21.15.6:0/2343970331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f024b7fe640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 0x7f024c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.300+0000 7f024affd640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 -- 172.21.15.6:0/2343970331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 msgr2=0x7f024c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 0x7f024c19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 -- 172.21.15.6:0/2343970331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 msgr2=0x7f024c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 -- 172.21.15.6:0/2343970331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c1a6310 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024affd640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f024bfff640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0244005cc0 tx=0x7f0244032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244032e00 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02440044d0 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c1a65a0 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244030b70 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.301+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1a6b40 con 0x7f024c108c10 2024-09-21T08:18:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.302+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c102da0 con 0x7f024c108c10 2024-09-21T08:18:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.304+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0244030d10 con 0x7f024c108c10 2024-09-21T08:18:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.305+0000 7f0248ff9640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 0x7f02340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.305+0000 7f024b7fe640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 0x7f02340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.305+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f0244108f20 con 0x7f024c108c10 2024-09-21T08:18:52.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.306+0000 7f024b7fe640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 0x7f02340b8c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f024c06b280 tx=0x7f023c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.308+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02440cf030 con 0x7f024c108c10 2024-09-21T08:18:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.497+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f024c10aa60 con 0x7f024c108c10 2024-09-21T08:18:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.498+0000 7f0248ff9640 1 -- 172.21.15.6:0/2343970331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) ==== 93+0+10 (secure 0 0 0) 0x7f02440d3410 con 0x7f024c108c10 2024-09-21T08:18:52.499 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 msgr2=0x7f02340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 0x7f02340b8c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f024c06b280 tx=0x7f023c00b390 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 msgr2=0x7f024c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0244005cc0 tx=0x7f0244032a10 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 shutdown_connections 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f02340b6700 0x7f02340b8c10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c108c10 0x7f024c19bb00 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f024c1082c0 0x7f024c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 --2- 172.21.15.6:0/2343970331 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f024c102990 0x7f024c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 >> 172.21.15.6:0/2343970331 conn(0x7f024c0fe3b0 msgr2=0x7f024c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 shutdown_connections 2024-09-21T08:18:52.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.500+0000 7f0251bad640 1 -- 172.21.15.6:0/2343970331 wait complete. 2024-09-21T08:18:52.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T08:18:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 -- 172.21.15.6:0/1802145963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601082e0 msgr2=0x7f78601086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 --2- 172.21.15.6:0/1802145963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601082e0 0x7f78601086f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7850009900 tx=0x7f785002a410 comp rx=0 tx=0).stop 2024-09-21T08:18:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 -- 172.21.15.6:0/1802145963 shutdown_connections 2024-09-21T08:18:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 --2- 172.21.15.6:0/1802145963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 0x7f786010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 --2- 172.21.15.6:0/1802145963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601082e0 0x7f78601086f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 --2- 172.21.15.6:0/1802145963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601029b0 0x7f7860102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 -- 172.21.15.6:0/1802145963 >> 172.21.15.6:0/1802145963 conn(0x7f78600fe3f0 msgr2=0x7f7860100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 -- 172.21.15.6:0/1802145963 shutdown_connections 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.645+0000 7f786819b640 1 -- 172.21.15.6:0/1802145963 wait complete. 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 Processor -- start 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 -- start start 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601082e0 0x7f78601997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 0x7f786019ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f78601127a0 con 0x7f78601029b0 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7860112620 con 0x7f78601082e0 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f786819b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7860112920 con 0x7f7860108c30 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45692/0 (socket says 172.21.15.6:45692) 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 -- 172.21.15.6:0/1510614927 learned_addr learned my addr 172.21.15.6:0/1510614927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865736640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601082e0 0x7f78601997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7866738640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 0x7f786019ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 -- 172.21.15.6:0/1510614927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 msgr2=0x7f786019ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 0x7f786019ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 -- 172.21.15.6:0/1510614927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601082e0 msgr2=0x7f78601997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.646+0000 7f7865f37640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601082e0 0x7f78601997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f7865f37640 1 -- 172.21.15.6:0/1510614927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786019f170 con 0x7f78601029b0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f7865f37640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f785c007910 tx=0x7f785c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c019070 con 0x7f78601029b0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f785c005020 con 0x7f78601029b0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786019f460 con 0x7f78601029b0 2024-09-21T08:18:52.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c0049e0 con 0x7f78601029b0 2024-09-21T08:18:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.647+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786006b8a0 con 0x7f78601029b0 2024-09-21T08:18:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.648+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7860103c20 con 0x7f78601029b0 2024-09-21T08:18:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.650+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f785c01c070 con 0x7f78601029b0 2024-09-21T08:18:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.650+0000 7f7856ffd640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 0x7f784c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.651+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7f785c0e8ba0 con 0x7f78601029b0 2024-09-21T08:18:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.651+0000 7f7865736640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 0x7f784c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.651+0000 7f7865736640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 0x7f784c0b8c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7850005940 tx=0x7f78500058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:52.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.654+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f785c0b3090 con 0x7f78601029b0 2024-09-21T08:18:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.846+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f786019a360 con 0x7f78601029b0 2024-09-21T08:18:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.846+0000 7f7856ffd640 1 -- 172.21.15.6:0/1510614927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) ==== 104+0+11 (secure 0 0 0) 0x7f785c0b7fd0 con 0x7f78601029b0 2024-09-21T08:18:52.847 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 msgr2=0x7f784c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 0x7f784c0b8c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7850005940 tx=0x7f78500058d0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 msgr2=0x7f7860199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f785c007910 tx=0x7f785c007dd0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 shutdown_connections 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f784c0b6700 0x7f784c0b8c10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7860108c30 0x7f786019ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78601082e0 0x7f78601997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 --2- 172.21.15.6:0/1510614927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78601029b0 0x7f7860199240 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.848+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 >> 172.21.15.6:0/1510614927 conn(0x7f78600fe3f0 msgr2=0x7f7860100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.849+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 shutdown_connections 2024-09-21T08:18:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.849+0000 7f786819b640 1 -- 172.21.15.6:0/1510614927 wait complete. 2024-09-21T08:18:52.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T08:18:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- 172.21.15.6:0/3000436889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81082f0 msgr2=0x7effd8108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 --2- 172.21.15.6:0/3000436889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81082f0 0x7effd8108700 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7effcc009900 tx=0x7effcc02a410 comp rx=0 tx=0).stop 2024-09-21T08:18:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- 172.21.15.6:0/3000436889 shutdown_connections 2024-09-21T08:18:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 --2- 172.21.15.6:0/3000436889 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd8108c40 0x7effd810f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 --2- 172.21.15.6:0/3000436889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81082f0 0x7effd8108700 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 --2- 172.21.15.6:0/3000436889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd81029c0 0x7effd8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- 172.21.15.6:0/3000436889 >> 172.21.15.6:0/3000436889 conn(0x7effd80fe400 msgr2=0x7effd8100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- 172.21.15.6:0/3000436889 shutdown_connections 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- 172.21.15.6:0/3000436889 wait complete. 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 Processor -- start 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.992+0000 7effdd98e640 1 -- start start 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd81082f0 0x7effd819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd8108c40 0x7effd819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effd81127b0 con 0x7effd81029c0 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effd8112630 con 0x7effd8108c40 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdd98e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7effd8112930 con 0x7effd81082f0 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45714/0 (socket says 172.21.15.6:45714) 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 -- 172.21.15.6:0/416323144 learned_addr learned my addr 172.21.15.6:0/416323144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd67fc640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd81082f0 0x7effd819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd77fe640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd8108c40 0x7effd819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 -- 172.21.15.6:0/416323144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd81082f0 msgr2=0x7effd819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd81082f0 0x7effd819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 -- 172.21.15.6:0/416323144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd8108c40 msgr2=0x7effd819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd8108c40 0x7effd819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 -- 172.21.15.6:0/416323144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd81a02b0 con 0x7effd81029c0 2024-09-21T08:18:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effd6ffd640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7effc800eab0 tx=0x7effc800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.993+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc800ce40 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.994+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effc8011900 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.994+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd81a05a0 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.994+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8010990 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.994+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd81a6d30 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.994+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd8103c30 con 0x7effd81029c0 2024-09-21T08:18:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.996+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7effc8011470 con 0x7effd81029c0 2024-09-21T08:18:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.997+0000 7effdc98c640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 0x7effc00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.997+0000 7effd67fc640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 0x7effc00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.997+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7effc80e80c0 con 0x7effd81029c0 2024-09-21T08:18:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:52.997+0000 7effd67fc640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 0x7effc00b8b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7effcc005940 tx=0x7effcc0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.000+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effc8016030 con 0x7effd81029c0 2024-09-21T08:18:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.190+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7effd81a6fe0 con 0x7effd81029c0 2024-09-21T08:18:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.191+0000 7effdc98c640 1 -- 172.21.15.6:0/416323144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) ==== 100+0+11 (secure 0 0 0) 0x7effc80ae1d0 con 0x7effd81029c0 2024-09-21T08:18:53.192 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-09-21T08:18:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 msgr2=0x7effc00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 0x7effc00b8b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7effcc005940 tx=0x7effcc0058d0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 msgr2=0x7effd819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7effc800eab0 tx=0x7effc800ef70 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 shutdown_connections 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7effc00b6680 0x7effc00b8b90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7effd81082f0 0x7effd819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effd8108c40 0x7effd819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 --2- 172.21.15.6:0/416323144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd81029c0 0x7effd819a380 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 >> 172.21.15.6:0/416323144 conn(0x7effd80fe400 msgr2=0x7effd8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 shutdown_connections 2024-09-21T08:18:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.193+0000 7effdd98e640 1 -- 172.21.15.6:0/416323144 wait complete. 2024-09-21T08:18:53.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- 172.21.15.6:0/937208044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 msgr2=0x7fced010d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 --2- 172.21.15.6:0/937208044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced010d780 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009900 tx=0x7fcecc02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- 172.21.15.6:0/937208044 shutdown_connections 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 --2- 172.21.15.6:0/937208044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 0x7fced0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 --2- 172.21.15.6:0/937208044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced010d780 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 --2- 172.21.15.6:0/937208044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 0x7fced0104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- 172.21.15.6:0/937208044 >> 172.21.15.6:0/937208044 conn(0x7fced00fe3c0 msgr2=0x7fced0100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- 172.21.15.6:0/937208044 shutdown_connections 2024-09-21T08:18:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- 172.21.15.6:0/937208044 wait complete. 2024-09-21T08:18:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 Processor -- start 2024-09-21T08:18:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.336+0000 7fced8332640 1 -- start start 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 0x7fced019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 0x7fced019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fced0113820 con 0x7fced0105240 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fced01136a0 con 0x7fced01048f0 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced8332640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fced01139a0 con 0x7fced010dd50 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45724/0 (socket says 172.21.15.6:45724) 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 -- 172.21.15.6:0/1061594929 learned_addr learned my addr 172.21.15.6:0/1061594929 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced68cf640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 0x7fced019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced60ce640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 0x7fced019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 -- 172.21.15.6:0/1061594929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 msgr2=0x7fced019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 0x7fced019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 -- 172.21.15.6:0/1061594929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 msgr2=0x7fced019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 0x7fced019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 -- 172.21.15.6:0/1061594929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced01a0250 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fced58cd640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005940 tx=0x7fcecc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.337+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc03f030 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.338+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcecc003a80 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.338+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced01a04e0 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.338+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035070 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.338+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced01a6cd0 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.339+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced006bfa0 con 0x7fced0105240 2024-09-21T08:18:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.340+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fcecc042030 con 0x7fced0105240 2024-09-21T08:18:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.341+0000 7fcec77fe640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 0x7fcebc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.341+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7fcecc1082f0 con 0x7fced0105240 2024-09-21T08:18:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.341+0000 7fced60ce640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 0x7fcebc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.342+0000 7fced60ce640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 0x7fcebc0b8c10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcec000bbe0 tx=0x7fcec000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.345+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcecc0d2840 con 0x7fced0105240 2024-09-21T08:18:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:53 smithi119 ceph-mon[33564]: pgmap v902: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2286260610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:18:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/2343970331' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:53 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1510614927' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:53 smithi145 ceph-mon[34049]: pgmap v902: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2286260610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:18:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/2343970331' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:53 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1510614927' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:53 smithi006 ceph-mon[30970]: pgmap v902: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2286260610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:18:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/2343970331' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:53 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1510614927' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:18:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.534+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fced019b440 con 0x7fced0105240 2024-09-21T08:18:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.534+0000 7fcec77fe640 1 -- 172.21.15.6:0/1061594929 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v109) ==== 103+0+11 (secure 0 0 0) 0x7fced019b440 con 0x7fced0105240 2024-09-21T08:18:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 msgr2=0x7fcebc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 0x7fcebc0b8c10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcec000bbe0 tx=0x7fcec000b390 comp rx=0 tx=0).stop 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 msgr2=0x7fced019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005940 tx=0x7fcecc0040e0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 shutdown_connections 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fcebc0b6700 0x7fcebc0b8c10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fced010dd50 0x7fced019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fced0105240 0x7fced019a8c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 --2- 172.21.15.6:0/1061594929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fced01048f0 0x7fced019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 >> 172.21.15.6:0/1061594929 conn(0x7fced00fe3c0 msgr2=0x7fced00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:53.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 shutdown_connections 2024-09-21T08:18:53.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.537+0000 7fced8332640 1 -- 172.21.15.6:0/1061594929 wait complete. 2024-09-21T08:18:53.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T08:18:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 -- 172.21.15.6:0/1070402559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad74108c40 msgr2=0x7fad7410f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/1070402559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad74108c40 0x7fad7410f470 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009ca0 tx=0x7fad6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 -- 172.21.15.6:0/1070402559 shutdown_connections 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/1070402559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad741082f0 0x7fad74108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/1070402559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad74108c40 0x7fad7410f470 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/1070402559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74103130 0x7fad74103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 -- 172.21.15.6:0/1070402559 >> 172.21.15.6:0/1070402559 conn(0x7fad74079e50 msgr2=0x7fad7407a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 -- 172.21.15.6:0/1070402559 shutdown_connections 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.676+0000 7fad7b4b6640 1 -- 172.21.15.6:0/1070402559 wait complete. 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 Processor -- start 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 -- start start 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad74103130 0x7fad74199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 0x7fad7419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112800 con 0x7fad741082f0 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112680 con 0x7fad74108c40 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad7b4b6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112980 con 0x7fad74103130 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad78a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad78a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45748/0 (socket says 172.21.15.6:45748) 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.677+0000 7fad78a51640 1 -- 172.21.15.6:0/3636884798 learned_addr learned my addr 172.21.15.6:0/3636884798 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad79252640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad74103130 0x7fad74199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad79a53640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 0x7fad7419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 -- 172.21.15.6:0/3636884798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad74103130 msgr2=0x7fad74199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad74103130 0x7fad74199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 -- 172.21.15.6:0/3636884798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 msgr2=0x7fad7419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 0x7fad7419e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 -- 172.21.15.6:0/3636884798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7419f0b0 con 0x7fad741082f0 2024-09-21T08:18:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad79a53640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 0x7fad7419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad78a51640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fad6800d740 tx=0x7fad6800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68017070 con 0x7fad741082f0 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad6800de50 con 0x7fad741082f0 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7419f3a0 con 0x7fad741082f0 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6800f620 con 0x7fad741082f0 2024-09-21T08:18:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.678+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad741a5b30 con 0x7fad741082f0 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.679+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7406b720 con 0x7fad741082f0 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.681+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fad6801a070 con 0x7fad741082f0 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.682+0000 7fad667fc640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 0x7fad600b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.682+0000 7fad79252640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 0x7fad600b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.682+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9511+0+0 (secure 0 0 0) 0x7fad680e7520 con 0x7fad741082f0 2024-09-21T08:18:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.682+0000 7fad79252640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 0x7fad600b8c10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad700058c0 tx=0x7fad7000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:18:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.685+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad680ad6b0 con 0x7fad741082f0 2024-09-21T08:18:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.924+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fad7410a4a0 con 0x7fad741082f0 2024-09-21T08:18:53.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.932+0000 7fad667fc640 1 -- 172.21.15.6:0/3636884798 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+834043 (secure 0 0 0) 0x7fad680b1a90 con 0x7fad741082f0 2024-09-21T08:18:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:18:53.943 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 25, 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "active_gid": 14226, 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "active_name": "x", 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addrs": { 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1939189819 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1939189819 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addr": "172.21.15.6:6801/1939189819", 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "active_change": "2024-09-21T07:52:01.430301+0000", 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "available": true, 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "standbys": [ 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24145, 2024-09-21T08:18:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "z", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540719139924082687, 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-21T08:18:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-21T08:18:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-21T08:18:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:18:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:18:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:18:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.000 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nginx": { 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nginx", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.002 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nginx container image", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:18:54.005 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.006 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:18:54.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba_metrics": { 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.010 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.017 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.018 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.020 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-21T08:18:54.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.031 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:18:54.033 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:18:54.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.035 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:18:54.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:18:54.037 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:18:54.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.043 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_interval": { 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.045 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.054 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-21T08:18:54.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.057 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.058 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.060 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.063 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.065 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.070 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.073 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:18:54.076 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:18:54.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:18:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "[]", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:18:54.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "{}", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:18:54.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:18:54.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:18:54.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:18:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:18:54.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.094 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.097 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.099 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.105 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.106 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.107 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:54.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.112 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:54.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "sso_oauth2": { 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sso_oauth2", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-21T08:18:54.122 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:54.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.125 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.129 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:18:54.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.142 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:54.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-21T08:18:54.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-21T08:18:54.148 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.150 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.153 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.158 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.159 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:54.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-21T08:18:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.165 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.168 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.174 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:18:54.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-21T08:18:54.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.187 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-21T08:18:54.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-21T08:18:54.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-21T08:18:54.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-21T08:18:54.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-21T08:18:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.198 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.205 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.206 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.207 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.213 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.218 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.222 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-21T08:18:54.223 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.225 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-21T08:18:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-21T08:18:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:18:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max_requests": { 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_requests", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-21T08:18:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-21T08:18:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-21T08:18:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-21T08:18:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-21T08:18:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-21T08:18:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smb", 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "internal_store_backend": { 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "internal_store_backend", 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "update_orchestration": { 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "update_orchestration", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-21T08:18:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:18:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:18:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-21T08:18:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-21T08:18:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-21T08:18:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24167, 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "y", 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540719139924082687, 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-21T08:18:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-21T08:18:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:18:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-21T08:18:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:18:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:18:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:18:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-21T08:18:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nginx": { 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nginx", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nginx container image", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-21T08:18:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba_metrics": { 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:18:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:18:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:18:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-21T08:18:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-21T08:18:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-21T08:18:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_interval": { 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:18:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:18:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:18:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:18:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-21T08:18:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "[]", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "{}", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:18:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:18:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:18:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:18:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "sso_oauth2": { 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sso_oauth2", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-21T08:18:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-21T08:18:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-21T08:18:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-21T08:18:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-21T08:18:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-21T08:18:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:18:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-21T08:18:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-21T08:18:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-21T08:18:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:18:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-21T08:18:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max_requests": { 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_requests", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:18:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-21T08:18:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-21T08:18:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-21T08:18:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smb", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "internal_store_backend": { 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "internal_store_backend", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "update_orchestration": { 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "update_orchestration", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:18:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-21T08:18:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:18:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-21T08:18:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "modules": [ 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard", 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "iostat", 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "nfs", 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "restful", 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_schedule" 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-09-21T08:18:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-09-21T08:18:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-09-21T08:18:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-09-21T08:18:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:18:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-09-21T08:18:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-09-21T08:18:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-09-21T08:18:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:18:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nginx": { 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nginx", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nginx container image", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:18:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:18:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba_metrics": { 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-09-21T08:18:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:18:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:18:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:18:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:18:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_keepalive_interval": { 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-09-21T08:18:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:18:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:18:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:18:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:18:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "[]", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "{}", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.031 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.033 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.035 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.037 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.038 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-09-21T08:18:55.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-09-21T08:18:55.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-09-21T08:18:55.041 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:55.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.053 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.054 INFO:teuthology.orchestra.run.smithi006.stdout: "sso_oauth2": { 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sso_oauth2", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.055 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.057 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.058 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.061 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.062 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.063 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:18:55.065 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:18:55.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.069 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.073 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.078 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.079 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:18:55.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.086 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.088 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:55.094 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.100 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.103 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.104 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.106 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.109 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.119 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-09-21T08:18:55.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.125 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.129 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.130 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.141 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.145 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.146 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-09-21T08:18:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.150 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.152 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-09-21T08:18:55.154 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.165 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.171 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.178 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.179 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.183 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.191 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:18:55.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:55.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-09-21T08:18:55.198 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:55.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.203 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.210 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max_requests": { 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_requests", 2024-09-21T08:18:55.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.219 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.220 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.222 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.229 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-09-21T08:18:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-09-21T08:18:55.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-09-21T08:18:55.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smb", 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "internal_store_backend": { 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "internal_store_backend", 2024-09-21T08:18:55.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "update_orchestration": { 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "update_orchestration", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.275 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-09-21T08:18:55.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.281 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:55.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-09-21T08:18:55.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.299 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.304 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-09-21T08:18:55.306 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.307 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.309 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.310 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.315 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.316 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-09-21T08:18:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:18:55.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.321 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.323 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.325 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-09-21T08:18:55.327 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-09-21T08:18:55.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "sqlite3_killpoint": { 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:18:55.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "dev", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-09-21T08:18:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-09-21T08:18:55.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "services": { 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard": "https://172.21.15.6:8443/" 2024-09-21T08:18:55.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "always_on_modules": { 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "octopus": [ 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "pacific": [ 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-21T08:18:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "quincy": [ 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-21T08:18:55.335 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "reef": [ 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-21T08:18:55.336 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "squid": [ 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "last_failure_osd_epoch": 5, 2024-09-21T08:18:55.337 INFO:teuthology.orchestra.run.smithi006.stdout: "active_clients": [ 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1610154042 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "libcephsqlite", 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 530598631 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2099904765 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.339 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2128961780 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3383858157 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2796729657 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:55.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-21T08:18:55.342 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 msgr2=0x7fad600b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 0x7fad600b8c10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad700058c0 tx=0x7fad7000a2d0 comp rx=0 tx=0).stop 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 msgr2=0x7fad74199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fad6800d740 tx=0x7fad6800dc00 comp rx=0 tx=0).stop 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 shutdown_connections 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fad600b6700 0x7fad600b8c10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad74108c40 0x7fad7419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad741082f0 0x7fad74199720 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 --2- 172.21.15.6:0/3636884798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad74103130 0x7fad74199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:18:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 >> 172.21.15.6:0/3636884798 conn(0x7fad74079e50 msgr2=0x7fad74104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:18:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 shutdown_connections 2024-09-21T08:18:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:18:53.938+0000 7fad7b4b6640 1 -- 172.21.15.6:0/3636884798 wait complete. 2024-09-21T08:18:55.349 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T08:18:55.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T08:18:55.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/416323144' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1061594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:54 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3636884798' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/416323144' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1061594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:54 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3636884798' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/416323144' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1061594929' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:18:55.351 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:54 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3636884798' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:18:55.377 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:55 smithi006 ceph-mon[30970]: pgmap v903: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:55.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:55 smithi119 ceph-mon[33564]: pgmap v903: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:55.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:55 smithi145 ceph-mon[34049]: pgmap v903: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:18:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:56.221 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:56.221 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:18:56.221 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.002140834, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000362745, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:56.222 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 335, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 327, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1026496, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 201328, 2024-09-21T08:18:56.223 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.067136687, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.029969726, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.047120860, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 327, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.031987287, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000097820 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.224 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 1026496, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 201328 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 249, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 204464, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.028867737, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.023726126, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002400778, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 247, 2024-09-21T08:18:56.225 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.019302906, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000078149 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 204464 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-21T08:18:56.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:18:56.227 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-21T08:18:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148704, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:18:56.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 968, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:18:56.230 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 333, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 976803, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 333, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 333, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 976803, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:56.231 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:57.058 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T08:18:57.058 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T08:18:57.058 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T08:18:57.058 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T08:18:57.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T08:18:57.361 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:57.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:57 smithi119 ceph-mon[33564]: pgmap v904: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:57.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:57 smithi145 ceph-mon[34049]: pgmap v904: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:57.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:57 smithi006 ceph-mon[30970]: pgmap v904: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 341, 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 333, 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1028128, 2024-09-21T08:18:57.915 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 205168, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.077441042, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.034395966, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.051817525, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 333, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.034295079, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000102988 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:57.916 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 1028128, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 205168 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 253, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 205168, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.026715421, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.021794022, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.001874175, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:57.917 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 251, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.014139486, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000056332 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 205168 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.918 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.000269051, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000179753, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-21T08:18:57.920 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:18:57.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-21T08:18:57.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148744, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 30, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-21T08:18:57.923 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 968, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-21T08:18:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 339, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 977583, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 339, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 339, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 977583, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:57.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:57.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:57.926 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:58.582 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T08:18:58.582 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T08:18:58.582 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T08:18:58.582 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T08:18:58.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T08:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:18:59.314 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:18:59 smithi006 ceph-mon[30970]: pgmap v905: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 4, 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2912, 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 448, 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:59.366 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.003320135, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000046333, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002251046, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.003973758, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001324586 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 333, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 327, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1024128, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 202144, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.069485111, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.032104164, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.047780766, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:59.368 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 326, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.023294402, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000071455 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 1024128, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 202144 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2024-09-21T08:18:59.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 250, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 204640, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.026524844, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.021168772, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002106064, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 248, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.017159305, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000069190 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:18:59.370 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 204640 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:18:59.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:18:59.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:18:59.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148721, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 30, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-21T08:18:59.374 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 968, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 335, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 977063, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-21T08:18:59.375 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 335, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 335, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 977063, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:18:59.376 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:18:59.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:18:59 smithi119 ceph-mon[33564]: pgmap v905: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:18:59.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:18:59 smithi145 ceph-mon[34049]: pgmap v905: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T08:19:00.031 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T08:19:00.031 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T08:19:00.032 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T08:19:00.032 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T08:19:00.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T08:19:00.301 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 4, 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2912, 2024-09-21T08:19:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 448, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.003192087, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000046015, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002209526, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.003975798, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001325266 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:19:00.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 338, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 332, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1025488, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 205344, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.069693765, 2024-09-21T08:19:00.846 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.030382790, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.049234980, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 331, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.021714907, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000065603 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 1025488, 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 205344 2024-09-21T08:19:00.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 255, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 205520, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.028214731, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.022400118, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002486135, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 253, 2024-09-21T08:19:00.848 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.020621390, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000081507 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 205520 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-09-21T08:19:00.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:00.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148744, 2024-09-21T08:19:00.852 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 30, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-09-21T08:19:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 340, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 977713, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 340, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 340, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 977713, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:19:00.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-21T08:19:00.856 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-21T08:19:01.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:01 smithi119 ceph-mon[33564]: pgmap v906: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:19:01.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:01 smithi145 ceph-mon[34049]: pgmap v906: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:19:01.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:01 smithi006 ceph-mon[30970]: pgmap v906: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T08:19:01.645 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T08:19:01.645 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T08:19:01.645 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T08:19:01.645 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T08:19:01.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T08:19:01.982 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T08:19:02.597 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 54630, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 50791, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 17334155, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 79959489, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 13, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 3.794427849, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 1.773401170, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 2.037250637, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.338295532, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 50790, 2024-09-21T08:19:02.598 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.373972161, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000046740 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 76685, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.013585450, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000177 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 12307, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 12555, 2024-09-21T08:19:02.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3142859, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 60491634, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.962501263, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.433669114, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.187674664, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.277431878, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 12553, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.131353265, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000090126 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.600 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 630304 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 13459, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 12417, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 4628995, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 33485716, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 299, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 9, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 1.298424992, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.538281148, 2024-09-21T08:19:02.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.388600916, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.323122661, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 12416, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.806054595, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000064920 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2102, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000395765, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000188 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1706576, 2024-09-21T08:19:02.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 476832 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 16780, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 25.694656333, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001531266 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.603 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 931, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.235675187, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000253141 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 10130, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 10130, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 10130, 2024-09-21T08:19:02.604 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 84.736010798, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.008364857 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 90, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 9, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 1, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 2054, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 207, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 1847, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 1690, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-21T08:19:02.605 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 1041, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 1042, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 2, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 55957, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 53634, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 35, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T08:19:02.606 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 30234, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 1011, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 1406055888, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 30234, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 1049, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 30, 2024-09-21T08:19:02.607 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 1019, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 29185, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 10166, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 5743, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 1, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 31033, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 10783, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 65, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 2690 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-21T08:19:02.608 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 1, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 405, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 250, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 155, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T08:19:02.609 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 16, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 16616, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 30, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 10, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T08:19:02.610 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 18231, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 18231, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 40, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 40, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 3, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 146126312, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-09-21T08:19:02.611 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3702, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 37.546691731, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.010142272 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 1775, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 2054, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 279, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 109, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 122, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 13, 2024-09-21T08:19:02.612 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 2054, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 2423, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 369, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 1042, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 1305, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 263, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 147084, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 361639936 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 11169, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 10130, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 314, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T08:19:02.613 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1259, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 41.754221435, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.033164592 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 782, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.764439014, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002256315 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 155, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.299169132, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001930123 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5209, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 36.012978185, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.006913606 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.615 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.616 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T08:19:02.617 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 18, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002940752, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000163375 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 37, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.041555672, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001123126 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 18, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.199772693, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.011098482 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1907, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.170370454, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001138107 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 146, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.173224194, 2024-09-21T08:19:02.619 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001186467 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 388, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.924771673, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004960751 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.620 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.003999557, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001999778 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 12, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.080661750, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.006721812 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.621 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.004013495, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001337831 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.622 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 10, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.024725775, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002472577 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.623 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 184, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.279167017, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001517212 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T08:19:02.624 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 2, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 5, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 3, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 1173, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 586, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 569, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:02.625 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:02.626 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T08:19:02.627 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 696503, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 205, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:02.628 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 9736, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 197, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 6215766, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 63961, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T08:19:02.629 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 36017, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 143260110, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 37, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 36017, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 36017, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 90.602841797, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002515557 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 36017, 2024-09-21T08:19:02.630 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 36634 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 36017, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 30412, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 5605, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 0, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 11, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 148, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 3820, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 156, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T08:19:02.631 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 1, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 5, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 1086, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 30264, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 22, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T08:19:02.632 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 1, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T08:19:02.633 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 109, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 34, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 12, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 12, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 905, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 0, 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 215 2024-09-21T08:19:02.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 46, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 9, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 536, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 250, 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T08:19:02.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 80392, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 17778134, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 80392, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 80392, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 17778134, 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:02.636 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:02.637 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 36017, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 143288440, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 36017, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 143288440, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 36017, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 36017, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 36017, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 36017, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 250, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 28330, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 250, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 118, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 28330, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.640 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x56125670f520": { 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 60, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 18231, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 141932008, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 18231, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:02.641 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3702, 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 141931948, 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 18570 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:02.642 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T08:19:03.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:03 smithi119 ceph-mon[33564]: pgmap v907: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T08:19:03.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:03 smithi145 ceph-mon[34049]: pgmap v907: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T08:19:03.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:03 smithi006 ceph-mon[30970]: pgmap v907: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T08:19:03.656 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T08:19:03.656 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=18 2024-09-21T08:19:03.656 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=12 2024-09-21T08:19:03.656 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T08:19:03.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T08:19:03.913 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 338, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 332, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1025488, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 205360, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.055735870, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.026255540, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.039915105, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:04.528 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 331, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.017474174, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000052792 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1025488, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 205360 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 6, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 256, 2024-09-21T08:19:04.529 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3232, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 205792, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.019344128, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.013928664, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.003161553, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 255, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.016180675, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000063453 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:04.530 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 205792 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.000376537, 2024-09-21T08:19:04.531 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000303433, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:19:04.532 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:04.533 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:04.534 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 148704, 2024-09-21T08:19:04.535 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 29, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T08:19:04.536 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 340, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 977713, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 340, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:04.537 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 340, 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 977713, 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:04.538 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T08:19:05.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:05 smithi119 ceph-mon[33564]: pgmap v908: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 23 KiB/s wr, 4 op/s 2024-09-21T08:19:05.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:05 smithi145 ceph-mon[34049]: pgmap v908: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 23 KiB/s wr, 4 op/s 2024-09-21T08:19:05.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:05 smithi006 ceph-mon[30970]: pgmap v908: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 23 KiB/s wr, 4 op/s 2024-09-21T08:19:05.644 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-21T08:19:05.644 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-21T08:19:05.644 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-21T08:19:05.644 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T08:19:05.644 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T08:19:05.902 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T08:19:06.598 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T08:19:06.598 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.001208970, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000264542, 2024-09-21T08:19:06.599 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 340, 2024-09-21T08:19:06.600 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 332, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1027856, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 204528, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.054371810, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.025420254, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.038824914, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 332, 2024-09-21T08:19:06.601 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.020895452, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000062938 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1027856, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 204528 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 253, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:06.602 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 205168, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.018531473, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.014651238, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001451056, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 251, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.013756245, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000054805 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:06.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 205168 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:06.604 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:06.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:06.606 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 148761, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 31, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:06.607 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 338, 2024-09-21T08:19:06.608 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 977453, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 338, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 338, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 977453, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:06.609 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T08:19:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:07 smithi119 ceph-mon[33564]: pgmap v909: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T08:19:07.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:07 smithi119 ceph-mon[33564]: osdmap e110: 12 total, 12 up, 12 in 2024-09-21T08:19:07.437 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-21T08:19:07.437 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-21T08:19:07.437 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-21T08:19:07.437 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T08:19:07.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T08:19:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:07 smithi145 ceph-mon[34049]: pgmap v909: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T08:19:07.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:07 smithi145 ceph-mon[34049]: osdmap e110: 12 total, 12 up, 12 in 2024-09-21T08:19:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:07 smithi006 ceph-mon[30970]: pgmap v909: 129 pgs: 129 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T08:19:07.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:07 smithi006 ceph-mon[30970]: osdmap e110: 12 total, 12 up, 12 in 2024-09-21T08:19:07.684 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.b/config 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 347, 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 339, 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1030448, 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 208224, 2024-09-21T08:19:08.452 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.060008717, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.026350753, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.043506352, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 339, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.019585173, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000057773 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:08.453 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1030448, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 208224 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 257, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 205872, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.019049563, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.015103032, 2024-09-21T08:19:08.454 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001464660, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 255, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015589083, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000061133 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 205872 2024-09-21T08:19:08.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.000356830, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000283821, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:08.456 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.457 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:08.458 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:08.459 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 148738, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 31, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:08.460 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T08:19:08.461 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 345, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 979064, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 345, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 345, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 979064, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T08:19:08.462 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T08:19:08.463 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T08:19:08.463 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:08.463 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T08:19:08.463 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T08:19:09.134 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T08:19:09.134 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T08:19:09.134 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T08:19:09.134 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T08:19:09.135 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T08:19:09.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:09 smithi119 ceph-mon[33564]: pgmap v911: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:09.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:09 smithi145 ceph-mon[34049]: pgmap v911: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:09.459 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T08:19:09.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:09 smithi006 ceph-mon[30970]: pgmap v911: 129 pgs: 129 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 0, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 2, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 0, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.001074339, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.000182328, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:10.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:10.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 254, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 205344, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.019289823, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.015129824, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.001516858, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 252, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.016745814, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000066451 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:10.221 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 205344 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 342, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 334, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1028400, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 205808, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:10.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.058652958, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.027626995, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.040154145, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 334, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.020433608, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000061178 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1028400, 2024-09-21T08:19:10.223 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 205808 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:10.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:10.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-21T08:19:10.226 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148704, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 29, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:10.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:10.228 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:10.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 340, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 977713, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 340, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 340, 2024-09-21T08:19:10.230 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 977713, 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:10.231 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-21T08:19:11.189 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-21T08:19:11.189 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-21T08:19:11.189 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-21T08:19:11.189 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T08:19:11.189 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: pgmap v912: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:19:11.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:11 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:19:11.441 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: pgmap v912: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:19:11.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:11 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:19:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: pgmap v912: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T08:19:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:19:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T08:19:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:19:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:19:11.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:11 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' 2024-09-21T08:19:12.430 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-21T08:19:12.430 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:12.430 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 4, 2024-09-21T08:19:12.430 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 4, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 2912, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 448, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.003127096, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000048469, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.002175953, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.003885089, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001295029 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.431 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 339, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 333, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1025760, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 206000, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:12.432 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.056376103, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.026781580, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.040870430, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 332, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.017034129, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000051307 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1025760, 2024-09-21T08:19:12.433 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 206000 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 255, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 205520, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.019170817, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.015200144, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.001433407, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:12.434 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 253, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.013617200, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000053822 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 205520 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-21T08:19:12.435 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:12.436 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:12.437 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148721, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 30, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:12.438 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:12.439 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 341, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 977843, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 341, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:12.440 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 341, 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 977843, 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:12.441 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-21T08:19:12.441 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:12 smithi145 ceph-mon[34049]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:19:12.441 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:12 smithi145 ceph-mon[34049]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:19:12.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:12 smithi006 ceph-mon[30970]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:19:12.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:12 smithi006 ceph-mon[30970]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:19:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:12 smithi119 ceph-mon[33564]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-21T08:19:12.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:12 smithi119 ceph-mon[33564]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-21T08:19:13.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:13 smithi145 ceph-mon[34049]: pgmap v913: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T08:19:13.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:13 smithi006 ceph-mon[30970]: pgmap v913: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T08:19:13.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:13 smithi119 ceph-mon[33564]: pgmap v913: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T08:19:13.685 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-21T08:19:13.685 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-21T08:19:13.685 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-21T08:19:13.685 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T08:19:13.685 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T08:19:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T08:19:14.509 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-21T08:19:14.509 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:14.509 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1003, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 996, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 34814800, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 411621, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 7, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.143991147, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.057194195, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.070723897, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.019330583, 2024-09-21T08:19:14.510 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 995, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.048908989, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000049154 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1063200, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 211280 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:14.511 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2772, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 3022, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 84229593, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 1496945, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 7, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.358231913, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.136742508, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.117339724, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.081997373, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3021, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.115148338, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000038115 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.512 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 617296 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 677, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 679, 2024-09-21T08:19:14.513 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 25361681, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 215301, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 6, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.079628635, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.028015526, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.028855162, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.017882215, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 677, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.027125061, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000040066 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:14.514 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-21T08:19:14.515 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6821, 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.180088556, 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000026402 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-21T08:19:14.516 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.517 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 0, 2024-09-21T08:19:14.518 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 2392, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2392, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 0, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 2392, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 0, 2024-09-21T08:19:14.519 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 2, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 0, 2024-09-21T08:19:14.520 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 1011, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 1406055888, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 6, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 0, 2024-09-21T08:19:14.521 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 0 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 0, 2024-09-21T08:19:14.522 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-21T08:19:14.523 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0, 2024-09-21T08:19:14.524 INFO:teuthology.orchestra.run.smithi145.stdout: "uninline_started": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "uninline_succeeded": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "uninline_write_failed": 0 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 18232, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-09-21T08:19:14.525 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 40, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 3, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 146126448, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 146126312, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.526 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 18232 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 1775, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 2024, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 249, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 109, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 122, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 13, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 2392, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 2396, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 4, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 0, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 0, 2024-09-21T08:19:14.527 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 127524, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 331665408 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.528 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.529 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-21T08:19:14.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.531 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.533 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.534 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.535 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.536 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:19:14.539 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 0, 2024-09-21T08:19:14.540 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 5351, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:14.541 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:14.542 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:14.543 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:14.544 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 232903, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 77, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 9976, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 203, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:14.545 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 5990687, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 49979, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 4073, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 26, 2024-09-21T08:19:14.546 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 4, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 4073, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4073, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.807900039, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001180432 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-21T08:19:14.547 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4073, 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4074 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 4073, 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 4073, 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 0, 2024-09-21T08:19:14.548 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 2371, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 0, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 1699, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 0, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 0, 2024-09-21T08:19:14.549 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-21T08:19:14.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 2, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:19:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:19:14.552 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-21T08:19:14.553 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-21T08:19:14.554 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 111, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 28, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 10, 2024-09-21T08:19:14.555 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 10, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 0, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 0 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.556 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 0, 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.557 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 0, 2024-09-21T08:19:14.558 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-21T08:19:14.559 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.559 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:14.559 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:14.559 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-21T08:19:14.559 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 4448, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 143983706, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 4448, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4448, 2024-09-21T08:19:14.560 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 143983706, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:14.561 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4073, 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 142206318, 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4073, 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 142206318, 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:14.562 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-21T08:19:14.563 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4073, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 4073, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4073, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 4073, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.564 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.565 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55df510d35f0": { 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-21T08:19:14.566 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "trackedop": { 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 0 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:14.567 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-21T08:19:14.896 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:14 smithi145 ceph-mon[34049]: osdmap e111: 12 total, 12 up, 12 in 2024-09-21T08:19:14.908 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:14 smithi119 ceph-mon[33564]: osdmap e111: 12 total, 12 up, 12 in 2024-09-21T08:19:14.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:14 smithi006 ceph-mon[30970]: osdmap e111: 12 total, 12 up, 12 in 2024-09-21T08:19:15.560 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T08:19:15.560 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:19:15.560 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:19:15.560 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T08:19:15.560 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T08:19:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.c/config 2024-09-21T08:19:15.907 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:15 smithi119 ceph-mon[33564]: pgmap v915: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 127 B/s wr, 2 op/s 2024-09-21T08:19:15.930 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:15 smithi145 ceph-mon[34049]: pgmap v915: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 127 B/s wr, 2 op/s 2024-09-21T08:19:15.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:15 smithi006 ceph-mon[30970]: pgmap v915: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 127 B/s wr, 2 op/s 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 4, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 4, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 2912, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 448, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-21T08:19:16.388 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.003097406, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000033937, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.002314600, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.003993896, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001331298 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.389 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 259, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 206224, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.020161847, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.016147955, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.001293025, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:16.390 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 257, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018243868, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000070987 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 206224 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:19:16.391 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 346, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 340, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1028352, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 209696, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.057801723, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.027011070, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.042442288, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 339, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018223461, 2024-09-21T08:19:16.392 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000053756 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1028352, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 209696 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-21T08:19:16.393 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:19:16.394 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:19:16.395 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148744, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 30, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:19:16.396 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 968, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-21T08:19:16.397 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 348, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 979454, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 348, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 348, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 979454, 2024-09-21T08:19:16.398 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-21T08:19:16.399 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-21T08:19:16.943 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:16 smithi145 ceph-mon[34049]: pgmap v916: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 103 B/s wr, 2 op/s 2024-09-21T08:19:16.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:16 smithi006 ceph-mon[30970]: pgmap v916: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 103 B/s wr, 2 op/s 2024-09-21T08:19:17.118 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T08:19:17.118 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T08:19:17.118 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T08:19:17.119 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T08:19:17.128 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T08:19:17.128 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T08:19:17.129 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:19:17.157 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:16 smithi119 ceph-mon[33564]: pgmap v916: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 103 B/s wr, 2 op/s 2024-09-21T08:19:17.166 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T08:19:17.167 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:19:17.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:19:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 -- 172.21.15.6:0/1800142633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4102a80 msgr2=0x7f6cc4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/1800142633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4102a80 0x7f6cc4102e90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009900 tx=0x7f6cb402a410 comp rx=0 tx=0).stop 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 -- 172.21.15.6:0/1800142633 shutdown_connections 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/1800142633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc4108d10 0x7f6cc410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/1800142633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc41083c0 0x7f6cc41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/1800142633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4102a80 0x7f6cc4102e90 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 -- 172.21.15.6:0/1800142633 >> 172.21.15.6:0/1800142633 conn(0x7f6cc4079740 msgr2=0x7f6cc4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 -- 172.21.15.6:0/1800142633 shutdown_connections 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.051+0000 7f6cc9a98640 1 -- 172.21.15.6:0/1800142633 wait complete. 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 Processor -- start 2024-09-21T08:19:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 -- start start 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc4102a80 0x7f6cc419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc41083c0 0x7f6cc419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4113950 con 0x7f6cc4108d10 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41137d0 con 0x7f6cc4102a80 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc9a98640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4113ad0 con 0x7f6cc41083c0 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52648/0 (socket says 172.21.15.6:52648) 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc3fff640 1 -- 172.21.15.6:0/3589193619 learned_addr learned my addr 172.21.15.6:0/3589193619 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc37fe640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc4102a80 0x7f6cc419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.052+0000 7f6cc2ffd640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc41083c0 0x7f6cc419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 -- 172.21.15.6:0/3589193619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc41083c0 msgr2=0x7f6cc419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc41083c0 0x7f6cc419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 -- 172.21.15.6:0/3589193619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc4102a80 msgr2=0x7f6cc419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc4102a80 0x7f6cc419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 -- 172.21.15.6:0/3589193619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41a02f0 con 0x7f6cc4108d10 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc3fff640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00eaa0 tx=0x7f6cbc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00cdb0 con 0x7f6cc4108d10 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41a05e0 con 0x7f6cc4108d10 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cbc005020 con 0x7f6cc4108d10 2024-09-21T08:19:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0116d0 con 0x7f6cc4108d10 2024-09-21T08:19:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.053+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a6d40 con 0x7f6cc4108d10 2024-09-21T08:19:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.054+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc4103d00 con 0x7f6cc4108d10 2024-09-21T08:19:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.056+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f6cbc0051d0 con 0x7f6cc4108d10 2024-09-21T08:19:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.057+0000 7f6cc0ff9640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 0x7f6cac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.057+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7f6cbc0e7ff0 con 0x7f6cc4108d10 2024-09-21T08:19:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.057+0000 7f6cc37fe640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 0x7f6cac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.057+0000 7f6cc37fe640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 0x7f6cac0b8b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40057c0 tx=0x7f6cb40058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.060+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cbc016030 con 0x7f6cc4108d10 2024-09-21T08:19:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.264+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6cc4102e90 con 0x7f6cc4108d10 2024-09-21T08:19:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.264+0000 7f6cc0ff9640 1 -- 172.21.15.6:0/3589193619 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v111) ==== 81+0+871 (secure 0 0 0) 0x7f6cbc0b2540 con 0x7f6cc4108d10 2024-09-21T08:19:18.266 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2176108638 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:18.266 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/548693640 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1495310432 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3861437943 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1282952085 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/558991039 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3295809902 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4039375936 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:18.267 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1669454132 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:listed 15 entries 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.266+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 msgr2=0x7f6cac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.266+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 0x7f6cac0b8b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40057c0 tx=0x7f6cb40058d0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.266+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 msgr2=0x7f6cc419fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.266+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00eaa0 tx=0x7f6cbc00ef60 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 shutdown_connections 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f6cac0b6680 0x7f6cac0b8b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cc41083c0 0x7f6cc419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cc4108d10 0x7f6cc419fbc0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 --2- 172.21.15.6:0/3589193619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc4102a80 0x7f6cc419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 >> 172.21.15.6:0/3589193619 conn(0x7f6cc4079740 msgr2=0x7f6cc4101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 shutdown_connections 2024-09-21T08:19:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:18.267+0000 7f6cc9a98640 1 -- 172.21.15.6:0/3589193619 wait complete. 2024-09-21T08:19:19.150 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-21T08:19:19.151 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:19:19.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:19:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:19 smithi119 ceph-mon[33564]: pgmap v917: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:19.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:19 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3589193619' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:19 smithi145 ceph-mon[34049]: pgmap v917: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:19.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:19 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3589193619' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:19.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:19 smithi006 ceph-mon[30970]: pgmap v917: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:19.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:19 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3589193619' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 -- 172.21.15.6:0/3253291212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10c020 msgr2=0x7fb67c112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 --2- 172.21.15.6:0/3253291212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10c020 0x7fb67c112850 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb674009ca0 tx=0x7fb67402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 -- 172.21.15.6:0/3253291212 shutdown_connections 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 --2- 172.21.15.6:0/3253291212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10c020 0x7fb67c112850 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 --2- 172.21.15.6:0/3253291212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10b6d0 0x7fb67c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 --2- 172.21.15.6:0/3253291212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c1061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 -- 172.21.15.6:0/3253291212 >> 172.21.15.6:0/3253291212 conn(0x7fb67c101860 msgr2=0x7fb67c103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 -- 172.21.15.6:0/3253291212 shutdown_connections 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.009+0000 7fb681b7e640 1 -- 172.21.15.6:0/3253291212 wait complete. 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 Processor -- start 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 -- start start 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:20.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10c020 0x7fb67c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c115be0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c115a60 con 0x7fb67c10c020 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb681b7e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c115d60 con 0x7fb67c105d90 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb67affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb67affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52652/0 (socket says 172.21.15.6:52652) 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb67affd640 1 -- 172.21.15.6:0/1941106641 learned_addr learned my addr 172.21.15.6:0/1941106641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.010+0000 7fb67bfff640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10c020 0x7fb67c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 -- 172.21.15.6:0/1941106641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 msgr2=0x7fb67c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:20.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 -- 172.21.15.6:0/1941106641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10c020 msgr2=0x7fb67c1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10c020 0x7fb67c1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 -- 172.21.15.6:0/1941106641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c1a2520 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb67affd640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb67000e9f0 tx=0x7fb67000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67000ccc0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c1a2810 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6700108c0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670018660 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.011+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c1a8f70 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.012+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c1061a0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.015+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb670010430 con 0x7fb67c10b6d0 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.015+0000 7fb678ff9640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 0x7fb6640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:20.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.015+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 0x7fb6640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:20.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.015+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7fb6700e84e0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.016+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 0x7fb6640b8b90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009c20 tx=0x7fb66c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:20.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.018+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6700ae650 con 0x7fb67c10b6d0 2024-09-21T08:19:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.218+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb67c19d6e0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.218+0000 7fb678ff9640 1 -- 172.21.15.6:0/1941106641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v111) ==== 81+0+871 (secure 0 0 0) 0x7fb67c19d6e0 con 0x7fb67c10b6d0 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2176108638 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3452647007 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/548693640 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1495310432 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3861437943 2024-09-22T07:50:30.675598+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1282952085 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/558991039 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2249378231 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:20.222 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1452797413 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:20.222 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3295809902 2024-09-22T07:50:57.944225+0000 2024-09-21T08:19:20.222 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4039375936 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:20.222 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1669454132 2024-09-22T07:52:01.430168+0000 2024-09-21T08:19:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:listed 15 entries 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 msgr2=0x7fb6640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 0x7fb6640b8b90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009c20 tx=0x7fb66c005f90 comp rx=0 tx=0).stop 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 msgr2=0x7fb67c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb67000e9f0 tx=0x7fb67000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 shutdown_connections 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fb6640b6680 0x7fb6640b8b90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb67c10c020 0x7fb67c1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c10b6d0 0x7fb67c19cb50 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 --2- 172.21.15.6:0/1941106641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb67c105d90 0x7fb67c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 >> 172.21.15.6:0/1941106641 conn(0x7fb67c101860 msgr2=0x7fb67c108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 shutdown_connections 2024-09-21T08:19:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:20.221+0000 7fb681b7e640 1 -- 172.21.15.6:0/1941106641 wait complete. 2024-09-21T08:19:20.912 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-21T08:19:20.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:19:20.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /tmp/cephfs 2024-09-21T08:19:20.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[85572]: fuse finished with error 0 and tester_r 0 2024-09-21T08:19:21.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:19:21.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:21 smithi006 ceph-mon[30970]: pgmap v918: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:21.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:21 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1941106641' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:21 smithi119 ceph-mon[33564]: pgmap v918: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:21.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:21 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1941106641' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:21 smithi145 ceph-mon[34049]: pgmap v918: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T08:19:21.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:21 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1941106641' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:19:23.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:23 smithi119 ceph-mon[33564]: pgmap v919: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T08:19:23.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:23 smithi145 ceph-mon[34049]: pgmap v919: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T08:19:23.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:23 smithi006 ceph-mon[30970]: pgmap v919: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T08:19:25.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:25 smithi119 ceph-mon[33564]: pgmap v920: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 98 B/s wr, 2 op/s 2024-09-21T08:19:25.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:25 smithi145 ceph-mon[34049]: pgmap v920: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 98 B/s wr, 2 op/s 2024-09-21T08:19:25.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:25 smithi006 ceph-mon[30970]: pgmap v920: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 98 B/s wr, 2 op/s 2024-09-21T08:19:27.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:19:27.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:19:27.139 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-21T08:19:27.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:19:27.185 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-21T08:19:27.223 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-21T08:19:27.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:19:27.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-21T08:19:27.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:19:27.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-21T08:19:27.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:27 smithi006 ceph-mon[30970]: pgmap v921: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:27.387 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T08:19:27.398 INFO:tasks.cephadm:Teardown begin 2024-09-21T08:19:27.398 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T08:19:27.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:19:27.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:27 smithi119 ceph-mon[33564]: pgmap v921: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:27.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:27 smithi145 ceph-mon[34049]: pgmap v921: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:27.698 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:28.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 -- 172.21.15.6:0/3368841298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 msgr2=0x7fde3c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:28.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3368841298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c1098e0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009900 tx=0x7fde2c02a410 comp rx=0 tx=0).stop 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 -- 172.21.15.6:0/3368841298 shutdown_connections 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3368841298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c109e20 0x7fde3c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3368841298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c1098e0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3368841298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c103b90 0x7fde3c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 -- 172.21.15.6:0/3368841298 >> 172.21.15.6:0/3368841298 conn(0x7fde3c0ff5e0 msgr2=0x7fde3c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 -- 172.21.15.6:0/3368841298 shutdown_connections 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.310+0000 7fde42e3a640 1 -- 172.21.15.6:0/3368841298 wait complete. 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 Processor -- start 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 -- start start 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c103b90 0x7fde3c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 0x7fde3c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c113990 con 0x7fde3c1094d0 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c113810 con 0x7fde3c109e20 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.311+0000 7fde42e3a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c113b10 con 0x7fde3c103b90 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48572/0 (socket says 172.21.15.6:48572) 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 -- 172.21.15.6:0/3910029641 learned_addr learned my addr 172.21.15.6:0/3910029641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde40bd6640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c103b90 0x7fde3c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde413d7640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 0x7fde3c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 -- 172.21.15.6:0/3910029641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c103b90 msgr2=0x7fde3c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c103b90 0x7fde3c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 -- 172.21.15.6:0/3910029641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 msgr2=0x7fde3c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 0x7fde3c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 -- 172.21.15.6:0/3910029641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3c1a86e0 con 0x7fde3c1094d0 2024-09-21T08:19:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde413d7640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 0x7fde3c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde33fff640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fde2c005940 tx=0x7fde2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c03f030 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde2c003c90 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3c1a8970 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.312+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c035070 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.313+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3c1a8e50 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.314+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3c103fa0 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.315+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fde2c042030 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.316+0000 7fde31ffb640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 0x7fde240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.316+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7fde2c1084a0 con 0x7fde3c1094d0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.316+0000 7fde40bd6640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 0x7fde240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.317+0000 7fde40bd6640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 0x7fde240b8b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde380058c0 tx=0x7fde3800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.319+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde2c0ce610 con 0x7fde3c1094d0 2024-09-21T08:19:28.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.544+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde3c02e640 con 0x7fde3c1094d0 2024-09-21T08:19:28.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.544+0000 7fde31ffb640 1 -- 172.21.15.6:0/3910029641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7fde2c0d29f0 con 0x7fde3c1094d0 2024-09-21T08:19:28.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:19:28.547 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:19:28.547 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 msgr2=0x7fde240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 0x7fde240b8b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde380058c0 tx=0x7fde3800a2d0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 msgr2=0x7fde3c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fde2c005940 tx=0x7fde2c0042f0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 shutdown_connections 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fde240b6680 0x7fde240b8b90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde3c109e20 0x7fde3c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde3c1094d0 0x7fde3c075c50 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 --2- 172.21.15.6:0/3910029641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde3c103b90 0x7fde3c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.547+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 >> 172.21.15.6:0/3910029641 conn(0x7fde3c0ff5e0 msgr2=0x7fde3c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.548+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 shutdown_connections 2024-09-21T08:19:28.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:28.548+0000 7fde42e3a640 1 -- 172.21.15.6:0/3910029641 wait complete. 2024-09-21T08:19:29.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:29 smithi006 ceph-mon[30970]: pgmap v922: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:29.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:29 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3910029641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:29.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:19:29.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:29 smithi119 ceph-mon[33564]: pgmap v922: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:29.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:29 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3910029641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:29 smithi145 ceph-mon[34049]: pgmap v922: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:29.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:29 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3910029641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 -- 172.21.15.6:0/3935933343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 msgr2=0x7f03841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 --2- 172.21.15.6:0/3935933343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f03841087b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0378009900 tx=0x7f037802a410 comp rx=0 tx=0).stop 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 -- 172.21.15.6:0/3935933343 shutdown_connections 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 --2- 172.21.15.6:0/3935933343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384108cf0 0x7f038410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 --2- 172.21.15.6:0/3935933343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f03841087b0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 --2- 172.21.15.6:0/3935933343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384102a60 0x7f0384102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 -- 172.21.15.6:0/3935933343 >> 172.21.15.6:0/3935933343 conn(0x7f0384079730 msgr2=0x7f0384079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 -- 172.21.15.6:0/3935933343 shutdown_connections 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.125+0000 7f038a46d640 1 -- 172.21.15.6:0/3935933343 wait complete. 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.126+0000 7f038a46d640 1 Processor -- start 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.126+0000 7f038a46d640 1 -- start start 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 0x7f038419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384108cf0 0x7f038419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0384112860 con 0x7f03841083a0 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f03841126e0 con 0x7f0384108cf0 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f038a46d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f03841129e0 con 0x7f0384102a60 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48602/0 (socket says 172.21.15.6:48602) 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 -- 172.21.15.6:0/3716964885 learned_addr learned my addr 172.21.15.6:0/3716964885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f0388a0a640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384108cf0 0x7f038419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f0383fff640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 0x7f038419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 -- 172.21.15.6:0/3716964885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 msgr2=0x7f038419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 0x7f038419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 -- 172.21.15.6:0/3716964885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384108cf0 msgr2=0x7f038419bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384108cf0 0x7f038419bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 -- 172.21.15.6:0/3716964885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03841a64a0 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f0383fff640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 0x7f038419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03837fe640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f037802a930 tx=0x7f0378003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.127+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037803f070 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.128+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f037803baf0 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.128+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03841a6730 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.128+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378035030 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.128+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841a6c10 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.129+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0384103ce0 con 0x7f03841083a0 2024-09-21T08:19:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.130+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0378042070 con 0x7f03841083a0 2024-09-21T08:19:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.131+0000 7f03817fa640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 0x7f036c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.131+0000 7f0383fff640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 0x7f036c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.131+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7f03781086f0 con 0x7f03841083a0 2024-09-21T08:19:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.132+0000 7f0383fff640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 0x7f036c0b8b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f038406c760 tx=0x7f0374005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.134+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03780ce800 con 0x7f03841083a0 2024-09-21T08:19:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.360+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0384102e70 con 0x7f03841083a0 2024-09-21T08:19:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.361+0000 7f03817fa640 1 -- 172.21.15.6:0/3716964885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11839 (secure 0 0 0) 0x7f0384102e70 con 0x7f03841083a0 2024-09-21T08:19:30.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:19:30.363 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"btime":"2024-09-21T07:59:28:670569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/161038542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":161038542},{"type":"v1","addr":"172.21.15.6:6835","nonce":161038542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3652258575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":3652258575},{"type":"v1","addr":"172.21.15.6:6837","nonce":3652258575}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14835,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/387284597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":387284597},{"type":"v1","addr":"172.21.15.6:6839","nonce":387284597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14847,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1772436480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1772436480},{"type":"v1","addr":"172.21.15.6:6841","nonce":1772436480}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24619,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/4259948654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4259948654},{"type":"v1","addr":"172.21.15.145:6833","nonce":4259948654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/592378988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":592378988},{"type":"v1","addr":"172.21.15.119:6833","nonce":592378988}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24650,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/467473041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":467473041},{"type":"v1","addr":"172.21.15.119:6835","nonce":467473041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1223773032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":1223773032},{"type":"v1","addr":"172.21.15.145:6835","nonce":1223773032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2301419443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2301419443},{"type":"v1","addr":"172.21.15.145:6837","nonce":2301419443}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24674,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/649850898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":649850898},{"type":"v1","addr":"172.21.15.119:6837","nonce":649850898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:58:46.069948+0000","modified":"2024-09-21T07:59:28.356248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24713},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24694":{"gid":24694,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3378332428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3378332428},{"type":"v1","addr":"172.21.15.145:6839","nonce":3378332428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24713":{"gid":24713,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/1644051507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1644051507},{"type":"v1","addr":"172.21.15.119:6839","nonce":1644051507}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24713,"qdb_cluster":[24713]},"id":1}]} 2024-09-21T08:19:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-09-21T08:19:30.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 msgr2=0x7f036c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:30.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 0x7f036c0b8b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f038406c760 tx=0x7f0374005f90 comp rx=0 tx=0).stop 2024-09-21T08:19:30.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 msgr2=0x7f038419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:30.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f037802a930 tx=0x7f0378003b90 comp rx=0 tx=0).stop 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 shutdown_connections 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f036c0b6680 0x7f036c0b8b90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0384108cf0 0x7f038419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841083a0 0x7f038419b6d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 --2- 172.21.15.6:0/3716964885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0384102a60 0x7f038419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 >> 172.21.15.6:0/3716964885 conn(0x7f0384079730 msgr2=0x7f03841044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 shutdown_connections 2024-09-21T08:19:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:30.363+0000 7f038a46d640 1 -- 172.21.15.6:0/3716964885 wait complete. 2024-09-21T08:19:31.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:19:31.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:31 smithi006 ceph-mon[30970]: pgmap v923: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:31.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:31 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3716964885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:31 smithi119 ceph-mon[33564]: pgmap v923: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:31.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:31 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3716964885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:31 smithi145 ceph-mon[34049]: pgmap v923: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:31.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:31 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3716964885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:19:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.780+0000 7f7d60354640 1 -- 172.21.15.6:0/1388164046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58109e10 msgr2=0x7f7d58110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.780+0000 7f7d60354640 1 --2- 172.21.15.6:0/1388164046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58109e10 0x7f7d58110640 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009ca0 tx=0x7f7d5002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 -- 172.21.15.6:0/1388164046 shutdown_connections 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 --2- 172.21.15.6:0/1388164046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 0x7f7d581098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 --2- 172.21.15.6:0/1388164046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58109e10 0x7f7d58110640 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 --2- 172.21.15.6:0/1388164046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58103b80 0x7f7d58103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 -- 172.21.15.6:0/1388164046 >> 172.21.15.6:0/1388164046 conn(0x7f7d580ff610 msgr2=0x7f7d58101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 -- 172.21.15.6:0/1388164046 shutdown_connections 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 -- 172.21.15.6:0/1388164046 wait complete. 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 Processor -- start 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.781+0000 7f7d60354640 1 -- start start 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 0x7f7d5819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58109e10 0x7f7d5819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581139d0 con 0x7f7d58103b80 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58113850 con 0x7f7d58109e10 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d60354640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58113b50 con 0x7f7d581094c0 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48616/0 (socket says 172.21.15.6:48616) 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 -- 172.21.15.6:0/1415012228 learned_addr learned my addr 172.21.15.6:0/1415012228 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5d8ef640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 0x7f7d5819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e8f1640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58109e10 0x7f7d5819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 -- 172.21.15.6:0/1415012228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 msgr2=0x7f7d5819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 0x7f7d5819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 -- 172.21.15.6:0/1415012228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58109e10 msgr2=0x7f7d5819fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58109e10 0x7f7d5819fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.782+0000 7f7d5e0f0640 1 -- 172.21.15.6:0/1415012228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d581a02d0 con 0x7f7d58103b80 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d5e0f0640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54017070 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d581a05c0 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d54009c30 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400f620 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.783+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581a6d20 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.784+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d58103f90 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.786+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f7d54005030 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.787+0000 7f7d4b7fe640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 0x7f7d440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.787+0000 7f7d5d8ef640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 0x7f7d440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.787+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7f7d540e7630 con 0x7f7d58103b80 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.788+0000 7f7d5d8ef640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 0x7f7d440b8b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7d58108e10 tx=0x7f7d4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.791+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d54009de0 con 0x7f7d58103b80 2024-09-21T08:19:31.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.983+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d5802e640 con 0x7f7d58103b80 2024-09-21T08:19:31.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.984+0000 7f7d4b7fe640 1 -- 172.21.15.6:0/1415012228 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+25392 (secure 0 0 0) 0x7f7d540b1b80 con 0x7f7d58103b80 2024-09-21T08:19:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-21T08:19:31.987 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":111,"fsid":"f3246cac-77ed-11ef-baf6-efdc52797490","created":"2024-09-21T07:50:07.867657+0000","modified":"2024-09-21T08:19:13.609033+0000","last_up_change":"2024-09-21T07:57:54.124610+0000","last_in_change":"2024-09-21T07:57:30.518963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:54:01.897308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:58:41.348167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:58:43.952628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":31,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:58:50.378691+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":31,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ba946387-792a-4df2-a544-d128afc01190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6803","nonce":3344893896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6805","nonce":3344893896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6809","nonce":3344893896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3344893896},{"type":"v1","addr":"172.21.15.6:6807","nonce":3344893896}]},"public_addr":"172.21.15.6:6803/3344893896","cluster_addr":"172.21.15.6:6805/3344893896","heartbeat_back_addr":"172.21.15.6:6809/3344893896","heartbeat_front_addr":"172.21.15.6:6807/3344893896","state":["exists","up"]},{"osd":1,"uuid":"93cedb16-3deb-4ddc-b6fa-38e5abf65026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6801","nonce":1612348700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6803","nonce":1612348700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6807","nonce":1612348700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1612348700},{"type":"v1","addr":"172.21.15.119:6805","nonce":1612348700}]},"public_addr":"172.21.15.119:6801/1612348700","cluster_addr":"172.21.15.119:6803/1612348700","heartbeat_back_addr":"172.21.15.119:6807/1612348700","heartbeat_front_addr":"172.21.15.119:6805/1612348700","state":["exists","up"]},{"osd":2,"uuid":"f67832f5-9808-4579-b997-627e0a1363dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6801","nonce":1447926373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6803","nonce":1447926373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6807","nonce":1447926373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":1447926373},{"type":"v1","addr":"172.21.15.145:6805","nonce":1447926373}]},"public_addr":"172.21.15.145:6801/1447926373","cluster_addr":"172.21.15.145:6803/1447926373","heartbeat_back_addr":"172.21.15.145:6807/1447926373","heartbeat_front_addr":"172.21.15.145:6805/1447926373","state":["exists","up"]},{"osd":3,"uuid":"1e42b2f0-bcf4-41b6-bcad-235a9a0cabf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6811","nonce":2874010915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6813","nonce":2874010915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6817","nonce":2874010915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":2874010915},{"type":"v1","addr":"172.21.15.6:6815","nonce":2874010915}]},"public_addr":"172.21.15.6:6811/2874010915","cluster_addr":"172.21.15.6:6813/2874010915","heartbeat_back_addr":"172.21.15.6:6817/2874010915","heartbeat_front_addr":"172.21.15.6:6815/2874010915","state":["exists","up"]},{"osd":4,"uuid":"a92a8a1e-7783-42c7-8724-62e824581e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6809","nonce":3176052266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6811","nonce":3176052266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6815","nonce":3176052266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3176052266},{"type":"v1","addr":"172.21.15.119:6813","nonce":3176052266}]},"public_addr":"172.21.15.119:6809/3176052266","cluster_addr":"172.21.15.119:6811/3176052266","heartbeat_back_addr":"172.21.15.119:6815/3176052266","heartbeat_front_addr":"172.21.15.119:6813/3176052266","state":["exists","up"]},{"osd":5,"uuid":"80b6eb01-3f7b-472a-aee0-0c1f8ff4e278","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6809","nonce":4185277964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6811","nonce":4185277964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6815","nonce":4185277964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":4185277964},{"type":"v1","addr":"172.21.15.145:6813","nonce":4185277964}]},"public_addr":"172.21.15.145:6809/4185277964","cluster_addr":"172.21.15.145:6811/4185277964","heartbeat_back_addr":"172.21.15.145:6815/4185277964","heartbeat_front_addr":"172.21.15.145:6813/4185277964","state":["exists","up"]},{"osd":6,"uuid":"24def8b3-915b-4aae-8d84-76eead4d123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6819","nonce":3354206555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6821","nonce":3354206555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6825","nonce":3354206555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3354206555},{"type":"v1","addr":"172.21.15.6:6823","nonce":3354206555}]},"public_addr":"172.21.15.6:6819/3354206555","cluster_addr":"172.21.15.6:6821/3354206555","heartbeat_back_addr":"172.21.15.6:6825/3354206555","heartbeat_front_addr":"172.21.15.6:6823/3354206555","state":["exists","up"]},{"osd":7,"uuid":"348c45b0-811d-4c56-a331-7033863e36d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6817","nonce":1355332181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6819","nonce":1355332181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6823","nonce":1355332181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1355332181},{"type":"v1","addr":"172.21.15.119:6821","nonce":1355332181}]},"public_addr":"172.21.15.119:6817/1355332181","cluster_addr":"172.21.15.119:6819/1355332181","heartbeat_back_addr":"172.21.15.119:6823/1355332181","heartbeat_front_addr":"172.21.15.119:6821/1355332181","state":["exists","up"]},{"osd":8,"uuid":"e25c1373-dd60-4948-a8d9-c5c43d9aebf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6817","nonce":3838836474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6819","nonce":3838836474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6823","nonce":3838836474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3838836474},{"type":"v1","addr":"172.21.15.145:6821","nonce":3838836474}]},"public_addr":"172.21.15.145:6817/3838836474","cluster_addr":"172.21.15.145:6819/3838836474","heartbeat_back_addr":"172.21.15.145:6823/3838836474","heartbeat_front_addr":"172.21.15.145:6821/3838836474","state":["exists","up"]},{"osd":9,"uuid":"565edfc0-01d7-484b-abb2-923dcd7337d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6827","nonce":514953614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6829","nonce":514953614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6833","nonce":514953614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":514953614},{"type":"v1","addr":"172.21.15.6:6831","nonce":514953614}]},"public_addr":"172.21.15.6:6827/514953614","cluster_addr":"172.21.15.6:6829/514953614","heartbeat_back_addr":"172.21.15.6:6833/514953614","heartbeat_front_addr":"172.21.15.6:6831/514953614","state":["exists","up"]},{"osd":10,"uuid":"16df7040-3040-4d5c-8bfd-8f00307555eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6825","nonce":597400106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6827","nonce":597400106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6831","nonce":597400106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":597400106},{"type":"v1","addr":"172.21.15.119:6829","nonce":597400106}]},"public_addr":"172.21.15.119:6825/597400106","cluster_addr":"172.21.15.119:6827/597400106","heartbeat_back_addr":"172.21.15.119:6831/597400106","heartbeat_front_addr":"172.21.15.119:6829/597400106","state":["exists","up"]},{"osd":11,"uuid":"818aec19-fff3-4e7a-959c-785c93f0462d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6825","nonce":2180299713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6827","nonce":2180299713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6831","nonce":2180299713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2180299713},{"type":"v1","addr":"172.21.15.145:6829","nonce":2180299713}]},"public_addr":"172.21.15.145:6825/2180299713","cluster_addr":"172.21.15.145:6827/2180299713","heartbeat_back_addr":"172.21.15.145:6831/2180299713","heartbeat_front_addr":"172.21.15.145:6829/2180299713","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:09.127712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:33.781824+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:53:58.512796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:24.296322+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:54:50.147806+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:16.481344+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:55:41.885400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:08.254042+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:56:33.963487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:00.229282+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:26.590417+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:57:51.999422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/2176108638":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6800/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:6801/3452647007":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/548693640":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6800/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1495310432":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/3861437943":"2024-09-22T07:50:30.675598+0000","172.21.15.6:0/1282952085":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/558991039":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6800/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:6801/2249378231":"2024-09-22T07:52:01.430168+0000","172.21.15.6:6801/1452797413":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/3295809902":"2024-09-22T07:50:57.944225+0000","172.21.15.6:0/4039375936":"2024-09-22T07:52:01.430168+0000","172.21.15.6:0/1669454132":"2024-09-22T07:52:01.430168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]},{"pool":4,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 msgr2=0x7f7d440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 0x7f7d440b8b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7d58108e10 tx=0x7f7d4c00a2d0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 msgr2=0x7f7d5819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400de10 comp rx=0 tx=0).stop 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 shutdown_connections 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f7d440b6680 0x7f7d440b8b90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d581094c0 0x7f7d5819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d58109e10 0x7f7d5819fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 --2- 172.21.15.6:0/1415012228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d58103b80 0x7f7d5819a360 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 >> 172.21.15.6:0/1415012228 conn(0x7f7d580ff610 msgr2=0x7f7d58101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 shutdown_connections 2024-09-21T08:19:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:31.987+0000 7f7d60354640 1 -- 172.21.15.6:0/1415012228 wait complete. 2024-09-21T08:19:32.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:32 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/1415012228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:19:32.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:32 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/1415012228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:19:32.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:32 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/1415012228' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:19:32.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs fail cephfs 2024-09-21T08:19:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:33.377 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:33 smithi006 ceph-mon[30970]: pgmap v924: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:33.407 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:33 smithi119 ceph-mon[33564]: pgmap v924: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:33.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:33 smithi145 ceph-mon[34049]: pgmap v924: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T08:19:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 -- 172.21.15.6:0/3290159036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 msgr2=0x7fa30010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 --2- 172.21.15.6:0/3290159036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30010d8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009900 tx=0x7fa2f402a410 comp rx=0 tx=0).stop 2024-09-21T08:19:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 -- 172.21.15.6:0/3290159036 shutdown_connections 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 --2- 172.21.15.6:0/3290159036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa300110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 --2- 172.21.15.6:0/3290159036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30010d8d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 --2- 172.21.15.6:0/3290159036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa300104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 -- 172.21.15.6:0/3290159036 >> 172.21.15.6:0/3290159036 conn(0x7fa3000797b0 msgr2=0x7fa300079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 -- 172.21.15.6:0/3290159036 shutdown_connections 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.575+0000 7fa305e95640 1 -- 172.21.15.6:0/3290159036 wait complete. 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.576+0000 7fa305e95640 1 Processor -- start 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.576+0000 7fa305e95640 1 -- start start 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa30019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa30019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa300113950 con 0x7fa300105380 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001137d0 con 0x7fa30010de60 2024-09-21T08:19:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa305e95640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa300113ad0 con 0x7fa300104a30 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48628/0 (socket says 172.21.15.6:48628) 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 -- 172.21.15.6:0/128424662 learned_addr learned my addr 172.21.15.6:0/128424662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2ff7fe640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa30019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2fffff640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa30019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 -- 172.21.15.6:0/128424662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 msgr2=0x7fa30019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa30019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 -- 172.21.15.6:0/128424662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 msgr2=0x7fa30019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa30019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 -- 172.21.15.6:0/128424662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3001a0350 con 0x7fa300105380 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2ff7fe640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa30019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2fffff640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa30019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.577+0000 7fa2feffd640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004770 tx=0x7fa2f4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.578+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f403f030 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.578+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3001a05e0 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.578+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f4004440 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.578+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4035070 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.578+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3001a6da0 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.579+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30006bed0 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.580+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa2f4042030 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.581+0000 7fa2fcff9640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 0x7fa2e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.581+0000 7fa2ff7fe640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 0x7fa2e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.581+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9511+0+0 (secure 0 0 0) 0x7fa2f4108390 con 0x7fa300105380 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.582+0000 7fa2ff7fe640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 0x7fa2e80b8b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00058c0 tx=0x7fa2f0005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.584+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2f40ce500 con 0x7fa300105380 2024-09-21T08:19:33.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.812+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa300108f40 con 0x7fa300105380 2024-09-21T08:19:33.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.815+0000 7fa2fcff9640 1 -- 172.21.15.6:0/128424662 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fa2f40d28e0 con 0x7fa300105380 2024-09-21T08:19:33.817 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T08:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 msgr2=0x7fa2e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 0x7fa2e80b8b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00058c0 tx=0x7fa2f0005850 comp rx=0 tx=0).stop 2024-09-21T08:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 msgr2=0x7fa30019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004770 tx=0x7fa2f4004040 comp rx=0 tx=0).stop 2024-09-21T08:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 shutdown_connections 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7fa2e80b6680 0x7fa2e80b8b90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa30010de60 0x7fa30019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa300105380 0x7fa30019a980 secure :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4004770 tx=0x7fa2f4004040 comp rx=0 tx=0).stop 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 --2- 172.21.15.6:0/128424662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa300104a30 0x7fa30019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 >> 172.21.15.6:0/128424662 conn(0x7fa3000797b0 msgr2=0x7fa3001009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 shutdown_connections 2024-09-21T08:19:33.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:33.818+0000 7fa305e95640 1 -- 172.21.15.6:0/128424662 wait complete. 2024-09-21T08:19:34.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a[30966]: 2024-09-21T08:19:33.813+0000 7f7992cc8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:19:34.157 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: osdmap e112: 12 total, 12 up, 12 in 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:34 smithi119 ceph-mon[33564]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:19:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: ignoring --setuser ceph since I am not root 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:19:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: ignoring --setgroup ceph since I am not root 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:19:33 smithi119 ceph-mds[63025]: -- 172.21.15.119:0/2959555971 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652ffb37860 con 0x565303cdfa80 2024-09-21T08:19:34.158 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:19:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: starting mds.b at 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: osdmap e112: 12 total, 12 up, 12 in 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:34 smithi145 ceph-mon[34049]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:19:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: ignoring --setuser ceph since I am not root 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:19:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: ignoring --setgroup ceph since I am not root 2024-09-21T08:19:34.193 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:19:33 smithi145 ceph-mds[62902]: -- 172.21.15.145:0/3497776977 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564320bcf860 con 0x564324d77180 2024-09-21T08:19:34.194 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:19:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: starting mds.i at 2024-09-21T08:19:34.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:19:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:19:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:19:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/128424662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:19:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: osdmap e112: 12 total, 12 up, 12 in 2024-09-21T08:19:34.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:34 smithi006 ceph-mon[30970]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T08:19:34.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T08:19:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:35.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: pgmap v926: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T08:19:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.119:6838/3624113989,v1:172.21.15.119:6839/3624113989] up:boot 2024-09-21T08:19:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: mds.? [v2:172.21.15.145:6838/201820125,v1:172.21.15.145:6839/201820125] up:boot 2024-09-21T08:19:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T08:19:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:19:35.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:35 smithi006 ceph-mon[30970]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:19:35.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 -- 172.21.15.6:0/2776474346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678102f30 msgr2=0x7f967810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 --2- 172.21.15.6:0/2776474346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678102f30 0x7f967810fc50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f966802a480 comp rx=0 tx=0).stop 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 -- 172.21.15.6:0/2776474346 shutdown_connections 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 --2- 172.21.15.6:0/2776474346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9678110190 0x7f96781125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 --2- 172.21.15.6:0/2776474346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678102f30 0x7f967810fc50 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 --2- 172.21.15.6:0/2776474346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96781025e0 0x7f96781029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 -- 172.21.15.6:0/2776474346 >> 172.21.15.6:0/2776474346 conn(0x7f9678079710 msgr2=0x7f9678079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 -- 172.21.15.6:0/2776474346 shutdown_connections 2024-09-21T08:19:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.344+0000 7f9680224640 1 -- 172.21.15.6:0/2776474346 wait complete. 2024-09-21T08:19:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 Processor -- start 2024-09-21T08:19:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 -- start start 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96781025e0 0x7f967819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 0x7f967819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9678115b30 con 0x7f9678110190 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96781159b0 con 0x7f9678102f30 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f9680224640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9678115cb0 con 0x7f96781025e0 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f967e7c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f967e7c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48648/0 (socket says 172.21.15.6:48648) 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f967e7c1640 1 -- 172.21.15.6:0/471417647 learned_addr learned my addr 172.21.15.6:0/471417647 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f967dfc0640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96781025e0 0x7f967819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.345+0000 7f967d7bf640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 0x7f967819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 -- 172.21.15.6:0/471417647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96781025e0 msgr2=0x7f967819c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96781025e0 0x7f967819c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 -- 172.21.15.6:0/471417647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 msgr2=0x7f967819cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 0x7f967819cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 -- 172.21.15.6:0/471417647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96781a2410 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967d7bf640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 0x7f967819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f967e7c1640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f967000eaa0 tx=0x7f967000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670004d20 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9670005020 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700116d0 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96781a2700 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.346+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96781a2bc0 con 0x7f9678110190 2024-09-21T08:19:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.347+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967806c280 con 0x7f9678110190 2024-09-21T08:19:35.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.349+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f96700051d0 con 0x7f9678110190 2024-09-21T08:19:35.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.349+0000 7f966effd640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 0x7f96640b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:35.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.350+0000 7f967dfc0640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 0x7f96640b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:35.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.350+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9509+0+0 (secure 0 0 0) 0x7f96700e8030 con 0x7f9678110190 2024-09-21T08:19:35.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.350+0000 7f967dfc0640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 0x7f96640b8bc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f967400abe0 tx=0x7f967400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.353+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9670016030 con 0x7f9678110190 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: pgmap v926: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.119:6838/3624113989,v1:172.21.15.119:6839/3624113989] up:boot 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: mds.? [v2:172.21.15.145:6838/201820125,v1:172.21.15.145:6839/201820125] up:boot 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:19:35.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:35 smithi119 ceph-mon[33564]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: pgmap v926: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.119:6838/3624113989,v1:172.21.15.119:6839/3624113989] up:boot 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: mds.? [v2:172.21.15.145:6838/201820125,v1:172.21.15.145:6839/201820125] up:boot 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:19:35.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:35 smithi145 ceph-mon[34049]: from='mgr.14226 172.21.15.6:0/910602394' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:19:35.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:35.580+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f96781a90f0 con 0x7f9678110190 2024-09-21T08:19:36.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.137+0000 7f966effd640 1 -- 172.21.15.6:0/471417647 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f96700ae1a0 con 0x7f9678110190 2024-09-21T08:19:36.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 msgr2=0x7f96640b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:36.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 0x7f96640b8bc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f967400abe0 tx=0x7f967400a2d0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 msgr2=0x7f96781a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f967000eaa0 tx=0x7f967000eea0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 shutdown_connections 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f96640b66b0 0x7f96640b8bc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678110190 0x7f96781a1da0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9678102f30 0x7f967819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 --2- 172.21.15.6:0/471417647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96781025e0 0x7f967819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 >> 172.21.15.6:0/471417647 conn(0x7f9678079710 msgr2=0x7f9678109d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 shutdown_connections 2024-09-21T08:19:36.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:36.140+0000 7f9680224640 1 -- 172.21.15.6:0/471417647 wait complete. 2024-09-21T08:19:36.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:36 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:19:36.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:36 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:19:36.456 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:36 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:19:36.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T08:19:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: pgmap v927: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: Cluster is now healthy 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:19:37.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:37 smithi119 ceph-mon[33564]: fsmap 12 up:standby 2024-09-21T08:19:37.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: pgmap v927: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:37.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:19:37.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:19:37.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: Cluster is now healthy 2024-09-21T08:19:37.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:19:37.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:37 smithi006 ceph-mon[30970]: fsmap 12 up:standby 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: pgmap v927: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: Cluster is now healthy 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/471417647' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:19:37.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:37 smithi145 ceph-mon[34049]: fsmap 12 up:standby 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.529+0000 7f0d82941640 1 -- 172.21.15.6:0/69053426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c1049e0 msgr2=0x7f0d7c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 --2- 172.21.15.6:0/69053426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c104df0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009900 tx=0x7f0d6c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 -- 172.21.15.6:0/69053426 shutdown_connections 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 --2- 172.21.15.6:0/69053426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c105330 0x7f0d7c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 --2- 172.21.15.6:0/69053426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c10de40 0x7f0d7c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 --2- 172.21.15.6:0/69053426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c104df0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 -- 172.21.15.6:0/69053426 >> 172.21.15.6:0/69053426 conn(0x7f0d7c079750 msgr2=0x7f0d7c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 -- 172.21.15.6:0/69053426 shutdown_connections 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.530+0000 7f0d82941640 1 -- 172.21.15.6:0/69053426 wait complete. 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 Processor -- start 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 -- start start 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 0x7f0d7c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c113950 con 0x7f0d7c10de40 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1137d0 con 0x7f0d7c105330 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d82941640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c113ad0 con 0x7f0d7c1049e0 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d80ede640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d80ede640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54144/0 (socket says 172.21.15.6:54144) 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d80ede640 1 -- 172.21.15.6:0/3056672983 learned_addr learned my addr 172.21.15.6:0/3056672983 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d7bfff640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.531+0000 7f0d7b7fe640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 0x7f0d7c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 -- 172.21.15.6:0/3056672983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c1049e0 msgr2=0x7f0d7c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 -- 172.21.15.6:0/3056672983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 msgr2=0x7f0d7c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 0x7f0d7c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 -- 172.21.15.6:0/3056672983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1a02d0 con 0x7f0d7c10de40 2024-09-21T08:19:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d7b7fe640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 0x7f0d7c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d80ede640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009fd0 tx=0x7f0d7400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74017070 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1a05c0 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d74003e00 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74010460 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.532+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1a6de0 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.533+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c06c280 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.535+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0d74003970 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.535+0000 7f0d797fa640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 0x7f0d640b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.536+0000 7f0d7bfff640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 0x7f0d640b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.536+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9509+0+0 (secure 0 0 0) 0x7f0d740e78c0 con 0x7f0d7c10de40 2024-09-21T08:19:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.536+0000 7f0d7bfff640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 0x7f0d640b8bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c004770 tx=0x7f0d6c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.539+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d740ada30 con 0x7f0d7c10de40 2024-09-21T08:19:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:37.728+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d7c104df0 con 0x7f0d7c10de40 2024-09-21T08:19:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.140+0000 7f0d797fa640 1 -- 172.21.15.6:0/3056672983 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) ==== 181+0+0 (secure 0 0 0) 0x7f0d7c104df0 con 0x7f0d7c10de40 2024-09-21T08:19:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-09-21T08:19:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.143+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 msgr2=0x7f0d640b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.143+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 0x7f0d640b8bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c004770 tx=0x7f0d6c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:19:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.143+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 msgr2=0x7f0d7c19fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.143+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009fd0 tx=0x7f0d7400b260 comp rx=0 tx=0).stop 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 shutdown_connections 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f0d640b66b0 0x7f0d640b8bc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d7c10de40 0x7f0d7c19fc60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d7c105330 0x7f0d7c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 --2- 172.21.15.6:0/3056672983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d7c1049e0 0x7f0d7c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.144+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 >> 172.21.15.6:0/3056672983 conn(0x7f0d7c079750 msgr2=0x7f0d7c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.145+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 shutdown_connections 2024-09-21T08:19:38.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:38.145+0000 7f0d82941640 1 -- 172.21.15.6:0/3056672983 wait complete. 2024-09-21T08:19:38.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:38 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:38.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:38 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:38.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:38 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:38.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T08:19:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:39 smithi006 ceph-mon[30970]: pgmap v928: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:39.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:39 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:39.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:39 smithi006 ceph-mon[30970]: osdmap e113: 12 total, 12 up, 12 in 2024-09-21T08:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:39 smithi119 ceph-mon[33564]: pgmap v928: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:39 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:39.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:39 smithi119 ceph-mon[33564]: osdmap e113: 12 total, 12 up, 12 in 2024-09-21T08:19:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:39 smithi145 ceph-mon[34049]: pgmap v928: 129 pgs: 129 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T08:19:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:39 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3056672983' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:39.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:39 smithi145 ceph-mon[34049]: osdmap e113: 12 total, 12 up, 12 in 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 -- 172.21.15.6:0/2889418799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f932810de70 msgr2=0x7f9328110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 --2- 172.21.15.6:0/2889418799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f932810de70 0x7f9328110340 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9320009900 tx=0x7f932002a410 comp rx=0 tx=0).stop 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 -- 172.21.15.6:0/2889418799 shutdown_connections 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 --2- 172.21.15.6:0/2889418799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93281052a0 0x7f932810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 --2- 172.21.15.6:0/2889418799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f932810de70 0x7f9328110340 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 --2- 172.21.15.6:0/2889418799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281048c0 0x7f9328104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 -- 172.21.15.6:0/2889418799 >> 172.21.15.6:0/2889418799 conn(0x7f9328079760 msgr2=0x7f9328079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 -- 172.21.15.6:0/2889418799 shutdown_connections 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.673+0000 7f932d27b640 1 -- 172.21.15.6:0/2889418799 wait complete. 2024-09-21T08:19:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 Processor -- start 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 -- start start 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281052a0 0x7f932819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 0x7f932819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9328113960 con 0x7f93281048c0 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93281137e0 con 0x7f93281052a0 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.674+0000 7f932d27b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9328113ae0 con 0x7f932810de70 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54168/0 (socket says 172.21.15.6:54168) 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 -- 172.21.15.6:0/4171155169 learned_addr learned my addr 172.21.15.6:0/4171155169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f93277fe640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 0x7f932819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f93267fc640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281052a0 0x7f932819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 -- 172.21.15.6:0/4171155169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 msgr2=0x7f932819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 0x7f932819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 -- 172.21.15.6:0/4171155169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281052a0 msgr2=0x7f932819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281052a0 0x7f932819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 -- 172.21.15.6:0/4171155169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93281a0360 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f93277fe640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 0x7f932819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f9326ffd640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f931800ccb0 tx=0x7f931800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318003990 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93281a0650 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9318004020 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931800f6b0 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.675+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93281a6db0 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.676+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f932806c190 con 0x7f93281048c0 2024-09-21T08:19:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.679+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9318003b30 con 0x7f93281048c0 2024-09-21T08:19:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.680+0000 7f930ffff640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 0x7f93100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.680+0000 7f93267fc640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 0x7f93100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.680+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8955+0+0 (secure 0 0 0) 0x7f93180e7e30 con 0x7f93281048c0 2024-09-21T08:19:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.681+0000 7f93267fc640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 0x7f93100b8b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f931c005fd0 tx=0x7f931c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.682+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9318014030 con 0x7f93281048c0 2024-09-21T08:19:39.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:39.874+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9328104cd0 con 0x7f93281048c0 2024-09-21T08:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.150+0000 7f930ffff640 1 -- 172.21.15.6:0/4171155169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) ==== 169+0+0 (secure 0 0 0) 0x7f93180ae170 con 0x7f93281048c0 2024-09-21T08:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 msgr2=0x7f93100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 0x7f93100b8b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f931c005fd0 tx=0x7f931c005850 comp rx=0 tx=0).stop 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 msgr2=0x7f932819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f931800ccb0 tx=0x7f931800a620 comp rx=0 tx=0).stop 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 shutdown_connections 2024-09-21T08:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f93100b6680 0x7f93100b8b90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f932810de70 0x7f932819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93281052a0 0x7f932819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 --2- 172.21.15.6:0/4171155169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93281048c0 0x7f932819a3f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 >> 172.21.15.6:0/4171155169 conn(0x7f9328079760 msgr2=0x7f93280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.152+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 shutdown_connections 2024-09-21T08:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:40.153+0000 7f932d27b640 1 -- 172.21.15.6:0/4171155169 wait complete. 2024-09-21T08:19:40.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:40 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:40.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:40 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:40.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:40 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:40.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f3246cac-77ed-11ef-baf6-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T08:19:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:41 smithi006 ceph-mon[30970]: pgmap v930: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:41 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:41.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:41 smithi006 ceph-mon[30970]: osdmap e114: 12 total, 12 up, 12 in 2024-09-21T08:19:41.211 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/mon.a/config 2024-09-21T08:19:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:41 smithi119 ceph-mon[33564]: pgmap v930: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:41 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:41.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:41 smithi119 ceph-mon[33564]: osdmap e114: 12 total, 12 up, 12 in 2024-09-21T08:19:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:41 smithi145 ceph-mon[34049]: pgmap v930: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:41 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/4171155169' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:41.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:41 smithi145 ceph-mon[34049]: osdmap e114: 12 total, 12 up, 12 in 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 -- 172.21.15.6:0/1876629470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 msgr2=0x7f269c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 --2- 172.21.15.6:0/1876629470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c1087b0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2690009900 tx=0x7f269002a410 comp rx=0 tx=0).stop 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 -- 172.21.15.6:0/1876629470 shutdown_connections 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 --2- 172.21.15.6:0/1876629470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c108cf0 0x7f269c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 --2- 172.21.15.6:0/1876629470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c1087b0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 --2- 172.21.15.6:0/1876629470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c102a60 0x7f269c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 -- 172.21.15.6:0/1876629470 >> 172.21.15.6:0/1876629470 conn(0x7f269c079720 msgr2=0x7f269c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 -- 172.21.15.6:0/1876629470 shutdown_connections 2024-09-21T08:19:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.833+0000 7f26a10d0640 1 -- 172.21.15.6:0/1876629470 wait complete. 2024-09-21T08:19:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.834+0000 7f26a10d0640 1 Processor -- start 2024-09-21T08:19:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.834+0000 7f26a10d0640 1 -- start start 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c102a60 0x7f269c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c108cf0 0x7f269c1a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f269c113920 con 0x7f269c1083a0 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1137a0 con 0x7f269c108cf0 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f26a10d0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f269c113aa0 con 0x7f269c102a60 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54186/0 (socket says 172.21.15.6:54186) 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 -- 172.21.15.6:0/3836291659 learned_addr learned my addr 172.21.15.6:0/3836291659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269ad9d640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c102a60 0x7f269c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269b59e640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c108cf0 0x7f269c1a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 -- 172.21.15.6:0/3836291659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c102a60 msgr2=0x7f269c19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c102a60 0x7f269c19c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 -- 172.21.15.6:0/3836291659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c108cf0 msgr2=0x7f269c1a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c108cf0 0x7f269c1a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.835+0000 7f269a59c640 1 -- 172.21.15.6:0/3836291659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1a24e0 con 0x7f269c1083a0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f269a59c640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2690005940 tx=0x7f26900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269003f030 con 0x7f269c1083a0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1a2770 con 0x7f269c1083a0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2690003c90 con 0x7f269c1083a0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690035070 con 0x7f269c1083a0 2024-09-21T08:19:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.836+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1a8f30 con 0x7f269c1083a0 2024-09-21T08:19:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.837+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c103ce0 con 0x7f269c1083a0 2024-09-21T08:19:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.839+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2690042030 con 0x7f269c1083a0 2024-09-21T08:19:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.839+0000 7f2683fff640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:19:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.839+0000 7f269ad9d640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:19:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.840+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8367+0+0 (secure 0 0 0) 0x7f2690107f90 con 0x7f269c1083a0 2024-09-21T08:19:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.840+0000 7f269ad9d640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 0x7f26840b8b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f268c00bbe0 tx=0x7f268c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:19:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:41.842+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26900d2900 con 0x7f269c1083a0 2024-09-21T08:19:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.031+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f269c1a9100 con 0x7f269c1083a0 2024-09-21T08:19:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.157+0000 7f2683fff640 1 -- 172.21.15.6:0/3836291659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v115) ==== 178+0+0 (secure 0 0 0) 0x7f26900d7840 con 0x7f269c1083a0 2024-09-21T08:19:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2024-09-21T08:19:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.161+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 msgr2=0x7f26840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.161+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 0x7f26840b8b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f268c00bbe0 tx=0x7f268c00b390 comp rx=0 tx=0).stop 2024-09-21T08:19:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.161+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 msgr2=0x7f269c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:19:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.161+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2690005940 tx=0x7f26900042f0 comp rx=0 tx=0).stop 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 shutdown_connections 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:6800/1939189819,v1:172.21.15.6:6801/1939189819] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f269c108cf0 0x7f269c1a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c1083a0 0x7f269c19cb10 secure :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2690005940 tx=0x7f26900042f0 comp rx=0 tx=0).stop 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 --2- 172.21.15.6:0/3836291659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f269c102a60 0x7f269c19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:19:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.162+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 >> 172.21.15.6:0/3836291659 conn(0x7f269c079720 msgr2=0x7f269c1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:19:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.163+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 shutdown_connections 2024-09-21T08:19:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-21T08:19:42.163+0000 7f26a10d0640 1 -- 172.21.15.6:0/3836291659 wait complete. 2024-09-21T08:19:42.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:42 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:42.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:42 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:42.658 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:42 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:19:42.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:19:43.004 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:19:43.050 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:19:43.100 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T08:19:43.100 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:19:43.157 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:19:43.182 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:19:43.258 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T08:19:43.258 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T08:19:43.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a 2024-09-21T08:19:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:43 smithi119 ceph-mon[33564]: pgmap v932: 33 pgs: 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:43 smithi119 ceph-mon[33564]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:43.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:43 smithi119 ceph-mon[33564]: osdmap e115: 12 total, 12 up, 12 in 2024-09-21T08:19:43.442 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:43 smithi145 ceph-mon[34049]: pgmap v932: 33 pgs: 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:43 smithi145 ceph-mon[34049]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:43.443 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:43 smithi145 ceph-mon[34049]: osdmap e115: 12 total, 12 up, 12 in 2024-09-21T08:19:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 ceph-mon[30970]: pgmap v932: 33 pgs: 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:19:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 ceph-mon[30970]: from='client.? 172.21.15.6:0/3836291659' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:19:43.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 ceph-mon[30970]: osdmap e115: 12 total, 12 up, 12 in 2024-09-21T08:19:43.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 systemd[1]: Stopping Ceph mon.a for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:43.915 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a[30966]: 2024-09-21T08:19:43.657+0000 7f79984d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:19:43.915 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a[30966]: 2024-09-21T08:19:43.657+0000 7f79984d3640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T08:19:44.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:43 smithi006 podman[123962]: 2024-09-21 08:19:43.914713229 +0000 UTC m=+0.387421478 container died 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T08:19:44.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:44 smithi006 podman[123962]: 2024-09-21 08:19:44.35559258 +0000 UTC m=+0.828300818 container cleanup 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:19:44.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:44 smithi006 bash[123962]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a 2024-09-21T08:19:44.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 21 08:19:44 smithi006 podman[123972]: 2024-09-21 08:19:44.617629229 +0000 UTC m=+0.697714117 container remove 15e6fb8cbba79d4205d0c7dd81009f220fc2b7e04f307c90b0d17ab8a4f95217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:19:44.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.a.service' 2024-09-21T08:19:45.004 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:19:45.004 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T08:19:45.004 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T08:19:45.005 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.b 2024-09-21T08:19:45.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:45 smithi119 systemd[1]: Stopping Ceph mon.b for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-b[33560]: 2024-09-21T08:19:46.946+0000 7f0c80bcb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:19:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-b[33560]: 2024-09-21T08:19:46.946+0000 7f0c80bcb640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:19:47.408 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:47 smithi119 podman[66929]: 2024-09-21 08:19:47.13198959 +0000 UTC m=+1.687096255 container died 16d27952c7f043b5207cb12471c619f255a32695603350d6c33c40138dd88593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T08:19:50.555 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:50 smithi119 podman[66929]: 2024-09-21 08:19:50.32801814 +0000 UTC m=+4.883124800 container cleanup 16d27952c7f043b5207cb12471c619f255a32695603350d6c33c40138dd88593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T08:19:50.556 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 08:19:50 smithi119 bash[66929]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-b 2024-09-21T08:19:50.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.b.service' 2024-09-21T08:19:50.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:19:50.827 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T08:19:50.827 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T08:19:50.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.c 2024-09-21T08:19:51.193 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:50 smithi145 systemd[1]: Stopping Ceph mon.c for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c[34031]: 2024-09-21T08:19:51.416+0000 7f6503af5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:19:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c[34031]: 2024-09-21T08:19:51.416+0000 7f6503af5640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:19:51.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:51 smithi145 podman[67266]: 2024-09-21 08:19:51.570275825 +0000 UTC m=+0.497894310 container died a49f3f96aa2a971733022264ca11400928732cc85bcfd9a870d2d8856f047411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:19:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 podman[67266]: 2024-09-21 08:19:55.492250728 +0000 UTC m=+4.419869202 container cleanup a49f3f96aa2a971733022264ca11400928732cc85bcfd9a870d2d8856f047411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T08:19:55.693 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 bash[67266]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c 2024-09-21T08:19:55.976 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.c.service' 2024-09-21T08:19:55.998 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 podman[67280]: 2024-09-21 08:19:55.735927633 +0000 UTC m=+4.026024817 container remove a49f3f96aa2a971733022264ca11400928732cc85bcfd9a870d2d8856f047411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:19:55.998 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T08:19:55.998 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 systemd[1]: Stopped Ceph mon.c for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T08:19:55.998 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 21 08:19:55 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mon.c.service: Consumed 18.322s CPU time. 2024-09-21T08:19:56.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:19:56.059 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T08:19:56.059 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T08:19:56.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x 2024-09-21T08:19:56.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 systemd[1]: Stopping Ceph mgr.x for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:56.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:19:56.379+0000 7f6b3ce01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:19:56.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x[31200]: 2024-09-21T08:19:56.379+0000 7f6b3ce01640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T08:19:56.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 podman[124076]: 2024-09-21 08:19:56.420529929 +0000 UTC m=+0.159097646 container died 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T08:19:57.183 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 podman[124076]: 2024-09-21 08:19:56.947406291 +0000 UTC m=+0.685974001 container cleanup 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T08:19:57.183 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:56 smithi006 bash[124076]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x 2024-09-21T08:19:57.433 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:57 smithi006 podman[124090]: 2024-09-21 08:19:57.182705849 +0000 UTC m=+0.757351691 container remove 9f9ae6555fd3f972bb781ed46b24f646856d03d96aac42ad4096963408f80f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:19:57.433 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:57 smithi006 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service: Deactivated successfully. 2024-09-21T08:19:57.433 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 21 08:19:57 smithi006 systemd[1]: Stopped Ceph mgr.x for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T08:19:57.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.x.service' 2024-09-21T08:19:57.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:19:57.472 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T08:19:57.472 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T08:19:57.472 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.y 2024-09-21T08:19:57.813 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 08:19:57 smithi119 systemd[1]: Stopping Ceph mgr.y for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:58.118 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 08:19:57 smithi119 podman[67049]: 2024-09-21 08:19:57.812152087 +0000 UTC m=+0.145428247 container died 2ab3b8a08f759c179a17b94e931d5d682450ce158849162558ff5d33b6246afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T08:19:58.408 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 08:19:58 smithi119 podman[67049]: 2024-09-21 08:19:58.217032732 +0000 UTC m=+0.550308884 container cleanup 2ab3b8a08f759c179a17b94e931d5d682450ce158849162558ff5d33b6246afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:19:58.408 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 08:19:58 smithi119 bash[67049]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-y 2024-09-21T08:19:58.674 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.y.service' 2024-09-21T08:19:58.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:19:58.709 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T08:19:58.710 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T08:19:58.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.z 2024-09-21T08:19:59.054 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 08:19:58 smithi145 systemd[1]: Stopping Ceph mgr.z for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:19:59.358 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 08:19:59 smithi145 podman[67387]: 2024-09-21 08:19:59.053354006 +0000 UTC m=+0.154456125 container died 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:19:59.693 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 08:19:59 smithi145 podman[67387]: 2024-09-21 08:19:59.498133758 +0000 UTC m=+0.599235866 container cleanup 1a5a2f4758a75af0603ba183b265f355999fa3db0761d08bfc103bcc80557688 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T08:19:59.693 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 21 08:19:59 smithi145 bash[67387]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mgr-z 2024-09-21T08:20:00.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mgr.z.service' 2024-09-21T08:20:00.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:00.115 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T08:20:00.115 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T08:20:00.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.0 2024-09-21T08:20:00.445 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:00 smithi006 systemd[1]: Stopping Ceph osd.0 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:00.710 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T08:20:00.443+0000 7fe2eaadd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:00.711 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T08:20:00.443+0000 7fe2eaadd640 -1 osd.0 115 *** Got signal Terminated *** 2024-09-21T08:20:00.711 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0[48328]: 2024-09-21T08:20:00.443+0000 7fe2eaadd640 -1 osd.0 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:06.371 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:06 smithi006 podman[124197]: 2024-09-21 08:20:06.075346508 +0000 UTC m=+5.764013692 container died bae51fbccb8dd181c9b4e47d6d194ae079997db1722799131f653ec6822ec786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:20:06.711 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:06 smithi006 podman[124197]: 2024-09-21 08:20:06.569534343 +0000 UTC m=+6.258201528 container cleanup bae51fbccb8dd181c9b4e47d6d194ae079997db1722799131f653ec6822ec786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T08:20:06.711 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:06 smithi006 bash[124197]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0 2024-09-21T08:20:07.172 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:06 smithi006 podman[124212]: 2024-09-21 08:20:06.854820913 +0000 UTC m=+0.778309440 container remove bae51fbccb8dd181c9b4e47d6d194ae079997db1722799131f653ec6822ec786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:20:07.425 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.074369625 +0000 UTC m=+0.016417526 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:07.425 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.18054276 +0000 UTC m=+0.122590661 container create d74251f51fdfa71abc2d691aaf46f4e9a9481ba86c9b13c3aebec3790da90957 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T08:20:07.425 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.424799348 +0000 UTC m=+0.366847258 container init d74251f51fdfa71abc2d691aaf46f4e9a9481ba86c9b13c3aebec3790da90957 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:07.710 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.42827921 +0000 UTC m=+0.370327118 container start d74251f51fdfa71abc2d691aaf46f4e9a9481ba86c9b13c3aebec3790da90957 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T08:20:07.710 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.533332476 +0000 UTC m=+0.475380390 container attach d74251f51fdfa71abc2d691aaf46f4e9a9481ba86c9b13c3aebec3790da90957 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:20:08.146 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 21 08:20:07 smithi006 podman[124304]: 2024-09-21 08:20:07.848668959 +0000 UTC m=+0.790716861 container died d74251f51fdfa71abc2d691aaf46f4e9a9481ba86c9b13c3aebec3790da90957 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:08.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T08:20:08.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:08.490 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T08:20:08.490 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T08:20:08.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.1 2024-09-21T08:20:08.805 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:08 smithi119 systemd[1]: Stopping Ceph osd.1 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:09.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T08:20:08.804+0000 7fa0c056f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:09.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T08:20:08.804+0000 7fa0c056f640 -1 osd.1 115 *** Got signal Terminated *** 2024-09-21T08:20:09.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1[38261]: 2024-09-21T08:20:08.804+0000 7fa0c056f640 -1 osd.1 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:14.790 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:14 smithi119 podman[67187]: 2024-09-21 08:20:14.4745932 +0000 UTC m=+5.799468773 container died da09b9edea66a00de41fd9a96c649291b9da7a482a2fee65e9ba4590c728fc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:20:15.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:14 smithi119 podman[67187]: 2024-09-21 08:20:14.897036364 +0000 UTC m=+6.221911926 container cleanup da09b9edea66a00de41fd9a96c649291b9da7a482a2fee65e9ba4590c728fc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T08:20:15.158 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:14 smithi119 bash[67187]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1 2024-09-21T08:20:15.588 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67202]: 2024-09-21 08:20:15.173644184 +0000 UTC m=+0.696089902 container remove da09b9edea66a00de41fd9a96c649291b9da7a482a2fee65e9ba4590c728fc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:20:15.869 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67293]: 2024-09-21 08:20:15.490783405 +0000 UTC m=+0.015998258 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:15.869 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67293]: 2024-09-21 08:20:15.624729793 +0000 UTC m=+0.149944632 container create 87123fa2b15bb316c368ce6bd938454fd5fe004410c51d2398b96101f80231cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T08:20:15.870 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67293]: 2024-09-21 08:20:15.869093556 +0000 UTC m=+0.394308397 container init 87123fa2b15bb316c368ce6bd938454fd5fe004410c51d2398b96101f80231cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:16.127 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67293]: 2024-09-21 08:20:15.872511052 +0000 UTC m=+0.397725898 container start 87123fa2b15bb316c368ce6bd938454fd5fe004410c51d2398b96101f80231cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T08:20:16.128 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:15 smithi119 podman[67293]: 2024-09-21 08:20:15.961050795 +0000 UTC m=+0.486265650 container attach 87123fa2b15bb316c368ce6bd938454fd5fe004410c51d2398b96101f80231cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T08:20:16.128 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 08:20:16 smithi119 podman[67293]: 2024-09-21 08:20:16.100261346 +0000 UTC m=+0.625476186 container died 87123fa2b15bb316c368ce6bd938454fd5fe004410c51d2398b96101f80231cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T08:20:16.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T08:20:16.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:16.801 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T08:20:16.801 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T08:20:16.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.2 2024-09-21T08:20:17.120 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:16 smithi145 systemd[1]: Stopping Ceph osd.2 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:17.443 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T08:20:17.118+0000 7fbb6e9fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:17.443 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T08:20:17.118+0000 7fbb6e9fe640 -1 osd.2 115 *** Got signal Terminated *** 2024-09-21T08:20:17.443 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2[39119]: 2024-09-21T08:20:17.118+0000 7fbb6e9fe640 -1 osd.2 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:22.970 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:22 smithi145 podman[67524]: 2024-09-21 08:20:22.704295266 +0000 UTC m=+5.708302571 container died 27acd0f51464a329e85e843aa1ac13060ed8e72badf507822b156565a88f3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:20:23.279 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:23 smithi145 podman[67524]: 2024-09-21 08:20:23.035255341 +0000 UTC m=+6.039262635 container cleanup 27acd0f51464a329e85e843aa1ac13060ed8e72badf507822b156565a88f3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:20:23.279 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:23 smithi145 bash[67524]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2 2024-09-21T08:20:23.686 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:23 smithi145 podman[67539]: 2024-09-21 08:20:23.27839696 +0000 UTC m=+0.574332340 container remove 27acd0f51464a329e85e843aa1ac13060ed8e72badf507822b156565a88f3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:20:23.943 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:23 smithi145 podman[67628]: 2024-09-21 08:20:23.588721722 +0000 UTC m=+0.015967996 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:23.943 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:23 smithi145 podman[67628]: 2024-09-21 08:20:23.721161978 +0000 UTC m=+0.148408289 container create bd00dd852ed3619967bbfccacbaf4343bbdaac6df308ef8db17a30adfff67d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T08:20:24.304 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:24 smithi145 podman[67628]: 2024-09-21 08:20:24.007448804 +0000 UTC m=+0.434695072 container init bd00dd852ed3619967bbfccacbaf4343bbdaac6df308ef8db17a30adfff67d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:24.304 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:24 smithi145 podman[67628]: 2024-09-21 08:20:24.010838488 +0000 UTC m=+0.438084757 container start bd00dd852ed3619967bbfccacbaf4343bbdaac6df308ef8db17a30adfff67d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:20:24.304 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:24 smithi145 podman[67628]: 2024-09-21 08:20:24.11600239 +0000 UTC m=+0.543248658 container attach bd00dd852ed3619967bbfccacbaf4343bbdaac6df308ef8db17a30adfff67d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T08:20:24.572 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 21 08:20:24 smithi145 podman[67628]: 2024-09-21 08:20:24.303736042 +0000 UTC m=+0.730982329 container died bd00dd852ed3619967bbfccacbaf4343bbdaac6df308ef8db17a30adfff67d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T08:20:24.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T08:20:25.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:25.014 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T08:20:25.014 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T08:20:25.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.3 2024-09-21T08:20:25.358 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:25 smithi006 systemd[1]: Stopping Ceph osd.3 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:25.710 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:25.356+0000 7f257a939640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:25.711 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:25.356+0000 7f257a939640 -1 osd.3 115 *** Got signal Terminated *** 2024-09-21T08:20:25.711 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:25 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:25.356+0000 7f257a939640 -1 osd.3 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:26.494+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:27.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:26 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:26.786+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:27.504+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:27.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:27 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:27.775+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:27.961 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:27 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:27.577+0000 7f2576f24640 -1 osd.3 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:19:59.651106+0000 front 2024-09-21T08:19:59.651148+0000 (oldest deadline 2024-09-21T08:20:27.251984+0000) 2024-09-21T08:20:28.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:28 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:28.522+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:28.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:28.628+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:28.960 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:28 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:28.570+0000 7f2576f24640 -1 osd.3 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:19:59.651106+0000 front 2024-09-21T08:19:59.651148+0000 (oldest deadline 2024-09-21T08:20:27.251984+0000) 2024-09-21T08:20:28.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:28 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:28.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:29.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:29 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:29.519+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:29.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:29.656+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:29.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:29 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:29.792+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:29.960 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:29 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3[54431]: 2024-09-21T08:20:29.616+0000 7f2576f24640 -1 osd.3 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:19:59.651106+0000 front 2024-09-21T08:19:59.651148+0000 (oldest deadline 2024-09-21T08:20:27.251984+0000) 2024-09-21T08:20:30.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:30 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:30.480+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:30.942 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:30.688+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:31.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:30 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:30.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:31.424 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:31 smithi006 podman[124407]: 2024-09-21 08:20:31.131374819 +0000 UTC m=+5.906831260 container died 07a4712b093b135371bdaaaf1f79bd92b92ba1a6e08e2536b77ab54d11e71baf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T08:20:31.710 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:31 smithi006 podman[124407]: 2024-09-21 08:20:31.631768237 +0000 UTC m=+6.407224667 container cleanup 07a4712b093b135371bdaaaf1f79bd92b92ba1a6e08e2536b77ab54d11e71baf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:20:31.710 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:31 smithi006 bash[124407]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3 2024-09-21T08:20:31.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:31 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:31.523+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:31.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:31.672+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:32.210 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:31 smithi006 podman[124422]: 2024-09-21 08:20:31.900464543 +0000 UTC m=+0.763218110 container remove 07a4712b093b135371bdaaaf1f79bd92b92ba1a6e08e2536b77ab54d11e71baf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:20:32.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:31 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:31.803+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:32.520 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.155154996 +0000 UTC m=+0.016538980 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:32.521 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.267885109 +0000 UTC m=+0.129269077 container create b8b2cb275c6866b1766c9a40684a9fe7acff0fc6d3f93bd75c323da9926925f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T08:20:32.840 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.520412712 +0000 UTC m=+0.381796681 container init b8b2cb275c6866b1766c9a40684a9fe7acff0fc6d3f93bd75c323da9926925f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T08:20:32.840 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.523941687 +0000 UTC m=+0.385325664 container start b8b2cb275c6866b1766c9a40684a9fe7acff0fc6d3f93bd75c323da9926925f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:32.840 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.6119561 +0000 UTC m=+0.473340083 container attach b8b2cb275c6866b1766c9a40684a9fe7acff0fc6d3f93bd75c323da9926925f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T08:20:32.840 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 21 08:20:32 smithi006 podman[124512]: 2024-09-21 08:20:32.718740139 +0000 UTC m=+0.580124118 container died b8b2cb275c6866b1766c9a40684a9fe7acff0fc6d3f93bd75c323da9926925f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T08:20:32.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:32 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:32.560+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:32.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:32.675+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:33.090 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:32 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:32.839+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:33.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T08:20:33.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:33.568 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T08:20:33.568 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T08:20:33.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.4 2024-09-21T08:20:33.894 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:33 smithi119 systemd[1]: Stopping Ceph osd.4 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:33.895 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:33.552+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:34.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T08:20:33.893+0000 7f04c4e04640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:34.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T08:20:33.893+0000 7f04c4e04640 -1 osd.4 115 *** Got signal Terminated *** 2024-09-21T08:20:34.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:33 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T08:20:33.893+0000 7f04c4e04640 -1 osd.4 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:34.192 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:33.709+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:34.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:33 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:33.791+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:34.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:34 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:34.542+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:35.047 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:34.754+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:35.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:34 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:34.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:35.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:35.188+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:35.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:35 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:35.560+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:35.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:35.751+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:35.943 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:35.751+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:36.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:35 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:35.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:36.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:35 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:35.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:36.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:36 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:36.231+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:36.907 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:36 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:36.525+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:36.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:36 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:36.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:36.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:36 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:36.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:36.961 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:36 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:36.647+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:37.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:36 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:36.882+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:37.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:36 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:36.749+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:37.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:36 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:36.749+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:37.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:37 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:37.238+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:37.809 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:37 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T08:20:37.543+0000 7f04c13ef640 -1 osd.4 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.066255+0000 front 2024-09-21T08:20:13.066292+0000 (oldest deadline 2024-09-21T08:20:37.166419+0000) 2024-09-21T08:20:37.809 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:37 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:37.501+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:37.809 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:37 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:37.501+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:37.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:37.675+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:37.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:37.795+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:37.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:37 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:37.795+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:38.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:37 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:37.858+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:38.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:37 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:37.757+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:38.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:37 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:37.757+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:38.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:38 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:38.232+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:38.907 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:38 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4[44822]: 2024-09-21T08:20:38.576+0000 7f04c13ef640 -1 osd.4 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.066255+0000 front 2024-09-21T08:20:13.066292+0000 (oldest deadline 2024-09-21T08:20:37.166419+0000) 2024-09-21T08:20:38.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:38 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:38.467+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:38.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:38 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:38.467+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:38.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:38 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:38.664+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:38.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:38 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:38.795+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:38.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:38 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:38.795+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:39.186 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:38 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:38.874+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:39.186 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:38 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:38.727+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:39.186 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:38 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:38.727+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:39.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:39 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:39.184+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:39.731 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:39 smithi119 podman[67395]: 2024-09-21 08:20:39.519133416 +0000 UTC m=+5.752168308 container died 4bebb988a6b7554ef841ae0bb07cd738409b810df35d92dfe37712c36293300e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:20:39.731 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:39 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:39.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:39.731 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:39 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:39.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:39.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:39 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:39.635+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:39.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:39 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:39.762+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:39.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:39 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:39.762+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:40.137 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:39 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:39.776+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:40.137 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:39 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:39.776+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:40.138 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:39 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:39.864+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:40.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:39 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:39.729+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:40.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:39 smithi119 podman[67395]: 2024-09-21 08:20:39.885646699 +0000 UTC m=+6.118681590 container cleanup 4bebb988a6b7554ef841ae0bb07cd738409b810df35d92dfe37712c36293300e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:40.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:39 smithi119 bash[67395]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4 2024-09-21T08:20:40.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:40 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:40.136+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:40.483 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67422]: 2024-09-21 08:20:40.187281027 +0000 UTC m=+0.666867012 container remove 4bebb988a6b7554ef841ae0bb07cd738409b810df35d92dfe37712c36293300e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:20:40.748 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67513]: 2024-09-21 08:20:40.448933318 +0000 UTC m=+0.016327804 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:40.748 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67513]: 2024-09-21 08:20:40.578419858 +0000 UTC m=+0.145814326 container create 41a6f33c56cda111d917b89afe56b7866bcd61d66753eb734617ba9c4476f73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:40.748 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:40 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:40.481+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:40.748 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:40 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:40.481+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:40.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:40 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:40.616+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:40.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:40 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:40.743+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:40.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:40 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:40.743+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:41.048 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67513]: 2024-09-21 08:20:40.857643635 +0000 UTC m=+0.425038110 container init 41a6f33c56cda111d917b89afe56b7866bcd61d66753eb734617ba9c4476f73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:20:41.048 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67513]: 2024-09-21 08:20:40.861068643 +0000 UTC m=+0.428463115 container start 41a6f33c56cda111d917b89afe56b7866bcd61d66753eb734617ba9c4476f73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T08:20:41.049 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:40 smithi119 podman[67513]: 2024-09-21 08:20:40.932616444 +0000 UTC m=+0.500010914 container attach 41a6f33c56cda111d917b89afe56b7866bcd61d66753eb734617ba9c4476f73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:20:41.049 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:40 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:40.746+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:41.137 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:40 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:40.858+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:41.138 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:40 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:40.823+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:41.138 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:40 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:40.823+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:41.386 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 08:20:41 smithi119 podman[67513]: 2024-09-21 08:20:41.04795883 +0000 UTC m=+0.615353311 container died 41a6f33c56cda111d917b89afe56b7866bcd61d66753eb734617ba9c4476f73e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T08:20:41.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:41 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:41.136+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:41.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:41 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:41.434+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:41.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:41 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:41.434+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:41.730 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T08:20:41.773 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:41.773 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T08:20:41.773 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T08:20:41.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.5 2024-09-21T08:20:41.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:41 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:41.585+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:41.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:41 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:41.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:41.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:41 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:41.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:42.156 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:41 smithi145 systemd[1]: Stopping Ceph osd.5 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:42.177 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:41 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:41.849+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:42.177 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:41 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:41.833+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:42.178 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:41 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:41.833+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:42.178 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:41 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:41.732+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:42.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:42.155+0000 7f09fcf4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:42.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:42.155+0000 7f09fcf4d640 -1 osd.5 115 *** Got signal Terminated *** 2024-09-21T08:20:42.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:42.155+0000 7f09fcf4d640 -1 osd.5 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:42.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:42.163+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:42.754 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:42 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:42.465+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:42.754 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:42 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:42.465+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:42.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:42 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:42.624+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:42.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:42 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:42.828+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:42.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:42 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:42.828+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:43.117 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:42.887+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:43.118 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:42.808+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:43.118 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:42 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:42.808+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:43.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:42 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:42.753+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:43.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:43 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:43.116+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:43.786 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:43 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:43.501+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:43.786 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:43 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:43.501+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:43.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:43 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:43.615+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:43.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:43 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:43.819+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:43.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:43 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:43.819+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:44.147 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:43 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:43.886+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:44.147 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:43 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:43.762+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:44.147 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:43 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:43.762+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:44.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:43 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:43.784+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:44.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:44 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:44.145+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:44.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:44 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:44.145+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.238478+0000 front 2024-09-21T08:20:19.238728+0000 (oldest deadline 2024-09-21T08:20:43.938717+0000) 2024-09-21T08:20:44.757 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:44 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:44.472+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:44.757 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:44 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:44.472+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:44.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:44 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:44.635+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:44.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:44 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:44.850+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:44.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:44 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:44.850+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:45.147 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:44 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:44.891+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:45.148 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:44 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:44.812+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:45.148 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:44 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:44.812+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:45.157 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:44 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:44.756+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:45.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:45 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:45.146+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:45.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:45 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:45.146+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.238478+0000 front 2024-09-21T08:20:19.238728+0000 (oldest deadline 2024-09-21T08:20:43.938717+0000) 2024-09-21T08:20:45.717 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:45 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:45.427+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:45.717 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:45 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:45.427+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:45.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:45 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:45.632+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:45.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:45 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:45.632+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:45.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:45 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:45.828+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:45.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:45 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:45.828+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:45.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:45 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:45.828+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:46.144 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:45 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:45.918+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:46.144 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:45 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:45.845+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:46.145 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:45 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:45.845+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:46.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:45 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:45.716+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:46.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:45 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:45.716+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:46.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:46.143+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:46.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:46.143+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.238478+0000 front 2024-09-21T08:20:19.238728+0000 (oldest deadline 2024-09-21T08:20:43.938717+0000) 2024-09-21T08:20:46.843 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:46.590+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:46.843 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:46.590+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:46.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:46.668+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:46.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:46.668+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:46.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:46.437+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:46.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:46 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:46.437+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:47.102 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:46.879+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:47.102 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:46.822+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:47.102 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:46.822+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:47.103 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:46 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:46.822+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:47.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:46.842+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:47.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:46.842+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:47.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:46.842+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:47.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:47.101+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.136913+0000 front 2024-09-21T08:20:11.137003+0000 (oldest deadline 2024-09-21T08:20:34.636844+0000) 2024-09-21T08:20:47.443 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5[45207]: 2024-09-21T08:20:47.101+0000 7f09f9538640 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.238478+0000 front 2024-09-21T08:20:19.238728+0000 (oldest deadline 2024-09-21T08:20:43.938717+0000) 2024-09-21T08:20:47.709 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:47 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:47.420+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:47.709 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:47 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:47.420+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:47.709 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:47 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:47.420+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:47.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:47 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:47.607+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:47.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:47 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:47.607+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:47.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:47 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:47.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:47.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:47 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:47.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:47.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:47 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:47.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:48.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:47 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:47.707+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:48.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:47 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:47.707+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:48.193 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:47 smithi145 podman[67745]: 2024-09-21 08:20:47.994831436 +0000 UTC m=+6.017287143 container died b316a4c3e1c3c16e23c3b2f4a67ce4eeb0f18aa6769fb4ccefa30b64966db8e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T08:20:48.194 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:47.883+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:48.194 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:47.883+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:48.194 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:47.835+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:48.194 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:47.835+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:48.194 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:47 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:47.835+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:48.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:48 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:48.376+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:48.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:48 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:48.376+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:48.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:48 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:48.376+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:48.666 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:48 smithi145 podman[67745]: 2024-09-21 08:20:48.396766577 +0000 UTC m=+6.419222276 container cleanup b316a4c3e1c3c16e23c3b2f4a67ce4eeb0f18aa6769fb4ccefa30b64966db8e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:48.666 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:48 smithi145 bash[67745]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5 2024-09-21T08:20:48.924 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:48 smithi145 podman[67760]: 2024-09-21 08:20:48.665494495 +0000 UTC m=+0.663549556 container remove b316a4c3e1c3c16e23c3b2f4a67ce4eeb0f18aa6769fb4ccefa30b64966db8e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2) 2024-09-21T08:20:48.925 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:48 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:48.851+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:48.925 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:48 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:48.851+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:48.925 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:48 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:48.852+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:48.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:48 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:48.646+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:48.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:48 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:48.646+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:48.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:48 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:48.797+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:48.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:48 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:48.797+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:48.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:48 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:48.797+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:49.124 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:48 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:48.675+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:49.124 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:48 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:48.675+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:49.187 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:48 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:48.923+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:49.187 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:48 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:48.923+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:49.187 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:48.907272626 +0000 UTC m=+0.015891457 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:49.187 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:49.033061026 +0000 UTC m=+0.141679850 container create 598b5c95257ffb6210a5fa1289c639722307b84eb5848c44861920747dfdf5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T08:20:49.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:49.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:49.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:49.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:49.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:49.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:49.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:49.310992006 +0000 UTC m=+0.419610836 container init 598b5c95257ffb6210a5fa1289c639722307b84eb5848c44861920747dfdf5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T08:20:49.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:49.314488557 +0000 UTC m=+0.423107378 container start 598b5c95257ffb6210a5fa1289c639722307b84eb5848c44861920747dfdf5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T08:20:49.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:49.436105134 +0000 UTC m=+0.544723985 container attach 598b5c95257ffb6210a5fa1289c639722307b84eb5848c44861920747dfdf5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T08:20:49.693 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 21 08:20:49 smithi145 podman[67846]: 2024-09-21 08:20:49.501333076 +0000 UTC m=+0.609951896 container died 598b5c95257ffb6210a5fa1289c639722307b84eb5848c44861920747dfdf5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-5-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T08:20:49.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:49 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:49.603+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:49.961 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:49 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:49.603+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:49.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:49 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:49.839+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:49.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:49 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:49.839+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:49.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:49 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:49.839+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:50.124 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:49 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:49.921+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:50.124 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:49 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:49.921+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:50.124 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:49 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:49.829+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:50.124 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:49 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:49.830+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:50.124 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:49 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:49.830+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:50.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T08:20:50.157 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:49.690+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:50.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:49 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:49.690+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:50.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:50.180 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T08:20:50.181 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T08:20:50.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.6 2024-09-21T08:20:50.460 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 systemd[1]: Stopping Ceph osd.6 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:50.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:50.368+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:50.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:50.368+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:50.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:50.368+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:50.821 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:50.494+0000 7efc2361e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:50.821 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:50.494+0000 7efc2361e640 -1 osd.6 115 *** Got signal Terminated *** 2024-09-21T08:20:50.821 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:50.494+0000 7efc2361e640 -1 osd.6 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:50.821 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:50.609+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:50.821 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:50.609+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:51.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:50.739+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:51.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:50 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:50.739+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:51.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:50.875+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:51.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:50.875+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:51.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:50.869+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:51.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:50.869+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:51.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:50 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:50.869+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:51.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:50.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:51.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:50.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:51.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:50.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:51.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:51.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:51.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:51.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:51.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:51.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:51.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:51.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:51.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:51.635+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:51.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:51.635+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:51.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:51.865+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:51.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:51.865+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:51.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:51.865+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:51.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:51 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:51.865+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:52.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:51.700+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:52.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:51 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:51.700+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:52.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:51.899+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:52.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:51.899+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:52.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:51.881+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:52.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:51.881+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:52.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:51 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:51.881+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:52.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:52.329+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:52.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:52.329+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:52.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:52.329+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:52.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:52.329+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:52.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:52.671+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:52.961 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:52.671+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:52.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:52.877+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:52.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:52.877+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:52.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:52.877+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:52.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:52 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:52.877+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:53.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:52.701+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:53.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:52 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:52.701+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:53.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:52 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:52.925+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:53.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:52 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:52.925+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:53.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:52 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:52.851+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:53.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:52 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:52.851+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:53.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:52 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:52.851+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:53.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:53.353+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:53.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:53.353+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:53.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:53.353+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:53.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:53.353+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:53.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:53.679+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:53.961 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:53.679+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:53.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:53.888+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:53.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:53.888+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:53.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:53.888+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:53.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:53 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:53.888+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:54.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:53.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:54.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:53.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:54.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:53 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:53.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:54.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:53.971+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:54.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:53.971+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:54.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:53.892+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:54.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:53.892+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:54.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:53 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:53.892+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:54.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:54.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:54.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:54.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:54.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:54.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:54.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:54.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:54.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:54.633+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:12.772510+0000 front 2024-09-21T08:20:12.772313+0000 (oldest deadline 2024-09-21T08:20:35.672238+0000) 2024-09-21T08:20:54.960 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6[60996]: 2024-09-21T08:20:54.633+0000 7efc1bc01640 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.374727+0000 front 2024-09-21T08:20:21.374897+0000 (oldest deadline 2024-09-21T08:20:44.874759+0000) 2024-09-21T08:20:54.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:54.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:54.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:54.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:54.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:54.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:54.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:54 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:54.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:55.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:54.765+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:55.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:54.765+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:55.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:54 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:54.765+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:55.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:54 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:54.967+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:55.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:54 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:54.967+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:55.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:54 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:54.935+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:55.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:54 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:54.935+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:55.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:54 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:54.935+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:55.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:55.381+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:55.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:55.381+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:55.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:55.381+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:55.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:55.381+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:56.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:55.789+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:56.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:55.789+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:56.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:55.789+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:56.210 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:56 smithi006 podman[124615]: 2024-09-21 08:20:56.084168898 +0000 UTC m=+5.706654964 container died 7f871781f888a10a41783699d3b2a7f2d532b02904c7846ebbcac13c1058950f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T08:20:56.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:55 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:55.859+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:56.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:55 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:55.859+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:56.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:55 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:55.859+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:56.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:55 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:55.859+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:56.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.000+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:56.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.000+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:56.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.000+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:20:56.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:55 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:55.966+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:56.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:55 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:55.966+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:56.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:55 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:55.966+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:56.710 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:56 smithi006 podman[124615]: 2024-09-21 08:20:56.560970556 +0000 UTC m=+6.183456688 container cleanup 7f871781f888a10a41783699d3b2a7f2d532b02904c7846ebbcac13c1058950f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T08:20:56.711 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:56 smithi006 bash[124615]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6 2024-09-21T08:20:56.744 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:56.425+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:56.744 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:56.425+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:56.744 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:56.425+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:56.744 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:56.425+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:57.156 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:56 smithi006 podman[124630]: 2024-09-21 08:20:56.837321506 +0000 UTC m=+0.747638706 container remove 7f871781f888a10a41783699d3b2a7f2d532b02904c7846ebbcac13c1058950f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T08:20:57.156 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:56.876+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:57.156 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:56.876+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:57.156 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:56.876+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:57.156 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:56 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:56.876+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:57.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:56.742+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:57.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:56.742+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:57.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:56 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:56.742+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.962+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.962+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:56.962+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:56.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:56.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:57.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:56 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:56.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:57.419 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.058406193 +0000 UTC m=+0.016409733 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:20:57.419 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.163123161 +0000 UTC m=+0.121126747 container create e4e53f2849581132f4f6c121050e1dfcca5f780f3dac12d5fc9a86b5e2c231fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:20:57.419 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.419020307 +0000 UTC m=+0.377023847 container init e4e53f2849581132f4f6c121050e1dfcca5f780f3dac12d5fc9a86b5e2c231fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:57.710 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.422407147 +0000 UTC m=+0.380410677 container start e4e53f2849581132f4f6c121050e1dfcca5f780f3dac12d5fc9a86b5e2c231fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T08:20:57.711 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.518925854 +0000 UTC m=+0.476929396 container attach e4e53f2849581132f4f6c121050e1dfcca5f780f3dac12d5fc9a86b5e2c231fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:57.711 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 21 08:20:57 smithi006 podman[124719]: 2024-09-21 08:20:57.615825644 +0000 UTC m=+0.573829179 container died e4e53f2849581132f4f6c121050e1dfcca5f780f3dac12d5fc9a86b5e2c231fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:20:57.734 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:57.410+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:57.734 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:57.410+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:57.734 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:57.410+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:57.734 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:57.410+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:58.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:57.733+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:58.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:57.733+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:58.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:57 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:57.733+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:57.961+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:57.961+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:57.961+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:57.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:57.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:58.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:57 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:57.934+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:58.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:57 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:57.843+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:58.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:57 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:57.843+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:58.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:57 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:57.843+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:58.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:57 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:57.843+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:58.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.6.service' 2024-09-21T08:20:58.273 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:20:58.273 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T08:20:58.274 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T08:20:58.274 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.7 2024-09-21T08:20:58.581 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 systemd[1]: Stopping Ceph osd.7 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:20:58.582 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:58.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:58.582 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:58.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:58.582 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:58.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:58.582 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:58.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.580+0000 7fb34cf3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.580+0000 7fb34cf3f640 -1 osd.7 115 *** Got signal Terminated *** 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.580+0000 7fb34cf3f640 -1 osd.7 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.738+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.738+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:20:58.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:58 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:58.738+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:20:59.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:58 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:58.837+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:20:59.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:58 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:58.837+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:20:59.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:58 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:58.837+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:20:59.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:58 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:58.837+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:58.948+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:58.948+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:58.948+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:58.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:58.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:20:59.363 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:20:58 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:58.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:20:59.723 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:59.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:20:59.723 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:59.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:20:59.723 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:59.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:20:59.723 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:20:59.457+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:00.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:59.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:21:00.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:59.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:21:00.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:20:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:20:59.722+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:21:00.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:59.824+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:00.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:59.824+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:00.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:59.824+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:00.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:59.824+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:00.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:20:59 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:20:59.824+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:00.325 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:59.999+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:00.325 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:59.999+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:00.325 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:20:59.999+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:00.326 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:59 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:59.954+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:00.326 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:59 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:59.954+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:00.326 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:20:59 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:20:59.954+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:00.707 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:00.430+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:00.707 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:00.430+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:00.707 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:00.430+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:00.707 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:00.430+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:01.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:00.706+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:21:01.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:00.706+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:21:01.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:00.706+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:21:01.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:00 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:00.706+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.095757+0000 front 2024-09-21T08:20:35.095958+0000 (oldest deadline 2024-09-21T08:20:59.795833+0000) 2024-09-21T08:21:01.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:00.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:01.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:00.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:01.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:00.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:01.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:00.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:01.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:00 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:00.847+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:01.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:00.952+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:00.952+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:00.952+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:00.952+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:00.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:00.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:01.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:00 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:00.964+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:01.678 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:01.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:01.678 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:01.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:01.678 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:01.418+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:01.678 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:01.418+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:02.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:01.677+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:21:02.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:01.677+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:21:02.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:01.677+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:21:02.158 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:01.677+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.095757+0000 front 2024-09-21T08:20:35.095958+0000 (oldest deadline 2024-09-21T08:20:59.795833+0000) 2024-09-21T08:21:02.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:01 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:01.870+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:02.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:01 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:01.870+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:02.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:01 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:01.870+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:02.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:01 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:01.870+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:02.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:01 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:01.870+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:02.425 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:02.422+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:02.425 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:02.422+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:01.989+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:01.989+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:01.989+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:01.989+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:01.982+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:01.982+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:01.982+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:02.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:01 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:01.982+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:02.422+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:02.422+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:02.422+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:02.637+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.492487+0000 front 2024-09-21T08:20:13.492436+0000 (oldest deadline 2024-09-21T08:20:39.392640+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:02.637+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:19.393195+0000 front 2024-09-21T08:20:19.393335+0000 (oldest deadline 2024-09-21T08:20:45.293242+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:02.637+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:28.794440+0000 front 2024-09-21T08:20:28.794418+0000 (oldest deadline 2024-09-21T08:20:53.394758+0000) 2024-09-21T08:21:02.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:02 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7[51394]: 2024-09-21T08:21:02.637+0000 7fb34952a640 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.095757+0000 front 2024-09-21T08:20:35.095958+0000 (oldest deadline 2024-09-21T08:20:59.795833+0000) 2024-09-21T08:21:03.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:02.821+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:03.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:02.821+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:03.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:02.821+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:03.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:02.821+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:03.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:02 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:02.821+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:03.036+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:03.036+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:03.036+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:03.036+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:03.032+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:03.032+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:03.032+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:03.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:03 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:03.032+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:03.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:03 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:03.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:03.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:03 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:03.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:03.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:03 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:03.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:03.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:03 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:03.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:03.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:03 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:03.377+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:04.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:03 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:03.833+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:04.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:03 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:03.833+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:04.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:03 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:03.833+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:04.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:03 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:03.833+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:04.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:03 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:03.833+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:04.082+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:04.082+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:04.082+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:04.082+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:04.058+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:04.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:04.058+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:04.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:04.058+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:04.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:04 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:04.058+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:04.658 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:04 smithi119 podman[67617]: 2024-09-21 08:21:04.391827952 +0000 UTC m=+5.922188490 container died 0a001937241b6ebceec3528c08ffc018474edeaf25a64bab29b16966cc0a0b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:21:04.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:04.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:04.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:04.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:04.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:04.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:04.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:04.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:04.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:04.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:05.033 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:04 smithi119 podman[67617]: 2024-09-21 08:21:04.797579367 +0000 UTC m=+6.327939905 container cleanup 0a001937241b6ebceec3528c08ffc018474edeaf25a64bab29b16966cc0a0b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T08:21:05.033 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:04 smithi119 bash[67617]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7 2024-09-21T08:21:05.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:04.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:05.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:04.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:05.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:04.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:05.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:04.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:05.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:04 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:04.793+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:05.341 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67634]: 2024-09-21 08:21:05.032508833 +0000 UTC m=+0.634814851 container remove 0a001937241b6ebceec3528c08ffc018474edeaf25a64bab29b16966cc0a0b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:05.041+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:05.041+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:05.041+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:05.041+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:05.066+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:05.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:05.066+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:05.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:05.066+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:05.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:05 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:05.066+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:05.611 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.243586759 +0000 UTC m=+0.015439957 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:21:05.611 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.381222032 +0000 UTC m=+0.153075212 container create b578d4c05da905782ca97bb5de630fd00b9cdfec97aaa53858a566047e38bacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T08:21:05.611 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.610797202 +0000 UTC m=+0.382650382 container init b578d4c05da905782ca97bb5de630fd00b9cdfec97aaa53858a566047e38bacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:21:05.612 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:05 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:05.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:05.612 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:05 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:05.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:05.612 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:05 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:05.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:05.612 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:05 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:05.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:05.612 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:05 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:05.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:05.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.614264108 +0000 UTC m=+0.386117290 container start b578d4c05da905782ca97bb5de630fd00b9cdfec97aaa53858a566047e38bacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T08:21:05.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.744275994 +0000 UTC m=+0.516129202 container attach b578d4c05da905782ca97bb5de630fd00b9cdfec97aaa53858a566047e38bacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T08:21:05.908 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 08:21:05 smithi119 podman[67720]: 2024-09-21 08:21:05.799921297 +0000 UTC m=+0.571774485 container died b578d4c05da905782ca97bb5de630fd00b9cdfec97aaa53858a566047e38bacf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T08:21:06.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:05 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:05.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:06.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:05 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:05.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:06.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:05 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:05.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:06.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:05 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:05.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:06.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:05 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:05.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.020+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.020+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.020+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.020+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:06.034+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:06.034+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:06.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:06.034+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:06.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:06.034+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:06.484 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:06.358+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:06.484 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:06.358+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:06.484 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:06.358+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:06.484 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:06.358+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:06.484 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:06 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:06.358+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:06.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.7.service' 2024-09-21T08:21:06.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:06.544 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T08:21:06.544 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T08:21:06.544 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.8 2024-09-21T08:21:06.860 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 systemd[1]: Stopping Ceph osd.8 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:06.860 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.859+0000 7f5a64953640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:06.860 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.859+0000 7f5a64953640 -1 osd.8 115 *** Got signal Terminated *** 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:07.079+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:07.079+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:07.079+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:07.079+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:06 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:06.859+0000 7f5a64953640 -1 osd.8 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:07.013+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:07.193 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:07.013+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:07.194 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:07.013+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:07.194 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:07.013+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:07.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:06 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:06.773+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:07.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:06 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:06.773+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:07.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:06 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:06.773+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:07.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:06 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:06.773+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:07.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:06 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:06.773+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:07.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:07.372+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:07.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:07.372+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:07.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:07.372+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:07.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:07.372+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:07.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:07 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:07.372+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:08.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:07 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:07.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:08.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:07 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:07.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:08.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:07 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:07.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:08.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:07 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:07.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:08.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:07 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:07.752+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:08.093+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:08.093+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:08.093+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:08.093+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:08.035+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:08.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:08.035+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:08.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:08.035+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:08.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:08 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:08.035+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:08.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:08.407+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:08.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:08.407+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:08.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:08.407+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:08.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:08.407+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:08.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:08 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:08.407+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:09.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:08.776+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:09.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:08.776+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:09.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:08.776+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:09.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:08.776+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:09.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:08 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:08.776+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:09.054+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:09.054+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:09.054+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:09.054+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:09.054+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:44.819754+0000 front 2024-09-21T08:20:44.819801+0000 (oldest deadline 2024-09-21T08:21:08.319918+0000) 2024-09-21T08:21:09.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:09.116+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:09.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:09.116+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:09.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:09.116+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:09.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:09.116+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:09.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:09 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:09.116+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:09.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:09.433+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:09.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:09.433+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:09.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:09.433+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:09.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:09.433+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:09.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:09 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:09.433+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:10.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:10.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:10.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:10.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:10.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:10.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:09 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:09.798+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:10.162+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:10.162+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:10.162+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:10.162+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:10.162+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:10.092+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:10.092+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:10.092+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:10.092+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:10.400 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:10.092+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:44.819754+0000 front 2024-09-21T08:20:44.819801+0000 (oldest deadline 2024-09-21T08:21:08.319918+0000) 2024-09-21T08:21:10.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:10 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:10.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:10.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:10 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:10.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:10.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:10 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:10.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:10.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:10 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:10.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:10.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:10 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:10.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:11.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:11.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:11.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:11.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:11.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:11.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:10 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:10.838+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:11.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:11.131+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.515431+0000 front 2024-09-21T08:20:11.515575+0000 (oldest deadline 2024-09-21T08:20:36.215479+0000) 2024-09-21T08:21:11.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:11.131+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:22.116444+0000 front 2024-09-21T08:20:22.116577+0000 (oldest deadline 2024-09-21T08:20:47.416620+0000) 2024-09-21T08:21:11.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:11.131+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.417241+0000 front 2024-09-21T08:20:27.417425+0000 (oldest deadline 2024-09-21T08:20:55.617600+0000) 2024-09-21T08:21:11.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:11.131+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.618310+0000 front 2024-09-21T08:20:35.618237+0000 (oldest deadline 2024-09-21T08:21:00.818469+0000) 2024-09-21T08:21:11.444 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8[51350]: 2024-09-21T08:21:11.131+0000 7f5a60f3e640 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:44.819754+0000 front 2024-09-21T08:20:44.819801+0000 (oldest deadline 2024-09-21T08:21:08.319918+0000) 2024-09-21T08:21:11.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:11.188+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:11.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:11.188+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:11.444 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:11.188+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:11.445 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:11.188+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:11.445 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:11 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:11.188+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:11.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:11 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:11.392+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:11.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:11 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:11.392+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:11.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:11 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:11.392+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:11.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:11 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:11.392+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:11.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:11 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:11.392+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:12.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:12.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:12.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:12.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:12.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:12.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:11 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:11.800+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:12.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:12 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:12.189+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:12.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:12 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:12.189+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:12.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:12 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:12.189+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:12.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:12 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:12.189+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:12.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:12 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:12.189+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:12.800 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:12 smithi145 podman[67959]: 2024-09-21 08:21:12.487625499 +0000 UTC m=+5.749033741 container died 7e4cf15db3fd3eb71681ac6ff1a91b90990124165fd49ef9ab760256426f6776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:21:12.801 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:12 smithi145 podman[67959]: 2024-09-21 08:21:12.800305708 +0000 UTC m=+6.061713949 container cleanup 7e4cf15db3fd3eb71681ac6ff1a91b90990124165fd49ef9ab760256426f6776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:12.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:12 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:12.440+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:13.189 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:12 smithi145 bash[67959]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8 2024-09-21T08:21:13.189 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[67977]: 2024-09-21 08:21:13.035222648 +0000 UTC m=+0.538528205 container remove 7e4cf15db3fd3eb71681ac6ff1a91b90990124165fd49ef9ab760256426f6776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:21:13.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:13.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:13.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:13.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:13.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:13.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:12 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:12.790+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.24666066 +0000 UTC m=+0.016386024 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.360982963 +0000 UTC m=+0.130708316 container create 6419d20b5349e76578f4d29efccca99e2d80a37df16b76a3f68879993db86e5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:13 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:13.187+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:13 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:13.187+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:13 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:13.187+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:13 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:13.187+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:13.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:13 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:13.187+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:13.792 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.605533493 +0000 UTC m=+0.375258850 container init 6419d20b5349e76578f4d29efccca99e2d80a37df16b76a3f68879993db86e5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T08:21:13.793 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.608734705 +0000 UTC m=+0.378460057 container start 6419d20b5349e76578f4d29efccca99e2d80a37df16b76a3f68879993db86e5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:21:13.793 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.688773586 +0000 UTC m=+0.458498939 container attach 6419d20b5349e76578f4d29efccca99e2d80a37df16b76a3f68879993db86e5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:13.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:13 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:13.445+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:14.067 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 21 08:21:13 smithi145 podman[68061]: 2024-09-21 08:21:13.792612531 +0000 UTC m=+0.562337896 container died 6419d20b5349e76578f4d29efccca99e2d80a37df16b76a3f68879993db86e5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T08:21:14.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:14.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:14.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:14.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:14.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:14.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:13 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:13.820+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:14.376 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:14 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:14.164+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:14.376 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:14 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:14.164+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:14.376 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:14 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:14.164+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:14.377 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:14 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:14.164+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:14.377 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:14 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:14.164+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:14.401 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.8.service' 2024-09-21T08:21:14.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:14.447 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T08:21:14.447 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T08:21:14.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.9 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:14.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:14 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:14.402+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:14.767 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 systemd[1]: Stopping Ceph osd.9 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:15.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.765+0000 7f59f918d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.765+0000 7f59f918d640 -1 osd.9 115 *** Got signal Terminated *** 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.765+0000 7f59f918d640 -1 osd.9 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:15.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:14 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:14.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:15.615 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:15.194+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:15.615 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:15.194+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:15.615 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:15.194+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:15.616 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:15.194+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:15.616 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:15.194+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:15.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:15 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:15.411+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:16.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:16.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:16.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:16.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:16.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:16.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:15 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:15.784+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:16.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:16 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:16.386+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:16.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:16 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:16.236+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:16.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:16 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:16.236+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:16.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:16 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:16.236+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:16.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:16 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:16.236+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:16.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:16 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:16.236+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:17.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:16 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:16.781+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:17.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:17.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:17 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:17.378+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:17.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:17.208+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:17.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:17.208+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:17.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:17.208+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:17.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:17.208+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:17.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:17 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:17.208+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:18.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:18.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:18.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:18.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:18.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:18.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:17 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:17.751+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:18.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:18 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:18.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:18.692 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:18.240+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:18.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:18.240+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:18.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:18.240+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:18.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:18.240+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:18.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:18 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:18.240+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:19.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:19.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:19.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:19.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:19.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:19.211 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:18 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:18.717+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:19.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:19 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:19.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:19.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:19.231+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:19.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:19.231+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:19.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:19.231+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:19.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:19.231+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:19.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:19.231+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:19.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:02.666873+0000 front 2024-09-21T08:20:02.667215+0000 (oldest deadline 2024-09-21T08:20:26.767026+0000) 2024-09-21T08:21:19.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.368841+0000 front 2024-09-21T08:20:11.368566+0000 (oldest deadline 2024-09-21T08:20:35.468811+0000) 2024-09-21T08:21:19.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:21.572935+0000 front 2024-09-21T08:20:21.572781+0000 (oldest deadline 2024-09-21T08:20:45.072783+0000) 2024-09-21T08:21:19.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:25.073150+0000 front 2024-09-21T08:20:25.073250+0000 (oldest deadline 2024-09-21T08:20:51.473856+0000) 2024-09-21T08:21:19.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:36.075402+0000 front 2024-09-21T08:20:36.075461+0000 (oldest deadline 2024-09-21T08:20:59.575209+0000) 2024-09-21T08:21:19.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:19 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9[67202]: 2024-09-21T08:21:19.669+0000 7f59f5778640 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.576613+0000 front 2024-09-21T08:20:43.576426+0000 (oldest deadline 2024-09-21T08:21:09.476408+0000) 2024-09-21T08:21:20.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:20.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:20.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:20.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:20.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:20.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:20.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:20 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:20.380+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:20.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:20 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:20.242+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:20.909 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:20 smithi006 podman[124821]: 2024-09-21 08:21:20.618975456 +0000 UTC m=+5.972227557 container died c14c45fbd867b1ab5debf5b0a022c63c6f2ea94ad33285a01896177a7b84ef65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:21:21.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124821]: 2024-09-21 08:21:21.091630362 +0000 UTC m=+6.444882434 container cleanup c14c45fbd867b1ab5debf5b0a022c63c6f2ea94ad33285a01896177a7b84ef65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T08:21:21.210 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 bash[124821]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9 2024-09-21T08:21:21.661 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124837]: 2024-09-21 08:21:21.342950952 +0000 UTC m=+0.723453898 container remove c14c45fbd867b1ab5debf5b0a022c63c6f2ea94ad33285a01896177a7b84ef65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:21.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:21 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:21.202+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:21.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:21 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:21.409+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:21.960 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124921]: 2024-09-21 08:21:21.66033902 +0000 UTC m=+0.109875529 container create 67da9f79668cbf7d874bfda1ede7f36130f956799044e649e2b7c6e40667218c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T08:21:21.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124921]: 2024-09-21 08:21:21.567187687 +0000 UTC m=+0.016724174 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:21:21.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124921]: 2024-09-21 08:21:21.829372513 +0000 UTC m=+0.278908989 container init 67da9f79668cbf7d874bfda1ede7f36130f956799044e649e2b7c6e40667218c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:21:21.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124921]: 2024-09-21 08:21:21.832910401 +0000 UTC m=+0.282446871 container start 67da9f79668cbf7d874bfda1ede7f36130f956799044e649e2b7c6e40667218c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:21:21.961 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:21 smithi006 podman[124921]: 2024-09-21 08:21:21.904334876 +0000 UTC m=+0.353871357 container attach 67da9f79668cbf7d874bfda1ede7f36130f956799044e649e2b7c6e40667218c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T08:21:22.307 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 21 08:21:22 smithi006 podman[124921]: 2024-09-21 08:21:22.026399514 +0000 UTC m=+0.475935992 container died 67da9f79668cbf7d874bfda1ede7f36130f956799044e649e2b7c6e40667218c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-9-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T08:21:22.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.9.service' 2024-09-21T08:21:22.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:22.625 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T08:21:22.625 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T08:21:22.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.10 2024-09-21T08:21:22.653 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:22.653 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:22.653 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:22.653 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:22.653 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:22.654 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:22.654 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.398+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:22.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:22 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:22.248+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:22.907 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 systemd[1]: Stopping Ceph osd.10 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:23.350 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.922+0000 7ff5d7886640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:23.350 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.922+0000 7ff5d7886640 -1 osd.10 115 *** Got signal Terminated *** 2024-09-21T08:21:23.350 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:22 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:22.922+0000 7ff5d7886640 -1 osd.10 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:21:23.350 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:23.351 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:23 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:23.348+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:23.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:23 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:23.295+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:24.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:24.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:24.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:24.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:24.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:24.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:24.659 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:24 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:24.373+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:24.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:24 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:24.287+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:25.443 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:25 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:25.239+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:25.658 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:25 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:25.384+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:26.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:26.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:26 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:26.286+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:26.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:26 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:26.417+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:27.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:27.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:27 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:27.280+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:00.231220+0000 front 2024-09-21T08:20:00.231382+0000 (oldest deadline 2024-09-21T08:20:26.131175+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:11.833339+0000 front 2024-09-21T08:20:11.833376+0000 (oldest deadline 2024-09-21T08:20:37.133669+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:17.134265+0000 front 2024-09-21T08:20:17.134277+0000 (oldest deadline 2024-09-21T08:20:47.134940+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-09-21T08:20:27.135725+0000 front 2024-09-21T08:20:27.135527+0000 (oldest deadline 2024-09-21T08:20:51.235596+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:38.737626+0000 front 2024-09-21T08:20:38.737597+0000 (oldest deadline 2024-09-21T08:21:02.237677+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:43.938697+0000 front 2024-09-21T08:20:43.938790+0000 (oldest deadline 2024-09-21T08:21:11.439341+0000) 2024-09-21T08:21:27.908 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:27 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10[57737]: 2024-09-21T08:21:27.429+0000 7ff5d3e71640 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:51.440163+0000 front 2024-09-21T08:20:51.440045+0000 (oldest deadline 2024-09-21T08:21:17.339843+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:28.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:28 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:28.320+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:28.886 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:28 smithi119 podman[67834]: 2024-09-21 08:21:28.584717594 +0000 UTC m=+5.767038966 container died 229930b8d6ca6e5391f5343bd67cf0fdb4e247104b4272cbd2522ebdceb1aab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:21:29.157 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:28 smithi119 podman[67834]: 2024-09-21 08:21:28.959735986 +0000 UTC m=+6.142057358 container cleanup 229930b8d6ca6e5391f5343bd67cf0fdb4e247104b4272cbd2522ebdceb1aab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T08:21:29.158 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:28 smithi119 bash[67834]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10 2024-09-21T08:21:29.521 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67850]: 2024-09-21 08:21:29.21138861 +0000 UTC m=+0.628117959 container remove 229930b8d6ca6e5391f5343bd67cf0fdb4e247104b4272cbd2522ebdceb1aab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:29.594 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:29.595 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:29 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:29.329+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:29.807 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.423578811 +0000 UTC m=+0.015950500 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:21:29.807 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.528701843 +0000 UTC m=+0.121073522 container create 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T08:21:29.807 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.722575906 +0000 UTC m=+0.314947590 container init 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T08:21:29.807 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.725732612 +0000 UTC m=+0.318104299 container start 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:21:29.807 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.805794802 +0000 UTC m=+0.398166489 container attach 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T08:21:30.158 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:29 smithi119 podman[67938]: 2024-09-21 08:21:29.910923247 +0000 UTC m=+0.503294936 container died 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T08:21:30.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.10.service' 2024-09-21T08:21:30.515 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:30 smithi119 podman[67961]: 2024-09-21 08:21:30.425425351 +0000 UTC m=+0.508628117 container remove 1578dfb65eabafcc748d35a4eb023b730971ba7549165f346b9f2f12c9222390 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:21:30.515 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:30 smithi119 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.10.service: Deactivated successfully. 2024-09-21T08:21:30.515 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:30 smithi119 systemd[1]: Stopped Ceph osd.10 for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T08:21:30.515 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 08:21:30 smithi119 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.10.service: Consumed 5min 34.705s CPU time. 2024-09-21T08:21:30.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:30.531 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T08:21:30.531 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T08:21:30.531 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.11 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.354+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:30.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 systemd[1]: Stopping Ceph osd.11 for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:31.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.835+0000 7f6b00fff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:31.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.835+0000 7f6b00fff640 -1 osd.11 115 *** Got signal Terminated *** 2024-09-21T08:21:31.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:30 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:30.836+0000 7f6b00fff640 -1 osd.11 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:31.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:31.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:31 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:31.348+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:32.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:32 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:32.346+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:33.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:33 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:33.342+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-21T08:21:10.338000+0000 front 2024-09-21T08:21:10.338028+0000 (oldest deadline 2024-09-21T08:21:32.638025+0000) 2024-09-21T08:21:34.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:34.694 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:34 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:34.368+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-21T08:21:10.338000+0000 front 2024-09-21T08:21:10.338028+0000 (oldest deadline 2024-09-21T08:21:32.638025+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-09-21T08:20:04.026489+0000 front 2024-09-21T08:20:04.026423+0000 (oldest deadline 2024-09-21T08:20:28.627070+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T08:20:13.729363+0000 front 2024-09-21T08:20:13.729389+0000 (oldest deadline 2024-09-21T08:20:35.429588+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-21T08:20:20.730693+0000 front 2024-09-21T08:20:20.730739+0000 (oldest deadline 2024-09-21T08:20:46.630858+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T08:20:35.233591+0000 front 2024-09-21T08:20:35.233527+0000 (oldest deadline 2024-09-21T08:21:01.034147+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-21T08:20:45.135099+0000 front 2024-09-21T08:20:45.135011+0000 (oldest deadline 2024-09-21T08:21:08.635112+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-09-21T08:20:53.936421+0000 front 2024-09-21T08:20:53.936260+0000 (oldest deadline 2024-09-21T08:21:19.836297+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T08:21:02.137518+0000 front 2024-09-21T08:21:02.137385+0000 (oldest deadline 2024-09-21T08:21:25.637189+0000) 2024-09-21T08:21:35.693 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:35 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11[57550]: 2024-09-21T08:21:35.328+0000 7f6af95e2640 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-21T08:21:10.338000+0000 front 2024-09-21T08:21:10.338028+0000 (oldest deadline 2024-09-21T08:21:32.638025+0000) 2024-09-21T08:21:36.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:36 smithi145 podman[68186]: 2024-09-21 08:21:36.548460449 +0000 UTC m=+5.817741576 container died 9a51a40d8c9d49f373157da07ebb431a726f2592fcb13d55d857da6cf267e73f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T08:21:37.179 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:36 smithi145 podman[68186]: 2024-09-21 08:21:36.977255098 +0000 UTC m=+6.246536210 container cleanup 9a51a40d8c9d49f373157da07ebb431a726f2592fcb13d55d857da6cf267e73f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:21:37.179 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:36 smithi145 bash[68186]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11 2024-09-21T08:21:37.442 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68204]: 2024-09-21 08:21:37.178670047 +0000 UTC m=+0.625988003 container remove 9a51a40d8c9d49f373157da07ebb431a726f2592fcb13d55d857da6cf267e73f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:21:37.823 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68288]: 2024-09-21 08:21:37.571171227 +0000 UTC m=+0.094031140 container create 595912f58d6a59f6f5b46ab87011e4891b329207bb153a5054328b1e8428f10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T08:21:37.824 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68288]: 2024-09-21 08:21:37.493428445 +0000 UTC m=+0.016288358 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:21:37.824 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68288]: 2024-09-21 08:21:37.823494067 +0000 UTC m=+0.346353980 container init 595912f58d6a59f6f5b46ab87011e4891b329207bb153a5054328b1e8428f10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T08:21:38.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68288]: 2024-09-21 08:21:37.826769123 +0000 UTC m=+0.349629038 container start 595912f58d6a59f6f5b46ab87011e4891b329207bb153a5054328b1e8428f10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-21T08:21:38.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:37 smithi145 podman[68288]: 2024-09-21 08:21:37.898442159 +0000 UTC m=+0.421302076 container attach 595912f58d6a59f6f5b46ab87011e4891b329207bb153a5054328b1e8428f10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:21:38.193 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 21 08:21:38 smithi145 podman[68288]: 2024-09-21 08:21:38.019769707 +0000 UTC m=+0.542629620 container died 595912f58d6a59f6f5b46ab87011e4891b329207bb153a5054328b1e8428f10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T08:21:38.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@osd.11.service' 2024-09-21T08:21:38.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:38.628 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T08:21:38.628 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T08:21:38.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.a 2024-09-21T08:21:38.944 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:38 smithi006 systemd[1]: Stopping Ceph mds.a for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:39.210 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:38 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a[73638]: 2024-09-21T08:21:38.942+0000 7f72d79b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:39.210 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:38 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a[73638]: 2024-09-21T08:21:38.942+0000 7f72d79b6640 -1 mds.a *** got signal Terminated *** 2024-09-21T08:21:40.936 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:40 smithi006 podman[125023]: 2024-09-21 08:21:40.644876727 +0000 UTC m=+1.808050745 container died 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T08:21:41.210 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:41 smithi006 podman[125023]: 2024-09-21 08:21:41.083909559 +0000 UTC m=+2.247083568 container cleanup 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:21:41.211 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:41 smithi006 bash[125023]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a 2024-09-21T08:21:41.518 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 21 08:21:41 smithi006 podman[125035]: 2024-09-21 08:21:41.260288114 +0000 UTC m=+0.597193902 container remove 89c622d586b55b5b65c5843817d549fcde82b6d3363f60a5edc07f0a98de2405 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:21:41.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.a.service' 2024-09-21T08:21:41.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:41.558 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T08:21:41.559 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T08:21:41.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.d 2024-09-21T08:21:41.880 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:41 smithi006 systemd[1]: Stopping Ceph mds.d for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:42.210 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:41 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d[72522]: 2024-09-21T08:21:41.879+0000 7f0d82bd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:42.210 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:41 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d[72522]: 2024-09-21T08:21:41.879+0000 7f0d82bd0640 -1 mds.d *** got signal Terminated *** 2024-09-21T08:21:45.950 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:45 smithi006 podman[125145]: 2024-09-21 08:21:45.594908608 +0000 UTC m=+3.816126630 container died 1f7001471cae33cce85273eaf2e8af05a163a5361f02aa39e5ebbec29a55d2c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:21:46.210 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:46 smithi006 podman[125145]: 2024-09-21 08:21:46.121234398 +0000 UTC m=+4.342452465 container cleanup 1f7001471cae33cce85273eaf2e8af05a163a5361f02aa39e5ebbec29a55d2c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T08:21:46.211 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 21 08:21:46 smithi006 bash[125145]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-d 2024-09-21T08:21:46.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.d.service' 2024-09-21T08:21:46.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:46.592 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T08:21:46.592 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T08:21:46.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.g 2024-09-21T08:21:46.926 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:46 smithi006 systemd[1]: Stopping Ceph mds.g for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:47.210 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g[73272]: 2024-09-21T08:21:46.925+0000 7fe0ff964640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:47.210 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:46 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g[73272]: 2024-09-21T08:21:46.925+0000 7fe0ff964640 -1 mds.g *** got signal Terminated *** 2024-09-21T08:21:49.192 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:48 smithi006 podman[125264]: 2024-09-21 08:21:48.935840705 +0000 UTC m=+2.123839688 container died e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T08:21:49.460 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:49 smithi006 podman[125264]: 2024-09-21 08:21:49.275067939 +0000 UTC m=+2.463066915 container cleanup e8a11bfbe886aa4cfcd8e3810b2247b62bbae70424418bcf9669264933a95389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:21:49.460 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 21 08:21:49 smithi006 bash[125264]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-g 2024-09-21T08:21:49.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.g.service' 2024-09-21T08:21:49.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:49.678 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T08:21:49.678 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T08:21:49.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.j 2024-09-21T08:21:50.210 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:49 smithi006 systemd[1]: Stopping Ceph mds.j for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:50.211 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j[72158]: 2024-09-21T08:21:50.012+0000 7fe038794640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:50.211 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:50 smithi006 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j[72158]: 2024-09-21T08:21:50.012+0000 7fe038794640 -1 mds.j *** got signal Terminated *** 2024-09-21T08:21:54.338 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:54 smithi006 podman[125389]: 2024-09-21 08:21:54.024440406 +0000 UTC m=+4.117823396 container died 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T08:21:54.639 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:54 smithi006 podman[125389]: 2024-09-21 08:21:54.429039049 +0000 UTC m=+4.522422042 container cleanup 45b8490faae1652b05876b46d79499a1ca2bff88dfa961fe2f4e3e00cdaaba36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:21:54.639 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 21 08:21:54 smithi006 bash[125389]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-j 2024-09-21T08:21:54.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.j.service' 2024-09-21T08:21:54.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:54.808 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T08:21:54.808 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T08:21:54.808 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.b 2024-09-21T08:21:55.158 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:54 smithi119 systemd[1]: Stopping Ceph mds.b for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:55.416 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: 2024-09-21T08:21:55.182+0000 7f15dc74b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:55.416 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:55 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b[63021]: 2024-09-21T08:21:55.182+0000 7f15dc74b640 -1 mds.b *** got signal Terminated *** 2024-09-21T08:21:58.194 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:57 smithi119 podman[68042]: 2024-09-21 08:21:57.919423437 +0000 UTC m=+2.906023434 container died 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:21:58.585 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:58 smithi119 podman[68042]: 2024-09-21 08:21:58.292072075 +0000 UTC m=+3.278672071 container cleanup 29689e897841fbc0811dbb7e7f475516877b8ef3585ac2c124e896368278b008 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:21:58.585 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 08:21:58 smithi119 bash[68042]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-b 2024-09-21T08:21:58.723 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.b.service' 2024-09-21T08:21:58.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:21:58.759 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T08:21:58.759 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T08:21:58.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.e 2024-09-21T08:21:58.907 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:21:58 smithi119 systemd[1]: Stopping Ceph mds.e for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:21:59.408 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:21:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e[62482]: 2024-09-21T08:21:59.062+0000 7f4f0cb4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:21:59.408 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:21:59 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e[62482]: 2024-09-21T08:21:59.062+0000 7f4f0cb4b640 -1 mds.e *** got signal Terminated *** 2024-09-21T08:22:00.571 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:22:00 smithi119 podman[68174]: 2024-09-21 08:22:00.26676436 +0000 UTC m=+1.296189281 container died 58c95e949ecef24ed729bf7ca9cfa03413611f8b742017a5ea680e61223c5a1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:22:00.571 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:22:00 smithi119 podman[68174]: 2024-09-21 08:22:00.570563337 +0000 UTC m=+1.599988263 container cleanup 58c95e949ecef24ed729bf7ca9cfa03413611f8b742017a5ea680e61223c5a1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:22:00.908 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:22:00 smithi119 bash[68174]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e 2024-09-21T08:22:00.908 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 08:22:00 smithi119 podman[68188]: 2024-09-21 08:22:00.8133443 +0000 UTC m=+0.542540856 container remove 58c95e949ecef24ed729bf7ca9cfa03413611f8b742017a5ea680e61223c5a1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:22:00.942 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.e.service' 2024-09-21T08:22:00.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:00.976 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T08:22:00.976 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T08:22:00.977 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.h 2024-09-21T08:22:01.291 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:01 smithi119 systemd[1]: Stopping Ceph mds.h for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:01.658 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h[62753]: 2024-09-21T08:22:01.290+0000 7fce25b7f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:01.658 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:01 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h[62753]: 2024-09-21T08:22:01.290+0000 7fce25b7f640 -1 mds.h *** got signal Terminated *** 2024-09-21T08:22:04.092 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:03 smithi119 podman[68295]: 2024-09-21 08:22:03.772542277 +0000 UTC m=+2.574570834 container died 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T08:22:04.408 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:04 smithi119 podman[68295]: 2024-09-21 08:22:04.190949572 +0000 UTC m=+2.992978129 container cleanup 88cc9ea232a31ce4c8b937d119e4ef0358e479671929a95b2eafd76022e60790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:22:04.408 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 08:22:04 smithi119 bash[68295]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-h 2024-09-21T08:22:04.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.h.service' 2024-09-21T08:22:04.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:04.653 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T08:22:04.653 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T08:22:04.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.k 2024-09-21T08:22:04.970 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:04 smithi119 systemd[1]: Stopping Ceph mds.k for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:05.407 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k[62200]: 2024-09-21T08:22:04.969+0000 7f8b19b44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:05.408 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:04 smithi119 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k[62200]: 2024-09-21T08:22:04.969+0000 7f8b19b44640 -1 mds.k *** got signal Terminated *** 2024-09-21T08:22:06.908 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:06 smithi119 podman[68415]: 2024-09-21 08:22:06.667358358 +0000 UTC m=+1.796491178 container died d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:22:07.337 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:07 smithi119 podman[68415]: 2024-09-21 08:22:07.036318543 +0000 UTC m=+2.165451293 container cleanup d82824ca1f4f7b9c791a23d5ce661b238e9f5582524c84d51fcc7999d03b1ba6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:22:07.338 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 08:22:07 smithi119 bash[68415]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-k 2024-09-21T08:22:07.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.k.service' 2024-09-21T08:22:07.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:07.492 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T08:22:07.492 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T08:22:07.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.c 2024-09-21T08:22:07.785 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:07 smithi145 systemd[1]: Stopping Ceph mds.c for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:08.043 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c[62630]: 2024-09-21T08:22:07.783+0000 7f212b5d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:08.044 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:07 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c[62630]: 2024-09-21T08:22:07.783+0000 7f212b5d1640 -1 mds.c *** got signal Terminated *** 2024-09-21T08:22:09.443 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:09 smithi145 podman[68393]: 2024-09-21 08:22:09.240275495 +0000 UTC m=+1.559700921 container died e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T08:22:09.778 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:09 smithi145 podman[68393]: 2024-09-21 08:22:09.558966545 +0000 UTC m=+1.878391965 container cleanup e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T08:22:09.778 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:09 smithi145 bash[68393]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c 2024-09-21T08:22:10.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.c.service' 2024-09-21T08:22:10.028 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:09 smithi145 podman[68418]: 2024-09-21 08:22:09.77683057 +0000 UTC m=+0.535497533 container remove e4851bde3bc288c264b32b2b2cb5dd6fbea1aa3d144be0ad2b7bb9e16b4b31b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T08:22:10.029 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:10 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.c.service: Deactivated successfully. 2024-09-21T08:22:10.029 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:10 smithi145 systemd[1]: Stopped Ceph mds.c for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T08:22:10.029 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 21 08:22:10 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.c.service: Consumed 1.151s CPU time. 2024-09-21T08:22:10.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:10.042 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T08:22:10.042 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T08:22:10.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.f 2024-09-21T08:22:10.355 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:10 smithi145 systemd[1]: Stopping Ceph mds.f for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:10.693 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f[62363]: 2024-09-21T08:22:10.354+0000 7f4526b36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:10.693 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:10 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f[62363]: 2024-09-21T08:22:10.354+0000 7f4526b36640 -1 mds.f *** got signal Terminated *** 2024-09-21T08:22:14.655 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:14 smithi145 podman[68526]: 2024-09-21 08:22:14.37035106 +0000 UTC m=+4.113723295 container died 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:22:14.943 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:14 smithi145 podman[68526]: 2024-09-21 08:22:14.737441008 +0000 UTC m=+4.480813240 container cleanup 4796e15e45909afbaaa2cf7c39e9ce9a7a9256e8d669068cadcae38893d15dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T08:22:14.943 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 21 08:22:14 smithi145 bash[68526]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-f 2024-09-21T08:22:15.109 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.f.service' 2024-09-21T08:22:15.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:15.143 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T08:22:15.143 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T08:22:15.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.i 2024-09-21T08:22:15.442 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:15 smithi145 systemd[1]: Stopping Ceph mds.i for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:15.693 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: 2024-09-21T08:22:15.440+0000 7f7b35287640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:15.693 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:15 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i[62898]: 2024-09-21T08:22:15.440+0000 7f7b35287640 -1 mds.i *** got signal Terminated *** 2024-09-21T08:22:18.301 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:17 smithi145 podman[68648]: 2024-09-21 08:22:17.95096391 +0000 UTC m=+2.594231929 container died b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:22:18.617 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 podman[68648]: 2024-09-21 08:22:18.382562086 +0000 UTC m=+3.025830092 container cleanup b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T08:22:18.617 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 bash[68648]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i 2024-09-21T08:22:18.861 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.i.service' 2024-09-21T08:22:18.883 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 podman[68659]: 2024-09-21 08:22:18.617117158 +0000 UTC m=+0.664189055 container remove b8211331bacefb36c7e7cb721804f3d99fb555bcd1b43258b8a80d84d64554da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:22:18.883 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T08:22:18.884 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 systemd[1]: Stopped Ceph mds.i for f3246cac-77ed-11ef-baf6-efdc52797490. 2024-09-21T08:22:18.884 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 21 08:22:18 smithi145 systemd[1]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.i.service: Consumed 6.360s CPU time. 2024-09-21T08:22:18.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:18.895 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T08:22:18.896 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T08:22:18.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.l 2024-09-21T08:22:19.192 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:18 smithi145 systemd[1]: Stopping Ceph mds.l for f3246cac-77ed-11ef-baf6-efdc52797490... 2024-09-21T08:22:19.692 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l[62084]: 2024-09-21T08:22:19.236+0000 7efd8e0ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:22:19.693 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:19 smithi145 ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l[62084]: 2024-09-21T08:22:19.236+0000 7efd8e0ee640 -1 mds.l *** got signal Terminated *** 2024-09-21T08:22:23.512 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:23 smithi145 podman[68770]: 2024-09-21 08:22:23.251947811 +0000 UTC m=+4.117314950 container died 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T08:22:23.896 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:23 smithi145 podman[68770]: 2024-09-21 08:22:23.594814449 +0000 UTC m=+4.460181587 container cleanup 88892584b58702701d15f0f81cb5e792a85d5237b845146744b6a8328e211135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:22:23.896 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 21 08:22:23 smithi145 bash[68770]: ceph-f3246cac-77ed-11ef-baf6-efdc52797490-mds-l 2024-09-21T08:22:24.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f3246cac-77ed-11ef-baf6-efdc52797490@mds.l.service' 2024-09-21T08:22:24.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:22:24.052 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T08:22:24.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T08:22:24.265 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:22:26.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T08:22:27.073 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:22:29.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T08:22:29.747 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:22:32.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:22:32.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:22:32.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:22:32.284 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T08:22:32.285 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi006/crash 2024-09-21T08:22:32.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash -- . 2024-09-21T08:22:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:22:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:22:32.332 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi119/crash 2024-09-21T08:22:32.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash -- . 2024-09-21T08:22:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:22:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:22:32.377 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi145/crash 2024-09-21T08:22:32.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash -- . 2024-09-21T08:22:32.414 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:22:32.414 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:22:32.415 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T08:22:32.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T08:22:32.503 INFO:tasks.cephadm:Compressing logs... 2024-09-21T08:22:32.503 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:22:32.505 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:22:32.507 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:22:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T08:22:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.10.log 2024-09-21T08:22:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T08:22:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.7.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.b.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.k.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T08:22:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.y.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log: /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.h.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.b.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.e.log 2024-09-21T08:22:32.544 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:22:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T08:22:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T08:22:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T08:22:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.i.log 2024-09-21T08:22:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.c.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.11.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.c.log: /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.l.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log: -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.8.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.z.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.c.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.z.log: --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.f.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T08:22:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.log: -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.9.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.a.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log: /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.a.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.g.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.6.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.d.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.x.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.j.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.d.log: /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T08:22:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:22:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 87.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T08:22:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.e.log.gz 2024-09-21T08:22:32.575 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 81.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:22:32.588 INFO:teuthology.orchestra.run.smithi006.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T08:22:32.660 INFO:teuthology.orchestra.run.smithi145.stderr: 93.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T08:22:32.669 INFO:teuthology.orchestra.run.smithi119.stderr: 93.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T08:22:32.678 INFO:teuthology.orchestra.run.smithi145.stderr: 90.2% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T08:22:32.687 INFO:teuthology.orchestra.run.smithi006.stderr: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.j.log.gz 2024-09-21T08:22:32.691 INFO:teuthology.orchestra.run.smithi145.stderr: 95.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.l.log.gz 2024-09-21T08:22:32.698 INFO:teuthology.orchestra.run.smithi006.stderr: 90.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T08:22:32.715 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:22:32.716 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T08:22:32.724 INFO:teuthology.orchestra.run.smithi119.stderr: 94.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.h.log.gz 2024-09-21T08:22:32.738 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:22:32.746 INFO:teuthology.orchestra.run.smithi119.stderr: 87.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T08:22:32.750 INFO:teuthology.orchestra.run.smithi119.stderr: 90.1% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T08:22:32.755 INFO:teuthology.orchestra.run.smithi006.stderr: 84.4% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:22:32.834 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T08:22:32.836 INFO:teuthology.orchestra.run.smithi006.stderr: 95.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.d.log.gz 2024-09-21T08:22:32.847 INFO:teuthology.orchestra.run.smithi006.stderr: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.a.log.gz 2024-09-21T08:22:32.855 INFO:teuthology.orchestra.run.smithi119.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:22:32.859 INFO:teuthology.orchestra.run.smithi006.stderr: 95.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.g.log.gz 2024-09-21T08:22:32.866 INFO:teuthology.orchestra.run.smithi145.stderr: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.c.log.gz 2024-09-21T08:22:32.867 INFO:teuthology.orchestra.run.smithi145.stderr: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.f.log.gz 2024-09-21T08:22:32.891 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T08:22:32.909 INFO:teuthology.orchestra.run.smithi145.stderr: 87.0% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T08:22:32.959 INFO:teuthology.orchestra.run.smithi006.stderr: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:22:33.067 INFO:teuthology.orchestra.run.smithi119.stderr: 94.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.k.log.gz 2024-09-21T08:22:33.390 INFO:teuthology.orchestra.run.smithi145.stderr: 95.3% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.i.log.gz 2024-09-21T08:22:34.440 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.c.log.gz 2024-09-21T08:22:35.363 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T08:22:35.600 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.b.log.gz 2024-09-21T08:22:47.735 INFO:teuthology.orchestra.run.smithi006.stderr: 90.2% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mon.a.log.gz 2024-09-21T08:24:35.358 INFO:teuthology.orchestra.run.smithi145.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.8.log.gz 2024-09-21T08:26:54.106 INFO:teuthology.orchestra.run.smithi145.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T08:27:20.371 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.10.log.gz 2024-09-21T08:27:23.251 INFO:teuthology.orchestra.run.smithi145.stderr: 90.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.11.log.gz 2024-09-21T08:27:57.785 INFO:teuthology.orchestra.run.smithi145.stderr: 90.7% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T08:27:57.787 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-21T08:27:57.787 INFO:teuthology.orchestra.run.smithi145.stderr:real 5m25.265s 2024-09-21T08:27:57.787 INFO:teuthology.orchestra.run.smithi145.stderr:user 5m22.864s 2024-09-21T08:27:57.787 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m12.040s 2024-09-21T08:27:58.892 INFO:teuthology.orchestra.run.smithi119.stderr: 94.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-mds.b.log.gz 2024-09-21T08:28:08.158 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T08:29:04.898 INFO:teuthology.orchestra.run.smithi119.stderr: 90.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.7.log.gz 2024-09-21T08:29:16.798 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T08:29:16.800 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-21T08:29:16.800 INFO:teuthology.orchestra.run.smithi119.stderr:real 6m44.279s 2024-09-21T08:29:16.800 INFO:teuthology.orchestra.run.smithi119.stderr:user 5m18.104s 2024-09-21T08:29:16.800 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m12.610s 2024-09-21T08:33:01.994 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T08:38:51.327 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T08:39:22.055 INFO:teuthology.orchestra.run.smithi006.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T08:39:27.485 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.6.log.gz 2024-09-21T08:40:13.078 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/f3246cac-77ed-11ef-baf6-efdc52797490/ceph-osd.9.log.gz 2024-09-21T08:40:13.080 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-21T08:40:13.080 INFO:teuthology.orchestra.run.smithi006.stderr:real 17m40.560s 2024-09-21T08:40:13.080 INFO:teuthology.orchestra.run.smithi006.stderr:user 7m46.296s 2024-09-21T08:40:13.080 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m19.721s 2024-09-21T08:40:13.080 INFO:tasks.cephadm:Archiving logs... 2024-09-21T08:40:13.081 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi006/log 2024-09-21T08:40:13.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:41:24.890 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi119/log 2024-09-21T08:41:24.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:42:17.825 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi145/log 2024-09-21T08:42:17.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:43:13.004 INFO:tasks.cephadm:Removing cluster... 2024-09-21T08:43:13.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force 2024-09-21T08:43:13.220 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:43:13.968 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force 2024-09-21T08:43:14.295 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:43:14.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f3246cac-77ed-11ef-baf6-efdc52797490 --force 2024-09-21T08:43:15.138 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: f3246cac-77ed-11ef-baf6-efdc52797490 2024-09-21T08:43:15.791 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T08:43:15.791 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:43:15.814 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:43:15.833 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:43:15.850 INFO:tasks.cephadm:Teardown complete 2024-09-21T08:43:15.851 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T08:43:15.867 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T08:43:15.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:43:15.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:43:15.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:43:15.998 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T08:43:16.008 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T08:43:16.009 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:43:16.011 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:43:16.014 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:43:16.026 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:43:16.028 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:43:16.028 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:43:16.038 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:43:16.038 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-21T08:43:16.039 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -60us[ -53us] +/- 59ms 2024-09-21T08:43:16.039 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 65 +83us[ +93us] +/- 53ms 2024-09-21T08:43:16.039 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -60us[ -53us] +/- 73ms 2024-09-21T08:43:16.039 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:43:16.044 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:43:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T08:43:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -53us[ -42us] +/- 59ms 2024-09-21T08:43:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 +99us[ +111us] +/- 54ms 2024-09-21T08:43:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -64us[ -64us] +/- 73ms 2024-09-21T08:43:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:43:16.057 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:43:16.057 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-21T08:43:16.057 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -60us[ -50us] +/- 59ms 2024-09-21T08:43:16.057 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +75us[ +87us] +/- 53ms 2024-09-21T08:43:16.058 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -66us[ -66us] +/- 73ms 2024-09-21T08:43:16.058 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:43:16.058 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T08:43:16.068 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T08:43:16.069 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T08:43:16.140 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:43:16.298 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:43:16.420 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:43:16.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:43:16.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:16.569 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:43:16.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:16.602 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:43:16.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:16.631 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T08:43:16.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T08:43:16.673 INFO:teuthology.task.internal:Duration was 3603.389928 seconds 2024-09-21T08:43:16.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T08:43:16.758 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T08:43:16.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:43:16.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:43:16.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:43:16.816 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:43:16.826 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:43:16.851 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:43:17.256 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T08:43:17.257 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-09-21T08:43:17.257 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:43:17.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T08:43:17.283 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:43:17.315 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-21T08:43:17.315 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:43:17.344 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T08:43:17.344 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:43:17.347 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:43:17.358 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:43:17.412 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T08:43:17.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:43:17.422 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:43:17.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:43:19.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T08:43:19.060 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T08:43:19.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:43:19.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:43:19.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:43:19.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T08:43:19.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.289 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.321 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-09-21T08:43:19.325 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-21T08:43:19.344 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-21T08:43:19.369 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:19.398 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:19.416 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:43:19.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:43:19.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T08:43:19.511 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T08:43:19.512 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi006 2024-09-21T08:43:19.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:43:19.583 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi119 2024-09-21T08:43:19.584 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:43:19.625 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913624/remote/smithi145 2024-09-21T08:43:19.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:43:19.665 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T08:43:19.666 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:43:19.668 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:43:19.670 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:43:19.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T08:43:19.733 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T08:43:19.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T08:43:19.777 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T08:43:19.778 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:43:19.780 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:43:19.783 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:43:19.794 INFO:teuthology.orchestra.run.smithi006.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:43 /home/ubuntu/cephtest 2024-09-21T08:43:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:43 /home/ubuntu/cephtest 2024-09-21T08:43:19.800 INFO:teuthology.orchestra.run.smithi145.stdout: 265933 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:43 /home/ubuntu/cephtest 2024-09-21T08:43:19.801 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T08:43:19.850 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T08:43:20.027 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 3603.389928340912 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T08:43:20.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:43:20.117 INFO:teuthology.run:pass